Baoyu URL To Markdown
sdyckjq-lab/llm-wiki-skill
Fetch any URL and convert to markdown using Chrome CDP. An agent skill from sdyckjq-lab/llm-wiki-skill.
Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows.
Install Operator Eval
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install JetXu-LLM/DocMason operator-eval --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/operator/operator-eval .claude/skills/operator-eval && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .claude/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-evalType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install JetXu-LLM/DocMason operator-eval --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/operator/operator-eval .agents/skills/operator-eval && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .agents/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install JetXu-LLM/DocMason operator-eval --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/operator/operator-eval .cursor/skills/operator-eval && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .cursor/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/JetXu-LLM/DocMason.git --path skills/operator/operator-eval--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install JetXu-LLM/DocMason operator-eval --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/operator/operator-eval .gemini/skills/operator-eval && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .gemini/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install JetXu-LLM/DocMason operator-evalInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/operator/operator-eval .github/skills/operator-eval && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .github/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add JetXu-LLM/DocMason --skill operator-eval -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install JetXu-LLM/DocMason operator-eval --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/JetXu-LLM/DocMason.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/operator/operator-eval .opencode/skills/operator-eval && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "operator-eval" agent skill from https://github.com/JetXu-LLM/DocMason/tree/main/skills/operator/operator-eval into .opencode/skills/operator-eval/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "operator-eval", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
operator-eval- GitHub stars
- 147
- Token cost
- ~433 tokens
- SKILL.md length
- 188 words
- Files
- 8
- Skills in repo
- 15
- Repo updated
- First seen
- Licence
- Apache-2.0
At a glance
Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows.
- Works in 7 steps: Read the current operator request from… → Validate the request against the tracked… → Execute exactly one requested action… → …
- Knowledge Management work in your project
- SKILL.md covers Required Capabilities, Procedure and Notes
- Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
What it does
Operator Eval is an agent skill from JetXu-LLM/DocMason. Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows.
Its SKILL.md is about 430 tokens, which your agent loads only when the skill is triggered. The skill folder holds 8 other files (for example `examples/README.md`, `examples/template_baseline.json` and `examples/template_candidate.json`).
It sits in Knowledge Management. The repository describes itself as: DocMason is a repo-native agent that turns your complex office files into a local LLM knowledge base and your second brain. The repo is the app. Codex is the runtime. The licence is Apache-2.0.
When your agent uses it
- Knowledge Management work in your project
Example prompts
- “/operator-eval”
Workflow steps
7 steps, taken from the first numbered list in SKILL.md.
- Read the current operator request from runtime/eval/requests/current.json.
- Validate the request against the tracked examples in skills/operator/operator-eval/examples/.
- Execute exactly one requested action through the operator-eval runtime surface
- Keep live eval truth under runtime/eval/, not under tracked repository paths.
- Keep review of ordinary runtime activity under runtime/logs/.
- Treat tracked examples as schema guidance only. Never commit confidential runtime/eval payloads.
- Return the operator-facing result, written artifacts, and next corrective step to the main agent.
What it can do on your machine
Read from SKILL.md and the folder at commit 362417b. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Operator Eval loads about 433 tokens when it runs. Until then it costs about 39 tokens; SKILL.md has 188 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from JetXu-LLM/DocMason at commit 362417b, republished under its Apache-2.0 licence (© JetXu-LLM). 188 words, ~433 tokens.
Download SKILL.mdSave it as
.claude/skills/operator-eval/SKILL.md (or your agent's skills folder). This skill also uses 7 other files; get the full folder from GitHub.- name
- operator-eval
- description
- Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows.
Operator Eval
Use this workflow only for advanced operator-quality tasks such as replayable evaluation runs, regression review, candidate promotion, and baseline freezing.
This workflow is intentionally open-source but non-first-contact.
Do not surface it in ordinary user entry flows, and do not treat it as part of the default ask experience.
Required Capabilities
- local file access
- shell or command execution
- ability to inspect structured JSON output
Procedure
- Read the current operator request from
runtime/eval/requests/current.json. - Validate the request against the tracked examples in
skills/operator/operator-eval/examples/. - Execute exactly one requested action through the
operator-evalruntime surface:run-suitereview-regressionspromote-candidatefreeze-baseline
- Keep live eval truth under
runtime/eval/, not under tracked repository paths. - Keep review of ordinary runtime activity under
runtime/logs/. - Treat tracked examples as schema guidance only. Never commit confidential runtime/eval payloads.
- Return the operator-facing result, written artifacts, and next corrective step to the main agent.
Notes
- This workflow is intentionally absent from first-contact guidance.
- Frozen baselines and promotion decisions remain human-governed even though this workflow is productized.
skills/operator/operator-eval/examples/exists so fresh open-source users can understand the local-only artifact contracts without access to private corpus data.
© JetXu-LLM, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
SKILL.md and 7 other files in skills/operator/operator-eval of JetXu-LLM/DocMason.
- SKILL.md
- examples/README.md
- examples/template_baseline.json
- examples/template_candidate.json
- examples/template_request.json
- examples/template_rubric.json
- examples/template_suite.json
- workflow.json
Open the folder on GitHubat commit 362417b
Compare with similar skills
Operator Eval next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Operator Eval this skillJetXu-LLM/DocMason | 147 | — | ~433 | Automated safety check: Pass | Apache-2.0 | |
| Baoyu URL To Markdownsdyckjq-lab/llm-wiki-skill | 2.5k | 3 repos | ~3.2k | Automated safety check: Pass | None | |
| Logseq Review Workflow Evallogseq/logseq | 45k | — | ~1k | Automated safety check: Pass | AGPL-3.0 | |
| Obsidian CLIAtmosphere/atmosphere | 3.8k | 13 repos | ~795 | Automated safety check: Pass | Apache-2.0 | |
| Esm Cjs Risk Scanlogseq/logseq | 45k | — | ~3.3k | Automated safety check: Pass | AGPL-3.0 | |
| Capture Conversationoutline/outline | 41k | — | ~474 | Automated safety check: Pass | Custom licence |
Similar skills
Logseq Review Workflow Eval
logseq/logseq
Compare two revisions of the Logseq logseq-review-workflow skill by running the same review prompt against isolated before and after skill snapshots, collecting both outputs, and producing a…
Obsidian CLI
Atmosphere/atmosphere
Interact with Obsidian vaults using the Obsidian CLI to read, create, search, and manage notes, tasks, properties, and more.
Esm Cjs Risk Scan
logseq/logseq
Scan Logseq ClojureScript Node/Electron targets for npm module loading risks, especially ESM-only packages that may fail when loaded through js/require or shadow-cljs require-based shims.
Capture Conversation
outline/outline
Save the current conversation, a decision, or a set of notes as a document in an Outline collection; use when the user wants to keep what was discussed in their knowledge base.
Karpathy LLM Wiki
Astro-Han/karpathy-llm-wiki
A skill your agent uses when building or maintaining a personal LLM-powered knowledge base.
More from JetXu-LLM/DocMason
All 15 skills in this repoAsk
JetXu-LLM/DocMason
Accept an ordinary user question inside a DocMason workspace, route it to the right inner workflow, and preserve conversation-native logs automatically.
Adapter Sync
JetXu-LLM/DocMason
Generate or refresh the local Claude adapter surface for DocMason from canonical committed sources.
Grounded Answer
JetXu-LLM/DocMason
Answer a user question through DocMason's canonical grounded workflow using retrieval, provenance tracing, render escalation, and a final answer-state check.
Grounded Composition
JetXu-LLM/DocMason
Produce evidence-backed research, planning, drafting, or composition output from the published DocMason knowledge base while preserving provenance and answer-file discipline.
Knowledge Base Sync
JetXu-LLM/DocMason
Stage, incrementally refresh, validate, and publish the DocMason knowledge base from the local source corpus.
Knowledge Construction
JetXu-LLM/DocMason
Write bilingual Phase 3 knowledge objects for staged DocMason sources from rendered evidence and extracted structure.
Related
Categories
Questions about Operator Eval
What does Operator Eval do?
Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows. Operator Eval is an agent skill from JetXu-LLM/DocMason. Run the hidden operator-only evaluation loop over local runtime/eval artifacts without exposing that surface in normal first-contact workflows.
When should I use Operator Eval?
Operator Eval fits situations like: knowledge Management work in your project.
How do I install Operator Eval in Claude Code?
Run `npx skills add JetXu-LLM/DocMason --skill operator-eval -a claude-code`. Or copy the skill folder (skills/operator/operator-eval in JetXu-LLM/DocMason) into .claude/skills/operator-eval in your project. Claude Code loads it when a task matches its description.
How do I install Operator Eval in Codex?
Run `npx skills add JetXu-LLM/DocMason --skill operator-eval -a codex`. Or copy the skill folder (skills/operator/operator-eval in JetXu-LLM/DocMason) into .agents/skills/operator-eval in your project. Codex loads it when a task matches its description.
Can I use Operator Eval in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add JetXu-LLM/DocMason --skill operator-eval -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/operator-eval, .gemini/skills/operator-eval, .github/skills/operator-eval and .opencode/skills/operator-eval in your project.
What does Operator Eval need to run?
SKILL.md names no scripts, command-line tools or credentials: Operator Eval is instructions for the agent only.
Does Operator Eval access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Operator Eval safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Operator Eval use?
Operator Eval is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Operator Eval use?
About 433 tokens (SKILL.md is roughly 1.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Operator Eval?
Skills that share tags, products or a category with Operator Eval: Baoyu URL To Markdown (sdyckjq-lab/llm-wiki-skill, 2.5k stars), Logseq Review Workflow Eval (logseq/logseq, 45k stars), Obsidian CLI (Atmosphere/atmosphere, 3.8k stars) and Esm Cjs Risk Scan (logseq/logseq, 45k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Operator Eval?
JetXu-LLM (a GitHub user) maintains it in JetXu-LLM/DocMason, which has 147 GitHub stars. The repository holds 15 skills in this directory. The repository was last updated on September 30, 2026.
Source: JetXu-LLM/DocMason on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.