Woo AI Smoke
woocommerce/woocommerce-ios
Evaluate WooAIAssistant against a structured scenario suite with hard invariants + LLM-as-judge rubric scoring.
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise…
Install Advanced Evaluation
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install aiskillstore/marketplace advanced-evaluation --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .claude/skills/advanced-evaluation && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .claude/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluationType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install aiskillstore/marketplace advanced-evaluation --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .agents/skills/advanced-evaluation && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .agents/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install aiskillstore/marketplace advanced-evaluation --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .cursor/skills/advanced-evaluation && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .cursor/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/aiskillstore/marketplace.git --path skills/chakshugautam/advanced-evaluation--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install aiskillstore/marketplace advanced-evaluation --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .gemini/skills/advanced-evaluation && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .gemini/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install aiskillstore/marketplace advanced-evaluationInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .github/skills/advanced-evaluation && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .github/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add aiskillstore/marketplace --skill advanced-evaluation -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install aiskillstore/marketplace advanced-evaluation --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/aiskillstore/marketplace.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/chakshugautam/advanced-evaluation .opencode/skills/advanced-evaluation && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "advanced-evaluation" agent skill from https://github.com/aiskillstore/marketplace/tree/main/skills/chakshugautam/advanced-evaluation into .opencode/skills/advanced-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "advanced-evaluation", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
advanced-evaluation- GitHub stars
- 430
- Used in
- 4 other repos
- Token cost
- ~4.2k tokens
- SKILL.md length
- 1,198 words
- Files
- 6 (incl. scripts, references)
- Skills in repo
- 1,108
- Repo updated
- First seen
- Licence
- None found
At a glance
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise…
- Works in 4 steps: First pass: Response A in first… → Second pass: Response B in first… → Consistency check: If passes disagree,… → …
- Asks to implement LLM-as-judge
- SKILL.md covers When to Activate, Core Concepts, Evaluation Approaches and Practical Guidance, plus 5 more sections
- Runs Python scripts from its folder
What it does
Advanced Evaluation is an agent skill from aiskillstore/marketplace. This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
Its SKILL.md is about 4.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 7 other files, including scripts and reference files (for example `references/bias-mitigation.md`, `references/implementation-patterns.md` and `references/metrics-guide.md`).
It sits in Education, covering Quizzes and assessments and LLM evaluation. The repository describes itself as: Security-audited skills for Claude, Codex & Claude Code. One-click install, quality verified.
When your agent uses it
- Asks to implement LLM-as-judge
- Compare model outputs
- Create evaluation rubrics
- Mitigate evaluation bias
Example prompts
- “implement LLM-as-judge”
- “compare model outputs”
- “create evaluation rubrics”
- “/advanced-evaluation”
Requirements
- Python 3
Workflow steps
4 steps, taken from the first numbered list in SKILL.md.
- First pass: Response A in first position, Response B in second
- Second pass: Response B in first position, Response A in second
- Consistency check: If passes disagree, return TIE with reduced confidence
- Final verdict: Consistent winner with averaged confidence
What it can do on your machine
Read from SKILL.md and the folder at commit ad8daf7. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Ships 1 file in scripts/ (Python), which the agent can run.
From the folder's file list and the shell code blocks in SKILL.md.
Network
Links to these hosts (documentation or services it may open):
arxiv.orgeugeneyan.com
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Advanced Evaluation loads about 4.2k tokens when it runs, and up to ~11k if it reads all its reference files. Until then it costs about 74 tokens; SKILL.md has 1,198 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
SKILL.md
Without a licence we can't republish the file, so here is its outline and opening line. It has 1,198 words (~4,171 tokens).
“This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.”
- name
- advanced-evaluation
Files
SKILL.md and 5 other files (scripts, references) in skills/chakshugautam/advanced-evaluation of aiskillstore/marketplace.
- SKILL.md
- references/bias-mitigation.md
- references/implementation-patterns.md
- references/metrics-guide.md
- scripts/evaluation_example.py
- skill-report.json
Open the folder on GitHubat commit ad8daf7
Used in 4 other repositories
We found 22 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 4 other GitHub owners. This page covers the copy in aiskillstore/marketplace, which our catalogue first saw on October 7, 2026.
- majiayu000/claude-skill-registryskills/ai-llm/advanced-evaluationskills/ai-llm/advanced-evaluation-kursku-skills+8 more
- sickn33/agentic-awesome-skillsskills/advanced-evaluationplugins/agentic-awesome-skills/skills/advanced-evaluation+1 more
- lingxling/awesome-skills-cnantigravity-awesome-skills/skills/advanced-evaluationantigravity-awesome-skills/plugins/agentic-awesome-skills/skills/advanced-evaluation+1 more
- henryalouf/ruflow.agents/skills/advanced-evaluation.agents/skills/antigravity-awesome-skills/skills/advanced-evaluation+4 more
Compare with similar skills
Advanced Evaluation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Advanced Evaluation this skillaiskillstore/marketplace | 430 | 4 repos | ~4.2k | Automated safety check: Pass | None | |
| Woo AI Smokewoocommerce/woocommerce-ios | 358 | 1 repos | ~7.4k | Automated safety check: Notes | GPL-2.0 | |
| Design AI BenchmarkingAperivue/medsci-skills | 329 | — | ~2.4k | Automated safety check: Pass | MIT | |
| Agentic Evaluation Frameworkborghei/Claude-Skills | 881 | — | ~1.9k | Automated safety check: Pass | MIT | |
| Quality Reportindranilbanerjee/digital-marketing-pro | 855 | 1 repos | ~2.5k | Automated safety check: Pass | MIT | |
| AI Eval Planmohitagw15856/pm-claude-skills | 1.4k | — | ~996 | Automated safety check: Pass | MIT |
Similar skills
Design AI Benchmarking
Aperivue/medsci-skills
A skill your agent uses when designing a study that benchmarks AI systems against a human-expert panel, before data collection.
Agentic Evaluation Framework
borghei/Claude-Skills
This skill should be used when the user asks to "evaluate LLM output quality", "set up LLM-as-judge", "build an eval rubric", "compare model outputs pairwise", or "measure agent quality".
Quality Report
indranilbanerjee/digital-marketing-pro
Report content-quality trends over time from logged evaluations: weekly score trend charts, a content-type leaderboard, per-dimension performance breakdown, statistically flagged regression alerts…
AI Eval Plan
mohitagw15856/pm-claude-skills
Design an evaluation plan for an LLM or AI feature before shipping it.
Task Creator
benchflow-ai/benchflow
SkillsBench task authoring — walk a contributor from idea to submission-ready task following CONTRIBUTING.md and the task-implementation rubric.
More from aiskillstore/marketplace
All 1,108 skills in this repoCode Stats
aiskillstore/marketplace
Analyze codebase with tokei (fast line counts by language) and difft (semantic AST-aware diffs).
File Search
aiskillstore/marketplace
Modern file and content search using fd, ripgrep (rg), and fzf.
Data Processing
aiskillstore/marketplace
Process JSON with jq and YAML/TOML with yq. An agent skill from aiskillstore/marketplace.
Doc Scanner
aiskillstore/marketplace
Scans for project documentation files (AGENTS.md, CLAUDE.md, GEMINI.md, COPILOT.md, CURSOR.md, WARP.md, and 15+ other formats) and synthesizes guidance.
Find Replace
aiskillstore/marketplace
Modern find-and-replace using sd (simpler than sed) and batch replacement patterns.
Investigating Codebases
aiskillstore/marketplace
Automatically activated when user asks how something works, wants to understand unfamiliar code, needs to explore a new codebase, or asks questions like "where is X implemented?", "how does Y…
Related
Categories
Questions about Advanced Evaluation
What does Advanced Evaluation do?
This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise…. Advanced Evaluation is an agent skill from aiskillstore/marketplace. This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
When should I use Advanced Evaluation?
Advanced Evaluation fits situations like: asks to implement LLM-as-judge; compare model outputs; create evaluation rubrics; mitigate evaluation bias.
How do I install Advanced Evaluation in Claude Code?
Run `npx skills add aiskillstore/marketplace --skill advanced-evaluation -a claude-code`. Or copy the skill folder (skills/chakshugautam/advanced-evaluation in aiskillstore/marketplace) into .claude/skills/advanced-evaluation in your project. Claude Code loads it when a task matches its description.
How do I install Advanced Evaluation in Codex?
Run `npx skills add aiskillstore/marketplace --skill advanced-evaluation -a codex`. Or copy the skill folder (skills/chakshugautam/advanced-evaluation in aiskillstore/marketplace) into .agents/skills/advanced-evaluation in your project. Codex loads it when a task matches its description.
Can I use Advanced Evaluation in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add aiskillstore/marketplace --skill advanced-evaluation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/advanced-evaluation, .gemini/skills/advanced-evaluation, .github/skills/advanced-evaluation and .opencode/skills/advanced-evaluation in your project.
What does Advanced Evaluation need to run?
Going by SKILL.md and its folder, Advanced Evaluation needs Python for the scripts in its folder. Our summary lists: Python 3.
Does Advanced Evaluation access the network?
SKILL.md names 2 domains. As links in the text: arxiv.org and eugeneyan.com. This is read from the text; nothing was executed.
Is Advanced Evaluation safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
What licence does Advanced Evaluation use?
No licence was found for Advanced Evaluation or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.
How many tokens does Advanced Evaluation use?
About 4.2k tokens (SKILL.md is roughly 17k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 6.9k tokens, read only when the agent opens those files.
What are the alternatives to Advanced Evaluation?
Skills that share tags, products or a category with Advanced Evaluation: Woo AI Smoke (woocommerce/woocommerce-ios, 358 stars), Design AI Benchmarking (Aperivue/medsci-skills, 329 stars), Agentic Evaluation Framework (borghei/Claude-Skills, 881 stars) and Quality Report (indranilbanerjee/digital-marketing-pro, 855 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Advanced Evaluation?
aiskillstore (a GitHub organization) maintains it in aiskillstore/marketplace, which has 430 GitHub stars. The repository holds 1,108 skills in this directory. The repository was last updated on October 7, 2026.
Source: aiskillstore/marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.