Official agent skill

Fix Prompt Evaluation Diagnostics

by microsoft in microsoft/vscode-chat-customizations-evaluation

Applies the fixes suggested by the Chat Customizations Evaluations extension to a prompt, agent, skill or instruction file, changing only what each diagnostic requires.

OfficialCustom licenceAuto-check passedAgent Workflows

Install Fix Prompt Evaluation Diagnostics

skills CLI
$ npx skills add microsoft/vscode-chat-customizations-evaluation --skill fix-customization-evaluation-diagnostics -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install microsoft/vscode-chat-customizations-evaluation fix-customization-evaluation-diagnostics --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/microsoft/vscode-chat-customizations-evaluation.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/fix-customization-evaluation-diagnostics .claude/skills/fix-customization-evaluation-diagnostics && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
fix-customization-evaluation-diagnostics
GitHub stars
141
Token cost
~506 tokens
SKILL.md length
261 words
Files
1
Skills in repo
2
Repo updated
First seen
Licence
Custom licence

At a glance

Applies the fixes suggested by the Chat Customizations Evaluations extension to a prompt, agent, skill or instruction file, changing only what each diagnostic requires.

  • Resolving diagnostics on a prompt or skill file in the editor
  • SKILL.md covers Purpose, Usage and Instructions
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Cleaning up contradictions and ambiguities in an agent instruction file

What it does

The extension's analyzer reports problems in prompt, agent, skill and instruction files: contradictions, ambiguities, persona conflicts, cognitive load issues and coverage gaps. This skill runs when you click the Implement suggestions button in the editor title bar, receiving diagnostics that each carry a line number, code, message and sometimes a suggestion. You can also call it directly, in which case the agent looks up the diagnostics from the extension itself.

For each diagnostic the agent edits the file directly, using the suggestion when there is one and its own judgment otherwise. It keeps the overall structure, tone and intent, and when two diagnostics conflict it picks the fix that leaves the prompt clearer and more consistent. It does not add instructions or sections that were not there and does not remove instructions unless a diagnostic calls for it, as with a contradiction.

When your agent uses it

  • Resolving diagnostics on a prompt or skill file in the editor
  • Cleaning up contradictions and ambiguities in an agent instruction file
  • Applying evaluation suggestions without rewriting the whole file

Example prompts

  • “Implement the suggestions from the evaluation diagnostics on this prompt file.”
  • “Find the diagnostics in my agent file and fix the contradictions.”
  • “Resolve the persona conflict flagged on line 12 of this instruction file.”

Requirements

  • VS Code with the Chat Customizations Evaluations extension

What it can do on your machine

Read from SKILL.md and the folder at commit 53a27a9. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Fix Prompt Evaluation Diagnostics loads about 506 tokens when it runs. Until then it costs about 56 tokens; SKILL.md has 261 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~56
When it runs · the whole SKILL.md, loaded when a task matches
~506

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 261 words (~506 tokens).

“Fix issues found by the Chat Customizations Evaluations analyzer in prompt, agent, skill, and instruction files. The diagnostics include contradictions, ambiguities, persona conflicts, cognitive load issues, and coverage gaps.”

— opening of SKILL.md by microsoft, Custom licence
name
fix-customization-evaluation-diagnostics

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/fix-customization-evaluation-diagnostics of microsoft/vscode-chat-customizations-evaluation.

Open the folder on GitHubat commit 53a27a9

Compare with similar skills

Fix Prompt Evaluation Diagnostics next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Fix Prompt Evaluation Diagnostics compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Fix Prompt Evaluation Diagnostics this skillmicrosoft/vscode-chat-customizations-evaluation141—~506Automated safety check: PassCustom licence
Microsoft Skill CreatorMicrosoftDocs/mcp1.9k3 repos~2.1kAutomated safety check: PassCC-BY-4.0
Harness Agent Team Designerrevfactory/harness9.1k—~4.5kAutomated safety check: PassApache-2.0
Harness Evolution Feedback Looprevfactory/harness9.1k—~855Automated safety check: PassApache-2.0
Skill Creatorccusage/ccusage19k—~1.1kAutomated safety check: PassCustom licence
Workflow Schema Tuningbreaking-brake/cc-wf-studio5.4k—~1.3kAutomated safety check: PassCustom licence

Similar skills

  • Microsoft Skill Creator

    MicrosoftDocs/mcp

    Official

    Create agent skills for Microsoft technologies using official documentation.

    1.9k GitHub starsUsed in 3 repos~2.1k tokens
    Agent WorkflowsAuto-check passed
  • Harness Agent Team Designer

    revfactory/harness

    Designs a project-specific agent harness: defines specialist agents, writes the skills they follow, picks an execution mode and model for each, and keeps the setup maintained.

    9.1k GitHub stars~4.5k tokensUpdated 9 days ago
    Agent WorkflowsAuto-check passed
  • Collects feedback on how an agent harness performed, generalizes it, and updates the harness agents, skills and orchestrator along with a change-history table.

    9.1k GitHub stars~855 tokensUpdated 9 days ago
    Agent WorkflowsAuto-check passed
  • Skill Creator

    ccusage/ccusage

    Guides repo-local skill creation and updates. An agent skill from ccusage/ccusage.

    19k GitHub stars~1.1k tokensUpdated today
    Agent WorkflowsAuto-check passed
  • Workflow Schema Tuning

    breaking-brake/cc-wf-studio

    Guides edits to cc-wf-studio's workflow schema so AI agents generate better workflows, treating schema text as prompt engineering rather than validation.

    5.4k GitHub stars~1.3k tokensUpdated today
    Agent WorkflowsAuto-check passed
  • Agnix

    agent-sh/agnix

    A skill your agent uses when user asks to 'lint agent configs', 'validate skills', 'check CLAUDE.md', 'validate hooks', 'lint MCP'.

    444 GitHub stars~874 tokensUpdated today
    Agent WorkflowsAuto-check passed

More from microsoft/vscode-chat-customizations-evaluation

  • Analyze Chat Customization

    microsoft/vscode-chat-customizations-evaluation

    Official

    Runs Chat Customizations Evaluations analysis for the active customization file and summarizes the findings from the Problems panel.

    141 GitHub stars~135 tokensUpdated 4 days ago
    Auto-check passed

Categories

Questions about Fix Prompt Evaluation Diagnostics

What does Fix Prompt Evaluation Diagnostics do?

Applies the fixes suggested by the Chat Customizations Evaluations extension to a prompt, agent, skill or instruction file, changing only what each diagnostic requires. The extension's analyzer reports problems in prompt, agent, skill and instruction files: contradictions, ambiguities, persona conflicts, cognitive load issues and coverage gaps. This skill runs when you click the Implement suggestions button in the editor title bar, receiving diagnostics that each carry a line number, code, message and sometimes a suggestion.

When should I use Fix Prompt Evaluation Diagnostics?

Fix Prompt Evaluation Diagnostics fits situations like: resolving diagnostics on a prompt or skill file in the editor; cleaning up contradictions and ambiguities in an agent instruction file; applying evaluation suggestions without rewriting the whole file.

How do I install Fix Prompt Evaluation Diagnostics in Claude Code?

Run `npx skills add microsoft/vscode-chat-customizations-evaluation --skill fix-customization-evaluation-diagnostics -a claude-code`. Or copy the skill folder (skills/fix-customization-evaluation-diagnostics in microsoft/vscode-chat-customizations-evaluation) into .claude/skills/fix-customization-evaluation-diagnostics in your project. Claude Code loads it when a task matches its description.

How do I install Fix Prompt Evaluation Diagnostics in Codex?

Run `npx skills add microsoft/vscode-chat-customizations-evaluation --skill fix-customization-evaluation-diagnostics -a codex`. Or copy the skill folder (skills/fix-customization-evaluation-diagnostics in microsoft/vscode-chat-customizations-evaluation) into .agents/skills/fix-customization-evaluation-diagnostics in your project. Codex loads it when a task matches its description.

Can I use Fix Prompt Evaluation Diagnostics in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add microsoft/vscode-chat-customizations-evaluation --skill fix-customization-evaluation-diagnostics -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/fix-customization-evaluation-diagnostics, .gemini/skills/fix-customization-evaluation-diagnostics, .github/skills/fix-customization-evaluation-diagnostics and .opencode/skills/fix-customization-evaluation-diagnostics in your project.

What does Fix Prompt Evaluation Diagnostics need to run?

SKILL.md names no scripts, command-line tools or credentials: Fix Prompt Evaluation Diagnostics is instructions for the agent only. Our summary lists: VS Code with the Chat Customizations Evaluations extension.

Does Fix Prompt Evaluation Diagnostics access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Fix Prompt Evaluation Diagnostics safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Fix Prompt Evaluation Diagnostics use?

Fix Prompt Evaluation Diagnostics has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Fix Prompt Evaluation Diagnostics use?

About 506 tokens (SKILL.md is roughly 2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Fix Prompt Evaluation Diagnostics?

Skills that share tags, products or a category with Fix Prompt Evaluation Diagnostics: Microsoft Skill Creator (MicrosoftDocs/mcp, 1.9k stars), Harness Agent Team Designer (revfactory/harness, 9.1k stars), Harness Evolution Feedback Loop (revfactory/harness, 9.1k stars) and Skill Creator (ccusage/ccusage, 19k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Fix Prompt Evaluation Diagnostics?

microsoft (a GitHub organization, an official publisher) maintains it in microsoft/vscode-chat-customizations-evaluation, which has 141 GitHub stars. The repository holds 2 skills in this directory. The repository was last updated on October 3, 2026.

Source: microsoft/vscode-chat-customizations-evaluation on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.