Prompt Regression
agentscope-ai/OpenJudge
A skill your agent uses when the user has changed a prompt (system prompt, RAG template, agent instruction, etc.) and wants to know whether the candidate is better or worse than the baseline.
Automatically improves prompts based on output quality, user feedback, and A/B testing results
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizer --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/core/prompt-optimizer .claude/skills/prompt-optimizer && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .claude/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizerType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizer --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/core/prompt-optimizer .agents/skills/prompt-optimizer && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .agents/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizer --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/core/prompt-optimizer .cursor/skills/prompt-optimizer && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .cursor/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/Ckokoski/AuthorAgent.git --path skills/core/prompt-optimizer--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizer --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/core/prompt-optimizer .gemini/skills/prompt-optimizer && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .gemini/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizerInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/core/prompt-optimizer .github/skills/prompt-optimizer && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .github/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install Ckokoski/AuthorAgent prompt-optimizer --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/Ckokoski/AuthorAgent.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/core/prompt-optimizer .opencode/skills/prompt-optimizer && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "prompt-optimizer" agent skill from https://github.com/Ckokoski/AuthorAgent/tree/main/skills/core/prompt-optimizer into .opencode/skills/prompt-optimizer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "prompt-optimizer", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
prompt-optimizerAutomatically improves prompts based on output quality, user feedback, and A/B testing results
Prompt Optimizer is an agent skill from Ckokoski/AuthorAgent. Automatically improves prompts based on output quality, user feedback, and A/B testing results
Its SKILL.md is about 1.5k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in AI & LLM Engineering, covering Prompt engineering and A/B testing. The repository describes itself as: The Autonomous AI Writing Agent — a secure, author-focused AI for fiction and nonfiction authors (Planning, Revision, Promotion, and more). The licence is MIT.
7 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 47e9570. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md (its code samples are json).
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Prompt Optimizer loads about 1.5k tokens when it runs. Until then it costs about 28 tokens; SKILL.md has 505 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from Ckokoski/AuthorAgent at commit 47e9570, republished under its MIT licence (© Ckokoski). 505 words, ~1,462 tokens.
.claude/skills/prompt-optimizer/SKILL.md (or your agent's skills folder).AuthorAgent's prompts are its most important tool. This skill continuously optimizes them based on what actually produces good results — not guesswork, but measured outcomes.
Every skill, goal step, and system prompt contains prompts. Some work great. Some produce mediocre results. Without measurement, you're flying blind. The Prompt Optimizer tracks which prompt formulations produce the best outputs and evolves them over time.
Every prompt sent to an AI provider is logged with its outcome:
{
"promptId": "p-347",
"timestamp": "2026-02-24T15:00:00Z",
"template": "Write a compelling book blurb for: {{description}}...",
"skill": "blurb-writer",
"taskType": "marketing",
"provider": "gemini",
"inputTokens": 450,
"outputTokens": 890,
"outcome": "accepted",
"userEdited": false,
"qualitySignals": {
"wordCount": 147,
"completeness": true,
"followedInstructions": true,
"userAccepted": true
}
}The optimizer watches for these signals:
Positive signals (prompt is working):
Negative signals (prompt needs improvement):
When a prompt consistently underperforms, the optimizer creates variations:
Prompt Lab: "blurb-writer" skill
════════════════════════════════
Original (Score: 6.2/10 across 14 uses):
"Write a compelling book blurb for: {{description}}.
Create 3 versions: (1) short tagline, (2) back-cover
blurb (150 words), (3) Amazon description with HTML."
Variation A (Score: 7.8/10 across 6 uses):
"You are a bestselling book marketer. Write a blurb
for: {{description}}.
Rules: Hook in first sentence. No spoilers past Act 1.
End with a question or cliffhanger.
Format: tagline (10 words max), back cover (150 words),
Amazon listing (with <b> tags for emphasis)."
Variation B (Score: 8.1/10 across 4 uses):
"Study these bestselling blurbs for pacing and hooks:
[example 1], [example 2].
Now write a blurb for: {{description}} using the same
techniques. Output: tagline, 150-word back cover,
Amazon description."
→ RECOMMENDATION: Promote Variation B to primary.Add Specificity — Vague prompts ("write well") → Specific ("write in present tense, under 3000 words, with a cliffhanger ending")
Add Examples — Show the AI what "good" looks like for this task
Add Constraints — Boundaries improve output ("exactly 3 paragraphs", "no adverbs", "start with dialogue")
Role Framing — "You are a [expert role]" can dramatically change quality
Chain of Thought — For complex tasks, add "First analyze X, then plan Y, then write Z"
Negative Examples — "Do NOT do X" can be as powerful as "Do Y"
Output Format — Specifying exact output format reduces parsing errors
When the optimizer detects a consistently weak prompt:
Prompt data lives in workspace/memory/prompts/:
workspace/memory/prompts/
├── prompt-log.jsonl # All prompt executions and outcomes
├── prompt-variants.json # Active A/B test variants
├── prompt-winners.json # Promoted prompt improvements
└── prompt-archive.jsonl # Retired prompt versionsoptimize prompt for blurb-writerAnalyzes all historical uses of the blurb-writer skill and suggests improvements.
test prompt: "Write a blurb for {{description}} using the hook-mystery-stakes formula"Runs the variation alongside the current prompt and compares results.
prompt statsShows prompt win rates, A/B test status, and optimization suggestions.
update prompt for [skill]: [new prompt text]Manually override a skill's prompt template.
optimize prompt for [skill] — Analyze and suggest improvements for a skill's promptsprompt stats — View performance metrics across all promptsprompt lab — Enter interactive prompt testing modetest prompt [text] — A/B test a prompt variationshow prompt winners — See which optimizations have been promotedprompt history [skill] — View prompt evolution for a specific skill© Ckokoski, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/core/prompt-optimizer of Ckokoski/AuthorAgent.
Open the folder on GitHubat commit 47e9570
Prompt Optimizer next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Prompt Optimizer this skillCkokoski/AuthorAgent | 123 | — | ~1.5k | Automated safety check: Pass | MIT | |
| Prompt Regressionagentscope-ai/OpenJudge | 870 | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | |
| Prompt Governancealirezarezvani/claude-skills | 28k | — | ~2.8k | Automated safety check: Pass | MIT | |
| Prompt LabMathews-Tom/armory | 328 | — | ~2.1k | Automated safety check: Pass | MIT | |
| Sap AI Coresecondsky/sap-skills | 462 | — | ~3.3k | Automated safety check: Pass | GPL-3.0 | |
| Langchain Prompt Engineeringjeremylongshore/tons-of-skills-marketplace | 2.8k | — | ~4.4k | Automated safety check: Pass | MIT |
agentscope-ai/OpenJudge
A skill your agent uses when the user has changed a prompt (system prompt, RAG template, agent instruction, etc.) and wants to know whether the candidate is better or worse than the baseline.
alirezarezvani/claude-skills
A skill your agent uses when managing prompts in production at scale: versioning prompts, running A/B tests on prompts, building prompt registries, preventing prompt regressions, or creating eval…
Mathews-Tom/armory
LLM prompt engineering: analyzes failure modes, generates variants (direct, few-shot, CoT), designs rubrics, produces test suites.
secondsky/sap-skills
Guides development with SAP AI Core and SAP AI Launchpad for enterprise AI/ML workloads on SAP BTP.
jeremylongshore/tons-of-skills-marketplace
Manage LangChain 1.0 prompts like code — LangSmith prompt hub versioning, XML-tag conventions for Claude, few-shot example selection, discriminated-union extraction schemas, and A/B test wiring.
severity1/claude-code-prompt-improver
This skill enriches vague prompts with targeted research and clarification before execution.
Ckokoski/AuthorAgent
Structured post-goal reflection that extracts lessons, evaluates quality, and feeds the self-improvement loop
Ckokoski/AuthorAgent
Find and analyze comparable titles for query letters, marketing, and positioning strategy
Ckokoski/AuthorAgent
Scan manuscript for inconsistencies in characters, timeline, settings, and names
Ckokoski/AuthorAgent
Advanced 47-marker voice analysis engine — analyzes your writing to build a comprehensive Voice Profile for AuthorClaw
Ckokoski/AuthorAgent
Transform raw speech-to-text dictation into polished prose while preserving the author's natural voice
Ckokoski/AuthorAgent
Intelligent error diagnosis, automatic recovery strategies, and prevention of recurring failures
Categories
Automatically improves prompts based on output quality, user feedback, and A/B testing results. Prompt Optimizer is an agent skill from Ckokoski/AuthorAgent.
Prompt Optimizer fits situations like: tasks that involve Prompt engineering; tasks that involve A/B testing.
Run `npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a claude-code`. Or copy the skill folder (skills/core/prompt-optimizer in Ckokoski/AuthorAgent) into .claude/skills/prompt-optimizer in your project. Claude Code loads it when a task matches its description.
Run `npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a codex`. Or copy the skill folder (skills/core/prompt-optimizer in Ckokoski/AuthorAgent) into .agents/skills/prompt-optimizer in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add Ckokoski/AuthorAgent --skill prompt-optimizer -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/prompt-optimizer, .gemini/skills/prompt-optimizer, .github/skills/prompt-optimizer and .opencode/skills/prompt-optimizer in your project.
SKILL.md names no scripts, command-line tools or credentials: Prompt Optimizer is instructions for the agent only.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Prompt Optimizer is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.5k tokens (SKILL.md is roughly 5.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Prompt Optimizer: Prompt Regression (agentscope-ai/OpenJudge, 870 stars), Prompt Governance (alirezarezvani/claude-skills, 28k stars), Prompt Lab (Mathews-Tom/armory, 328 stars) and Sap AI Core (secondsky/sap-skills, 462 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Ckokoski (a GitHub user) maintains it in Ckokoski/AuthorAgent, which has 123 GitHub stars. The repository holds 23 skills in this directory. The repository was last updated on July 11, 2026.
Source: Ckokoski/AuthorAgent on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.