Agent skill

Bench Repro

by D-Robotics in D-Robotics/moss

How to reproduce and grade a bench task or A/B arm for moss capability work

MITAuto-check passed

Install Bench Repro

skills CLI
$ npx skills add D-Robotics/moss --skill bench-repro -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install D-Robotics/moss bench-repro --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/D-Robotics/moss.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.moss/skills/bench-repro .claude/skills/bench-repro && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
bench-repro
GitHub stars
143
Token cost
~288 tokens
SKILL.md length
113 words
Files
1
Skills in repo
3
Repo updated
First seen
Licence
MIT

At a glance

How to reproduce and grade a bench task or A/B arm for moss capability work

  • Calls npm; needs MOSS_BENCH_API_KEY

What it does

Bench Repro is an agent skill from D-Robotics/moss. How to reproduce and grade a bench task or A/B arm for moss capability work

Its SKILL.md is about 290 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It works with npm. The licence is MIT.

Example prompts

  • “/bench-repro”

Requirements

  • A credential in MOSS_BENCH_API_KEY

What it can do on your machine

Read from SKILL.md and the folder at commit 58e7f61. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • npm

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use npm, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • MOSS_BENCH_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Bench Repro loads about 288 tokens when it runs. Until then it costs about 22 tokens; SKILL.md has 113 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~22
When it runs · the whole SKILL.md, loaded when a task matches
~288

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from D-Robotics/moss at commit 58e7f61, republished under its MIT licence (© D-Robotics). 113 words, ~288 tokens.

Download SKILL.mdSave it as .claude/skills/bench-repro/SKILL.md (or your agent's skills folder).
name
bench-repro
description
How to reproduce and grade a bench task or A/B arm for moss capability work
when
running benchmarks, investigating a bench regression, or collecting A/B evidence

Reproducing bench evidence

  • Internal bench: npm run bench -- --task <id> --samples <n> --label <label> (provider via MOSS_BENCH_API_KEY, --model, --base-url; temp=0; approval=never). Results land in bench/results/<label>/ (never committed).
  • A/B: npm run bench:ab -- <engine> --samples <n> for best-of-n / reasoning-high / goal-loop / model-routing; the verdict json lands in bench/results/ab-<engine>-<stamp>.json.
  • Noise discipline: compare only same-SHA runs; use npm run bench:noise for the noise band; a delta inside the band is not evidence.
  • SWE-bench (external board): npm run bench:swe -- --samples 2 --label <label> produces predictions; grade with npm run bench:swe -- --eval --label <label>. Instance subset is locked in bench/boards/swebench-instances.json — never edit it mid-study.
  • A baseline must be collected from a pinned build (--dist bench/.cache/<snapshot>/dist), not from a dirty tree.

© D-Robotics, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .moss/skills/bench-repro of D-Robotics/moss.

Open the folder on GitHubat commit 58e7f61

Compare with similar skills

Bench Repro next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Bench Repro compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Bench Repro this skillD-Robotics/moss143—~288Automated safety check: PassMIT
Defuddlekepano/obsidian-skills49k12 repos~208Automated safety check: PassMIT
Vercel Deploybytedance/deer-flow83k10 repos~797Automated safety check: PassMIT
MCP Server BuildershareAI-lab/learn-claude-code78k5 repos~1.2kAutomated safety check: PassMIT
Knap Markdown Templateskepano/obsidian-skills49k2 repos~986Automated safety check: PassMIT
Install Anti-Slop Oxlint Rulesdmmulroy/anti-slop5.3k1 repos~2.2kAutomated safety check: PassMIT

Similar skills

  • Defuddle

    kepano/obsidian-skills

    Uses the Defuddle CLI to pull clean, readable Markdown, JSON or metadata from web pages, stripping navigation, ads and clutter to save tokens.

    49k GitHub starsUsed in 12 repos~208 tokens
    Knowledge ManagementAuto-check passed
  • Vercel Deploy

    bytedance/deer-flow

    Deploys a project to Vercel with one script and no login, then returns a live preview URL and a claim link for moving the deployment into your own Vercel account.

    83k GitHub starsUsed in 10 repos~797 tokens
    DevOps & CloudAuto-check passed
  • MCP Server Builder

    shareAI-lab/learn-claude-code

    Walks through building MCP servers in Python or TypeScript that expose tools, resources and prompts to Claude, with templates, registration and testing.

    78k GitHub starsUsed in 5 repos~1.2k tokens
    Agent WorkflowsAuto-check passed
  • Knap Markdown Templates

    kepano/obsidian-skills

    Renders Markdown notes from Knap templates and JSON data on the command line, including notes built from Defuddle web page output.

    49k GitHub starsUsed in 2 repos~986 tokens
    Documents & OfficeAuto-check passed
  • Installs, updates or migrates the vendored anti-slop Oxlint plugin in a repository, keeping local rule changes and the plugin's license and provenance files.

    5.3k GitHub starsUsed in 1 repo~2.2k tokens
    DevelopmentAuto-check passed
  • Nx Run Tasks

    nomcopter/react-mosaic

    Helps with running tasks in an Nx workspace. An agent skill from nomcopter/react-mosaic.

    4.8k GitHub starsUsed in 8 repos~613 tokens
    DevelopmentAuto-check passed

More from D-Robotics/moss

  • Patch Discipline

    D-Robotics/moss

    How to make code changes in the moss repo — read-before-edit, minimal diffs, verify with real runs

    143 GitHub stars~264 tokensUpdated 6 days ago
    Auto-check passed
  • Worktree Parallel

    D-Robotics/moss

    How to run writable sub-agents in isolated git worktrees and merge their lease patches

    143 GitHub stars~313 tokensUpdated 6 days ago
    Auto-check passed

Works with

Questions about Bench Repro

What does Bench Repro do?

How to reproduce and grade a bench task or A/B arm for moss capability work. Bench Repro is an agent skill from D-Robotics/moss.

How do I install Bench Repro in Claude Code?

Run `npx skills add D-Robotics/moss --skill bench-repro -a claude-code`. Or copy the skill folder (.moss/skills/bench-repro in D-Robotics/moss) into .claude/skills/bench-repro in your project. Claude Code loads it when a task matches its description.

How do I install Bench Repro in Codex?

Run `npx skills add D-Robotics/moss --skill bench-repro -a codex`. Or copy the skill folder (.moss/skills/bench-repro in D-Robotics/moss) into .agents/skills/bench-repro in your project. Codex loads it when a task matches its description.

Can I use Bench Repro in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add D-Robotics/moss --skill bench-repro -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/bench-repro, .gemini/skills/bench-repro, .github/skills/bench-repro and .opencode/skills/bench-repro in your project.

What does Bench Repro need to run?

Going by SKILL.md and its folder, Bench Repro needs the command-line tools its instructions call (npm) and credentials named MOSS_BENCH_API_KEY. Our summary lists: A credential in MOSS_BENCH_API_KEY.

Does Bench Repro access the network?

SKILL.md contains no URLs. Its commands use npm, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Bench Repro safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Bench Repro use?

Bench Repro is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Bench Repro use?

About 288 tokens (SKILL.md is roughly 1.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Bench Repro?

Skills that share tags, products or a category with Bench Repro: Defuddle (kepano/obsidian-skills, 49k stars), Vercel Deploy (bytedance/deer-flow, 83k stars), MCP Server Builder (shareAI-lab/learn-claude-code, 78k stars) and Knap Markdown Templates (kepano/obsidian-skills, 49k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Bench Repro?

D-Robotics (a GitHub organization) maintains it in D-Robotics/moss, which has 143 GitHub stars. The repository holds 3 skills in this directory. The repository was last updated on October 2, 2026.

Source: D-Robotics/moss on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.