PR Babysitter
openinterpreter/openinterpreter
Watches an open GitHub pull request until it merges, handling review comments, diagnosing CI failures and retrying flaky checks along the way.
Generate a combined benchmark analysis for the group-sequential-design skill by reading all benchmark GitHub issues, selecting the latest completed run per issue, and producing a structured…
No licenceAuto-check passed
Install Benchmark Summary
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install RConsortium/pharma-skills benchmark-summary --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/_automation/benchmark-summary .claude/skills/benchmark-summary && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .claude/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summaryType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install RConsortium/pharma-skills benchmark-summary --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/_automation/benchmark-summary .agents/skills/benchmark-summary && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .agents/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install RConsortium/pharma-skills benchmark-summary --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/_automation/benchmark-summary .cursor/skills/benchmark-summary && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .cursor/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/RConsortium/pharma-skills.git --path _automation/benchmark-summary--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install RConsortium/pharma-skills benchmark-summary --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/_automation/benchmark-summary .gemini/skills/benchmark-summary && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .gemini/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install RConsortium/pharma-skills benchmark-summaryInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/_automation/benchmark-summary .github/skills/benchmark-summary && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .github/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add RConsortium/pharma-skills --skill benchmark-summary -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install RConsortium/pharma-skills benchmark-summary --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/RConsortium/pharma-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/_automation/benchmark-summary .opencode/skills/benchmark-summary && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "benchmark-summary" agent skill from https://github.com/RConsortium/pharma-skills/tree/main/_automation/benchmark-summary into .opencode/skills/benchmark-summary/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "benchmark-summary", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
benchmark-summary- GitHub stars
- 118
- Token cost
- ~1.9k tokens
- SKILL.md length
- 672 words
- Files
- 1
- Skills in repo
- 13
- Repo updated
- First seen
- Licence
- None found
At a glance
Generate a combined benchmark analysis for the group-sequential-design skill by reading all benchmark GitHub issues, selecting the latest completed run per issue, and producing a structured…
- Works in 5 steps: Discover all benchmark issues → Fetch results for each issue → Select the latest completed run per issue → …
- The user asks to update the benchmark summary
- SKILL.md covers Step 1 — Discover all…, Step 2 — Fetch results for…, Step 3 — Select the latest… and Step 4 — Build the…, plus 2 more sections
- Calls gh and jq
What it does
Benchmark Summary is an agent skill from RConsortium/pharma-skills. Generate a combined benchmark analysis for the group-sequential-design skill by reading all benchmark GitHub issues, selecting the latest completed run per issue, and producing a structured three-section report (summary table + overall scorecard + failure pattern analysis). Use this skill whenever the user asks to update the benchmark summary, generate the benchmark analysis, summarize skill vs no-skill results, add failure patterns, or produce benchmarkanalysisYYYY-MM-DD.md. Always invoke for any request to…
Its SKILL.md is about 1.9k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It works with GitHub. The repository describes itself as: A collection of agent skills for BioPharma use cases GSDBench Intake https://rconsortium.github.io/pharma-skills/gsdbench-intake/.
When your agent uses it
- The user asks to update the benchmark summary
- Generate the benchmark analysis
- Summarize skill vs no-skill results
- Add failure patterns
Example prompts
- “/benchmark-summary”
Workflow steps
5 steps, taken from the step headings in SKILL.md.
- Discover all benchmark issues
- Fetch results for each issue
- Select the latest completed run per issue
- Build the three-section document
- Save locally and post to GitHub
What it can do on your machine
Read from SKILL.md and the folder at commit ae5d83b. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
ghjq
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md. Its commands use gh, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Benchmark Summary loads about 1.9k tokens when it runs. Until then it costs about 147 tokens; SKILL.md has 672 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
Without a licence we can't republish the file, so here is its outline and opening line. It has 672 words (~1,898 tokens).
“Produce the combined benchmark analysis document for RConsortium/pharma-skills. This involves reading benchmark results that live as comments on GitHub issues, selecting the right run for each, and synthesizing them into a structured report.”
- name
- benchmark-summary
Files
Just SKILL.md in _automation/benchmark-summary of RConsortium/pharma-skills.
Open the folder on GitHubat commit ae5d83b
Compare with similar skills
Benchmark Summary next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Benchmark Summary this skillRConsortium/pharma-skills | 118 | — | ~1.9k | Automated safety check: Pass | None | |
| PR Babysitteropeninterpreter/openinterpreter | 69k | 3 repos | ~4.2k | Automated safety check: Pass | Apache-2.0 | |
| Diagnosing Superpowers Sessionsobra/superpowers | 296k | 3 repos | ~1.7k | Automated safety check: Pass | MIT | |
| GitHub Deep Researchbytedance/deer-flow | 83k | 5 repos | ~1.3k | Automated safety check: Pass | MIT | |
| Greplooponyx-dot-app/onyx | 32k | 4 repos | ~3.3k | Automated safety check: Pass | MIT | |
| Update V8 Versionopeninterpreter/openinterpreter | 69k | 2 repos | ~845 | Automated safety check: Pass | Apache-2.0 |
Similar skills
Diagnosing Superpowers Sessions
obra/superpowers
Investigates a session where Superpowers went wrong, reads the transcripts on disk and produces an evidence-cited report, optionally prepared as a bug report for the maintainers.
GitHub Deep Research
bytedance/deer-flow
Researches a GitHub repository over four rounds using the GitHub API and web search, then writes a structured markdown report with timeline, metrics and Mermaid diagrams.
Greploop
onyx-dot-app/onyx
Iteratively improves a PR (GitHub), MR (GitLab), or shelved changelist (Perforce) until Greptile gives it a 5/5 confidence score with zero unresolved comments.
Update V8 Version
openinterpreter/openinterpreter
Bumps the pinned v8 and rusty_v8 versions in Codex, validates the release-candidate path with the v8-canary check, and traces failures to upstream build changes.
Last30days
mvanhorn/last30days-skill
Research what people actually say about any topic in the last 30 days.
More from RConsortium/pharma-skills
All 13 skills in this repoRounding
RConsortium/pharma-skills
Audit R code that prepares CSR/TLF statistics for SAS-compatible rounding compliance (ties away from zero, round-once-at-display, fixed trailing-zero precision).
Issue To Eval
RConsortium/pharma-skills
Converts one or more GitHub Issues into standardized benchmark data using automated scripts.
Weekly Summary
RConsortium/pharma-skills
Generate a concise weekly progress summary for the pharmaskills repository.
Admiral Adae
RConsortium/pharma-skills
Derives an ADaM Adverse Events Analysis Dataset (ADAE) using the {admiral} R package and pharmaverse ecosystem.
Admiral Adsl
RConsortium/pharma-skills
Derives an ADaM Subject-Level Analysis Dataset (ADSL) using the {admiral} R package and pharmaverse ecosystem.
Admiral Bds
RConsortium/pharma-skills
Derives ADaM Basic Data Structure (BDS) datasets using the {admiral} R package.
Related
Works with
Questions about Benchmark Summary
What does Benchmark Summary do?
Generate a combined benchmark analysis for the group-sequential-design skill by reading all benchmark GitHub issues, selecting the latest completed run per issue, and producing a structured…. Benchmark Summary is an agent skill from RConsortium/pharma-skills. Generate a combined benchmark analysis for the group-sequential-design skill by reading all benchmark GitHub issues, selecting the latest completed run per issue, and producing a structured three-section report (summary table + overall scorecard + failure pattern analysis).
When should I use Benchmark Summary?
Benchmark Summary fits situations like: the user asks to update the benchmark summary; generate the benchmark analysis; summarize skill vs no-skill results; add failure patterns.
How do I install Benchmark Summary in Claude Code?
Run `npx skills add RConsortium/pharma-skills --skill benchmark-summary -a claude-code`. Or copy the skill folder (_automation/benchmark-summary in RConsortium/pharma-skills) into .claude/skills/benchmark-summary in your project. Claude Code loads it when a task matches its description.
How do I install Benchmark Summary in Codex?
Run `npx skills add RConsortium/pharma-skills --skill benchmark-summary -a codex`. Or copy the skill folder (_automation/benchmark-summary in RConsortium/pharma-skills) into .agents/skills/benchmark-summary in your project. Codex loads it when a task matches its description.
Can I use Benchmark Summary in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add RConsortium/pharma-skills --skill benchmark-summary -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/benchmark-summary, .gemini/skills/benchmark-summary, .github/skills/benchmark-summary and .opencode/skills/benchmark-summary in your project.
What does Benchmark Summary need to run?
Going by SKILL.md and its folder, Benchmark Summary needs the command-line tools its instructions call (gh and jq).
Does Benchmark Summary access the network?
SKILL.md contains no URLs. Its commands use gh, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Is Benchmark Summary safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Benchmark Summary use?
No licence was found for Benchmark Summary or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.
How many tokens does Benchmark Summary use?
About 1.9k tokens (SKILL.md is roughly 7.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Benchmark Summary?
Skills that share tags, products or a category with Benchmark Summary: PR Babysitter (openinterpreter/openinterpreter, 69k stars), Diagnosing Superpowers Sessions (obra/superpowers, 296k stars), GitHub Deep Research (bytedance/deer-flow, 83k stars) and Greploop (onyx-dot-app/onyx, 32k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Benchmark Summary?
RConsortium (a GitHub organization) maintains it in RConsortium/pharma-skills, which has 118 GitHub stars. The repository holds 13 skills in this directory. The repository was last updated on October 4, 2026.
Source: RConsortium/pharma-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.