Debugging CI Failures
PostHog/posthog
Debugs failing GitHub Actions CI runs for PostHog PRs, commits, and branches, and answers broad CI-health questions ("is CI red?", "is master green today?", "what's broken right now?").
Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts.
MITAuto-check passed
Install Ebench Debug
$ npx skills add InternRobotics/EBench --skill ebench-debug -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install InternRobotics/EBench ebench-debug --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/ebench-debug .claude/skills/ebench-debug && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .claude/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debugType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add InternRobotics/EBench --skill ebench-debug -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install InternRobotics/EBench ebench-debug --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/ebench-debug .agents/skills/ebench-debug && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .agents/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add InternRobotics/EBench --skill ebench-debug -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install InternRobotics/EBench ebench-debug --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/ebench-debug .cursor/skills/ebench-debug && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .cursor/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/InternRobotics/EBench.git --path skills/ebench-debug--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add InternRobotics/EBench --skill ebench-debug -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install InternRobotics/EBench ebench-debug --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/ebench-debug .gemini/skills/ebench-debug && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .gemini/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install InternRobotics/EBench ebench-debugInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add InternRobotics/EBench --skill ebench-debug -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/ebench-debug .github/skills/ebench-debug && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .github/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add InternRobotics/EBench --skill ebench-debug -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install InternRobotics/EBench ebench-debug --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/InternRobotics/EBench.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/ebench-debug .opencode/skills/ebench-debug && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "ebench-debug" agent skill from https://github.com/InternRobotics/EBench/tree/main/skills/ebench-debug into .opencode/skills/ebench-debug/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ebench-debug", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
ebench-debug- GitHub stars
- 145
- Token cost
- ~862 tokens
- SKILL.md length
- 410 words
- Files
- 1
- Skills in repo
- 5
- Repo updated
- First seen
- Licence
- MIT
At a glance
Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts.
- SKILL.md covers Isolate the failing layer and Inspect one episode
- Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
What it does
Ebench Debug is an agent skill from InternRobotics/EBench. Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts.
Its SKILL.md is about 860 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
The repository describes itself as: Elemental Diagnosis of Generalist Mobile Manipulation Policies. The licence is MIT.
Example prompts
- “/ebench-debug”
Requirements
- Python 3
What it can do on your machine
Read from SKILL.md and the folder at commit 355fe56. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Ebench Debug loads about 862 tokens when it runs. Until then it costs about 41 tokens; SKILL.md has 410 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from InternRobotics/EBench at commit 355fe56, republished under its MIT licence (© InternRobotics). 410 words, ~862 tokens.
Download SKILL.mdSave it as
.claude/skills/ebench-debug/SKILL.md (or your agent's skills folder).- name
- ebench-debug
- description
- Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts.
Diagnose an EBench run
Work from the EBench root. Obtain the failing command with credentials redacted, run ID, worker ID, first relevant traceback, checkpoint/config, and whether the failure occurs during loading, readiness, reset, inference, step, or result saving. Read existing logs before rerunning anything.
Isolate the failing layer
| Evidence | Next useful check |
|---|---|
| Import/config/weight failure | Active interpreter, installed package path, pinned submodules, baseline overlays, checkpoint files/statistics; server restart will not fix a local import. |
| Online task pending | Query the existing task with gmp online ready; distinguish scheduling from failure and retain its task ID. |
| Authentication or route failure | Distinguish platform URL from evaluation endpoint; check run ID and credential presence without printing credentials. |
| Reset timeout | Compare readiness, status and server logs if available. Asset loading and worker failure are hypotheses until supported. EvalClient.reset() kills/recreates its workers, so it is not a read-only probe. |
| Step timeout/disconnect | Correlate worker/server timestamps. Server execution may have completed; inspect progress before recovery and discard stale observations/chunks. |
| GPU OOM | Inspect model size, dtype and workers per GPU; reduce concurrency within scope before changing the model or evaluation protocol. |
| Implausible motion/near-zero SR | Inspect camera order, normalization, joint/gripper order, relative/absolute base semantics, replan horizon, and history reset before attributing failure to model capability. |
| Empty/missing report | Locate the actual result root, check completed episode files and writer errors; distinguish client traces from server result artifacts. |
Read baselines/X-VLA/run.py for bounded recovery and third_party/genmanip-client/src/genmanip_client/eval_client.py for current reset/step/storage behavior. Do not turn every exception into an endless reconnect loop. Stop retries when the same failure persists without new evidence, and report the unresolved cause and retained artifacts.
Show full SKILL.md (146 more words)Show less
Inspect one episode
For client traces, gmp plot "$EPISODE_DIR" reads steps.jsonl and merged*.mp4, producing action/state plots and optional merged video. Inspect these against the adapter's transformations.
For server-side results, gmp visualize --project_root "$GENMANIP_ROOT" uses the project's result tree. Its optional visualize dependencies and Rerun viewer cache are separate from model inference; the pinned README calls for Python 3.11+ for that viewer path. A viewer dependency failure does not establish that inference failed.
Preserve logs, partial results, and task/seed identifiers. gmp clean deletes server evaluation results and logs; do not use it as a generic repair. Avoid resetting all workers to investigate one worker. Make the smallest justified fix and rerun only the needed verification within the requested evaluation scope.
Deliver the observed symptom, evidence-backed cause (or remaining hypotheses), changed files/settings, validation outcome, and whether interrupted/partial episodes affect reported scores. Keep policy failures separate from infrastructure failures.
© InternRobotics, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
Just SKILL.md in skills/ebench-debug of InternRobotics/EBench.
Open the folder on GitHubat commit 355fe56
Compare with similar skills
Ebench Debug next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Ebench Debug this skillInternRobotics/EBench | 145 | — | ~862 | Automated safety check: Pass | MIT | |
| Debugging CI FailuresPostHog/posthog | 40k | — | ~5.7k | Automated safety check: Pass | Custom licence | |
| Debugasgeirtj/system_prompts_leaks | 69k | — | ~439 | Automated safety check: Pass | CC0-1.0 | |
| Hypothesis-Driven Debuggingcode-yeongyu/oh-my-openagent | 70k | — | ~3.2k | Automated safety check: Pass | Custom licence | |
| Agent Introspection Debuggingaffaan-m/ECC | 275k | 2 repos | ~1.4k | Automated safety check: Pass | MIT | |
| Openclaw Debuggingopenclaw/openclaw | 392k | — | ~1.9k | Automated safety check: Pass | MIT |
Similar skills
- Official
Debug
asgeirtj/system_prompts_leaks
Enable debug logging for this session and help diagnose issues
Hypothesis-Driven Debugging
code-yeongyu/oh-my-openagent
Runs a hypothesis-driven debugging loop for crashes, hangs and silent failures in any language, grounding every claim in runtime evidence and locking the fix with a test.
Agent Introspection Debugging
affaan-m/ECC
Structured self-debugging workflow for AI agent failures using capture, diagnosis, contained recovery, and introspection reports.
Openclaw Debugging
openclaw/openclaw
Debug OpenClaw model, provider, tool-surface, code-mode, streaming, and live/Crabbox behavior by choosing the right logs, probes, and proof path before changing code, including fetching stored…
Diagnosing Superpowers Sessions
obra/superpowers
Investigates a session where Superpowers went wrong, reads the transcripts on disk and produces an evidence-cited report, optionally prepared as a bug report for the maintainers.
More from InternRobotics/EBench
Ebench Analyze
InternRobotics/EBench
Generate and interpret EBench evaluation reports, compare runs and baselines, and diagnose capability or generalization gaps with explicit data coverage and aggregation semantics.
Ebench Evaluate
InternRobotics/EBench
Run and monitor an EBench policy evaluation against a local GenManip server or the online service, including baseline launch commands, worker allocation, and reproducible run records.
Ebench Integrate Policy
InternRobotics/EBench
Implement or review a custom VLA policy adapter for EBench EvalClient, including observation preprocessing, action semantics, chunking, and episode resets.
Ebench Setup
InternRobotics/EBench
Prepare or check an EBench evaluation environment for OpenPI, X-VLA, InternVLA-A1, or a custom policy.
Questions about Ebench Debug
What does Ebench Debug do?
Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts. Ebench Debug is an agent skill from InternRobotics/EBench. Diagnose EBench evaluation failures, stalled workers, transport errors, invalid actions, and unexpectedly low scores using logs and episode artifacts.
How do I install Ebench Debug in Claude Code?
Run `npx skills add InternRobotics/EBench --skill ebench-debug -a claude-code`. Or copy the skill folder (skills/ebench-debug in InternRobotics/EBench) into .claude/skills/ebench-debug in your project. Claude Code loads it when a task matches its description.
How do I install Ebench Debug in Codex?
Run `npx skills add InternRobotics/EBench --skill ebench-debug -a codex`. Or copy the skill folder (skills/ebench-debug in InternRobotics/EBench) into .agents/skills/ebench-debug in your project. Codex loads it when a task matches its description.
Can I use Ebench Debug in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add InternRobotics/EBench --skill ebench-debug -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ebench-debug, .gemini/skills/ebench-debug, .github/skills/ebench-debug and .opencode/skills/ebench-debug in your project.
What does Ebench Debug need to run?
SKILL.md names no scripts, command-line tools or credentials: Ebench Debug is instructions for the agent only. Our summary lists: Python 3.
Does Ebench Debug access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Ebench Debug safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Ebench Debug use?
Ebench Debug is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Ebench Debug use?
About 862 tokens (SKILL.md is roughly 3.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Ebench Debug?
Skills that share tags, products or a category with Ebench Debug: Debugging CI Failures (PostHog/posthog, 40k stars), Debug (asgeirtj/system_prompts_leaks, 69k stars), Hypothesis-Driven Debugging (code-yeongyu/oh-my-openagent, 70k stars) and Agent Introspection Debugging (affaan-m/ECC, 275k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Ebench Debug?
InternRobotics (a GitHub organization) maintains it in InternRobotics/EBench, which has 145 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on September 24, 2026.
Source: InternRobotics/EBench on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.