Light Experiment Coding
Light0305/Light-skills
Builds the code for a frozen research experiment test-first, with leakage controls, seed handling and saved evidence so results can be rerun and audited.
Plans the ablation studies a paper needs after main results support its claim: Codex designs them like a reviewer, Claude Code checks feasibility and runs them.
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-planner --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/ablation-planner .claude/skills/ablation-planner && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .claude/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-plannerType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-planner --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/ablation-planner .agents/skills/ablation-planner && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .agents/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-planner --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/ablation-planner .cursor/skills/ablation-planner && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .cursor/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git --path skills/ablation-planner--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-planner --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/ablation-planner .gemini/skills/ablation-planner && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .gemini/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-plannerInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/ablation-planner .github/skills/ablation-planner && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .github/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install wanshuiyin/Auto-claude-code-research-in-sleep ablation-planner --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/ablation-planner .opencode/skills/ablation-planner && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "ablation-planner" agent skill from https://github.com/wanshuiyin/Auto-claude-code-research-in-sleep/tree/main/skills/ablation-planner into .opencode/skills/ablation-planner/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ablation-planner", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
ablation-plannerPlans the ablation studies a paper needs after main results support its claim: Codex designs them like a reviewer, Claude Code checks feasibility and runs them.
This skill plans the ablation studies a paper will need once main results support the claim. It splits the work between two models: Codex designs the ablations from a reviewer's point of view, and Claude Code checks feasibility and does the implementation. It applies when the result-to-claim check returns supported or partial, when you ask for ablation planning, or when the auto review loop flags missing ablations.
The agent first reads the project files for the method and its components, current experiment results from logs or W&B, the claims and the available compute. Codex returns a design that is normalized into a structured plan with component ablations at the highest priority. Claude Code then checks the compute budget, which ablations need code and which are config-only, and what can run in parallel, and it proposes cuts if the budget is tight. It creates configs or scripts, smoke tests each, runs them in the suggested order under descriptive names, logs results in `EXPERIMENT_LOG.md` and updates `findings.md`.
The rules keep roles clear: Codex leads, so Claude Code does not pre-filter the list; every ablation states what it tests and what is expected if the component matters, with no just-try-it runs; config-only ablations come first; and cuts are negotiated with Codex rather than dropped silently.
5 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit 26b95cf. It shows what the files ask for, not the result of running them.
Pre-approves these tools, so the agent can use them without asking each time:
Bash(*)ReadGrepGlobWriteEditmcp__codex__codexmcp__codex__codex-replyFrom allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md (its code samples are markdown).
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Ablation Study Planner loads about 1.3k tokens when it runs. Until then it costs about 37 tokens; SKILL.md has 321 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check noted patterns worth knowing about, such as sudo or a known installer.
allowed-tools: Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-replyAutomated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from wanshuiyin/Auto-claude-code-research-in-sleep at commit 26b95cf, republished under its MIT licence (© wanshuiyin). 321 words, ~1,283 tokens.
.claude/skills/ablation-planner/SKILL.md (or your agent's skills folder).Systematically design ablation studies that answer the questions reviewers will ask. Codex leads the design (reviewer perspective), CC reviews feasibility and implements.
/result-to-claim with claim_supported = yes or partial/auto-review-loop reviewer identifies missing ablationsCC reads available project files to build the full picture:
idea-stage/docs/research_contract.md, legacy docs/research_contract.md, or project CLAUDE.md)mcp__codex__codex:
model: gpt-6-astra
config: {"model_reasoning_effort": "xhigh"}
prompt: |
You are a rigorous ML reviewer planning ablation studies.
Given this method and results, design ablations that:
1. Isolate the contribution of each novel component
2. Answer questions reviewers will definitely ask
3. Test sensitivity to key hyperparameters
4. Compare against natural alternative design choices
Method: [description from project files]
Components: [list of removable/replaceable components]
Current results: [key metrics from experiments]
Claims: [what we claim and current evidence]
For each ablation, specify:
- name: what to change (e.g., "remove module X", "replace Y with Z")
- what_it_tests: the specific question this answers
- expected_if_component_matters: what we predict if the component is important
- priority: 1 (must-run) to 5 (nice-to-have)
Also provide:
- coverage_assessment: what reviewer questions these ablations answer
- unnecessary_ablations: experiments that seem useful but won't add insight
- suggested_order: run order optimized for maximum early information
- estimated_compute: total GPU-hours estimateNormalize Codex response into structured format:
## Ablation Plan
### Component Ablations (highest priority)
| # | Name | What It Tests | Expected If Matters | Priority |
|---|------|---------------|---------------------|----------|
| 1 | remove module X | contribution of X | performance drops on metric Y | 1 |
| 2 | replace X with simpler Z | value of learned vs fixed | drops, especially on dataset A | 2 |
### Hyperparameter Sensitivity
| # | Parameter | Values to Test | What It Tests | Priority |
|---|-----------|---------------|---------------|----------|
| 3 | lambda | [0.01, 0.1, 1.0] | sensitivity to regularization | 3 |
### Design Choice Comparisons
| # | Name | What It Tests | Priority |
|---|------|---------------|----------|
| 4 | joint vs separate matching | whether joint adds value | 4 |
### Coverage Assessment
[What reviewer questions these ablations answer]
### Unnecessary Ablations
[Experiments that seem useful but won't add insight — skip these]
### Run Order
[Optimized for maximum early information]
### Estimated Compute
[Total GPU-hours]Before running anything, CC checks:
ablation-no-module-X)what_it_tests and expected_if_component_matters. No "just try it" experiments.© wanshuiyin, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/ablation-planner of wanshuiyin/Auto-claude-code-research-in-sleep.
Open the folder on GitHubat commit 26b95cf
Ablation Study Planner next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Ablation Study Planner this skillwanshuiyin/Auto-claude-code-research-in-sleep | 17k | — | ~1.3k | Automated safety check: Notes | MIT | |
| Light Experiment CodingLight0305/Light-skills | 640 | — | ~2.3k | Automated safety check: Pass | MIT | |
| Light Research PlanLight0305/Light-skills | 640 | — | ~5.3k | Automated safety check: Pass | MIT | |
| Scientific Workflow ToolsDrugClaw/DrugClaw | 126 | — | ~712 | Automated safety check: Pass | Apache-2.0 | |
| Bio Experimental Design Multiple TestingGPTomics/bioSkills | 1.2k | 1 repos | ~3.5k | Automated safety check: Pass | MIT | |
| Scientific Critical Thinkingjaechang-hits/SciAgent-Skills | 374 | 1 repos | ~4.7k | Automated safety check: Pass | CC-BY-4.0 |
Light0305/Light-skills
Builds the code for a frozen research experiment test-first, with leakage controls, seed handling and saved evidence so results can be rerun and audited.
Light0305/Light-skills
Light 科研主线第 5 步·研究方案与实验设计:把 idea-critique 放行的 idea 与 data feasibility 拆成能真执行、能写进论文、 能复现的 question/estimand、实验矩阵与预注册包。何时用:idea 已通过审查要落地 / 要设计实验·消融·对比·敏感性· 泛化·鲁棒性 / 写研究方案 PROJECTPLAN / 锁 primary…
DrugClaw/DrugClaw
Research-method workflow guide for hypothesis framing, peer-review style critique, reproducibility planning, study-design checks, and scientific-writing structure.
GPTomics/bioSkills
Controls error rates across thousands of simultaneous tests in genomics discovery using false-discovery-rate methods (Benjamini-Hochberg 1995; Benjamini-Yekutieli 2001 for arbitrary dependence…
jaechang-hits/SciAgent-Skills
Evaluating scientific evidence and claims. An agent skill from jaechang-hits/SciAgent-Skills.
franklee16/academic-research-skills
A skill your agent uses when defending the research design of a The Journal of Politics (JOP) manuscript — causal identification for quantitative work, experimental and survey-experimental design…
wanshuiyin/Auto-claude-code-research-in-sleep
Builds an academic conference poster as a single HTML and CSS file with measurement-based gates, real paper figures and a print-ready PDF rendered through headless Chromium.
wanshuiyin/Auto-claude-code-research-in-sleep
Runs a mathematical proof project as a stateful pipeline of run directories: a local attempt first, then a manual GPT Pro handoff package, with an optional DeepSeek audit.
wanshuiyin/Auto-claude-code-research-in-sleep
Render an ARIS Markdown / JSON artifact (IDEAREPORT, AUTOREVIEW, KILLARGUMENT, PAPERPLAN, research-wiki state, etc.) into a single-file HTML view designed for human reading.
wanshuiyin/Auto-claude-code-research-in-sleep
Audit experiment integrity before claiming results. An agent skill from wanshuiyin/Auto-claude-code-research-in-sleep.
wanshuiyin/Auto-claude-code-research-in-sleep
Run the Anti-Autoresearch integrity-forensics DETERMINISTIC slice (numeric core + rules-only reporter) against a paper via a SHA-pinned thin launcher, then convert the verdict into a typed policy…
wanshuiyin/Auto-claude-code-research-in-sleep
Generate a long-form Chinese interview-prep cheat sheet on a specific ML/LLM topic — formulas with derivations, from-scratch PyTorch code, comparison tables, and 25 高频面试题 (L1 必会 / L2 进阶 / L3 顶级 lab).
Categories
Plans the ablation studies a paper needs after main results support its claim: Codex designs them like a reviewer, Claude Code checks feasibility and runs them. This skill plans the ablation studies a paper will need once main results support the claim. It splits the work between two models: Codex designs the ablations from a reviewer's point of view, and Claude Code checks feasibility and does the implementation.
Ablation Study Planner fits situations like: planning ablations after main results support the paper's claim; responding to a reviewer-style request for missing ablations; fitting an ablation list to a limited GPU budget.
Run `npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a claude-code`. Or copy the skill folder (skills/ablation-planner in wanshuiyin/Auto-claude-code-research-in-sleep) into .claude/skills/ablation-planner in your project. Claude Code loads it when a task matches its description.
Run `npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a codex`. Or copy the skill folder (skills/ablation-planner in wanshuiyin/Auto-claude-code-research-in-sleep) into .agents/skills/ablation-planner in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add wanshuiyin/Auto-claude-code-research-in-sleep --skill ablation-planner -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ablation-planner, .gemini/skills/ablation-planner, .github/skills/ablation-planner and .opencode/skills/ablation-planner in your project.
SKILL.md names no scripts, command-line tools or credentials: Ablation Study Planner is instructions for the agent only. Our summary lists: Codex reachable through the MCP tool the skill calls; Project files such as the research contract and the experiment log. Its frontmatter pre-approves these tools: Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-reply.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.
Ablation Study Planner is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.3k tokens (SKILL.md is roughly 5.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Ablation Study Planner: Light Experiment Coding (Light0305/Light-skills, 640 stars), Light Research Plan (Light0305/Light-skills, 640 stars), Scientific Workflow Tools (DrugClaw/DrugClaw, 126 stars) and Bio Experimental Design Multiple Testing (GPTomics/bioSkills, 1.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
wanshuiyin (a GitHub user) maintains it in wanshuiyin/Auto-claude-code-research-in-sleep, which has 17,205 GitHub stars. The repository holds 26 skills in this directory. The repository was last updated on October 7, 2026.
Source: wanshuiyin/Auto-claude-code-research-in-sleep on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.