Theory Variable Method Matrix
Drchronx/ai-agent-research-starter-kit
Build and maintain a theory-variable-method matrix from papers, Zotero metadata, Obsidian paper cards, and research notes.
學術研究實驗設計技能——從研究假設到可重現實驗計畫的完整流程。當使用者需要規劃實驗、設計 ablation study、選擇 baseline、確定評估指標,或問「我應該跑哪些實驗」時,一定要使用此技能。觸發詞包括:實驗設計、experiment design、ablation、baseline、跑什麼實驗、evaluation metric、如何驗證方法。適用於機器學習、NLP、CV…
$ npx skills add voidful/academic-skills --skill experiment-design -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install voidful/academic-skills experiment-design --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/experiment-design .claude/skills/experiment-design && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .claude/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/voidful/academic-skills/tree/main/experiment-designType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add voidful/academic-skills --skill experiment-design -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install voidful/academic-skills experiment-design --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/experiment-design .agents/skills/experiment-design && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .agents/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add voidful/academic-skills --skill experiment-design -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install voidful/academic-skills experiment-design --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/experiment-design .cursor/skills/experiment-design && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .cursor/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/voidful/academic-skills.git --path experiment-design--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add voidful/academic-skills --skill experiment-design -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install voidful/academic-skills experiment-design --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/experiment-design .gemini/skills/experiment-design && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .gemini/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install voidful/academic-skills experiment-designInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add voidful/academic-skills --skill experiment-design -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/experiment-design .github/skills/experiment-design && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .github/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add voidful/academic-skills --skill experiment-design -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install voidful/academic-skills experiment-design --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/voidful/academic-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/experiment-design .opencode/skills/experiment-design && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "experiment-design" agent skill from https://github.com/voidful/academic-skills/tree/main/experiment-design into .opencode/skills/experiment-design/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "experiment-design", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
experiment-design學術研究實驗設計技能——從研究假設到可重現實驗計畫的完整流程。當使用者需要規劃實驗、設計 ablation study、選擇 baseline、確定評估指標,或問「我應該跑哪些實驗」時,一定要使用此技能。觸發詞包括:實驗設計、experiment design、ablation、baseline、跑什麼實驗、evaluation metric、如何驗證方法。適用於機器學習、NLP、CV…
Experiment Design is an agent skill from voidful/academic-skills. 學術研究實驗設計技能——從研究假設到可重現實驗計畫的完整流程。當使用者需要規劃實驗、設計 ablation study、選擇 baseline、確定評估指標,或問「我應該跑哪些實驗」時,一定要使用此技能。觸發詞包括:實驗設計、experiment design、ablation、baseline、跑什麼實驗、evaluation metric、如何驗證方法。適用於機器學習、NLP、CV 等領域的實驗規劃。
Its SKILL.md is about 1.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 7 other files, including reference files (for example `references/ablation-design.md`, `references/baseline-selection.md` and `references/experiment-planning.md`). Compatibility notes: Works with Claude Code, ChatGPT/Codex CLI, and Gemini CLI.
It sits in Research & Science, covering Experimental design and Natural language processing. The repository describes itself as: A complete academic research Skill suite. Supports Claude Code, ChatGPT / Codex CLI, and Gemini CLI. The licence is MIT.
4 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 71e9c42. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Works with Claude Code, ChatGPT/Codex CLI, and Gemini CLI.
From compatibility in the SKILL.md frontmatter.
Experiment Design loads about 1.2k tokens when it runs, and up to ~9.2k if it reads all its reference files. Until then it costs about 56 tokens; SKILL.md has 303 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from voidful/academic-skills at commit 71e9c42, republished under its MIT licence (© voidful). 303 words, ~1,186 tokens.
.claude/skills/experiment-design/SKILL.md (or your agent's skills folder). This skill also uses 5 other files; get the full folder from GitHub.本技能提供一套結構化的實驗設計流程,適用於機器學習、自然語言處理、電腦視覺等領域的學術研究。目標是協助研究者從模糊的研究想法出發,產出一份嚴謹、可重現、且具說服力的實驗計畫。
好的實驗設計應具備以下特質:
完整的實驗設計遵循以下六步流程:
假設 → 變數 → 指標 → Baseline → Ablation → 計算預算每一步的產出都是下一步的輸入,形成嚴謹的推導鏈。
將模糊的研究動機轉化為可驗證的具體假設。
| 標準 | 說明 |
|---|---|
| 具體性 | 明確指出預期的效果方向與幅度 |
| 可測量性 | 可以用量化指標來驗證 |
| 可證偽性 | 存在可能否定假設的實驗結果 |
| 相關性 | 與研究問題直接相關 |
詳見:實驗規劃參考
研究者主動操控的變數,即實驗中「改變的東西」。
用來衡量實驗結果的變數,即「被測量的東西」。
實驗中保持不變的變數,確保比較的公平性。
詳見:實驗規劃參考
| 類別 | 指標範例 |
|---|---|
| 分類任務 | Accuracy、Precision、Recall、F1-score、AUC-ROC |
| 生成任務 | BLEU、ROUGE、METEOR、BERTScore、人工評估 |
| 資訊擷取 | MAP、MRR、NDCG、Recall@K |
| 效率指標 | FLOPs、參數量、推論延遲、記憶體佔用 |
| 穩健性 | 跨資料集表現、對抗樣本準確率 |
Ablation Study 是驗證方法中各組件貢獻的關鍵實驗。本技能定義四種 Ablation 模式:
逐一移除或替換方法中的各個組件,觀察效能變化。
探討關鍵超參數對效能的影響。
驗證方法的泛化能力。
透過可視化與案例分析深入理解模型行為。
單次實驗成本
實驗總量計算
總 GPU 時數 = 單次時數 × 模型變體數 × 資料集數 × 隨機種子數 × 超參組合數安全係數
實驗計畫必須包含完整的可重現性資訊,確保他人能夠精確重現結果。
硬體環境
軟體環境
隨機性控制
訓練協定
資料處理
評估協定
詳見:可重現性清單
本技能的最終產出為一份結構化的實驗計畫文件,包含以下章節:
使用模板:實驗計畫模板
在完成實驗計畫後,請確認以下項目:
© voidful, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 5 other files (references) in experiment-design of voidful/academic-skills.
Open the folder on GitHubat commit 71e9c42
Experiment Design next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Experiment Design this skillvoidful/academic-skills | 132 | — | ~1.2k | Automated safety check: Pass | MIT | |
| Theory Variable Method MatrixDrchronx/ai-agent-research-starter-kit | 134 | — | ~741 | Automated safety check: Pass | Custom licence | |
| Scientific Critical Thinkingweapp-tailwindcss/weapp-tailwindcss | 1.9k | 23 repos | ~5.9k | Automated safety check: Notes | MIT | |
| Claim-Driven Experiment PlannerzjYao36/Auto-Research-Refine | 128 | 7 repos | ~2.3k | Automated safety check: Notes | None | |
| Benchmark Paper TemplateHKUSTDial/Supervisor-Skills | 8.4k | — | ~2.8k | Automated safety check: Pass | CC-BY-4.0 | |
| Research Refine PipelinezjYao36/Auto-Research-Refine | 128 | 6 repos | ~1.4k | Automated safety check: Notes | None |
Drchronx/ai-agent-research-starter-kit
Build and maintain a theory-variable-method matrix from papers, Zotero metadata, Obsidian paper cards, and research notes.
weapp-tailwindcss/weapp-tailwindcss
Evaluate research rigor. An agent skill from weapp-tailwindcss/weapp-tailwindcss.
zjYao36/Auto-Research-Refine
Turns a refined research proposal into a claim-to-evidence-to-run-order roadmap instead of a sprawling benchmark wishlist.
HKUSTDial/Supervisor-Skills
Structures benchmark and evaluation papers around five pillars, with a completeness audit, an Introduction logic chain, a section skeleton and a pre-submission checklist.
zjYao36/Auto-Research-Refine
Chains research-refine and experiment-plan to turn a vague research direction into a focused proposal and a claim-driven experiment roadmap.
aiming-lab/AutoResearchClaw
Turns a broad metabolic modelling topic into a concrete, paper-shaped plan with organism, model, perturbations, metrics and figures before any FBA code is written.
voidful/academic-skills
Complete academic research skill suite covering the full pipeline: paper reading (read/explain papers with storytelling), idea generation (brainstorm research directions), experiment design (plan…
voidful/academic-skills
學術研究的 Idea 產生技能——從發散到收斂,系統化地產出高品質研究構想。當使用者想腦力激盪研究方向、找新 research idea、或問「我接下來可以做什麼研究」時,一定要使用此技能。觸發詞包括:brainstorm、想 idea、研究方向、下一步做什麼、有什麼可以研究的、找 gap、research proposal。適用於任何階段的學術研究構想生成。
voidful/academic-skills
太奶讀論文 — 一位百歲阿嬤用繁體中文、生活比喻和動漫梗,帶你讀懂學術論文。當使用者提供論文 PDF、arXiv 連結、或貼上論文文字,並想理解論文內容時,一定要使用此技能。觸發詞包括:讀論文、解釋論文、看不懂、幫我理解這篇、這篇在說什麼、paper reading、explain this paper。適用於任何學術論文的直觀導讀。
voidful/academic-skills
學術論文審稿技能 — 以結構化四步驟流程完成深度論文審查,涵蓋批判性審查、分數預測、要點精煉與正式審稿產出。當使用者需要 review 一篇論文、模擬 reviewer 反應、評估論文能否被接收、或幫助判斷論文優缺點時,一定要使用此技能。觸發詞包括:review 這篇、幫我審稿、reviewer 會怎麼說、這篇能上嗎、paper review、給分數、找…
voidful/academic-skills
頂級會議論文寫作技能——以嚴格 reviewer 視角指導從草稿到終稿的完整寫作流程。當使用者要寫論文、改善論文草稿、修改特定章節(introduction、method、experiments、conclusion)、潤色學術英文、回應 reviewer 意見,或問「這段怎麼寫」時,一定要使用此技能。觸發詞包括:寫論文、paper writing、improve my…
voidful/academic-skills
數學證明撰寫技能 — 從主張提取到 LaTeX 排版的完整證明工作流。當使用者需要撰寫或驗證數學定理、引理、命題的形式證明,或需要推導公式、整理理論分析時,一定要使用此技能。觸發詞包括:數學證明、prove、theorem、lemma、proposition、推導、理論分析、寫 proof、LaTeX 數學、formal…
Categories
學術研究實驗設計技能——從研究假設到可重現實驗計畫的完整流程。當使用者需要規劃實驗、設計 ablation study、選擇 baseline、確定評估指標,或問「我應該跑哪些實驗」時,一定要使用此技能。觸發詞包括:實驗設計、experiment design、ablation、baseline、跑什麼實驗、evaluation metric、如何驗證方法。適用於機器學習、NLP、CV…. Experiment Design is an agent skill from voidful/academic-skills.
Experiment Design fits situations like: tasks that involve Experimental design; tasks that involve Natural language processing.
Run `npx skills add voidful/academic-skills --skill experiment-design -a claude-code`. Or copy the skill folder (experiment-design in voidful/academic-skills) into .claude/skills/experiment-design in your project. Claude Code loads it when a task matches its description.
Run `npx skills add voidful/academic-skills --skill experiment-design -a codex`. Or copy the skill folder (experiment-design in voidful/academic-skills) into .agents/skills/experiment-design in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add voidful/academic-skills --skill experiment-design -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/experiment-design, .gemini/skills/experiment-design, .github/skills/experiment-design and .opencode/skills/experiment-design in your project.
SKILL.md names no scripts, command-line tools or credentials: Experiment Design is instructions for the agent only. Compatibility (from SKILL.md): Works with Claude Code, ChatGPT/Codex CLI, and Gemini CLI..
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Experiment Design is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.2k tokens (SKILL.md is roughly 4.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 8k tokens, read only when the agent opens those files.
Skills that share tags, products or a category with Experiment Design: Theory Variable Method Matrix (Drchronx/ai-agent-research-starter-kit, 134 stars), Scientific Critical Thinking (weapp-tailwindcss/weapp-tailwindcss, 1.9k stars), Claim-Driven Experiment Planner (zjYao36/Auto-Research-Refine, 128 stars) and Benchmark Paper Template (HKUSTDial/Supervisor-Skills, 8.4k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
voidful (a GitHub user) maintains it in voidful/academic-skills, which has 132 GitHub stars. The repository holds 8 skills in this directory. The repository was last updated on April 4, 2026.
Source: voidful/academic-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.