Agent skill

Training Check

by AI4Scientist in AI4Scientist/nano-scientist

Periodically check WandB metrics during training to catch problems early (NaN, loss divergence, idle GPUs).

No licenceAuto-check: notes

Install Training Check

skills CLI
$ npx skills add AI4Scientist/nano-scientist --skill training-check -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install AI4Scientist/nano-scientist training-check --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/AI4Scientist/nano-scientist.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/training-check .claude/skills/training-check && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
training-check
GitHub stars
128
Used in
3 other repos
Token cost
~1.3k tokens
SKILL.md length
528 words
Files
1
Skills in repo
74
Repo updated
First seen
Licence
None found

At a glance

Periodically check WandB metrics during training to catch problems early (NaN, loss divergence, idle GPUs).

  • Works in 4 steps: Read WandB Metrics → Judgment → Codex Judgment (only when unsure) → …
  • Training is running and you want automated health checks
  • SKILL.md covers Context: $ARGUMENTS, Constants, When to Use and Workflow, plus 3 more sections
  • Calls ssh

What it does

Training Check is an agent skill from AI4Scientist/nano-scientist. Periodically check WandB metrics during training to catch problems early (NaN, loss divergence, idle GPUs). Avoids wasting GPU hours on broken runs. Use when training is running and you want automated health checks.

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It works with Weights & Biases. The repository describes itself as: An autonomous research agent that turns a topic into a peer-reviewed technical report.

When your agent uses it

  • Training is running and you want automated health checks

Example prompts

  • “/training-check”

Requirements

  • Python 3
  • Pre-approved tools (allowed-tools): Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-reply

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Read WandB Metrics
  2. Judgment
  3. Codex Judgment (only when unsure)
  4. Act

What it can do on your machine

Read from SKILL.md and the folder at commit 7132192. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Bash(*)
    • Read
    • Grep
    • Glob
    • Write
    • Edit
    • mcp__codex__codex
    • mcp__codex__codex-reply

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • ssh

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use ssh, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Training Check loads about 1.3k tokens when it runs. Until then it costs about 58 tokens; SKILL.md has 528 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~58
When it runs · the whole SKILL.md, loaded when a task matches
~1.3k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NotePre-approves every shell command (allowed-tools: Bash)SKILL.md
    allowed-tools: Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-reply

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 528 words (~1,316 tokens).

“Periodically read WandB metrics during training to catch problems early. Do not wait until training finishes to discover it was a waste of GPU time.”

— opening of SKILL.md by AI4Scientist
name
training-check
allowed-tools
Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-reply
argument-hint
wandb-run-path

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/training-check of AI4Scientist/nano-scientist.

Open the folder on GitHubat commit 7132192

Used in 3 other repositories

We found 4 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 3 other GitHub owners. This page covers the copy in AI4Scientist/nano-scientist, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Training Check next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Training Check compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Training Check this skillAI4Scientist/nano-scientist1283 repos~1.3kAutomated safety check: NotesNone
Marimo Batchkoaning/gitcharts1451 repos~819Automated safety check: NotesNone
Weights & Biases Experiment TrackingOrchestra-Research/AI-Research-SKILLs13k9 repos~3.1kAutomated safety check: PassMIT
Comparefcakyon/phd-skills415—~1.2kAutomated safety check: PassMIT
ML Experiment IterationLeeroo-AI/superml195—~4.8kAutomated safety check: PassApache-2.0
LaminDB Biological Data Managementdavila7/claude-code-templates33k12 repos~3.6kAutomated safety check: PassMIT

Similar skills

  • Marimo Batch

    koaning/gitcharts

    An opintionated skill to prepare a marimo notebook to make it ready for a scheduled run.

    145 GitHub starsUsed in 1 repo~819 tokens
    Data & AnalyticsAuto-check: notes
  • Weights & Biases Experiment Tracking

    Orchestra-Research/AI-Research-SKILLs

    Guides an agent through tracking ML experiments with W&B: run logging, config capture, hyperparameter sweeps, artifacts and a model registry.

    13k GitHub starsUsed in 9 repos~3.1k tokens
    DevOps & CloudAuto-check passed
  • Compare

    fcakyon/phd-skills

    Same-epoch comparison of training runs across wandb, neptune, tensorboard, or mlflow.

    415 GitHub stars~1.2k tokensUpdated 24 days ago
    Research & ScienceAuto-check passed
  • ML Experiment Iteration

    Leeroo-AI/superml

    Produces ranked, evidence-grounded next steps when an ML experiment has stalled, drawing on a Leeroopedia knowledge base or on fetched docs and issues.

    195 GitHub stars~4.8k tokensUpdated 6 mo ago
    AI & LLM EngineeringAuto-check passed
  • LaminDB Biological Data Management

    davila7/claude-code-templates

    Manages biological datasets with LaminDB: versioned artifacts, run lineage, ontology-based annotation, schema validation and links to workflow managers and ML tools.

    33k GitHub starsUsed in 12 repos~3.6k tokens
    Research & ScienceAuto-check passed
  • Dashboard

    LegoX/Lego-RL

    Bring up the Lego-RL training dashboard (webui/) on whatever machine you are on, adapting to that box's layout instead of assuming this repo's paths.

    113 GitHub stars~4.2k tokensUpdated 2 days ago
    AI & LLM EngineeringAuto-check passed

More from AI4Scientist/nano-scientist

All 74 skills in this repo
  • Formula Derivation

    AI4Scientist/nano-scientist

    Structures and derives research formulas when the user wants to 推导公式, build a theory line, organize assumptions, turn scattered equations into a coherent derivation, or rewrite theory notes into a…

    128 GitHub starsUsed in 5 repos~2.3k tokens
    Auto-check passed
  • Paper Compile

    AI4Scientist/nano-scientist

    Compile LaTeX paper to PDF, fix errors, and verify output. An agent skill from AI4Scientist/nano-scientist.

    128 GitHub starsUsed in 5 repos~2.5k tokens
    Auto-check: notes
  • Paper Figure

    AI4Scientist/nano-scientist

    Generate publication-quality figures and tables from experiment results.

    128 GitHub starsUsed in 5 repos~2.9k tokens
    Auto-check: notes
  • Paper Navigator

    AI4Scientist/nano-scientist

    Find and read academic papers: disambiguate queries, discover papers (search, citation traversal, recommendations, arXiv monitoring, trending, GitHub search), evaluate (TLDR, citations, code, SOTA)…

    128 GitHub stars~7.7k tokensUpdated 4 mo ago
    Auto-check: notes
  • Proof Writer

    AI4Scientist/nano-scientist

    Writes rigorous mathematical proofs for ML/AI theory. An agent skill from AI4Scientist/nano-scientist.

    128 GitHub starsUsed in 5 repos~1.9k tokens
    Auto-check passed
  • Ablation Planner

    AI4Scientist/nano-scientist

    A skill your agent uses when main results pass result-to-claim (claimsupported=yes or partial) and ablation studies are needed for paper submission.

    128 GitHub starsUsed in 4 repos~1.3k tokens
    Auto-check: notes

Questions about Training Check

What does Training Check do?

Periodically check WandB metrics during training to catch problems early (NaN, loss divergence, idle GPUs). Training Check is an agent skill from AI4Scientist/nano-scientist. Periodically check WandB metrics during training to catch problems early (NaN, loss divergence, idle GPUs).

When should I use Training Check?

Training Check fits situations like: training is running and you want automated health checks.

How do I install Training Check in Claude Code?

Run `npx skills add AI4Scientist/nano-scientist --skill training-check -a claude-code`. Or copy the skill folder (skills/training-check in AI4Scientist/nano-scientist) into .claude/skills/training-check in your project. Claude Code loads it when a task matches its description.

How do I install Training Check in Codex?

Run `npx skills add AI4Scientist/nano-scientist --skill training-check -a codex`. Or copy the skill folder (skills/training-check in AI4Scientist/nano-scientist) into .agents/skills/training-check in your project. Codex loads it when a task matches its description.

Can I use Training Check in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add AI4Scientist/nano-scientist --skill training-check -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/training-check, .gemini/skills/training-check, .github/skills/training-check and .opencode/skills/training-check in your project.

What does Training Check need to run?

Going by SKILL.md and its folder, Training Check needs the command-line tools its instructions call (ssh). Our summary lists: Python 3. Its frontmatter pre-approves these tools: Bash(*), Read, Grep, Glob, Write, Edit, mcp__codex__codex, mcp__codex__codex-reply.

Does Training Check access the network?

SKILL.md contains no URLs. Its commands use ssh, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Training Check safe to install?

Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Training Check use?

No licence was found for Training Check or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Training Check use?

About 1.3k tokens (SKILL.md is roughly 5.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Training Check?

Skills that share tags, products or a category with Training Check: Marimo Batch (koaning/gitcharts, 145 stars), Weights & Biases Experiment Tracking (Orchestra-Research/AI-Research-SKILLs, 13k stars), Compare (fcakyon/phd-skills, 415 stars) and ML Experiment Iteration (Leeroo-AI/superml, 195 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Training Check?

AI4Scientist (a GitHub organization) maintains it in AI4Scientist/nano-scientist, which has 128 GitHub stars. The repository holds 74 skills in this directory. The repository was last updated on June 3, 2026.

Source: AI4Scientist/nano-scientist on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.