Megatron-LM on SLURM
NVIDIA/Megatron-LM
Shows how to launch distributed Megatron-LM training on a SLURM cluster: sbatch skeleton, torch.distributed.run setup, CUDA_DEVICE_MAX_CONNECTIONS rules and failure diagnosis.
Diagnose failed, hung, slow, OOM, NaN, illegal-memory-access, NCCL, compilation, rollout, or training runs in AReno.
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install inclusionAI/AReno areno-debug-runtime --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .claude/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .claude/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtimeType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install inclusionAI/AReno areno-debug-runtime --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .agents/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .agents/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install inclusionAI/AReno areno-debug-runtime --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .cursor/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .cursor/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/inclusionAI/AReno.git --path .agents/skills/areno-debug-runtime--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install inclusionAI/AReno areno-debug-runtime --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .gemini/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .gemini/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install inclusionAI/AReno areno-debug-runtimeInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .github/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .github/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add inclusionAI/AReno --skill areno-debug-runtime -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install inclusionAI/AReno areno-debug-runtime --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/inclusionAI/AReno.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/areno-debug-runtime .opencode/skills/areno-debug-runtime && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "areno-debug-runtime" agent skill from https://github.com/inclusionAI/AReno/tree/main/.agents/skills/areno-debug-runtime into .opencode/skills/areno-debug-runtime/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "areno-debug-runtime", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
areno-debug-runtimeDiagnose failed, hung, slow, OOM, NaN, illegal-memory-access, NCCL, compilation, rollout, or training runs in AReno.
Areno Debug Runtime is an agent skill from inclusionAI/AReno. Diagnose failed, hung, slow, OOM, NaN, illegal-memory-access, NCCL, compilation, rollout, or training runs in AReno. Use when runtime evidence must identify the first causal stage. Do not use for routine capacity planning without a failure.
Its SKILL.md is about 490 tokens, which your agent loads only when the skill is triggered. The skill folder holds 9 other files, including scripts and reference files (for example `agents/openai.yaml`, `references/error-taxonomy.md` and `references/nan-triage.md`).
It sits in AI & LLM Engineering, covering GPU and accelerator computing and Site reliability engineering. The repository describes itself as: An easy-to-use, fast toolkit to scale up RL post-training on a single node. The licence is Apache-2.0.
7 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit ce35e0d. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Ships 3 files in scripts/ (Python), which the agent can run.
Shell commands in SKILL.md call:
pythonFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Areno Debug Runtime loads about 486 tokens when it runs, and up to ~786 if it reads all its reference files. Until then it costs about 65 tokens; SKILL.md has 184 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
The full file from inclusionAI/AReno at commit ce35e0d, republished under its Apache-2.0 licence (© inclusionAI). 184 words, ~486 tokens.
.claude/skills/areno-debug-runtime/SKILL.md (or your agent's skills folder). This skill also uses 6 other files; get the full folder from GitHub.Do not modify parameters or code until the lifecycle stage and first causal error are identified.
When diagnosis requires a code fix, implement and commit it locally, then pull the branch on the remote reproduction host. Do not hot-patch the remote source.
python .agents/skills/areno-debug-runtime/scripts/summarize_traceback.py run.log
python .agents/skills/areno-debug-runtime/scripts/process_snapshot.py --pid <pid>
python .agents/skills/areno-debug-runtime/scripts/inspect_core.py <core-file> --executable <python>Use py-spy dump -p <pid> for a Python-side stall. Use Nsight Systems only after a bounded steady-state workload exists. Read references/error-taxonomy.md and references/nan-triage.md as applicable.
Report evidence, root cause, changed ownership boundary, and verification. A process exit without the first error is incomplete diagnosis.
© inclusionAI, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 6 other files (scripts, references) in .agents/skills/areno-debug-runtime of inclusionAI/AReno.
Open the folder on GitHubat commit ce35e0d
Areno Debug Runtime next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Areno Debug Runtime this skillinclusionAI/AReno | 323 | — | ~486 | Automated safety check: Pass | Apache-2.0 | |
| Megatron-LM on SLURMNVIDIA/Megatron-LM | 18k | — | ~1.8k | Automated safety check: Pass | Apache-2.0 | |
| Dynamo Interconnect CheckNVIDIA/skills | 3.5k | 1 repos | ~1.6k | Automated safety check: Pass | Apache-2.0 | |
| Lambda LabsLuciole-Studio/Misaka-Agent | 125 | 2 repos | ~3k | Automated safety check: Warn | MIT | |
| GPU Cluster Evaluationstas00/ml-engineering | 19k | — | ~25k | Automated safety check: Notes | CC-BY-SA-4.0 | |
| DGX Spark Memory and Thermal Opswshobson/agents | 40k | 1 repos | ~2k | Automated safety check: Pass | MIT |
NVIDIA/Megatron-LM
Shows how to launch distributed Megatron-LM training on a SLURM cluster: sbatch skeleton, torch.distributed.run setup, CUDA_DEVICE_MAX_CONNECTIONS rules and failure diagnosis.
NVIDIA/skills
Validate that a Dynamo deployment's NIXL/UCX/NCCL interconnect is ready for disaggregated serving over RDMA/NVLink.
Luciole-Studio/Misaka-Agent
On-demand GPU cloud instances for ML training. An agent skill from Luciole-Studio/Misaka-Agent.
stas00/ml-engineering
Runs an acceptance-style evaluation of an ML GPU cluster: environment dump, matmul FLOPS, all-reduce, disk benchmarks and a dated markdown report.
wshobson/agents
Plans memory headroom, works through out-of-memory failures and watches temperature and power during long ML training jobs on NVIDIA DGX Spark.
Orchestra-Research/AI-Research-SKILLs
Optimizes and serves LLMs on NVIDIA GPUs with TensorRT-LLM, covering quantization, in-flight batching, multi-GPU parallelism and the trtllm-serve command.
inclusionAI/AReno
Develop, optimize, debug, and validate an AReno CUDA, Triton, fused, attention, convolution, routing, or MoE operator.
inclusionAI/AReno
Run, configure, retry, and validate AReno SFT, DPO, GSPO, GRPO, PPO, and agentic training.
inclusionAI/AReno
Add or modify an AReno algorithm, trainer, loss, advantage calculation, role model, or algorithm-specific configuration.
inclusionAI/AReno
Measure and diagnose AReno rollout, prefill, decode, training, checkpoint, role-switch, communication, or Python scheduling performance.
inclusionAI/AReno
Compare an AReno branch, model, checkpoint, algorithm, scheduler, or kernel against a baseline.
inclusionAI/AReno
Add or debug an AReno model family, including config conversion, module construction, checkpoint load/save, text or multimodal inference, training backward, tensor parallelism, CUDA graph decode…
Categories
Diagnose failed, hung, slow, OOM, NaN, illegal-memory-access, NCCL, compilation, rollout, or training runs in AReno. Areno Debug Runtime is an agent skill from inclusionAI/AReno. Diagnose failed, hung, slow, OOM, NaN, illegal-memory-access, NCCL, compilation, rollout, or training runs in AReno.
Areno Debug Runtime fits situations like: runtime evidence must identify the first causal stage; routine capacity planning without a failure.
Run `npx skills add inclusionAI/AReno --skill areno-debug-runtime -a claude-code`. Or copy the skill folder (.agents/skills/areno-debug-runtime in inclusionAI/AReno) into .claude/skills/areno-debug-runtime in your project. Claude Code loads it when a task matches its description.
Run `npx skills add inclusionAI/AReno --skill areno-debug-runtime -a codex`. Or copy the skill folder (.agents/skills/areno-debug-runtime in inclusionAI/AReno) into .agents/skills/areno-debug-runtime in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add inclusionAI/AReno --skill areno-debug-runtime -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/areno-debug-runtime, .gemini/skills/areno-debug-runtime, .github/skills/areno-debug-runtime and .opencode/skills/areno-debug-runtime in your project.
Going by SKILL.md and its folder, Areno Debug Runtime needs Python for the scripts in its folder and the command-line tools its instructions call (python). Our summary lists: Python 3.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
Areno Debug Runtime is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 486 tokens (SKILL.md is roughly 1.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 300 tokens, read only when the agent opens those files.
Skills that share tags, products or a category with Areno Debug Runtime: Megatron-LM on SLURM (NVIDIA/Megatron-LM, 18k stars), Dynamo Interconnect Check (NVIDIA/skills, 3.5k stars), Lambda Labs (Luciole-Studio/Misaka-Agent, 125 stars) and GPU Cluster Evaluation (stas00/ml-engineering, 19k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
inclusionAI (a GitHub organization) maintains it in inclusionAI/AReno, which has 323 GitHub stars. The repository holds 10 skills in this directory. The repository was last updated on September 24, 2026.
Source: inclusionAI/AReno on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.