Agent skill

Vllm Pytorch CI Triage

by pytorch in pytorch/test-infra

Root-cause a vLLM torch-nightly CI regression report. An agent skill from pytorch/test-infra.

Custom licenceAuto-check passedAI & LLM Engineering

Install Vllm Pytorch CI Triage

skills CLI
$ npx skills add pytorch/test-infra --skill vllm-pytorch-ci-triage -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install pytorch/test-infra vllm-pytorch-ci-triage --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/pytorch/test-infra.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/vllm-pytorch-ci-triage .claude/skills/vllm-pytorch-ci-triage && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
vllm-pytorch-ci-triage
GitHub stars
113
Token cost
~2.4k tokens
SKILL.md length
1,146 words
Files
4
Skills in repo
11
Repo updated
First seen
Licence
Custom licence

At a glance

Root-cause a vLLM torch-nightly CI regression report. An agent skill from pytorch/test-infra.

  • Works in 4 steps: Read the cluster logs → NEW vs pre-existing → Group remaining failures by root cause → …
  • Tasks that involve LLM inference and serving
  • SKILL.md covers Step 1: Read the cluster logs, Step 2: NEW vs pre-existing, Step 3: Group remaining… and Step 4: Classify each group, plus 1 more section
  • Calls uv; reaches download.pytorch.org

What it does

Vllm Pytorch CI Triage is an agent skill from pytorch/test-infra. Root-cause a vLLM torch-nightly CI regression report. Reads the pre-fetched, ANSI-stripped cluster logs from the triage artifact, identifies the real exception per regressed cluster, groups clusters by shared root cause, routes each cause to pytorch/pytorch, infra, or vllm-project/vllm, and writes findings.md / findings.json. Inputs are produced upstream; it has no Buildkite/ClickHouse access, files no issues, and retries no jobs. Use in the vLLM torch-nightly triage cron's root-cause step.

Its SKILL.md is about 2.4k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files (for example `CONFIDENCE.md`, `GROUPING.md` and `ROUTING.md`).

It sits in AI & LLM Engineering, covering LLM inference and serving, Deep learning and Root cause analysis. It works with PyTorch, vLLM, ClickHouse and pytest. The repository describes itself as: This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests…

When your agent uses it

  • Tasks that involve LLM inference and serving
  • Tasks that involve Deep learning
  • Tasks that involve Root cause analysis

Example prompts

  • “/vllm-pytorch-ci-triage”

Requirements

  • Python 3

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Read the cluster logs
  2. NEW vs pre-existing
  3. Group remaining failures by root cause
  4. Classify each group

What it can do on your machine

Read from SKILL.md and the folder at commit 244725d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • uv

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • download.pytorch.org

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Vllm Pytorch CI Triage loads about 2.4k tokens when it runs. Until then it costs about 130 tokens; SKILL.md has 1,146 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~130
When it runs · the whole SKILL.md, loaded when a task matches
~2.4k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,146 words (~2,352 tokens).

“Read-only root-cause analysis for the vLLM torch-nightly triage cron. The upstream triage job runs the A/B (torch nightly vs same-commit baseline), parses the logs, and hands off artifacts; this skill reads that artifact, root-causes each regressed cluster, groups by shared…”

— opening of SKILL.md by pytorch, Custom licence
name
vllm-pytorch-ci-triage

Read the full SKILL.md on GitHub

Files

SKILL.md and 3 other files in .claude/skills/vllm-pytorch-ci-triage of pytorch/test-infra.

  • SKILL.md
  • CONFIDENCE.md
  • GROUPING.md
  • ROUTING.md

Open the folder on GitHubat commit 244725d

Compare with similar skills

Vllm Pytorch CI Triage next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Vllm Pytorch CI Triage compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Vllm Pytorch CI Triage this skillpytorch/test-infra113—~2.4kAutomated safety check: PassCustom licence
Graphsignalgraphsignal/graphsignal257—~6.3kAutomated safety check: PassApache-2.0
Magpie Kernel Evaluatoramd/skills408—~2.3kAutomated safety check: PassMIT
Spark Environment Setupwshobson/agents40k—~2kAutomated safety check: PassMIT
Quark Torch Quant Perfamd/Quark182—~3kAutomated safety check: PassMIT
ExecuTorch Cortex-M Backendpytorch/executorch5.1k—~872Automated safety check: PassCustom licence

Similar skills

  • Graphsignal

    graphsignal/graphsignal

    Profile AI inference workloads (vLLM, SGLang, TensorRT-LLM, PyTorch, any GPU application) with the Graphsignal profiler and read the results from its local /signals JSON endpoint.

    257 GitHub stars~6.3k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Benchmarks LLM inference and drives GPU kernel optimization with Magpie.

    408 GitHub stars~2.3k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Set up a working ML training/inference environment on NVIDIA DGX Spark (GB10, aarch64, CUDA 13).

    40k GitHub stars~2k tokensUpdated 6 days ago
    AI & LLM EngineeringAuto-check passed
  • Run, resume, monitor, diagnose, and report Quark Quant-Perf workflows for PyTorch and HuggingFace transformers models.

    182 GitHub stars~3k tokensUpdated 13 days ago
    AI & LLM EngineeringAuto-check passed
  • ExecuTorch Cortex-M Backend

    pytorch/executorch

    Developer guide for the Cortex-M (CMSIS-NN) backend in ExecuTorch: quantization pipeline, pass manager, tests and adding new ops.

    5.1k GitHub stars~872 tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Model Builder

    qualcomm/qai-appbuilder

    QAI ModelBuilder. An agent skill from qualcomm/qai-appbuilder.

    247 GitHub stars~4.1k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed

More from pytorch/test-infra

All 11 skills in this repo
  • Step-by-step playbook for migrating a pytorch/pytorch .github/workflows/.yml from EC2 to OSDC (ARC) runners — covers both dial-up and 100% opt-in patterns, with the inputs that must be plumbed…

    113 GitHub stars~2k tokensUpdated today
    Auto-check passed
  • Pytorch Clickhouse

    pytorch/test-infra

    Load this FIRST whenever working with PyTorch CI data (any pytorch/ org repo), the torchci/HUD codebase, or the PyTorch HUD ClickHouse database.

    113 GitHub stars~2.8k tokensUpdated today
    Auto-check passed
  • R2 Outage Toggle

    pytorch/test-infra

    Disable or re-enable Cloudflare R2 (download-r2.pytorch.org) usage in managev2.py during R2 outages.

    113 GitHub stars~1.5k tokensUpdated today
    Auto-check passed
  • Find reverts that landed on pytorch/pytorch main but are missing from a release branch (release/X.Y) because the reverted commit was already shipped in a release candidate, and open one cherry-pick…

    113 GitHub stars~2.6k tokensUpdated today
    Auto-check passed
  • Generate (and optionally open) a PyTorch release tracker / cherry-pick tracking issue from a release announcement, like https://github.com/pytorch/pytorch/issues/180506.

    113 GitHub stars~2.7k tokensUpdated today
    Auto-check passed
  • Generate a PyTorch release validation checklist issue by pulling open/closed issues from a GitHub milestone and cherry-picks from a release tracker issue.

    113 GitHub stars~2.2k tokensUpdated today
    Auto-check passed

Questions about Vllm Pytorch CI Triage

What does Vllm Pytorch CI Triage do?

Root-cause a vLLM torch-nightly CI regression report. An agent skill from pytorch/test-infra. Vllm Pytorch CI Triage is an agent skill from pytorch/test-infra. Root-cause a vLLM torch-nightly CI regression report.

When should I use Vllm Pytorch CI Triage?

Vllm Pytorch CI Triage fits situations like: tasks that involve LLM inference and serving; tasks that involve Deep learning; tasks that involve Root cause analysis.

How do I install Vllm Pytorch CI Triage in Claude Code?

Run `npx skills add pytorch/test-infra --skill vllm-pytorch-ci-triage -a claude-code`. Or copy the skill folder (.claude/skills/vllm-pytorch-ci-triage in pytorch/test-infra) into .claude/skills/vllm-pytorch-ci-triage in your project. Claude Code loads it when a task matches its description.

How do I install Vllm Pytorch CI Triage in Codex?

Run `npx skills add pytorch/test-infra --skill vllm-pytorch-ci-triage -a codex`. Or copy the skill folder (.claude/skills/vllm-pytorch-ci-triage in pytorch/test-infra) into .agents/skills/vllm-pytorch-ci-triage in your project. Codex loads it when a task matches its description.

Can I use Vllm Pytorch CI Triage in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add pytorch/test-infra --skill vllm-pytorch-ci-triage -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/vllm-pytorch-ci-triage, .gemini/skills/vllm-pytorch-ci-triage, .github/skills/vllm-pytorch-ci-triage and .opencode/skills/vllm-pytorch-ci-triage in your project.

What does Vllm Pytorch CI Triage need to run?

Going by SKILL.md and its folder, Vllm Pytorch CI Triage needs the command-line tools its instructions call (uv). Our summary lists: Python 3.

Does Vllm Pytorch CI Triage access the network?

SKILL.md names 1 domain. In commands or code: download.pytorch.org; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.

Is Vllm Pytorch CI Triage safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Vllm Pytorch CI Triage use?

Vllm Pytorch CI Triage has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Vllm Pytorch CI Triage use?

About 2.4k tokens (SKILL.md is roughly 9.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Vllm Pytorch CI Triage?

Skills that share tags, products or a category with Vllm Pytorch CI Triage: Graphsignal (graphsignal/graphsignal, 257 stars), Magpie Kernel Evaluator (amd/skills, 408 stars), Spark Environment Setup (wshobson/agents, 40k stars) and Quark Torch Quant Perf (amd/Quark, 182 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Vllm Pytorch CI Triage?

pytorch (a GitHub organization) maintains it in pytorch/test-infra, which has 113 GitHub stars. The repository holds 11 skills in this directory. The repository was last updated on October 9, 2026.

Source: pytorch/test-infra on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.