Agent skill

CI Metrics

by pytorch in pytorch/test-infra

Fallback loader for the canonical PyTorch ci-metrics skill. An agent skill from pytorch/test-infra.

Custom licenceAuto-check passedAI & LLM Engineering

Install CI Metrics

skills CLI
$ npx skills add pytorch/test-infra --skill ci-metrics -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install pytorch/test-infra ci-metrics --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/pytorch/test-infra.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/ci-metrics .claude/skills/ci-metrics && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
ci-metrics
GitHub stars
113
Token cost
~452 tokens
SKILL.md length
177 words
Files
1
Skills in repo
11
Repo updated
First seen
Licence
Custom licence

At a glance

Fallback loader for the canonical PyTorch ci-metrics skill. An agent skill from pytorch/test-infra.

  • Works in 3 steps: If the canonical instructions are… → If an accessible pytorch/pytorch… → Otherwise, fetch a fresh temporary copy…
  • Workflow trends
  • Calls curl; reaches raw.githubusercontent.com
  • Dashboard data only when the canonical instructions are not already loaded and no accessible pytorch/pytorch checkout contains them

What it does

CI Metrics is an agent skill from pytorch/test-infra. Fallback loader for the canonical PyTorch ci-metrics skill. Use for CI duration, failures, queue times, workflow trends, runner health, or dashboard data only when the canonical instructions are not already loaded and no accessible pytorch/pytorch checkout contains them.

Its SKILL.md is about 450 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in AI & LLM Engineering, covering Deep learning. It works with PyTorch. The repository describes itself as: This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests…

When your agent uses it

  • Workflow trends
  • Dashboard data only when the canonical instructions are not already loaded and no accessible pytorch/pytorch checkout contains them

Example prompts

  • “/ci-metrics”

Workflow steps

3 steps, taken from the first numbered list in SKILL.md.

  1. If the canonical instructions are already loaded in the current agent context, follow them directly. A skill catalog entry alone does not…
  2. If an accessible pytorch/pytorch checkout contains .claude/skills/ci-metrics/SKILL.md, read and follow that file, resolving relative paths…
  3. Otherwise, fetch a fresh temporary copy from pytorch/pytorch as shown below. Never reuse a previous download or another vendored copy.

What it can do on your machine

Read from SKILL.md and the folder at commit 5873748. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • curl

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • raw.githubusercontent.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

CI Metrics loads about 452 tokens when it runs. Until then it costs about 71 tokens; SKILL.md has 177 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~71
When it runs · the whole SKILL.md, loaded when a task matches
~452

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 177 words (~452 tokens).

“The canonical skill is pytorch/pytorch/.claude/skills/ci-metrics/SKILL.md; this loader does not count. Choose one instruction source in this order:”

— opening of SKILL.md by pytorch, Custom licence
name
ci-metrics

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .claude/skills/ci-metrics of pytorch/test-infra.

Open the folder on GitHubat commit 5873748

Compare with similar skills

CI Metrics next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

CI Metrics compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
CI Metrics this skillpytorch/test-infra113—~452Automated safety check: PassCustom licence
Add Uint Supportpytorch/pytorch104k2 repos~2.3kAutomated safety check: PassCustom licence
CLIP Image-Text MatchingOrchestra-Research/AI-Research-SKILLs13k7 repos~1.7kAutomated safety check: PassMIT
Add Torch Shapes Examplefacebook/pyrefly7.1k—~1.3kAutomated safety check: PassMIT
MUSA GPU Training Optimizeropen-infra-skills/infra-skills141—~1.7kAutomated safety check: PassApache-2.0
Ghstack CIpytorch/pytorch104k—~1.4kAutomated safety check: PassCustom licence

Similar skills

  • Add Uint Support

    pytorch/pytorch

    Add unsigned integer (uint) type support to PyTorch operators by updating ATDISPATCH macros.

    104k GitHub starsUsed in 2 repos~2.3k tokens
    AI & LLM EngineeringAuto-check passed
  • CLIP Image-Text Matching

    Orchestra-Research/AI-Research-SKILLs

    Explains OpenAI's CLIP model for zero-shot image classification, image-text similarity, semantic image search and content moderation, with install steps and code patterns.

    13k GitHub starsUsed in 7 repos~1.7k tokens
    AI & LLM EngineeringAuto-check passed
  • Add Torch Shapes Example

    facebook/pyrefly

    Official

    A skill your agent uses when adding a new PyTorch model to Pyrefly's shape-tracking example corpus under tensor-shapes/pyrefly-torch-stubs/examples — i.e.

    7.1k GitHub stars~1.3k tokensUpdated today
    AI & LLM EngineeringAuto-check passed
  • MUSA GPU Training Optimizer

    open-infra-skills/infra-skills

    Profiles, benchmarks and tunes AI training workloads on Moore Threads MUSA GPUs with a measurement-first process that keeps model behavior unchanged.

    141 GitHub stars~1.7k tokensUpdated 3 mo ago
    AI & LLM EngineeringAuto-check passed
  • Ghstack CI

    pytorch/pytorch

    Manage CI for PyTorch ghstack stacks by running CI where its results are useful now and deferring other PRs with [no-ci].

    104k GitHub stars~1.4k tokensUpdated today
    AI & LLM EngineeringAuto-check passed
  • Depth Estimation

    SharpAI/DeepCamera

    Real-time depth map privacy transforms using Depth Anything v2 (CoreML + PyTorch)

    3.1k GitHub stars~945 tokensUpdated 22 days ago
    AI & LLM EngineeringAuto-check passed

More from pytorch/test-infra

All 11 skills in this repo
  • Step-by-step playbook for migrating a pytorch/pytorch .github/workflows/.yml from EC2 to OSDC (ARC) runners — covers both dial-up and 100% opt-in patterns, with the inputs that must be plumbed…

    113 GitHub stars~2k tokensUpdated today
    Auto-check passed
  • Pytorch Clickhouse

    pytorch/test-infra

    Load this FIRST whenever working with PyTorch CI data (any pytorch/ org repo), the torchci/HUD codebase, or the PyTorch HUD ClickHouse database.

    113 GitHub stars~2.8k tokensUpdated today
    Auto-check passed
  • R2 Outage Toggle

    pytorch/test-infra

    Disable or re-enable Cloudflare R2 (download-r2.pytorch.org) usage in managev2.py during R2 outages.

    113 GitHub stars~1.5k tokensUpdated today
    Auto-check passed
  • Find reverts that landed on pytorch/pytorch main but are missing from a release branch (release/X.Y) because the reverted commit was already shipped in a release candidate, and open one cherry-pick…

    113 GitHub stars~2.6k tokensUpdated today
    Auto-check passed
  • Generate (and optionally open) a PyTorch release tracker / cherry-pick tracking issue from a release announcement, like https://github.com/pytorch/pytorch/issues/180506.

    113 GitHub stars~2.7k tokensUpdated today
    Auto-check passed
  • Generate a PyTorch release validation checklist issue by pulling open/closed issues from a GitHub milestone and cherry-picks from a release tracker issue.

    113 GitHub stars~2.2k tokensUpdated today
    Auto-check passed

Works with

Questions about CI Metrics

What does CI Metrics do?

Fallback loader for the canonical PyTorch ci-metrics skill. An agent skill from pytorch/test-infra. CI Metrics is an agent skill from pytorch/test-infra. Fallback loader for the canonical PyTorch ci-metrics skill.

When should I use CI Metrics?

CI Metrics fits situations like: workflow trends; dashboard data only when the canonical instructions are not already loaded and no accessible pytorch/pytorch checkout contains them.

How do I install CI Metrics in Claude Code?

Run `npx skills add pytorch/test-infra --skill ci-metrics -a claude-code`. Or copy the skill folder (.claude/skills/ci-metrics in pytorch/test-infra) into .claude/skills/ci-metrics in your project. Claude Code loads it when a task matches its description.

How do I install CI Metrics in Codex?

Run `npx skills add pytorch/test-infra --skill ci-metrics -a codex`. Or copy the skill folder (.claude/skills/ci-metrics in pytorch/test-infra) into .agents/skills/ci-metrics in your project. Codex loads it when a task matches its description.

Can I use CI Metrics in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add pytorch/test-infra --skill ci-metrics -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ci-metrics, .gemini/skills/ci-metrics, .github/skills/ci-metrics and .opencode/skills/ci-metrics in your project.

What does CI Metrics need to run?

Going by SKILL.md and its folder, CI Metrics needs the command-line tools its instructions call (curl).

Does CI Metrics access the network?

SKILL.md names 1 domain. In commands or code: raw.githubusercontent.com; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.

Is CI Metrics safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does CI Metrics use?

CI Metrics has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does CI Metrics use?

About 452 tokens (SKILL.md is roughly 1.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to CI Metrics?

Skills that share tags, products or a category with CI Metrics: Add Uint Support (pytorch/pytorch, 104k stars), CLIP Image-Text Matching (Orchestra-Research/AI-Research-SKILLs, 13k stars), Add Torch Shapes Example (facebook/pyrefly, 7.1k stars) and MUSA GPU Training Optimizer (open-infra-skills/infra-skills, 141 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains CI Metrics?

pytorch (a GitHub organization) maintains it in pytorch/test-infra, which has 113 GitHub stars. The repository holds 11 skills in this directory. The repository was last updated on October 9, 2026.

Source: pytorch/test-infra on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.