Agent skill

Vellum Test Selection

by vellum-ai in vellum-ai/vellum-assistant

Select focused verification commands for Vellum Assistant changes.

MITAuto-check passedDevelopment

Install Vellum Test Selection

skills CLI
$ npx skills add vellum-ai/vellum-assistant --skill vellum-test-selection -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install vellum-ai/vellum-assistant vellum-test-selection --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.cursor/skills/vellum-test-selection .claude/skills/vellum-test-selection && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
vellum-test-selection
GitHub stars
1.4k
Token cost
~575 tokens
SKILL.md length
233 words
Files
1
Skills in repo
108
Repo updated
First seen
Licence
MIT

At a glance

Select focused verification commands for Vellum Assistant changes.

  • Works in 6 steps: List changed files and group them by… → For direct implementation/test pairs,… → For route, protocol, migration, IPC,… → …
  • Deciding what tests
  • SKILL.md covers Core Rule, Setup, Selection Workflow and Common Commands, plus 2 more sections
  • Calls bun and bunx

What it does

Vellum Test Selection is an agent skill from vellum-ai/vellum-assistant. Select focused verification commands for Vellum Assistant changes. Use when deciding what tests, typechecks, lints, or smoke checks to run after editing this repository, especially before commits and pull requests.

Its SKILL.md is about 580 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Development, covering Linting and formatting and Pull requests. The repository describes itself as: An AI Assistant that’s easy to setup, does your work 24/7, knows your preferences and gets better over time. The licence is MIT.

When your agent uses it

  • Deciding what tests
  • Smoke checks to run after editing this repository
  • Especially before commits and pull requests

Example prompts

  • “/vellum-test-selection”

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. List changed files and group them by package.
  2. For direct implementation/test pairs, run the matching test file.
  3. For route, protocol, migration, IPC, provider, or schema changes, run nearby tests plus a package typecheck.
  4. For shared TypeScript contracts, run tests for each consumer package that imports the contract.
  5. For Swift or macOS client changes, prefer the existing platform-specific test command if one is already used in nearby docs or terminal…
  6. If a command is expected to be long-running, state that before running it.

What it can do on your machine

Read from SKILL.md and the folder at commit 33cc983. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • bun
    • bunx

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use bunx, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Vellum Test Selection loads about 575 tokens when it runs. Until then it costs about 59 tokens; SKILL.md has 233 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~59
When it runs · the whole SKILL.md, loaded when a task matches
~575

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from vellum-ai/vellum-assistant at commit 33cc983, republished under its MIT licence (© vellum-ai). 233 words, ~575 tokens.

Download SKILL.mdSave it as .claude/skills/vellum-test-selection/SKILL.md (or your agent's skills folder).
name
vellum-test-selection
description
Select focused verification commands for Vellum Assistant changes. Use when deciding what tests, typechecks, lints, or smoke checks to run after editing this repository, especially before commits and pull requests.

Vellum Test Selection

Core Rule

Never run unscoped bun test in this repository. The full suite is large and can hang or time out. Choose focused tests based on changed files, then add typechecking when the change affects shared contracts or cross-package behavior.

Setup

Before any Bun command:

bash
export PATH="$HOME/.bun/bin:$PATH"

Run commands from the package directory that owns the changed files, usually assistant, gateway, cli, clients/web, or clients/macos.

Selection Workflow

  1. List changed files and group them by package.
  2. For direct implementation/test pairs, run the matching test file.
  3. For route, protocol, migration, IPC, provider, or schema changes, run nearby tests plus a package typecheck.
  4. For shared TypeScript contracts, run tests for each consumer package that imports the contract.
  5. For Swift or macOS client changes, prefer the existing platform-specific test command if one is already used in nearby docs or terminal history.
  6. If a command is expected to be long-running, state that before running it.

Common Commands

Assistant focused test:

bash
cd assistant && bun test src/path/to/file.test.ts

Assistant test grep:

bash
cd assistant && bun test src/path/to/file.test.ts --grep "case name"

Assistant typecheck:

bash
cd assistant && bunx tsc --noEmit

Gateway focused test:

bash
cd gateway && bun test src/path/to/file.test.ts

Risk-Based Additions

Add typecheck when edits touch:

  • exported TypeScript types or schemas
  • route request/response shapes
  • daemon/client protocols
  • migrations and registry wiring
  • package boundary imports
  • provider abstractions
  • feature flag registry or resolver code

Add migration tests when edits touch:

  • assistant/src/persistence/migrations/
  • assistant/src/workspace/migrations/
  • persisted workspace files
  • database schema modules

Reporting

When proposing or running verification, explain why each command is selected and note anything intentionally skipped.

© vellum-ai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .cursor/skills/vellum-test-selection of vellum-ai/vellum-assistant.

Open the folder on GitHubat commit 33cc983

Compare with similar skills

Vellum Test Selection next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Vellum Test Selection compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Vellum Test Selection this skillvellum-ai/vellum-assistant1.4k—~575Automated safety check: PassMIT
Babysit PR To Pass CIsgl-project/sglang37k2 repos~3kAutomated safety check: PassApache-2.0
Changesetbiomejs/biome26k—~839Automated safety check: PassApache-2.0
Pre Pipeline Reviewsuperplanehq/superplane7.7k—~1.2kAutomated safety check: PassCustom licence
Lint Commit PRTresjs/tres3.8k—~1.1kAutomated safety check: PassMIT
PR Pushicebear0828/codex-proxy1.8k—~2.2kAutomated safety check: NotesCustom licence

Similar skills

  • Babysit PR To Pass CI

    sgl-project/sglang

    Start and persistently pursue a goal to babysit an SGLang pull request until selected GitHub Actions workflows pass on the latest PR head.

    37k GitHub starsUsed in 2 repos~3k tokens
    DevelopmentAuto-check passed
  • Changeset

    biomejs/biome

    Official

    A skill your agent uses when a Biome change may affect users and you must decide whether it needs a changeset, choose the release level, or create and edit .changeset/.md release-note text.

    26k GitHub stars~839 tokensUpdated today
    DevelopmentAuto-check passed
  • Pre Pipeline Review

    superplanehq/superplane

    Reviews SuperPlane code changes for correctness and reuse, then runs fast Make targets (lint, format, build) that Semaphore CI runs so easy checks do not fail in the pipeline.

    7.7k GitHub stars~1.2k tokensUpdated today
    DevelopmentAuto-check passed
  • Lint Commit PR

    Tresjs/tres

    Lint local changes, auto-fix, conventional commit, and optionally create PR

    3.8k GitHub stars~1.1k tokensUpdated yesterday
    DevelopmentAuto-check passed
  • PR Push

    icebear0828/codex-proxy

    Package the current working changes into a standards-compliant codex-proxy pull request: branch hygiene, commit message linting, CHANGELOG prompt, conventional commit, push, and gh pr create against…

    1.8k GitHub stars~2.2k tokensUpdated yesterday
    DevelopmentAuto-check: notes
  • PR Push

    icebear0828/codex-proxy

    Package the current working changes into a standards-compliant codex-proxy pull request: branch hygiene, commit message linting, CHANGELOG prompt, conventional commit, push, and gh pr create against…

    1.8k GitHub stars~2.3k tokensUpdated yesterday
    DevelopmentAuto-check: notes

More from vellum-ai/vellum-assistant

All 108 skills in this repo
  • Vellum GitHub App Setup

    vellum-ai/vellum-assistant

    Create and configure a GitHub App so the assistant can push commits, open PRs, and comment under its own bot identity.

    1.4k GitHub stars~3.1k tokensUpdated yesterday
    Auto-check passed
  • Discord App Setup

    vellum-ai/vellum-assistant

    Connect a Discord bot to the assistant via the Discord Gateway with guided application creation and intent configuration

    1.4k GitHub stars~4.2k tokensUpdated yesterday
    Auto-check passed
  • Sentry App Setup

    vellum-ai/vellum-assistant

    Create and configure a Sentry internal integration so the assistant can manage issues, alerts, and releases under its own identity

    1.4k GitHub stars~1.3k tokensUpdated yesterday
    Auto-check passed
  • Memory Corpus Ingest

    vellum-ai/vellum-assistant

    Ingest a large dataset into memory as a skimmed map. An agent skill from vellum-ai/vellum-assistant.

    1.4k GitHub stars~3k tokensUpdated yesterday
    Auto-check: notes
  • Plugin Builder

    vellum-ai/vellum-assistant

    A skill your agent uses when the user wants to build, scaffold, ship, or edit a Vellum plugin that bundles multiple surfaces (hooks, tools, skills, and more) into one installable package.

    1.4k GitHub stars~3.1k tokensUpdated yesterday
    Auto-check passed
  • Slack App Setup

    vellum-ai/vellum-assistant

    Connect a Slack app to the Vellum Assistant via Socket Mode.

    1.4k GitHub stars~2.5k tokensUpdated yesterday
    Auto-check: warnings

Categories

Questions about Vellum Test Selection

What does Vellum Test Selection do?

Select focused verification commands for Vellum Assistant changes. Vellum Test Selection is an agent skill from vellum-ai/vellum-assistant. Select focused verification commands for Vellum Assistant changes.

When should I use Vellum Test Selection?

Vellum Test Selection fits situations like: deciding what tests; smoke checks to run after editing this repository; especially before commits and pull requests.

How do I install Vellum Test Selection in Claude Code?

Run `npx skills add vellum-ai/vellum-assistant --skill vellum-test-selection -a claude-code`. Or copy the skill folder (.cursor/skills/vellum-test-selection in vellum-ai/vellum-assistant) into .claude/skills/vellum-test-selection in your project. Claude Code loads it when a task matches its description.

How do I install Vellum Test Selection in Codex?

Run `npx skills add vellum-ai/vellum-assistant --skill vellum-test-selection -a codex`. Or copy the skill folder (.cursor/skills/vellum-test-selection in vellum-ai/vellum-assistant) into .agents/skills/vellum-test-selection in your project. Codex loads it when a task matches its description.

Can I use Vellum Test Selection in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add vellum-ai/vellum-assistant --skill vellum-test-selection -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/vellum-test-selection, .gemini/skills/vellum-test-selection, .github/skills/vellum-test-selection and .opencode/skills/vellum-test-selection in your project.

What does Vellum Test Selection need to run?

Going by SKILL.md and its folder, Vellum Test Selection needs the command-line tools its instructions call (bun and bunx).

Does Vellum Test Selection access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Vellum Test Selection safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Vellum Test Selection use?

Vellum Test Selection is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Vellum Test Selection use?

About 575 tokens (SKILL.md is roughly 2.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Vellum Test Selection?

Skills that share tags, products or a category with Vellum Test Selection: Babysit PR To Pass CI (sgl-project/sglang, 37k stars), Changeset (biomejs/biome, 26k stars), Pre Pipeline Review (superplanehq/superplane, 7.7k stars) and Lint Commit PR (Tresjs/tres, 3.8k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Vellum Test Selection?

vellum-ai (a GitHub organization) maintains it in vellum-ai/vellum-assistant, which has 1,408 GitHub stars. The repository holds 108 skills in this directory. The repository was last updated on October 9, 2026.

Source: vellum-ai/vellum-assistant on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.