Official agent skill

Changeset Validation

by openai in openai/openai-agents-js

Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes).

OfficialMITAuto-check passedDevelopment

Install Changeset Validation

skills CLI
$ npx skills add openai/openai-agents-js --skill changeset-validation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install openai/openai-agents-js changeset-validation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/openai/openai-agents-js.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/changeset-validation .claude/skills/changeset-validation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
changeset-validation
GitHub stars
3.9k
Token cost
~607 tokens
SKILL.md length
280 words
Files
8 (incl. scripts, references)
Skills in repo
10
Repo updated
First seen
Licence
MIT

At a glance

Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes).

  • Works in 3 steps: Run → Apply the rules from… → Respond with a JSON verdict containing…
  • .changeset/ are modified
  • SKILL.md covers Overview, Quick start, Workflow and Branch-level changeset rule…, plus 2 more sections
  • Runs JavaScript and Shell scripts from its folder; calls pnpm

What it does

Changeset Validation is an agent skill from openai/openai-agents-js, published by the product's own GitHub organization. Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes). Use when packages/ or .changeset/ are modified, or when verifying PR changeset compliance and bump level.

Its SKILL.md is about 610 tokens, which your agent loads only when the skill is triggered. The skill folder holds 10 other files, including scripts and reference files (for example `agents/openai.yaml`, `references/validation-prompt.md` and `scripts/run-fixtures.sh`).

It sits in Development. It works with OpenAI and Git. The repository describes itself as: A lightweight, powerful framework for multi-agent workflows and voice agents. The licence is MIT.

When your agent uses it

  • .changeset/ are modified
  • Verifying PR changeset compliance and bump level

Example prompts

  • “/changeset-validation”

Requirements

  • Node.js
  • A Bash shell

Workflow steps

3 steps, taken from the first numbered list in SKILL.md.

  1. Run
  2. Apply the rules from references/validation-prompt.md to the generated prompt.
  3. Respond with a JSON verdict containing ok/errors/warnings/required_bump (English-only strings).

What it can do on your machine

Read from SKILL.md and the folder at commit d8fa6c3. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 5 files in scripts/ (JavaScript and Shell), which the agent can run.

    Shell commands in SKILL.md call:

    • pnpm

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use pnpm, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Changeset Validation loads about 607 tokens when it runs, and up to ~1.8k if it reads all its reference files. Until then it costs about 61 tokens; SKILL.md has 280 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~61
When it runs · the whole SKILL.md, loaded when a task matches
~607
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from openai/openai-agents-js at commit d8fa6c3, republished under its MIT licence (© openai). 280 words, ~607 tokens.

Download SKILL.mdSave it as .claude/skills/changeset-validation/SKILL.md (or your agent's skills folder). This skill also uses 7 other files; get the full folder from GitHub.
name
changeset-validation
description
Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes). Use when packages/ or .changeset/ are modified, or when verifying PR changeset compliance and bump level.

Changeset Validation

Overview

This skill validates whether changesets correctly reflect package changes and follow the repository rules. It relies on the shared prompt in references/validation-prompt.md so local Codex reviews and GitHub Actions share the same logic. Experimental or preview-only feature additions that are explicitly labeled as such in the diff may remain a patch bump when they do not change existing behavior. Major bumps are only allowed after the first major release; before that, do not use major bumps for feature-level changes.

Quick start

Local (Codex-driven):

  1. Run:
    bash
    pnpm changeset:validate-prompt
  2. Apply the rules from references/validation-prompt.md to the generated prompt.
  3. Respond with a JSON verdict containing ok/errors/warnings/required_bump (English-only strings).

CI (Codex Action):

  1. Run:
    bash
    pnpm changeset:validate-prompt -- --ci --output .github/codex/prompts/changeset-validation.generated.md
  2. Use openai/codex-action with the generated prompt and JSON schema to get a structured verdict.

Workflow

  1. Generate the prompt context via pnpm changeset:validate-prompt.
  2. Apply the rules in references/validation-prompt.md to judge correctness.
  3. Provide a clear verdict and required bump (patch/minor/major/none).
  4. If the changeset needs edits, update it and re-run the validation.

Branch-level changeset rule (do not skip)

  • If any .changeset/*.md file is already present in the current branch diff, treat it as the active changeset. Do not add a new changeset file.
  • Instead, update the existing changeset file by rewriting its summary to reflect the primary change relative to main. Do not try to capture every incremental update.
  • Keep the summary at one line; replace the line as needed rather than appending. If you must include multiple points, compress them into a single line.

Shared source of truth

  • Keep the prompt file as the single source of validation rules.
  • Keep the script lightweight: it should only gather context and emit the prompt.

Resources

  • references/validation-prompt.md

© openai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 7 other files (scripts, references) in .agents/skills/changeset-validation of openai/openai-agents-js.

  • SKILL.md
  • agents/openai.yaml
  • references/validation-prompt.md
  • scripts/changeset-assign-milestone.mjs
  • scripts/changeset-prompt.mjs
  • scripts/changeset-prompt.test.mjs
  • scripts/changeset-validation-result.mjs
  • scripts/run-fixtures.sh

Open the folder on GitHubat commit d8fa6c3

Compare with similar skills

Changeset Validation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Changeset Validation compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Changeset Validation this skillopenai/openai-agents-js3.9k—~607Automated safety check: PassMIT
Open Code Review CLIalibaba/open-code-review44k—~3.1kAutomated safety check: PassApache-2.0
Codexskills-directory/skill-codex1.5k3 repos~1.8kAutomated safety check: PassMIT
Openai Security Ownership Maptrailofbits/skills-curated5125 repos~2.2kAutomated safety check: NotesCC-BY-SA-4.0
Pulse Releasequnqin24/Pulse516—~1.3kAutomated safety check: PassApache-2.0
Pypi ReleasealchemiststudiosDOTai/tunacode125—~2.2kAutomated safety check: PassMIT

Similar skills

  • Open Code Review CLI

    alibaba/open-code-review

    Runs the ocr command-line tool to review Git changes, a commit or a branch comparison with an AI model, returning line-level comments and optionally applying fixes.

    44k GitHub stars~3.1k tokensUpdated 2 days ago
    DevelopmentAuto-check passed
  • Codex

    skills-directory/skill-codex

    A skill your agent uses when the user asks to run Codex CLI (codex exec, codex resume) or references OpenAI Codex for code analysis, refactoring, or automated editing

    1.5k GitHub starsUsed in 3 repos~1.8k tokens
    DevelopmentAuto-check passed
  • Openai Security Ownership Map

    trailofbits/skills-curated

    Official

    Analyze git repositories to build a security ownership topology (people-to-file), compute bus factor and sensitive-code ownership, and export CSV/JSON for graph databases and visualization.

    512 GitHub starsUsed in 5 repos~2.2k tokens
    DevelopmentAuto-check: notes
  • Pulse Release

    qunqin24/Pulse

    Release a new Pulse version end to end — checks, bilingual CHANGELOG entry, VERSION, tag, the release workflow, syncing main, and the issue replies that go with it.

    516 GitHub stars~1.3k tokensUpdated today
    DevelopmentAuto-check passed
  • Pypi Release

    alchemiststudiosDOTai/tunacode

    This skill should be used when releasing tunacode-cli to PyPI.

    125 GitHub stars~2.2k tokensUpdated 2 days ago
    DevelopmentAuto-check passed
  • Close Task Commit Push PR

    devoxx/DevoxxGenieIDEAPlugin

    Close the active backlog task (detected from branch name), commit all changes, push to remote, and open a pull request.

    684 GitHub stars~1k tokensUpdated 8 days ago
    DevelopmentAuto-check: notes

More from openai/openai-agents-js

All 10 skills in this repo
  • Pnpm Upgrade

    openai/openai-agents-js

    Official

    Keep pnpm current: preflight the published package and pnpm/action-setup self-installer, update pnpm locally, align packageManager in package.json, and refresh CI pins.

    3.9k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Final Release Review

    openai/openai-agents-js

    Official

    Assess a JS SDK release candidate or release plan against the previous release and recommend ship or block.

    3.9k GitHub stars~4k tokensUpdated today
    Auto-check passed
  • Sensitive Logging Audit

    openai/openai-agents-js

    Official

    Audit or fix sensitive-data exposure in JS SDK diagnostics, exceptions, logging, and telemetry.

    3.9k GitHub stars~2.2k tokensUpdated today
    Auto-check passed
  • Runtime Behavior Probe

    openai/openai-agents-js

    Official

    Plan and, after explicit approval, execute runtime-behavior probes for local or live integrations.

    3.9k GitHub stars~4.9k tokensUpdated today
    Auto-check passed
  • Code Change Verification

    openai/openai-agents-js

    Official

    Run the required final install, build, type, lint, test, and format checks after eligible SDK changes pass review.

    3.9k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Examples Run Analysis

    openai/openai-agents-js

    Official

    Analyze logs and source from a completed repository example run.

    3.9k GitHub stars~1.1k tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Changeset Validation

What does Changeset Validation do?

Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes). Changeset Validation is an agent skill from openai/openai-agents-js, published by the product's own GitHub organization. Validate changesets in openai-agents-js using LLM judgment against git diffs (including uncommitted local changes).

When should I use Changeset Validation?

Changeset Validation fits situations like: .changeset/ are modified; verifying PR changeset compliance and bump level.

How do I install Changeset Validation in Claude Code?

Run `npx skills add openai/openai-agents-js --skill changeset-validation -a claude-code`. Or copy the skill folder (.agents/skills/changeset-validation in openai/openai-agents-js) into .claude/skills/changeset-validation in your project. Claude Code loads it when a task matches its description.

How do I install Changeset Validation in Codex?

Run `npx skills add openai/openai-agents-js --skill changeset-validation -a codex`. Or copy the skill folder (.agents/skills/changeset-validation in openai/openai-agents-js) into .agents/skills/changeset-validation in your project. Codex loads it when a task matches its description.

Can I use Changeset Validation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add openai/openai-agents-js --skill changeset-validation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/changeset-validation, .gemini/skills/changeset-validation, .github/skills/changeset-validation and .opencode/skills/changeset-validation in your project.

What does Changeset Validation need to run?

Going by SKILL.md and its folder, Changeset Validation needs JavaScript and a shell for the scripts in its folder and the command-line tools its instructions call (pnpm). Our summary lists: Node.js; A Bash shell.

Does Changeset Validation access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Changeset Validation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Changeset Validation use?

Changeset Validation is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Changeset Validation use?

About 607 tokens (SKILL.md is roughly 2.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 1.2k tokens, read only when the agent opens those files.

What are the alternatives to Changeset Validation?

Skills that share tags, products or a category with Changeset Validation: Open Code Review CLI (alibaba/open-code-review, 44k stars), Codex (skills-directory/skill-codex, 1.5k stars), Openai Security Ownership Map (trailofbits/skills-curated, 512 stars) and Pulse Release (qunqin24/Pulse, 516 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Changeset Validation?

openai (a GitHub organization, an official publisher) maintains it in openai/openai-agents-js, which has 3,892 GitHub stars. The repository holds 10 skills in this directory. The repository was last updated on October 6, 2026.

Source: openai/openai-agents-js on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.