Agent skill

Phoenix Skills Audit

by Arize-ai in Arize-ai/phoenix

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…

Custom licenceAuto-check passedAI & LLM Engineering

Install Phoenix Skills Audit

skills CLI
$ npx skills add Arize-ai/phoenix --skill phoenix-skills-audit -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install Arize-ai/phoenix phoenix-skills-audit --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/Arize-ai/phoenix.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/phoenix-skills-audit .claude/skills/phoenix-skills-audit && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
phoenix-skills-audit
GitHub stars
12k
Token cost
~5.1k tokens
SKILL.md length
2,551 words
Files
2
Skills in repo
39
Repo updated
First seen
Licence
Custom licence

At a glance

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…

  • Works in 6 steps: Gather commits → Triage to user-facing surfaces → Locate the real code → …
  • A user asks to update those skills
  • SKILL.md covers Targets — the three skills…, Source mapping — which code…, Workflow and Grounding rules — do not skip, plus 4 more sections
  • Calls git and python

What it does

Phoenix Skills Audit is an agent skill from Arize-ai/phoenix. Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli, and phoenix-evals — so they stay in sync with what actually shipped. Use this skill whenever a user asks to update those skills, sync the skills with recent changes, audit skill drift, check what client/CLI/API changes need to land in the skills, or mentions "skill freshness", "skill drift", "stale skills", or "are the…

Its SKILL.md is about 5.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files (for example `evals/evals.json`).

It sits in AI & LLM Engineering, covering LLM observability and LLM evaluation. It works with Python and TypeScript. The repository describes itself as: AI Observability & Evaluation.

When your agent uses it

  • A user asks to update those skills
  • Sync the skills with recent changes
  • Audit skill drift
  • Check what client/CLI/API changes need to land in the skills

Example prompts

  • “skill freshness”
  • “skill drift”
  • “stale skills”
  • “/phoenix-skills-audit”

Requirements

  • Python 3

Workflow steps

6 steps, taken from the step headings in SKILL.md.

  1. Gather commits
  2. Triage to user-facing surfaces
  3. Locate the real code
  4. Map each finding to skill edits
  5. Apply the patches
  6. Write the run summary

What it can do on your machine

Read from SKILL.md and the folder at commit e471315. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • git
    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use git, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Phoenix Skills Audit loads about 5.1k tokens when it runs. Until then it costs about 186 tokens; SKILL.md has 2,551 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~186
When it runs · the whole SKILL.md, loaded when a task matches
~5.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 2,551 words (~5,075 tokens).

“Keep the three external-facing skills — phoenix-tracing, phoenix-cli, phoenix-evals — truthful about what the Phoenix Python clients, TypeScript clients, CLI, and APIs actually do today. The output is patches applied to the skill files, not a report. The skill reads…”

— opening of SKILL.md by Arize-ai, Custom licence
name
phoenix-skills-audit
metadata.internal
true

Read the full SKILL.md on GitHub

Files

SKILL.md and 1 other file in .agents/skills/phoenix-skills-audit of Arize-ai/phoenix.

  • SKILL.md
  • evals/evals.json

Open the folder on GitHubat commit e471315

Compare with similar skills

Phoenix Skills Audit next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Phoenix Skills Audit compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Phoenix Skills Audit this skillArize-ai/phoenix12k—~5.1kAutomated safety check: PassCustom licence
Failproof AI SDK IntegrationFailproofAI/failproofai5.3k—~6kAutomated safety check: PassCustom licence
Phoenix Evalsgithub/awesome-copilot40k2 repos~1.1kAutomated safety check: PassApache-2.0
Opik External Integrationscomet-ml/opik22k—~1.3kAutomated safety check: PassApache-2.0
Opik SDK Integrationscomet-ml/opik22k—~1.4kAutomated safety check: PassApache-2.0
Langchain Dependencieslangchain-ai/langchain-skills1.3k—~3.6kAutomated safety check: PassMIT

Similar skills

  • Failproof AI SDK Integration

    FailproofAI/failproofai

    Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.

    5.3k GitHub stars~6k tokensUpdated 4 days ago
    AI & LLM EngineeringAuto-check passed
  • Phoenix Evals

    github/awesome-copilot

    Official

    Build and run evaluators for AI/LLM applications using Phoenix.

    40k GitHub starsUsed in 2 repos~1.1k tokens
    AI & LLM EngineeringAuto-check passed
  • Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify.

    22k GitHub stars~1.3k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call.

    22k GitHub stars~1.4k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed
  • Langchain Dependencies

    langchain-ai/langchain-skills

    Official

    INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents.

    1.3k GitHub stars~3.6k tokensUpdated 2 days ago
    AI & LLM EngineeringAuto-check passed
  • Phoenix Tracing

    github/awesome-copilot

    Official

    OpenInference semantic conventions and instrumentation for Phoenix AI observability.

    40k GitHub starsUsed in 2 repos~1.6k tokens
    AI & LLM EngineeringAuto-check passed

More from Arize-ai/phoenix

All 39 skills in this repo
  • Harbor Exec

    Arize-ai/phoenix

    A skill your agent uses when working with Harbor's harbor exec CLI workflow: compiling files, directories, or globs into Harbor tasks; running map jobs; configuring artifacts and existence-only…

    12k GitHub stars~909 tokensUpdated yesterday
    Auto-check passed
  • Mintlify

    Arize-ai/phoenix

    Build and maintain documentation sites with Mintlify. An agent skill from Arize-ai/phoenix.

    12k GitHub starsUsed in 8 repos~3.4k tokens
    Auto-check passed
  • Phoenix Frontend

    Arize-ai/phoenix

    Frontend development guidelines for the Phoenix AI observability platform.

    12k GitHub stars~709 tokensUpdated yesterday
    Auto-check passed
  • Phoenix Graphql

    Arize-ai/phoenix

    Write efficient GraphQL queries against the Phoenix API. An agent skill from Arize-ai/phoenix.

    12k GitHub stars~2.2k tokensUpdated yesterday
    Auto-check passed
  • Phoenix Server

    Arize-ai/phoenix

    Backend development guide for the Phoenix AI observability platform (Strawberry GraphQL, SQLAlchemy async, FastAPI).

    12k GitHub stars~1.6k tokensUpdated yesterday
    Auto-check passed
  • Phoenix Storybook

    Arize-ai/phoenix

    Conventions for creating, modifying, and reviewing production-faithful Storybook stories in the Phoenix frontend (js/app/stories, js/app/.storybook).

    12k GitHub stars~1.9k tokensUpdated yesterday
    Auto-check passed

Questions about Phoenix Skills Audit

What does Phoenix Skills Audit do?

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…. Phoenix Skills Audit is an agent skill from Arize-ai/phoenix. Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli, and phoenix-evals — so they stay in sync with what actually shipped.

When should I use Phoenix Skills Audit?

Phoenix Skills Audit fits situations like: A user asks to update those skills; sync the skills with recent changes; audit skill drift; check what client/CLI/API changes need to land in the skills.

How do I install Phoenix Skills Audit in Claude Code?

Run `npx skills add Arize-ai/phoenix --skill phoenix-skills-audit -a claude-code`. Or copy the skill folder (.agents/skills/phoenix-skills-audit in Arize-ai/phoenix) into .claude/skills/phoenix-skills-audit in your project. Claude Code loads it when a task matches its description.

How do I install Phoenix Skills Audit in Codex?

Run `npx skills add Arize-ai/phoenix --skill phoenix-skills-audit -a codex`. Or copy the skill folder (.agents/skills/phoenix-skills-audit in Arize-ai/phoenix) into .agents/skills/phoenix-skills-audit in your project. Codex loads it when a task matches its description.

Can I use Phoenix Skills Audit in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add Arize-ai/phoenix --skill phoenix-skills-audit -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/phoenix-skills-audit, .gemini/skills/phoenix-skills-audit, .github/skills/phoenix-skills-audit and .opencode/skills/phoenix-skills-audit in your project.

What does Phoenix Skills Audit need to run?

Going by SKILL.md and its folder, Phoenix Skills Audit needs the command-line tools its instructions call (git and python). Our summary lists: Python 3.

Does Phoenix Skills Audit access the network?

SKILL.md contains no URLs. Its commands use git, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Phoenix Skills Audit safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Phoenix Skills Audit use?

Phoenix Skills Audit has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Phoenix Skills Audit use?

About 5.1k tokens (SKILL.md is roughly 20k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Phoenix Skills Audit?

Skills that share tags, products or a category with Phoenix Skills Audit: Failproof AI SDK Integration (FailproofAI/failproofai, 5.3k stars), Phoenix Evals (github/awesome-copilot, 40k stars), Opik External Integrations (comet-ml/opik, 22k stars) and Opik SDK Integrations (comet-ml/opik, 22k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Phoenix Skills Audit?

Arize-ai (a GitHub organization) maintains it in Arize-ai/phoenix, which has 11,770 GitHub stars. The repository holds 39 skills in this directory. The repository was last updated on October 10, 2026.

Source: Arize-ai/phoenix on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.