Agent skill

Arize Observability

by majiayu000 in majiayu000/claude-skill-registry

Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

MITAuto-check: notesDevOps & Cloud

Install Arize Observability

skills CLI
$ npx skills add majiayu000/claude-skill-registry --skill arize-observability -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install majiayu000/claude-skill-registry arize-observability --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/majiayu000/claude-skill-registry.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/ai-ml/arize-observability .claude/skills/arize-observability && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
arize-observability
GitHub stars
666
Used in
1 other repo
Token cost
~996 tokens
SKILL.md length
80 words
Files
2
Skills in repo
1,273
Repo updated
First seen
Licence
MIT

At a glance

Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

  • Tasks that involve Observability
  • SKILL.md covers Overview, Capabilities, Target Processes and Tools and Libraries, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Tasks that involve Embeddings

What it does

Arize Observability is an agent skill from majiayu000/claude-skill-registry. Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

Its SKILL.md is about 1000 tokens, which your agent loads only when the skill is triggered. The skill folder holds 1 other file (for example `metadata.json`).

It sits in DevOps & Cloud, covering Observability and Embeddings. It works with Arize Phoenix. The repository describes itself as: Searchable Claude Code skills catalog with source-linked guides and generated registry artifacts. The licence is MIT.

When your agent uses it

  • Tasks that involve Observability
  • Tasks that involve Embeddings

Example prompts

  • “/arize-observability”

Requirements

  • Pre-approved tools (allowed-tools): Read, Write, Bash, Glob, Grep

What it can do on your machine

Read from SKILL.md and the folder at commit 2d14a69. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Write
    • Bash
    • Glob
    • Grep

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are json and javascript).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Arize Observability loads about 996 tokens when it runs. Until then it costs about 27 tokens; SKILL.md has 80 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~27
When it runs · the whole SKILL.md, loaded when a task matches
~996

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NotePre-approves every shell command (allowed-tools: Bash)SKILL.md
    allowed-tools: Read, Write, Bash, Glob, Grep

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from majiayu000/claude-skill-registry at commit 2d14a69, republished under its MIT licence (© majiayu000). 80 words, ~996 tokens.

Download SKILL.mdSave it as .claude/skills/arize-observability/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
arize-observability
description
Arize AI skill for production ML monitoring, embedding drift, and performance analysis.
allowed-tools
Read, Write, Bash, Glob, Grep

arize-observability

Overview

Arize AI skill for production ML monitoring, embedding drift detection, and comprehensive performance analysis.

Capabilities

  • Production data logging
  • Embedding drift detection for NLP/CV models
  • Performance monitoring dashboards
  • Root cause analysis
  • Slice and dice analysis for segments
  • Bias monitoring
  • A/B test monitoring
  • Custom metrics and monitors

Target Processes

  • Model Performance Monitoring and Drift Detection
  • ML System Observability and Incident Response
  • Model Evaluation and Validation Framework

Tools and Libraries

  • Arize AI SDK
  • pandas
  • numpy

Input Schema

json
{
  "type": "object",
  "required": ["action"],
  "properties": {
    "action": {
      "type": "string",
      "enum": ["log", "monitor", "analyze", "alert-config", "compare"],
      "description": "Arize action to perform"
    },
    "logConfig": {
      "type": "object",
      "properties": {
        "modelId": { "type": "string" },
        "modelVersion": { "type": "string" },
        "modelType": { "type": "string", "enum": ["score_categorical", "regression", "ranking"] },
        "environment": { "type": "string", "enum": ["training", "validation", "production"] },
        "dataPath": { "type": "string" },
        "predictionIdColumn": { "type": "string" },
        "timestampColumn": { "type": "string" },
        "featureColumns": { "type": "array", "items": { "type": "string" } },
        "embeddingColumns": { "type": "array", "items": { "type": "string" } },
        "predictionColumn": { "type": "string" },
        "actualColumn": { "type": "string" }
      }
    },
    "monitorConfig": {
      "type": "object",
      "properties": {
        "metrics": { "type": "array", "items": { "type": "string" } },
        "thresholds": { "type": "object" },
        "schedule": { "type": "string" }
      }
    },
    "analysisConfig": {
      "type": "object",
      "properties": {
        "analysisType": { "type": "string", "enum": ["drift", "performance", "fairness", "data_quality"] },
        "timeRange": { "type": "object" },
        "segments": { "type": "array", "items": { "type": "string" } }
      }
    }
  }
}

Output Schema

json
{
  "type": "object",
  "required": ["status", "action"],
  "properties": {
    "status": {
      "type": "string",
      "enum": ["success", "error"]
    },
    "action": {
      "type": "string"
    },
    "logId": {
      "type": "string"
    },
    "dashboardUrl": {
      "type": "string"
    },
    "analysis": {
      "type": "object",
      "properties": {
        "overallScore": { "type": "number" },
        "driftMetrics": { "type": "object" },
        "performanceMetrics": { "type": "object" },
        "topIssues": { "type": "array" },
        "recommendations": { "type": "array", "items": { "type": "string" } }
      }
    },
    "alerts": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": { "type": "string" },
          "severity": { "type": "string" },
          "triggered": { "type": "boolean" }
        }
      }
    }
  }
}

Usage Example

javascript
{
  kind: 'skill',
  title: 'Log production predictions to Arize',
  skill: {
    name: 'arize-observability',
    context: {
      action: 'log',
      logConfig: {
        modelId: 'fraud-detector',
        modelVersion: '2.0.0',
        modelType: 'score_categorical',
        environment: 'production',
        dataPath: 'data/production_predictions.parquet',
        predictionIdColumn: 'request_id',
        timestampColumn: 'timestamp',
        featureColumns: ['amount', 'merchant_category', 'hour'],
        predictionColumn: 'fraud_probability',
        actualColumn: 'is_fraud'
      }
    }
  }
}

© majiayu000, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file in skills/ai-ml/arize-observability of majiayu000/claude-skill-registry.

  • SKILL.md
  • metadata.json

Open the folder on GitHubat commit 2d14a69

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in majiayu000/claude-skill-registry, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Arize Observability next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Arize Observability compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Arize Observability this skillmajiayu000/claude-skill-registry6661 repos~996Automated safety check: NotesMIT
Arize PhoenixArize-ai/phoenix12k1 repos~3.8kAutomated safety check: PassMIT
Azure Mgmt Arizeaiobservabilityeval Dotnetmicrosoft/skills3.1k5 repos~2kAutomated safety check: PassMIT
Caveman Gateway SetupJuliusBrussee/caveman110k1 repos~2.6kAutomated safety check: WarnApache-2.0
Agent Kill Switchvivekchand/clawmetry425—~1.1kAutomated safety check: PassMIT
Sls Dashboard Builderalibaba/loongsuite-pilot198—~1.8kAutomated safety check: PassApache-2.0

Similar skills

  • Arize Phoenix

    Arize-ai/phoenix

    Open-source AI observability platform for tracing, evaluating, and improving LLM applications with OpenTelemetry integration

    12k GitHub starsUsed in 1 repo~3.8k tokens
    DevOps & CloudAuto-check passed
  • Azure Resource Manager SDK for Arize AI Observability and Evaluation (.NET).

    3.1k GitHub starsUsed in 5 repos~2k tokens
    DevOps & CloudAuto-check passed
  • Caveman Gateway Setup

    JuliusBrussee/caveman

    Routes every LLM call in a repository through the Caveman Cloud gateway in record mode, so requests and costs are measured without changing behavior.

    110k GitHub starsUsed in 1 repo~2.6k tokens
    DevOps & CloudAuto-check: warnings
  • Agent Kill Switch

    vivekchand/clawmetry

    Give the human an off switch and a cost meter for the coding agents on this machine, using ClawMetry.

    425 GitHub stars~1.1k tokensUpdated today
    DevOps & CloudAuto-check passed
  • Sls Dashboard Builder

    alibaba/loongsuite-pilot

    当任务需要创建、修改、扩展或重组阿里云 SLS 的 dashboard JSON 或可导入的大盘配置时使用;尤其适用于线上大盘、强对比的分析看板、已校验的查询包,或需要专业中文标签与指标定义的运维向大盘。

    198 GitHub stars~1.8k tokensUpdated 9 days ago
    DevOps & CloudAuto-check passed
  • Clawmetry Selfcheck

    vivekchand/clawmetry

    Read your own agent telemetry from ClawMetry (waste, progress, cost) and act on it before finishing a task.

    425 GitHub stars~515 tokensUpdated today
    DevOps & CloudAuto-check passed

More from majiayu000/claude-skill-registry

All 1,273 skills in this repo
  • Deep Research

    majiayu000/claude-skill-registry

    Multi-source deep research using firecrawl and exa MCPs. An agent skill from majiayu000/claude-skill-registry.

    666 GitHub starsUsed in 6 repos~1.1k tokens
    Auto-check passed
  • Exa Search

    majiayu000/claude-skill-registry

    Neural search via Exa MCP for web, code, and company research.

    666 GitHub starsUsed in 5 repos~856 tokens
    Auto-check passed
  • Fal AI Media

    majiayu000/claude-skill-registry

    Unified media generation via fal.ai MCP — image, video, and audio.

    666 GitHub starsUsed in 5 repos~1.7k tokens
    Auto-check passed
  • Pyzotero

    majiayu000/claude-skill-registry

    Interact with Zotero reference management libraries using the pyzotero Python client.

    666 GitHub starsUsed in 5 repos~1.6k tokens
    Auto-check: notes
  • Bgpt Paper Search

    majiayu000/claude-skill-registry

    Search scientific papers and retrieve structured experimental data extracted from full-text studies via the BGPT MCP server.

    666 GitHub starsUsed in 4 repos~619 tokens
    Auto-check: notes
  • Bio Alignment Pairwise

    majiayu000/claude-skill-registry

    Perform pairwise sequence alignment using Biopython Bio.Align.PairwiseAligner.

    666 GitHub starsUsed in 4 repos~1.7k tokens
    Auto-check passed

Works with

Questions about Arize Observability

What does Arize Observability do?

Arize AI skill for production ML monitoring, embedding drift, and performance analysis. Arize Observability is an agent skill from majiayu000/claude-skill-registry. Arize AI skill for production ML monitoring, embedding drift, and performance analysis.

When should I use Arize Observability?

Arize Observability fits situations like: tasks that involve Observability; tasks that involve Embeddings.

How do I install Arize Observability in Claude Code?

Run `npx skills add majiayu000/claude-skill-registry --skill arize-observability -a claude-code`. Or copy the skill folder (skills/ai-ml/arize-observability in majiayu000/claude-skill-registry) into .claude/skills/arize-observability in your project. Claude Code loads it when a task matches its description.

How do I install Arize Observability in Codex?

Run `npx skills add majiayu000/claude-skill-registry --skill arize-observability -a codex`. Or copy the skill folder (skills/ai-ml/arize-observability in majiayu000/claude-skill-registry) into .agents/skills/arize-observability in your project. Codex loads it when a task matches its description.

Can I use Arize Observability in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add majiayu000/claude-skill-registry --skill arize-observability -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/arize-observability, .gemini/skills/arize-observability, .github/skills/arize-observability and .opencode/skills/arize-observability in your project.

What does Arize Observability need to run?

SKILL.md names no scripts, command-line tools or credentials: Arize Observability is instructions for the agent only. Its frontmatter pre-approves these tools: Read, Write, Bash, Glob, Grep.

Does Arize Observability access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Arize Observability safe to install?

Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Arize Observability use?

Arize Observability is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Arize Observability use?

About 996 tokens (SKILL.md is roughly 4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Arize Observability?

Skills that share tags, products or a category with Arize Observability: Arize Phoenix (Arize-ai/phoenix, 12k stars), Azure Mgmt Arizeaiobservabilityeval Dotnet (microsoft/skills, 3.1k stars), Caveman Gateway Setup (JuliusBrussee/caveman, 110k stars) and Agent Kill Switch (vivekchand/clawmetry, 425 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Arize Observability?

majiayu000 (a GitHub user) maintains it in majiayu000/claude-skill-registry, which has 666 GitHub stars. The repository holds 1,273 skills in this directory. The repository was last updated on October 7, 2026.

Source: majiayu000/claude-skill-registry on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.