Best LLM observability skills for Claude Code, Codex and other agents.

Finds every LLM workflow in a repository, proposes a labeling table and, once you agree, wires labels so Caveman Cloud groups spend per workflow.

JuliusBrussee/caveman

Read-only review of Caveman Cloud data to explain where LLM spend goes: cost, score, workflows, traces, latency, errors, routing and verified savings.

JuliusBrussee/caveman

Debugs LangChain and LangGraph agents by pulling recent execution traces with the langsmith-fetch CLI and reporting errors, tool calls, timings and token use.

ComposioHQ/awesome-claude-skills

CodexBar read. Provider usage, limits, credits, config health. JSON. No writes.

steipete/CodexBar

Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.

FailproofAI/failproofai

Build or review Langfuse backend code. An agent skill from langfuse/langfuse.

langfuse/langfuse

Navigate Langfuse repositories, code areas, and agent skills.

langfuse/langfuse

Routes every LLM call in a repository through the Caveman Cloud gateway in record mode, so requests and costs are measured without changing behavior.

JuliusBrussee/caveman

Refactor avoidable React useEffect usage in Langfuse frontend code.

langfuse/langfuse

Frontend development guidelines for the Phoenix AI observability platform.

Arize-ai/phoenix

Investigate AI traces, observations, exceptions, latency, sessions, prompts, datasets, annotation queues, and scores through Langfuse MCP.

avivsinai/langfuse-mcp

Integrate Databuddy analytics using the SDK, REST API, or MCP.

databuddy-analytics/Databuddy

Write efficient GraphQL queries against the Phoenix API. An agent skill from Arize-ai/phoenix.

Arize-ai/phoenix

Runs a real Codex CLI session through claude-tap and produces trace evidence and viewer screenshots for pull requests that touch capture, proxying or the viewer.

liaohch3/claude-tap

Builds a browser-based annotation page for reviewing LLM traces one at a time with pass/fail labels, notes and saved results, tailored to your data.

ai-evals-course/evals-skills

Run ServiceRadar web-ng locally against the live Kubernetes demo CNPG database for dashboard, SRQL, services, and UI testing.

carverauto/serviceradar

Create a new Langfuse integration page in the langfuse-docs repo.

langfuse/langfuse-docs

Interact with Langfuse and access its documentation: tracing, monitoring, creating datasets, running experiments, and evaluating AI applications.

langfuse/skills

Backend development guide for the Phoenix AI observability platform (Strawberry GraphQL, SQLAlchemy async, FastAPI).

Arize-ai/phoenix

Adds Olakai monitoring to an existing LLM application with minimal code changes, then configures custom KPIs so the dashboard tracks business outcomes instead of just token counts.

andrewyng/context-hub

Inspects and tunes the shared-vs-dedicated memory split on AMD Ryzen APUs with unified memory (UMA) so larger LLMs and image-gen models fit on the iGPU, or so reserved GPU memory is returned to the…

amd/skills

A skill your agent uses when building, modifying, or reviewing Phoenix LiveView tables with LiveTable, including schema-backed tables, context-owned data providers, joined queries, filters…

gurujada/live_table

Design, test, create, and attach LangSmith online evaluators for production traces or conversation threads.

langchain-ai/langsmith-skills

This skill should be used when the user wants to "set up tracing", "monitor my ADK agent", "configure logging", "add observability", "debug production traffic", or needs guidance on monitoring…

pifferologo/cloud-agents-cli

Conventions for creating, modifying, and reviewing production-faithful Storybook stories in the Phoenix frontend (js/app/stories, js/app/.storybook).

Arize-ai/phoenix

Writes Terraform alerting policies for AI agents that emit OpenTelemetry metrics, covering reliability, cost, safety, security and quality signals on Google Cloud.

google/skills

Use this skill working with Ash Framework or any of its extensions.

podlove/radiator

Answers token usage and cost questions from the Claude Command Center throughput dashboard and shares its link, for the last 7 days or one session.

amirfish1/claude-command-center

Queries OmniRoute call logs, usage history and analytics, filters them by provider, model, status or cost, and reads or sets usage budgets.

diegosouzapw/OmniRoute

A skill your agent uses when designing or architecting Elixir/Phoenix applications, creating comprehensive project documentation, planning OTP supervision trees, defining domain models with Ash…

maxim-ist/elixir-architect

Use this skill working with Phoenix Framework. An agent skill from podlove/radiator.

podlove/radiator

Full Sentry SDK setup for Elixir. An agent skill from getsentry/sentry-for-ai.

getsentry/sentry-for-ai

Mines local Claude Code session transcripts with a deterministic Python pipeline to show what the agent is actually used for, how often it fails and what it costs.

amd/gaia

Manage GitHub issues, labels, project boards, sprint operations, and roadmap health for the Arize-ai/phoenix repository.

Arize-ai/phoenix

Builds a new AI agent with Olakai monitoring from the start: CLI login, SDK integration, per-agent KPI configuration and an end-to-end check that data flows.

andrewyng/context-hub

Add or update a company in the Langfuse /users adopters table.

langfuse/langfuse-docs

Tune and review Langfuse autoscaling for web, web-iso, and web-ingestion.

langfuse/langfuse

A skill your agent uses for Elixir/Phoenix development in this repo: implementing features, refactors, debugging, tests, Ecto changes, and production-safe fixes.

streamband/hydra-srt

Logs and visualizes ML training metrics with Trackio, firing alerts for issues like loss spikes, and syncing a live dashboard to a Hugging Face Space.

huggingface/skills

Conduz a jornada de onboarding 'do zero ao agente de atendimento' do fazer.ai agents num VPS, escolhendo o orquestrador de deploy (Tier A Coolify, B Portainer, C compose genérico para VM crua ou…

fazer-ai/agents

Migrate to Langfuse from another LLM observability/evals platform (LangSmith, Arize AX, Phoenix, Braintrust, Helicone, Promptfoo, ...).

langfuse/skills

Queries Langfuse traces, prompts, datasets and sessions, and analyzes local LLM gateway logs for requests, context growth, token use and cache hits.

KonghaYao/peri

A skill your agent uses when the user wants to analyze agent telemetry traces to find bugs and get fix recommendations — walks through exporting traces from a local or remote watsonx Orchestrate…

IBM/ibm-watsonx-orchestrate-adk

Bootstrap a reproducible LLM Observability experiment through the Python ddtrace SDK or the Node dd-trace SDK.

datadog-labs/agent-skills

Add a new team member to Langfuse's canonical team data and shared team table.

langfuse/langfuse-docs

Use the writetodos tool effectively for task planning and decomposition in Deep Agents.

soba-labs/langchain-agent-skills

Use Langfuse's disposable per-PR previews at pr-N.preview.langfuse.com (synthetic data only).

langfuse/langfuse

LLM observability platform for tracing, evaluation, and monitoring.

Orchestra-Research/AI-Research-SKILLs