Python · LLM observability

Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.

FailproofAI/failproofai

Runs a real Codex CLI session through claude-tap and produces trace evidence and viewer screenshots for pull requests that touch capture, proxying or the viewer.

liaohch3/claude-tap

Backend development guide for the Phoenix AI observability platform (Strawberry GraphQL, SQLAlchemy async, FastAPI).

Arize-ai/phoenix

Mines local Claude Code session transcripts with a deterministic Python pipeline to show what the agent is actually used for, how often it fails and what it costs.

amd/gaia

Logs and visualizes ML training metrics with Trackio, firing alerts for issues like loss spikes, and syncing a live dashboard to a Hugging Face Space.

huggingface/skills

Bootstrap a reproducible LLM Observability experiment through the Python ddtrace SDK or the Node dd-trace SDK.

datadog-labs/agent-skills

Developer notes for working inside the Opik Python SDK: layered design, async versus blocking calls, integration styles, batching and dependency rules.

comet-ml/opik

Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify.

comet-ml/opik

Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call.

comet-ml/opik

Audit documentation gaps across the Phoenix repo by analyzing recent commits to main (default: last 7 days).

Arize-ai/phoenix

Create a new built-in classification evaluator for Phoenix evals.

Arize-ai/phoenix

Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.

Arize-ai/phoenix

Bump the next release-please version for a Phoenix Python package (arize-phoenix, arize-phoenix-client, arize-phoenix-evals, arize-phoenix-otel) by opening a PR with a Release-As commit footer.

Arize-ai/phoenix

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…

Arize-ai/phoenix

INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents.

langchain-ai/langchain-skills

OpenInference semantic conventions and instrumentation for Phoenix AI observability.

github/awesome-copilot

A skill your agent uses when you need to test or evaluate LangGraph/LangChain agents: writing unit or integration tests, generating test scaffolds, mocking LLM/tool behavior, running trajectory…

soba-labs/langchain-agent-skills

Build and run evaluators for AI/LLM applications using Phoenix.

github/awesome-copilot

Instrument the current project with Datadog LLM Observability for Python or Node.js/Next.js backends that call LLMs or run AI agents.

datadog-labs/agent-skills

Wire LangSmith tracing and custom metric callbacks into a LangChain 1.0 chain or LangGraph 1.0 agent correctly — env-var spelling, subgraph propagation, per-tenant dimensions, cost and latency…

jeremylongshore/tons-of-skills-marketplace

Manage LangChain 1.0 prompts like code — LangSmith prompt hub versioning, XML-tag conventions for Claude, few-shot example selection, discriminated-union extraction schemas, and A/B test wiring.

jeremylongshore/tons-of-skills-marketplace

Create a minimal working Langfuse trace example. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Install and configure Langfuse SDK authentication for LLM observability.

jeremylongshore/tons-of-skills-marketplace