LangChain · LLM observability

Debugs LangChain and LangGraph agents by pulling recent execution traces with the langsmith-fetch CLI and reporting errors, tool calls, timings and token use.

ComposioHQ/awesome-claude-skills

Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.

FailproofAI/failproofai

Routes every LLM call in a repository through the Caveman Cloud gateway in record mode, so requests and costs are measured without changing behavior.

JuliusBrussee/caveman

Sets up Arize Phoenix to trace, evaluate and monitor LLM applications, with instrumentation for OpenAI, LangChain and LlamaIndex and a self-hosted server.

Orchestra-Research/AI-Research-SKILLs

Developer notes for working inside the Opik Python SDK: layered design, async versus blocking calls, integration styles, batching and dependency rules.

comet-ml/opik

Enhancement-overlay skill — the DECISION + WIRING layer for LM observability that the single-backend skills [[langsmith]], [[phoenix]], [[mlflow]] do NOT cover.

agentsope/SkillAlchemy

Expert in Langfuse - the open-source LLM observability platform.

davila7/claude-code-templates

Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.

Arize-ai/phoenix

INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents.

langchain-ai/langchain-skills

A skill your agent uses when you need to test or evaluate LangGraph/LangChain agents: writing unit or integration tests, generating test scaffolds, mocking LLM/tool behavior, running trajectory…

soba-labs/langchain-agent-skills

Trace, evaluate, and deploy AI agents and LLM applications with LangSmith.

langchain-ai/docs

Deploy and operate production agent servers with LangSmith Deployment.

soba-labs/langchain-agent-skills

Expert in Langfuse - the open-source LLM observability platform.

sickn33/agentic-awesome-skills

Check that a code sample, API signature, default, or behavior claim in the docs is actually true, by running it or reading the product source.

langchain-ai/docs

Instrument an application with Sentry — detect the platform, install and initialize the SDK if needed, and wire up any signal — error monitoring, tracing/performance, logging, metrics, profiling…

getsentry/sentry-for-ai

Produce a reproducible, sanitized diagnostic bundle for a LangChain / LangGraph incident — environment snapshot, version manifest, filtered astreamevents(v2) transcript, propagating callback stack…

jeremylongshore/tons-of-skills-marketplace

Build reproducible evaluation pipelines for LangChain 1.0 chains and LangGraph 1.0 agents — golden datasets, LangSmith evaluate(), ragas RAG metrics, deepeval LLM-as-judge, agent trajectory…

jeremylongshore/tons-of-skills-marketplace

Wire LangSmith tracing and custom metric callbacks into a LangChain 1.0 chain or LangGraph 1.0 agent correctly — env-var spelling, subgraph propagation, per-tenant dimensions, cost and latency…

jeremylongshore/tons-of-skills-marketplace

Manage LangChain 1.0 prompts like code — LangSmith prompt hub versioning, XML-tag conventions for Claude, few-shot example selection, discriminated-union extraction schemas, and A/B test wiring.

jeremylongshore/tons-of-skills-marketplace