Topic · AI & LLM Engineering
Best LLM observability skills, page 2
LLM observability skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 49 | Modo operação do fazer.ai agents: debugar conversas em produção e corrigir comportamentos inesperados do agente. | fazer-ai/ | 118 | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | today |
| 50 | INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents. | langchain-ai/ | 1.3k | 1 repo | ~3.6k | Automated safety check: Pass | MIT | yesterday |
| 51 | Clean up and harden code introduced by the current branch without drifting into broad refactors. | Simon-Initiative/ | 119 | — | ~3.7k | Automated safety check: Pass | MIT | today |
| 52 | Core catalog of 8 critical Elixir/Phoenix anti-patterns covering error handling, separation of concerns, Ecto queries, and testing. | Gentleman-Programming/ | 657 | — | ~2.1k | Automated safety check: Pass | MIT | 6 mo ago |
| 53 | Converts draft customer-story Markdown into Langfuse website MDX (Fumadocs), collects missing metadata and assets, wires meta.json and authors. | langfuse/ | 246 | — | ~2.4k | Automated safety check: Pass | MIT | today |
| 54 | 54.Dev Bump Bump Heron version via the VERSION-file SSOT. An agent skill from Netis/heron. | Netis/ | 102 | — | ~983 | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 55 | INVOKE THIS SKILL when building, iterating on, copying, or sharing a LangSmith Custom App — a React/TypeScript UI that runs inside LangSmith and reads the LangSmith API. | langchain-ai/ | 159 | — | ~3.2k | Automated safety check: Pass | MIT | 4 days ago |
| 56 | Sets up Arize Phoenix to trace, evaluate and monitor LLM applications, with instrumentation for OpenAI, LangChain and LlamaIndex and a self-hosted server. | Orchestra-Research/ | 13k | 2 repos | ~2.9k | Automated safety check: Pass | MIT | 3 mo ago |
| 57 | Expert in Elixir, Phoenix Framework, and OTP. An agent skill from pass-agent/loomkin. | pass-agent/ | 181 | 1 repo | ~796 | Automated safety check: Pass | MIT | 4 mo ago |
| 58 | Research Hex packages (Sobelow, Phoenix, Ecto, Credo, Ash, etc). | bradleygolden/ | 176 | — | ~4.1k | Automated safety check: Notes | MIT | 8 mo ago |
| 59 | Shows today's Claude Code spending through the claude-view MCP server, with total cost, running sessions and a per-session breakdown, and other date ranges on request. | tombelieber/ | 110 | — | ~3k | Automated safety check: Pass | MIT | 6 days ago |
| 60 | Developer notes for working inside the Opik Python SDK: layered design, async versus blocking calls, integration styles, batching and dependency rules. | comet-ml/ | 22k | — | ~684 | Automated safety check: Pass | Apache-2.0 | today |
| 61 | Sync documentation with project state using ICAV workflow. An agent skill from Netis/heron. | Netis/ | 102 | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 62 | Work inside the Databuddy monorepo for internal implementation, debugging, review, and refactoring. | databuddy-analytics/ | 1.2k | — | ~11k | Automated safety check: Notes | AGPL-3.0 | today |
| 63 | Implements business-facing LLM calls as explicit, traceable workflows, keeping prompt versions, model policy, structured output and tracing scenarios in separate places. | lobehub/ | 83k | — | ~1.1k | Automated safety check: Pass | Unknown | today |
| 64 | Prepare Langfuse weekly production reviews covering failures, fixes, open issues, and tracking gaps. | langfuse/ | 35k | — | ~4.1k | Automated safety check: Pass | Unknown | today |
| 65 | 65.Usage Rules Search for package-specific usage rules and best practices from Elixir packages. | bradleygolden/ | 176 | — | ~4.9k | Automated safety check: Notes | MIT | 8 mo ago |
| 66 | INVOKE THIS SKILL when adding Arize AX tracing or observability to an app for the first time, or when the user wants to instrument their LLM app or get started with LLM observability. | boshi-xixixi/ | 274 | — | ~5.1k | Automated safety check: Notes | MIT | 4 mo ago |
| 67 | 67.Bench Run OhMyCode benchmarks — score any provider/model with token tracking. | AlphaLab-USTC/ | 131 | — | ~941 | Automated safety check: Pass | MIT | 6 mo ago |
| 68 | Inspects LobeHub agent execution snapshots by operation ID: failed tool calls, arguments and results, available tools, LLM calls and the surrounding context. | lobehub/ | 83k | — | ~5.3k | Automated safety check: Notes | Unknown | today |
| 69 | 69.Issue Triage Run open-source triage on Arize-ai/phoenix issues — classify type, check sufficiency, apply component and complexity labels, flag work that already shipped, investigate complex bugs, tidy… | Arize-ai/ | 12k | — | ~5.4k | Automated safety check: Pass | Apache-2.0 | today |
| 70 | View cost breakdowns, token usage, and call logs from the CLI. Filter by provider, model, or date range. Export usage reports and inspect… | diegosouzapw/ | 74k | — | ~693 | Automated safety check: Pass | MIT | today |
| 71 | Analyze Langfuse Cloud infrastructure cost structure using Metabase cost marts. | langfuse/ | 35k | — | ~672 | Automated safety check: Pass | Unknown | today |
| 72 | Design, implement, review, or harden Langfuse repo-owned autonomous agents. | langfuse/ | 35k | — | ~730 | Automated safety check: Pass | Unknown | today |
| 73 | Research Langfuse production telemetry with reusable Datadog queries. | langfuse/ | 35k | — | ~824 | Automated safety check: Pass | Unknown | today |
| 74 | Establish root cause by combining Datadog telemetry with the Langfuse repo. | langfuse/ | 35k | — | ~1.6k | Automated safety check: Pass | Unknown | today |
| 75 | Architect large or state-heavy Langfuse frontend features. An agent skill from langfuse/langfuse. | langfuse/ | 35k | — | ~1.4k | Automated safety check: Pass | Unknown | today |
| 76 | Review Langfuse changes for SSRF, tenant isolation, secret handling, unsafe redirects or uploads, RBAC drift, and client telemetry privacy. | langfuse/ | 35k | — | ~1.4k | Automated safety check: Pass | Unknown | today |
| 77 | Seed reproducible local Langfuse data in ClickHouse and Postgres. | langfuse/ | 35k | — | ~5.7k | Automated safety check: Pass | Unknown | today |
| 78 | Builds an explorable HTML report of Claude Code usage over a chosen period: tokens, cache behavior, subagents, skills and costly prompts. | anthropics/ | 37k | — | ~784 | Automated safety check: Pass | Apache-2.0 | today |
| 79 | Enhancement-overlay skill — the DECISION + WIRING layer for LM observability that the single-backend skills [[langsmith]], [[phoenix]], [[mlflow]] do NOT cover. | agentsope/ | 457 | — | ~4.4k | Automated safety check: Pass | MIT | 1 mo ago |
| 80 | 80.Phoenix CLI Debug LLM applications using the Phoenix CLI. An agent skill from Arize-ai/phoenix. | Arize-ai/ | 12k | — | ~6.8k | Automated safety check: Notes | Apache-2.0 | today |
| 81 | Searchable Elixir/Phoenix/Ecto solution documentation system with; Use when consulting past solutions… | oliver-kriska/ | 564 | — | ~528 | Automated safety check: Pass | MIT | 2 days ago |
| 82 | Shared workflow for editing Langfuse's repo-owned agent setup under .agents/. | langfuse/ | 35k | — | ~799 | Automated safety check: Pass | Unknown | today |
| 83 | Shared workflow for browser-based review of user-visible frontend changes in Langfuse. | langfuse/ | 35k | — | ~1k | Automated safety check: Pass | Unknown | today |
| 84 | 84.Git Workflow Langfuse repo Git, GitHub, commit, branch, pull request, issue search, release, and production-promotion workflow. | langfuse/ | 35k | — | ~1.3k | Automated safety check: Pass | Unknown | today |
| 85 | Answer "what should I do today" for a Langfuse maintainer, from the tracker rather than from memory: which projects you lead, which owe an update before the Monday engineering weekly, what shipped… | langfuse/ | 35k | — | ~3.4k | Automated safety check: Pass | Unknown | today |
| 86 | 86.Langfuse Expert in Langfuse - the open-source LLM observability platform. | davila7/ | 32k | 5 repos | ~1.4k | Automated safety check: Pass | MIT | today |
| 87 | A skill your agent uses when designing or evolving Hydra platform architecture across Elixir/Phoenix, SQLite, VictoriaMetrics/VictoriaLogs analytics, native/Rust, and runtime boundaries. | streamband/ | 146 | — | ~1.2k | Automated safety check: Pass | Apache-2.0 | 21 days ago |
| 88 | Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify. | comet-ml/ | 22k | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | today |
| 89 | Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call. | comet-ml/ | 22k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | today |
| 90 | Documents the Opik TypeScript SDK's layered architecture, flush and batching rules, and error-handling conventions for anyone changing code under sdks/typescript. | comet-ml/ | 22k | — | ~440 | Automated safety check: Pass | Apache-2.0 | today |
| 91 | 91.Code Review Review Langfuse code changes for correctness, regressions, and best practices. | langfuse/ | 35k | — | ~591 | Automated safety check: Pass | Unknown | today |
| 92 | OpenInference semantic conventions and instrumentation for Phoenix AI observability. | github/ | 40k | 3 repos | ~1.6k | Automated safety check: Pass | Apache-2.0 | today |
| 93 | Shared workflow for writing Langfuse changelog entries after a feature is complete. | langfuse/ | 35k | — | ~408 | Automated safety check: Pass | Unknown | today |
| 94 | Open-source AI observability platform for tracing, evaluating, and improving LLM applications with OpenTelemetry integration | Arize-ai/ | 12k | 1 repo | ~3.8k | Automated safety check: Pass | MIT | today |
| 95 | Design and implementation guide for the Phoenix CLI (px). An agent skill from Arize-ai/phoenix. | Arize-ai/ | 12k | — | ~4.2k | Automated safety check: Pass | Apache-2.0 | today |
| 96 | Audit documentation gaps across the Phoenix repo by analyzing recent commits to main (default: last 7 days). | Arize-ai/ | 12k | — | ~4.8k | Automated safety check: Pass | Unknown | today |
Explore related skills
Category
More topics in AI & LLM Engineering
- Building AI agents525
- Deep learning408
- Embeddings381
- LLM inference and serving364
- Retrieval-augmented generation360
- Prompt engineering350
- Fine-tuning313
- LLM evaluation303
- Speech recognition and synthesis272
- Structured output and tool calling271
- LLM cost and token optimization256
- LLM API integration218
- Model routing and gateways217
- LLM guardrails208
- Computer vision206
- Model hubs and datasets180
- GPU and accelerator computing171
- Diffusion and image models167
- Natural language processing141
- Reinforcement learning67
- AI interpretability23