Topic · AI & LLM Engineering

Best LLM observability skills, page 3

Skills #97–144 of 240, ranked by score.

LLM observability skills, ranked

Ranked by score. Sort bymost stars,trending,newest,recently updated

LLM observability skills, ranked
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
97

Audit documentation gaps across the Phoenix repo by analyzing recent commits to main (default: last 7 days).

Arize-ai/phoenix12k—~4.8kAutomated safety check: PassUnknowntoday
98

Create a new built-in classification evaluator for Phoenix evals.

Arize-ai/phoenix12k—~2.3kAutomated safety check: PassApache-2.0today
99

Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.

Arize-ai/phoenix12k—~1.4kAutomated safety check: PassApache-2.0today
100

Maintain the Phoenix llms.txt documentation index at docs/phoenix/llms.txt — the machine-readable docs map used by AI agents and the px docs fetch CLI.

Arize-ai/phoenix12k—~2.3kAutomated safety check: PassUnknowntoday
101

Write Playwright E2E tests for the Phoenix AI observability platform.

Arize-ai/phoenix12k—~3.6kAutomated safety check: PassUnknowntoday
102

Writes and maintains the body of a pull request opened by a coding agent on Arize-ai/phoenix, including a fixed "How this PR was made" section that reports steering, abandoned approaches, and…

Arize-ai/phoenix12k—~1.3kAutomated safety check: PassUnknowntoday
103

Write, extend, and debug PXI Playwright E2E tests for Phoenix.

Arize-ai/phoenix12k—~2.6kAutomated safety check: PassUnknowntoday
104

Bump the next release-please version for a Phoenix Python package (arize-phoenix, arize-phoenix-client, arize-phoenix-evals, arize-phoenix-otel) by opening a PR with a Release-As commit footer.

Arize-ai/phoenix12k—~708Automated safety check: PassApache-2.0today
105

Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…

Arize-ai/phoenix12k—~5.1kAutomated safety check: PassUnknowntoday
106

Maintaining packages/phoenix-sqlean, the vendored fork of nalgeon/sqlean.py published as arize-phoenix-sqlean.

Arize-ai/phoenix12k—~1.7kAutomated safety check: PassUnknowntoday
107

TypeScript conventions and patterns for any TypeScript code in the Phoenix monorepo — including js/packages/, js/app/, and any other TS directories.

Arize-ai/phoenix12k—~1.5kAutomated safety check: PassUnknowntoday
108

Maintain the bundled TypeScript package docs that ship inside Phoenix npm packages.

Arize-ai/phoenix12k—~2.2kAutomated safety check: PassApache-2.0today
109

Migrate or upgrade TypeScript tooling in the Phoenix monorepo.

Arize-ai/phoenix12k—~2.8kAutomated safety check: PassApache-2.0today
110

Searchable Elixir/Phoenix/Ecto solution documentation system with YAML frontmatter.

oliver-kriska/claude-elixir-phoenix565—~547Automated safety check: PassMIT2 days ago
111

Answers questions about agent spend, token use, traces, events, errors and tool usage by running read-only SQL against a local TMA1 observability store.

tma1-ai/tma1119—~5.1kAutomated safety check: NotesApache-2.020 days ago
112

Write idiomatic Elixir code with OTP patterns, supervision trees, and Phoenix LiveView.

davila7/claude-code-templates32k8 repos~486Automated safety check: PassMITtoday
113
113.Phoenix CLIOfficial

Debug LLM applications using the Phoenix CLI. An agent skill from github/awesome-copilot.

github/awesome-copilot40k2 repos~4kAutomated safety check: PassApache-2.0today
114

Development guide for the @arizeai/phoenix-client TypeScript SDK — run and resume experiments, manage OpenTelemetry tracer providers with stack-based attach/detach, and write vitest unit and…

Arize-ai/phoenix12k—~370Automated safety check: PassApache-2.0today
115

Find out what is going wrong in LLM or agent traffic by reading sampled Phoenix traces, spans, or sessions, writing free-form notes (open coding), then grouping the notes into a few narrow…

Arize-ai/phoenix12k—~6.4kAutomated safety check: PassApache-2.0today
116

Create Phoenix release documentation grounded in actual code changes.

Arize-ai/phoenix12k—~6.7kAutomated safety check: PassUnknowntoday
117

A skill your agent uses when you need to test or evaluate LangGraph/LangChain agents: writing unit or integration tests, generating test scaffolds, mocking LLM/tool behavior, running trajectory…

soba-labs/langchain-agent-skills107—~2.3kAutomated safety check: PassMIT1 mo ago
118
118.LangsmithOfficial

Trace, evaluate, and deploy AI agents and LLM applications with LangSmith.

langchain-ai/docs425—~935Automated safety check: PassMITtoday
119
119.Deploy

Elixir/Phoenix deployment patterns — Dockerfile, fly.toml, runtime.exs, mix release, rel/ overlays.

oliver-kriska/claude-elixir-phoenix565—~1.1kAutomated safety check: PassMIT2 days ago
120

Author or refine a Phoenix evaluator — code or LLM-as-a-judge — that scores a run's output.

Arize-ai/phoenix12k—~1.7kAutomated safety check: PassUnknowntoday
121

Run, read, and compare dataset-backed experiments to find evidence that a prompt or pipeline is improving.

Arize-ai/phoenix12k—~1.8kAutomated safety check: PassUnknowntoday
122

Screenshot a running Phoenix feature and attach images to a GitHub PR.

Arize-ai/phoenix12k—~979Automated safety check: PassUnknowntoday
123

Author, edit, or iterate on prompts in the Phoenix prompt playground, including running experiments over a dataset.

Arize-ai/phoenix12k—~3.9kAutomated safety check: PassUnknowntoday
124

A skill your agent uses for ServiceRadar Elixir, Phoenix, LiveView, Ash/Ecto, migrations, external downloads, Hex dependencies, formatting, or Dialyzer work.

carverauto/serviceradar921—~1.7kAutomated safety check: PassApache-2.0today
125

Deploy and operate production agent servers with LangSmith Deployment.

soba-labs/langchain-agent-skills107—~1.7kAutomated safety check: PassMIT1 mo ago
126
126.Phoenix EvalsOfficial

Build and run evaluators for AI/LLM applications using Phoenix.

github/awesome-copilot40k3 repos~1.1kAutomated safety check: PassApache-2.0today
127

Design system conventions for the Phoenix frontend — layout, dialogs, error display, BEM CSS class naming, and CSS design tokens.

Arize-ai/phoenix12k—~416Automated safety check: PassApache-2.0today
128

Guide for the phoenix-otel TypeScript package — OTel registration, stack-based global provider management, and provider lifecycle.

Arize-ai/phoenix12k—~330Automated safety check: PassApache-2.0today
129

REST API development for Phoenix. An agent skill from Arize-ai/phoenix.

Arize-ai/phoenix12k—~286Automated safety check: PassUnknowntoday
130

Bump outdated Hex deps — inventory, snapshot changelogs, update, fix breaks, split reviewable PRs (patches bundled, majors solo).

oliver-kriska/claude-elixir-phoenix565—~1.4kAutomated safety check: PassMIT2 days ago
131

Understand what a Phoenix dataset is and reason well about its examples, outputs, splits, and how it feeds evaluators and experiments.

Arize-ai/phoenix12k—~1.6kAutomated safety check: PassUnknowntoday
132

A skill your agent uses when extending phx.gen.auth — adding registration fields, custom user attributes, extra migrations alongside generated auth, fixture updates.

j-morgan6/elixir-phoenix-guide166—~2kAutomated safety check: PassMIT3 mo ago
133

Monitor LLMs and agentic apps: performance, token/cost, response quality, and workflow orchestration.

aspectrr/deer405—~858Automated safety check: PassMIT5 mo ago
134

Configure and interpret the Phoenix plugin for Harbor agent evaluations.

Arize-ai/phoenix12k—~3.4kAutomated safety check: WarnApache-2.0today
135

Fetch, organize, and analyze LangSmith traces for debugging and evaluation.

soba-labs/langchain-agent-skills107—~1.4kAutomated safety check: PassMIT1 mo ago
136

Generate unified, on-brand Instagram Reel covers for Yuval (YUV.AI Neon Phoenix system) — the signature look is a giant Hebrew headline BEHIND the subject cutout + a punch line IN FRONT (depth…

hoodini/ai-agents-skills281—~1.1kAutomated safety check: PassNo licence2 mo ago
137

Step-by-step guide for adding a new observability/tracing provider to Agent Kernel.

yaalalabs/agent-kernel191—~3.2kAutomated safety check: PassApache-2.0today
138

A skill your agent uses when deciding who may do what — ownership checks, policy modules, scoped queries, role-based access in LiveViews and controllers.

j-morgan6/elixir-phoenix-guide166—~2.1kAutomated safety check: PassMIT3 mo ago
139

Answer questions about LLM and agentic-application behavior from data already ingested into Elastic: latency and error rate, token and cost utilization, response quality and guardrail events, and…

elastic/agent-skills592—~4.9kAutomated safety check: PassApache-2.0today
140

A skill your agent uses when building WebSocket features with Phoenix Channels — socket auth, join authorization, handlein/push/broadcast, Presence.

j-morgan6/elixir-phoenix-guide166—~2.3kAutomated safety check: PassMIT3 mo ago
141

Adds Arize AX tracing to an LLM application for the first time.

github/awesome-copilot40k—~6.2kAutomated safety check: NotesMITtoday
142

INVOKE THIS SKILL when building, testing, or deploying Managed Deep Agents in LangSmith.

langchain-ai/langchain-skills1.3k—~8.7kAutomated safety check: NotesMIT2 days ago
143

A skill your agent uses when building JSON API endpoints — :api pipeline, FallbackController, error rendering, pagination, versioning, Bearer auth.

j-morgan6/elixir-phoenix-guide166—~2.8kAutomated safety check: PassMIT3 mo ago
144

Monitor and optimize LLM costs using Langfuse analytics and dashboards.

jeremylongshore/tons-of-skills-marketplace2.8k1 repo~2.4kAutomated safety check: PassMITtoday