AI & LLM Engineering · OpenTelemetry

Give the human an off switch and a cost meter for the coding agents on this machine, using ClawMetry.

vivekchand/clawmetry

当任务需要创建、修改、扩展或重组阿里云 SLS 的 dashboard JSON 或可导入的大盘配置时使用；尤其适用于线上大盘、强对比的分析看板、已校验的查询包，或需要专业中文标签与指标定义的运维向大盘。

alibaba/loongsuite-pilot

Read your own agent telemetry from ClawMetry (waste, progress, cost) and act on it before finishing a task.

vivekchand/clawmetry

Evaluate and score agent behavior against a golden reference.

agentevals-dev/agentevals

Propose an improved version of a prompt registered in a self-hosted AgentX (AgentX-trace-eval) instance, using real low-rated evaluation results as evidence, then publish it as a new version once…

AgentX-ai/AgentX-Trace-Eval

Writes Terraform alerting policies for AI agents that emit OpenTelemetry metrics, covering reliability, cost, safety, security and quality signals on Google Cloud.

google/skills

Full Sentry SDK setup for Elixir. An agent skill from getsentry/sentry-for-ai.

getsentry/sentry-for-ai

A skill your agent uses when the user wants to analyze agent telemetry traces to find bugs and get fix recommendations — walks through exporting traces from a local or remote watsonx Orchestrate…

IBM/ibm-watsonx-orchestrate-adk

Inspect and debug live streaming agent sessions to understand what the agent did.

agentevals-dev/agentevals

Sets up Arize Phoenix to trace, evaluate and monitor LLM applications, with instrumentation for OpenAI, LangChain and LlamaIndex and a self-hosted server.

Orchestra-Research/AI-Research-SKILLs

基于 LoongSuite Pilot / AI Coding Agent 日志生成事件洞察、组织洞察、数据质量、研发效能和 AI Native 使用类 SLS 报表时使用；包含 AI Coding 事件表语义，以及团队报表可选的部门维表、deptuser 组织关系、指标口径和公共 CTE，通常与 sls-dashboard-builder 一起使用。

alibaba/loongsuite-pilot

Run offline Python (pydanticevals) or Node.js (logfire/evals) evaluations and review them in Logfire.

pydantic/skills

Enhancement-overlay skill — the DECISION + WIRING layer for LM observability that the single-backend skills [[langsmith]], [[phoenix]], [[mlflow]] do NOT cover.

agentsope/SkillAlchemy

Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.

Arize-ai/phoenix

Bump the next release-please version for a Phoenix Python package (arize-phoenix, arize-phoenix-client, arize-phoenix-evals, arize-phoenix-otel) by opening a PR with a Release-As commit footer.

Arize-ai/phoenix

Maintain the bundled TypeScript package docs that ship inside Phoenix npm packages.

Arize-ai/phoenix

Answers questions about agent spend, token use, traces, events, errors and tool usage by running read-only SQL against a local TMA1 observability store.

tma1-ai/tma1

Development guide for the @arizeai/phoenix-client TypeScript SDK — run and resume experiments, manage OpenTelemetry tracer providers with stack-based attach/detach, and write vitest unit and…

Arize-ai/phoenix

Create Phoenix release documentation grounded in actual code changes.

Arize-ai/phoenix

A skill your agent uses when adding, renaming, removing, or reviewing mesh-llm OTLP metrics, telemetry attributes, metrics exporter settings, or telemetry documentation.

Mesh-LLM/mesh-llm

Guide for the phoenix-otel TypeScript package — OTel registration, stack-based global provider management, and provider lifecycle.

Arize-ai/phoenix

Open-source AI observability platform for tracing, evaluating, and improving LLM applications with OpenTelemetry integration

Arize-ai/phoenix

A skill your agent uses when working on skippy telemetry attributes, OTLP emission, benchmark metric names, runtime lifecycle telemetry, or separating telemetry/reporting ownership from stage…

Mesh-LLM/mesh-llm

A skill your agent uses when deploying, operating, integrating, or customizing the VSS RT-Embed Video Embedding microservice.

NVIDIA-AI-Blueprints/video-search-and-summarization

Configure and interpret the Phoenix plugin for Harbor agent evaluations.

Arize-ai/phoenix

Step-by-step guide for adding a new observability/tracing provider to Agent Kernel.

yaalalabs/agent-kernel

Adds Arize AX tracing to an LLM application for the first time.

github/awesome-copilot

Take a working agent prototype to a scalable, observable production deployment on Microsoft Foundry.

microsoft/ai-agents-for-beginners

Take one working agent prototype go scalable, observable production deployment for Microsoft Foundry.

microsoft/ai-agents-for-beginners

Local Langfuse documentation reference (latest). An agent skill from olorehq/olore.

olorehq/olore

A skill your agent uses when deploying, operating, or integrating the VSS 3.2 GA RT-Embed Video Embedding microservice.

NVIDIA/skills

Guides migration, provisioning, search, log-analytics, trace-analytics, and Agentic AI Assistant workflows for Amazon OpenSearch Service and Serverless across six capabilities — migration…

aws/agent-toolkit-for-aws

Analyze & debug GenAI/LLM apps: token cost & caching by prompt, model & provider; latency/errors; agent & tool loops/failures; conversations; guardrails; evaluations; OpenTelemetry/dt-evals setup.

Dynatrace/dynatrace-for-ai

Langfuse SDK best practices, patterns, and idiomatic usage. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Wire LangSmith tracing and custom metric callbacks into a LangChain 1.0 chain or LangGraph 1.0 agent correctly — env-var spelling, subgraph propagation, per-tenant dimensions, cost and latency…

jeremylongshore/tons-of-skills-marketplace

Wire LangChain 1.0 / LangGraph 1.0 traces into an OpenTelemetry-native backend (Jaeger, Honeycomb, Grafana Tempo, Datadog) with LLM-specific SLOs, safe prompt-content policy, and subgraph-aware span…

jeremylongshore/tons-of-skills-marketplace

Production-grade Langfuse architecture patterns and best practices.

jeremylongshore/tons-of-skills-marketplace

Upgrade Langfuse SDK versions and migrate between API changes.

jeremylongshore/tons-of-skills-marketplace

Create a minimal working Langfuse trace example. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Install and configure Langfuse SDK authentication for LLM observability.

jeremylongshore/tons-of-skills-marketplace

Execute Langfuse primary workflow: Tracing LLM calls and spans.

jeremylongshore/tons-of-skills-marketplace