AI & LLM Engineering · OpenTelemetry · For devops and sre engineers

Give the human an off switch and a cost meter for the coding agents on this machine, using ClawMetry.

vivekchand/clawmetry

当任务需要创建、修改、扩展或重组阿里云 SLS 的 dashboard JSON 或可导入的大盘配置时使用；尤其适用于线上大盘、强对比的分析看板、已校验的查询包，或需要专业中文标签与指标定义的运维向大盘。

alibaba/loongsuite-pilot

Read your own agent telemetry from ClawMetry (waste, progress, cost) and act on it before finishing a task.

vivekchand/clawmetry

Evaluate and score agent behavior against a golden reference.

agentevals-dev/agentevals

Propose an improved version of a prompt registered in a self-hosted AgentX (AgentX-trace-eval) instance, using real low-rated evaluation results as evidence, then publish it as a new version once…

AgentX-ai/AgentX-Trace-Eval

Writes Terraform alerting policies for AI agents that emit OpenTelemetry metrics, covering reliability, cost, safety, security and quality signals on Google Cloud.

google/skills

Inspect and debug live streaming agent sessions to understand what the agent did.

agentevals-dev/agentevals

基于 LoongSuite Pilot / AI Coding Agent 日志生成事件洞察、组织洞察、数据质量、研发效能和 AI Native 使用类 SLS 报表时使用；包含 AI Coding 事件表语义，以及团队报表可选的部门维表、deptuser 组织关系、指标口径和公共 CTE，通常与 sls-dashboard-builder 一起使用。

alibaba/loongsuite-pilot

Open-source AI observability platform for tracing, evaluating, and improving LLM applications with OpenTelemetry integration

Arize-ai/phoenix

Step-by-step guide for adding a new observability/tracing provider to Agent Kernel.

yaalalabs/agent-kernel

Adds Arize AX tracing to an LLM application for the first time.

github/awesome-copilot

Take a working agent prototype to a scalable, observable production deployment on Microsoft Foundry.

microsoft/ai-agents-for-beginners

Take one working agent prototype go scalable, observable production deployment for Microsoft Foundry.

microsoft/ai-agents-for-beginners

Analyze & debug GenAI/LLM apps: token cost & caching by prompt, model & provider; latency/errors; agent & tool loops/failures; conversations; guardrails; evaluations; OpenTelemetry/dt-evals setup.

Dynatrace/dynatrace-for-ai

Wire LangChain 1.0 / LangGraph 1.0 traces into an OpenTelemetry-native backend (Jaeger, Honeycomb, Grafana Tempo, Datadog) with LLM-specific SLOs, safe prompt-content policy, and subgraph-aware span…

jeremylongshore/tons-of-skills-marketplace