AI & LLM Engineering · By comet-ml

Scaffold a brand-new Comet example in this repo from the canonical template under templates/integration-example/.

comet-ml/comet-examples

Starts, rebuilds, and troubleshoots the Opik local dev stack, including an optional Comet Platform integration mode for the Opik team.

comet-ml/opik

Reference for the Opik SDK — tracing, span types, framework integrations, threads, and the prompt library (Python, TypeScript, REST).

comet-ml/opik-mcp

Build an LLM evaluation and run it against the app, returning an Opik experiment with scores and its link.

comet-ml/opik-mcp

Developer notes for working inside the Opik Python SDK: layered design, async versus blocking calls, integration styles, batching and dependency rules.

comet-ml/opik

Add Opik tracing to an existing app and verify a real trace lands.

comet-ml/opik-mcp

Improve a prompt with the Opik Agent Optimizer — resolve the prompt, a dataset, and a metric, pick the algorithm, run a bounded optimization, check the gain on held-out data, and save the winner as…

comet-ml/opik-mcp

Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify.

comet-ml/opik

Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call.

comet-ml/opik

Documents the Opik TypeScript SDK's layered architecture, flush and batching rules, and error-handling conventions for anyone changing code under sdks/typescript.

comet-ml/opik

Take a judge live on production traffic — create an Opik online evaluation rule (LLM-as-judge or Python metric) on a project with sampling, filters, variable mapping, and a cost cap, then confirm…

comet-ml/opik-mcp