Search

Model Context Protocol · comet-ml/opik-mcp

10 skills found.
Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
1

Reference for the Opik SDK — tracing, span types, framework integrations, threads, and the prompt library (Python, TypeScript, REST).

comet-ml/opik-mcp220—~2.1kAutomated safety check: PassApache-2.03 days ago
2

Run a candidate against the baseline over an Opik test suite and read the numbers back — which cases broke, which got fixed, the per-metric deltas, worst rows, and whether the two runs are…

comet-ml/opik-mcp220—~2.6kAutomated safety check: NotesApache-2.03 days ago
3

Surface the Opik traces worth a developer's attention, ranked by signal — Diagnostics issues first, then errors, failed tool calls, latency, regressions, and low online-eval scores.

comet-ml/opik-mcp220—~2.7kAutomated safety check: NotesApache-2.03 days ago
4

Build an LLM evaluation and run it against the app, returning an Opik experiment with scores and its link.

comet-ml/opik-mcp220—~2.5kAutomated safety check: NotesApache-2.03 days ago
5

Add Opik tracing to an existing app and verify a real trace lands.

comet-ml/opik-mcp220—~2.7kAutomated safety check: NotesApache-2.03 days ago
6

Improve a prompt with the Opik Agent Optimizer — resolve the prompt, a dataset, and a metric, pick the algorithm, run a bounded optimization, check the gain on held-out data, and save the winner as…

comet-ml/opik-mcp220—~2.6kAutomated safety check: NotesApache-2.03 days ago
7

Decide ship or hold for a candidate from the compare skill's numbers, against an explicit release policy — regressions, pass rate, safety-tagged cases, subgroup consistency, latency and cost…

comet-ml/opik-mcp220—~2.8kAutomated safety check: NotesApache-2.03 days ago
8

Root-cause a specific Opik trace, or a pattern across traces, and return a grounded explanation.

comet-ml/opik-mcp220—~2.4kAutomated safety check: NotesApache-2.03 days ago
9

Take a judge live on production traffic — create an Opik online evaluation rule (LLM-as-judge or Python metric) on a project with sampling, filters, variable mapping, and a cost cap, then confirm…

comet-ml/opik-mcp220—~3kAutomated safety check: NotesApache-2.03 days ago
10

Turn a failing Opik trace (or a described failure) into a repeatable regression check — a test-suite item with the trace's input and one or two binary assertions — so a fix can be verified by the…

comet-ml/opik-mcp220—~2.8kAutomated safety check: NotesApache-2.03 days ago