Testing & QA · By comet-ml

Investigates a failed Opik end-to-end test from CI, TestOps or a local run, decides regression versus flake, and proposes a fix without editing tests.

comet-ml/opik

Turns a code change into one committed, passing Playwright end-to-end spec by resolving the change scope and handing authoring to a companion skill.

comet-ml/opik

Run a candidate against the baseline over an Opik test suite and read the numbers back — which cases broke, which got fixed, the per-metric deltas, worst rows, and whether the two runs are…

comet-ml/opik-mcp

Procedure for choosing stable selectors when building Page Object Models for the Opik E2E suite by exploring the live UI with the Playwright MCP.

comet-ml/opik

Adds end-to-end Playwright tests to the Opik suite: scopes the feature, explores the live UI, writes a page object and spec, and runs it locally until green.

comet-ml/opik

Decide ship or hold for a candidate from the compare skill's numbers, against an explicit release policy — regressions, pass rate, safety-tagged cases, subgroup consistency, latency and cost…

comet-ml/opik-mcp

Adds a screenshot-comparison test for an Opik UI page, following the project's page-object pattern and deterministic seeding rules.

comet-ml/opik

Turn a failing Opik trace (or a described failure) into a repeatable regression check — a test-suite item with the trace's input and one or two binary assertions — so a fix can be verified by the…

comet-ml/opik-mcp