Failproof AI SDK Integration
FailproofAI/failproofai
Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.
Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call.
$ npx skills add comet-ml/opik --skill opik-integrations -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install comet-ml/opik opik-integrations --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/opik-integrations .claude/skills/opik-integrations && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .claude/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrationsType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add comet-ml/opik --skill opik-integrations -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install comet-ml/opik opik-integrations --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/opik-integrations .agents/skills/opik-integrations && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .agents/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add comet-ml/opik --skill opik-integrations -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install comet-ml/opik opik-integrations --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/opik-integrations .cursor/skills/opik-integrations && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .cursor/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/comet-ml/opik.git --path .agents/skills/opik-integrations--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add comet-ml/opik --skill opik-integrations -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install comet-ml/opik opik-integrations --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/opik-integrations .gemini/skills/opik-integrations && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .gemini/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install comet-ml/opik opik-integrationsInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add comet-ml/opik --skill opik-integrations -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/opik-integrations .github/skills/opik-integrations && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .github/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add comet-ml/opik --skill opik-integrations -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install comet-ml/opik opik-integrations --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/opik-integrations .opencode/skills/opik-integrations && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "opik-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-integrations into .opencode/skills/opik-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-integrations", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
opik-integrationsBuilds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call.
This skill is for contributors editing the Opik SDK itself, the code in sdks/python and sdks/typescript that lets users trace frameworks such as OpenAI, LangChain or Mistral with one call. It is distinct from the skills that add Opik tracing to someone else's application, and integrations that live outside the repo go to opik-external-integrations.
It begins with a questionnaire and never suggests a target: what to integrate with reference links, where it lives, the language (Python, TypeScript or both), the mode (new, update or maintain) and any specific flows to cover. The modes cover a framework with no dedicated integration yet, updates that follow new methods, fields or upstream changes, and verifying that the trace and span tree is still right after a dependency bump or refactor.
By default the work runs autonomously: it prepares dependencies, credentials and a backend, investigates the target library's API surface, hooks, streaming shape, usage format and errors, collects findings and a minimal example script, verifies itself, and ends with a high-level report, stopping early only on a true blocker. An interactive variant lets you approve the design first. Guides for Python and TypeScript and a workflow file with the Opik-MCP verification loop are included.
9 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit f217a86. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Opik SDK Integrations loads about 1.4k tokens when it runs. Until then it costs about 78 tokens; SKILL.md has 692 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from comet-ml/opik at commit f217a86, republished under its Apache-2.0 licence (© comet-ml). 692 words, ~1,427 tokens.
.claude/skills/opik-integrations/SKILL.md (or your agent's skills folder). This skill also uses 3 other files; get the full folder from GitHub.This skill is for building integrations into the Opik SDK itself — the code that ships inside opik / opik-* packages so that users can trace a framework (OpenAI, LangChain, Mistral, …) with one call.
Do not confuse this with the user-facing
instrument/opikskills, which add Opik tracing to someone else's application. This skill is for SDK contributors editingsdks/pythonandsdks/typescript.If the integration lives outside this repo — a standalone
opik-*package, or Opik support contributed into a third-party project (LiteLLM, Dify, a plugin, …) — use theopik-external-integrationsskill instead. This skill assumes the code ships insidesdks/.
Never assume or suggest a target. Collect, from the user, before doing anything: what to integrate (name + reference links), where it lives (this repo vs. external — route external requests to opik-external-integrations), language (python/typescript/both), mode (new/update/maintain), and any specific flows to cover. Do not present a menu of candidate libraries — the user names the target.
Integration work is multi-step. By default this skill runs autonomously: it makes its own preparations (deps, credentials, backend), runs every phase, self-verifies, and ends with a high-level report — only stopping early on a true blocker. Ask for the interactive variant if you want to approve the design before any code is written. The full playbook — phases, execution modes, the Opik-MCP verification loop, and the report template — lives in workflow.md. At a glance:
read/list the trace & spans).Never build an integration from a blank file. Identify the existing integration that shares the target's mechanism, copy its structure, and adapt. The decision tree:
| Target shape | Python pattern | TS pattern | Clone from |
|---|---|---|---|
| SDK client with methods to wrap (most providers) | Method patching (BaseTrackDecorator subclass) | Proxy wrapper | openai/ · opik-openai |
| Framework with a callback/tracer interface | Pure callback (BaseTracer) | Callback handler | langchain/ · opik-langchain |
| Framework already emitting OpenTelemetry spans | OTel | OTel exporter | otel/ · opik-vercel |
| Callbacks exist but are unreliable / need method hooks too | Hybrid | (rare) | adk/ |
If the target exposes an OpenAI-compatible endpoint, first check whether track_openai(..., provider=...) already covers the need before building a dedicated integration — sometimes the right answer is a docs page, not new code.
OpenTelemetry is backend-first. If the target already emits OpenTelemetry spans, the heavy lifting is done by Opik's OTLP ingestion endpoint on the backend — many such integrations are docs-only (point the framework's OTLP exporter at Opik with auth headers; no SDK code). Build a client-side piece only when you must shape what the backend receives — set Opik semantics, remap attributes, or bridge a framework that won't export raw OTLP. The client-side building block is a SpanProcessor in Python (integrations/otel/) or a SpanExporter in TypeScript (opik-vercel); a framework-specific OTel tracer wrapper (adk/patchers/adk_otel_tracer/) is the heavier variant. See the OTel sections in python.md / typescript.md.
sdks/typescript/design/INTEGRATIONS.md.python-sdk — three-layer architecture, batching, fake_backend, testlib verifiers, error handling.typescript-sdk — layered client, flush semantics, testing with vitest.write-docs — Fern MDX authoring, routing YAML, callouts, images.© comet-ml, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 3 other files in .agents/skills/opik-integrations of comet-ml/opik.
Open the folder on GitHubat commit f217a86
Opik SDK Integrations next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Opik SDK Integrations this skillcomet-ml/opik | 22k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | |
| Failproof AI SDK IntegrationFailproofAI/failproofai | 5.3k | — | ~6k | Automated safety check: Pass | Custom licence | |
| Langchain Dependencieslangchain-ai/langchain-skills | 1.3k | 1 repos | ~3.6k | Automated safety check: Pass | MIT | |
| Phoenix Tracinggithub/awesome-copilot | 40k | 3 repos | ~1.6k | Automated safety check: Pass | Apache-2.0 | |
| Phoenix Integration SnippetsArize-ai/phoenix | 12k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | |
| Phoenix Skills AuditArize-ai/phoenix | 12k | — | ~5.1k | Automated safety check: Pass | Custom licence |
FailproofAI/failproofai
Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.
langchain-ai/langchain-skills
INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents.
github/awesome-copilot
OpenInference semantic conventions and instrumentation for Phoenix AI observability.
Arize-ai/phoenix
Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.
Arize-ai/phoenix
Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…
soba-labs/langchain-agent-skills
A skill your agent uses when you need to test or evaluate LangGraph/LangChain agents: writing unit or integration tests, generating test scaffolds, mocking LLM/tool behavior, running trajectory…
comet-ml/opik
Checklist for wiring a new linter into Opik's Code Quality pipeline: the four files to edit, the silent-failure gotchas and the pass/fail verification loop.
comet-ml/opik
Shows how to add product analytics events to Opik's frontend, Java backend and Python SDK, all reporting through Segment to PostHog with an opik_ name prefix.
comet-ml/opik
Investigates a failed Opik end-to-end test from CI, TestOps or a local run, decides regression versus flake, and proposes a fix without editing tests.
comet-ml/opik
Rules for writing PR descriptions, changelog entries and feature documentation in the Opik repository, including the exact headings that CI requires.
comet-ml/opik
Turns a code change into one committed, passing Playwright end-to-end spec by resolving the change scope and handing authoring to a companion skill.
comet-ml/opik
Starts, rebuilds, and troubleshoots the Opik local dev stack, including an optional Comet Platform integration mode for the Opik team.
Works with
Categories
Builds, updates and verifies integrations inside the Opik Python and TypeScript SDKs so users can trace a framework or provider with one call. This skill is for contributors editing the Opik SDK itself, the code in sdks/python and sdks/typescript that lets users trace frameworks such as OpenAI, LangChain or Mistral with one call. It is distinct from the skills that add Opik tracing to someone else's application, and integrations that live outside the repo go to opik-external-integrations.
Opik SDK Integrations fits situations like: adding a new framework or provider integration to the Opik SDK; updating an integration to capture new fields or follow an upstream change; verifying an integration still logs the correct trace and span tree after a dependency bump; documenting and testing an SDK integration in Python or TypeScript.
Run `npx skills add comet-ml/opik --skill opik-integrations -a claude-code`. Or copy the skill folder (.agents/skills/opik-integrations in comet-ml/opik) into .claude/skills/opik-integrations in your project. Claude Code loads it when a task matches its description.
Run `npx skills add comet-ml/opik --skill opik-integrations -a codex`. Or copy the skill folder (.agents/skills/opik-integrations in comet-ml/opik) into .agents/skills/opik-integrations in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add comet-ml/opik --skill opik-integrations -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/opik-integrations, .gemini/skills/opik-integrations, .github/skills/opik-integrations and .opencode/skills/opik-integrations in your project.
SKILL.md names no scripts, command-line tools or credentials: Opik SDK Integrations is instructions for the agent only. Our summary lists: A checkout of the Opik repository with its Python and TypeScript SDKs; Credentials for the target library and a backend the Opik MCP can read.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Opik SDK Integrations is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.4k tokens (SKILL.md is roughly 5.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Opik SDK Integrations: Failproof AI SDK Integration (FailproofAI/failproofai, 5.3k stars), Langchain Dependencies (langchain-ai/langchain-skills, 1.3k stars), Phoenix Tracing (github/awesome-copilot, 40k stars) and Phoenix Integration Snippets (Arize-ai/phoenix, 12k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
comet-ml (a GitHub organization) maintains it in comet-ml/opik, which has 22,412 GitHub stars. The repository holds 19 skills in this directory. The repository was last updated on October 7, 2026.
Source: comet-ml/opik on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.