Failproof AI SDK Integration
FailproofAI/failproofai
Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.
Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify.
$ npx skills add comet-ml/opik --skill opik-external-integrations -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install comet-ml/opik opik-external-integrations --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/opik-external-integrations .claude/skills/opik-external-integrations && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .claude/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrationsType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add comet-ml/opik --skill opik-external-integrations -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install comet-ml/opik opik-external-integrations --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/opik-external-integrations .agents/skills/opik-external-integrations && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .agents/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add comet-ml/opik --skill opik-external-integrations -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install comet-ml/opik opik-external-integrations --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/opik-external-integrations .cursor/skills/opik-external-integrations && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .cursor/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/comet-ml/opik.git --path .agents/skills/opik-external-integrations--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add comet-ml/opik --skill opik-external-integrations -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install comet-ml/opik opik-external-integrations --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/opik-external-integrations .gemini/skills/opik-external-integrations && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .gemini/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install comet-ml/opik opik-external-integrationsInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add comet-ml/opik --skill opik-external-integrations -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/opik-external-integrations .github/skills/opik-external-integrations && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .github/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add comet-ml/opik --skill opik-external-integrations -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install comet-ml/opik opik-external-integrations --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/comet-ml/opik.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/opik-external-integrations .opencode/skills/opik-external-integrations && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "opik-external-integrations" agent skill from https://github.com/comet-ml/opik/tree/main/.agents/skills/opik-external-integrations into .opencode/skills/opik-external-integrations/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "opik-external-integrations", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
opik-external-integrationsBuilds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify.
This skill covers Opik integrations whose code lives in another repository. There are two shapes: a standalone opik-* package or plugin that depends on the published Opik SDK, with opik-openclaw and opik-claude-code-plugin as examples, and an upstream contribution that adds Opik support to a third-party project with its own logging, callback or plugin system, such as a callback in LiteLLM or an integration in Dify.
An activation gate limits use to external targets; integrations that ship under sdks/python or sdks/typescript belong to the opik-integrations skill. Two principles apply: follow the host repository's conventions for structure, dependencies, linting, tests and docs, mirroring its closest existing integration, and use Opik only through its published Python or TypeScript SDK or the REST API, never internal modules.
Work starts with a free-form questionnaire covering which external repo or package, the integration shape, the host language and stack, where the Opik code goes, how the host tests and documents, and how to run it to verify. A references file lists known external integrations, including the cookiecutter template and hosts like LiteLLM, Dify and n8n, and a workflow file holds the phases.
2 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit f217a86. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Opik External Integrations loads about 1.3k tokens when it runs. Until then it costs about 100 tokens; SKILL.md has 637 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from comet-ml/opik at commit f217a86, republished under its Apache-2.0 licence (© comet-ml). 637 words, ~1,285 tokens.
.claude/skills/opik-external-integrations/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.This skill builds Opik integrations whose code does not live in this repository. Two shapes:
opik-* package / plugin — its own repo or package that depends on the published Opik SDK. Examples: opik-openclaw, opik-claude-code-plugin.Activation gate — read this first. Use this skill only when the target lives in an external repo or external package. If the user wants an integration that ships inside
sdks/python/src/opik/integrations/orsdks/typescript/src/opik/integrations/, this is the wrong skill — useopik-integrations. When in doubt, ask the "where does it live" question (below) and route accordingly.
sdks/ layout, fake_backend, or Fern docs on an external repo. Read its CONTRIBUTING/AGENTS.md and mirror its closest existing integration/plugin.opik (Python) / opik (TypeScript) SDK or the REST API — the same surface end users get. Never import this repo's internal modules (opik.decorator.*, rest_api, message-processing internals); they are not available outside this repo and are not a stable contract.Collect everything up front, free-form — do not propose a target. See workflow.md Phase 0 for the full list. The essentials: which external repo/package (URL + links), integration shape (standalone package vs. upstream contribution vs. plugin), host language/stack, where the Opik code goes, how the host tests and documents, and how to run it to verify.
Once you know the target, check references.md — a curated list of known external integrations (standalone opik-* plugins incl. the cookiecutter template, and third-party host repos like LiteLLM / Dify / n8n) with their repo and Opik-docs URLs. If the target is listed or resembles one, start from its links and clone the closest sibling instead of researching blind.
Multi-step and autonomous by default (front-load preparation, run through, self-verify, end with a report); ask for the interactive variant to approve the design first. Full playbook in workflow.md. At a glance:
@opik.track / track_* wrappers, the low-level client, or REST. Lean on the opik and instrument skills for the public API.write-docs).The mechanism knowledge is shared — how a provider/framework exposes hooks, streaming, and usage is the same problem as in opik-integrations. Read that skill's python.md / typescript.md for the patterns (method patching, callback handler, OTel), but apply them against the published SDK surface and inside the host repo's structure.
opik / instrument — the user-facing public API surface (the right way to consume Opik from outside).opik-integrations — the integration mechanism patterns (patching / callback / OTel) and field mapping.write-docs — only if you also add an Opik-side docs page pointing at the external integration.© comet-ml, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 2 other files in .agents/skills/opik-external-integrations of comet-ml/opik.
Open the folder on GitHubat commit f217a86
Opik External Integrations next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Opik External Integrations this skillcomet-ml/opik | 22k | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | |
| Failproof AI SDK IntegrationFailproofAI/failproofai | 5.3k | — | ~6k | Automated safety check: Pass | Custom licence | |
| Langchain Dependencieslangchain-ai/langchain-skills | 1.3k | 1 repos | ~3.6k | Automated safety check: Pass | MIT | |
| SEO APIseranking/seo-skills | 160 | — | ~4.1k | Automated safety check: Pass | MIT | |
| Phoenix Tracinggithub/awesome-copilot | 40k | 3 repos | ~1.6k | Automated safety check: Pass | Apache-2.0 | |
| Phoenix Integration SnippetsArize-ai/phoenix | 12k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 |
FailproofAI/failproofai
Helps instrument a custom Python or TypeScript agent to record events for Failproof AI, verify what gets written, and run an evaluator worker that scores the runs.
langchain-ai/langchain-skills
INVOKE THIS SKILL when setting up a new project or when asked about package versions, installation, or dependency management for LangChain, LangGraph, LangSmith, or Deep Agents.
seranking/seo-skills
SE Ranking API integration architect. An agent skill from seranking/seo-skills.
github/awesome-copilot
OpenInference semantic conventions and instrumentation for Phoenix AI observability.
Arize-ai/phoenix
Generates onboarding code snippets for Phoenix tracing integrations and wires them into the project onboarding UI.
Arize-ai/phoenix
Audit recent changes to Phoenix's user-facing surfaces (Python clients, TypeScript clients, CLI, REST/GraphQL APIs) and patch the three external-facing agent skills — phoenix-tracing, phoenix-cli…
comet-ml/opik
Checklist for wiring a new linter into Opik's Code Quality pipeline: the four files to edit, the silent-failure gotchas and the pass/fail verification loop.
comet-ml/opik
Shows how to add product analytics events to Opik's frontend, Java backend and Python SDK, all reporting through Segment to PostHog with an opik_ name prefix.
comet-ml/opik
Investigates a failed Opik end-to-end test from CI, TestOps or a local run, decides regression versus flake, and proposes a fix without editing tests.
comet-ml/opik
Rules for writing PR descriptions, changelog entries and feature documentation in the Opik repository, including the exact headings that CI requires.
comet-ml/opik
Turns a code change into one committed, passing Playwright end-to-end spec by resolving the change scope and handing authoring to a companion skill.
comet-ml/opik
Starts, rebuilds, and troubleshoots the Opik local dev stack, including an optional Comet Platform integration mode for the Opik team.
Works with
Categories
Builds Opik tracing integrations that live outside the Opik repository, either as standalone opik-* packages or as contributions into projects such as LiteLLM or Dify. This skill covers Opik integrations whose code lives in another repository. There are two shapes: a standalone opik-* package or plugin that depends on the published Opik SDK, with opik-openclaw and opik-claude-code-plugin as examples, and an upstream contribution that adds Opik support to a third-party project with its own logging, callback or plugin system, such as a callback in LiteLLM or an integration in Dify.
Opik External Integrations fits situations like: building a standalone opik-* plugin or package for a new agent framework; contributing Opik tracing support into a third-party project; updating an existing external Opik integration after an SDK change; finding the closest existing integration to copy before starting a new one.
Run `npx skills add comet-ml/opik --skill opik-external-integrations -a claude-code`. Or copy the skill folder (.agents/skills/opik-external-integrations in comet-ml/opik) into .claude/skills/opik-external-integrations in your project. Claude Code loads it when a task matches its description.
Run `npx skills add comet-ml/opik --skill opik-external-integrations -a codex`. Or copy the skill folder (.agents/skills/opik-external-integrations in comet-ml/opik) into .agents/skills/opik-external-integrations in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add comet-ml/opik --skill opik-external-integrations -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/opik-external-integrations, .gemini/skills/opik-external-integrations, .github/skills/opik-external-integrations and .opencode/skills/opik-external-integrations in your project.
SKILL.md names no scripts, command-line tools or credentials: Opik External Integrations is instructions for the agent only. Our summary lists: The external repository or package you are targeting, checked out locally; The published Opik Python or TypeScript SDK.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Opik External Integrations is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.3k tokens (SKILL.md is roughly 5.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Opik External Integrations: Failproof AI SDK Integration (FailproofAI/failproofai, 5.3k stars), Langchain Dependencies (langchain-ai/langchain-skills, 1.3k stars), SEO API (seranking/seo-skills, 160 stars) and Phoenix Tracing (github/awesome-copilot, 40k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
comet-ml (a GitHub organization) maintains it in comet-ml/opik, which has 22,412 GitHub stars. The repository holds 19 skills in this directory. The repository was last updated on October 7, 2026.
Source: comet-ml/opik on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.