Datadog Query Recipes
langfuse/langfuse
Research Langfuse production telemetry with reusable Datadog queries.
A skill your agent uses when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js.
Install Llmobs Testing
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install DataDog/dd-trace-js llmobs-testing --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/llmobs-testing .claude/skills/llmobs-testing && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .claude/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testingType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install DataDog/dd-trace-js llmobs-testing --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/llmobs-testing .agents/skills/llmobs-testing && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .agents/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install DataDog/dd-trace-js llmobs-testing --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/llmobs-testing .cursor/skills/llmobs-testing && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .cursor/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/DataDog/dd-trace-js.git --path .agents/skills/llmobs-testing--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install DataDog/dd-trace-js llmobs-testing --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/llmobs-testing .gemini/skills/llmobs-testing && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .gemini/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install DataDog/dd-trace-js llmobs-testingInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/llmobs-testing .github/skills/llmobs-testing && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .github/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add DataDog/dd-trace-js --skill llmobs-testing -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install DataDog/dd-trace-js llmobs-testing --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/llmobs-testing .opencode/skills/llmobs-testing && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "llmobs-testing" agent skill from https://github.com/DataDog/dd-trace-js/tree/master/.agents/skills/llmobs-testing into .opencode/skills/llmobs-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "llmobs-testing", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
llmobs-testing- GitHub stars
- 836
- Token cost
- ~2k tokens
- SKILL.md length
- 917 words
- Files
- 5 (incl. references)
- Skills in repo
- 7
- Repo updated
- First seen
- Licence
- Custom licence
At a glance
A skill your agent uses when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js.
- Works in 4 steps: Test Structure → VCR Cassettes → Response Strategy And Operation Kind → …
- Debugging tests for an LLMObs plugin in dd-trace-js
- SKILL.md covers Decide how each instrumented…, Core Testing Concepts, Test File Organization and Span Kinds And The Fields They…, plus 1 more section
- Calls docker
What it does
Llmobs Testing is an agent skill from DataDog/dd-trace-js, published by the product's own GitHub organization. Use when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js. Triggers: "write LLMObs tests", "test an LLMObs plugin", "assertLlmObsSpanEvent", "useLlmObs", "getEvents", any MOCK matcher ("MOCKSTRING" / "MOCKNOTNULLISH" / "MOCKNUMBER" / "MOCKOBJECT"), "VCR cassette", "vcr proxy", "127.0.0.1:9126", "record a cassette", "test:llmobs:plugins".
Its SKILL.md is about 2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 5 other files, including reference files (for example `references/assertion-helpers.md`, `references/category-strategies.md` and `references/test-structure.md`).
It sits in AI & LLM Engineering. It works with Datadog. The repository describes itself as: Datadog APM client for Node.js.
When your agent uses it
- Debugging tests for an LLMObs plugin in dd-trace-js
Example prompts
- “write LLMObs tests”
- “test an LLMObs plugin”
- “assertLlmObsSpanEvent”
- “/llmobs-testing”
Requirements
- Docker
Workflow steps
4 steps, taken from the step headings in SKILL.md.
- Test Structure
- VCR Cassettes
- Response Strategy And Operation Kind
- Assertion Patterns
What it can do on your machine
Read from SKILL.md and the folder at commit a76ecb2. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
docker
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md. Its commands use docker, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Llmobs Testing loads about 2k tokens when it runs, and up to ~8.5k if it reads all its reference files. Until then it costs about 97 tokens; SKILL.md has 917 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 917 words (~2,035 tokens).
“That choice picks the response source and test setup — cassettes for a workflow record nothing, while pure-function tests for a provider-backed call miss the network surface entirely. The operation independently determines its span kind and fields. These are working…”
- name
- llmobs-testing
Files
SKILL.md and 4 other files (references) in .agents/skills/llmobs-testing of DataDog/dd-trace-js.
- SKILL.md
- references/assertion-helpers.md
- references/category-strategies.md
- references/test-structure.md
- references/vcr-cassettes.md
Open the folder on GitHubat commit a76ecb2
Compare with similar skills
Llmobs Testing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Llmobs Testing this skillDataDog/dd-trace-js | 836 | — | ~2k | Automated safety check: Pass | Custom licence | |
| Datadog Query Recipeslangfuse/langfuse | 36k | — | ~824 | Automated safety check: Pass | Custom licence | |
| Datadogolasunkanmi-SE/codebuddy | 141 | — | ~1.4k | Automated safety check: Pass | MIT | |
| Weekly Production Reviewlangfuse/langfuse | 36k | — | ~4.1k | Automated safety check: Pass | Custom licence | |
| Debug Issue With Datadoglangfuse/langfuse | 36k | — | ~1.6k | Automated safety check: Pass | Custom licence | |
| Dd Instrument Llmodatadog-labs/agent-skills | 177 | — | ~2.9k | Automated safety check: Pass | MIT |
Similar skills
Datadog
olasunkanmi-SE/codebuddy
Query metrics, manage monitors, post events, and interact with Datadog via the dogshell CLI.
Weekly Production Review
langfuse/langfuse
Prepare Langfuse weekly production reviews covering failures, fixes, open issues, and tracking gaps.
Debug Issue With Datadog
langfuse/langfuse
Establish root cause by combining Datadog telemetry with the Langfuse repo.
Dd Instrument Llmo
datadog-labs/agent-skills
Instrument the current project with Datadog LLM Observability for Python or Node.js/Next.js backends that call LLMs or run AI agents.
Dd Product Recommender
datadog-labs/agent-skills
Recommends the right Datadog products for a codebase and/or a stated goal — grounded in a tech-stack→product map and a use-case→product map built from Datadog product capabilities and common…
More from DataDog/dd-trace-js
- Official
Apm Integrations
DataDog/dd-trace-js
A skill your agent uses when adding, debugging, fixing, or modifying instrumentation and plugins for third-party libraries in dd-trace-js.
- Official
Llmobs Integration
DataDog/dd-trace-js
A skill your agent uses when adding, debugging, or modifying LLMObs plugins for an LLM library in dd-trace-js.
- Official
Serverless Integrations
DataDog/dd-trace-js
A skill your agent uses when adding, modifying, debugging, or reviewing dd-trace-js serverless platform integrations that create root invocation spans for AWS Lambda, Azure Functions, Google Cloud…
- Official
Architecture Review
DataDog/dd-trace-js
A skill your agent uses when a dd-trace-js change introduces or substantially changes a class hierarchy, module boundary, shared helper layer, public API, or duplicated behavior across multiple types.
- Official
Flaky Test Fixer
DataDog/dd-trace-js
A skill your agent uses when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in…
- Official
Test Optimization Testing
DataDog/dd-trace-js
Validate v5 compatibility when adding or modifying Test Optimization or test framework integration tests in dd-trace-js.
Related
Works with
Categories
Questions about Llmobs Testing
What does Llmobs Testing do?
A skill your agent uses when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js. Llmobs Testing is an agent skill from DataDog/dd-trace-js, published by the product's own GitHub organization. Use when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js.
When should I use Llmobs Testing?
Llmobs Testing fits situations like: debugging tests for an LLMObs plugin in dd-trace-js.
How do I install Llmobs Testing in Claude Code?
Run `npx skills add DataDog/dd-trace-js --skill llmobs-testing -a claude-code`. Or copy the skill folder (.agents/skills/llmobs-testing in DataDog/dd-trace-js) into .claude/skills/llmobs-testing in your project. Claude Code loads it when a task matches its description.
How do I install Llmobs Testing in Codex?
Run `npx skills add DataDog/dd-trace-js --skill llmobs-testing -a codex`. Or copy the skill folder (.agents/skills/llmobs-testing in DataDog/dd-trace-js) into .agents/skills/llmobs-testing in your project. Codex loads it when a task matches its description.
Can I use Llmobs Testing in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add DataDog/dd-trace-js --skill llmobs-testing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/llmobs-testing, .gemini/skills/llmobs-testing, .github/skills/llmobs-testing and .opencode/skills/llmobs-testing in your project.
What does Llmobs Testing need to run?
Going by SKILL.md and its folder, Llmobs Testing needs the command-line tools its instructions call (docker). Our summary lists: Docker.
Does Llmobs Testing access the network?
SKILL.md contains no URLs. Its commands use docker, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Is Llmobs Testing safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Llmobs Testing use?
Llmobs Testing has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.
How many tokens does Llmobs Testing use?
About 2k tokens (SKILL.md is roughly 8.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 6.5k tokens, read only when the agent opens those files.
What are the alternatives to Llmobs Testing?
Skills that share tags, products or a category with Llmobs Testing: Datadog Query Recipes (langfuse/langfuse, 36k stars), Datadog (olasunkanmi-SE/codebuddy, 141 stars), Weekly Production Review (langfuse/langfuse, 36k stars) and Debug Issue With Datadog (langfuse/langfuse, 36k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Llmobs Testing?
DataDog (a GitHub organization, an official publisher) maintains it in DataDog/dd-trace-js, which has 836 GitHub stars. The repository holds 7 skills in this directory. The repository was last updated on October 8, 2026.
Source: DataDog/dd-trace-js on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.