New: 97,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Official agent skill

Flaky Test Fixer

by DataDog in DataDog/dd-trace-js

A skill your agent uses when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in…

OfficialCustom licenceAuto-check passedTesting & QA

Install Flaky Test Fixer

skills CLI
$ npx skills add DataDog/dd-trace-js --skill flaky-test-fixer -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install DataDog/dd-trace-js flaky-test-fixer --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/DataDog/dd-trace-js.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/flaky-test-fixer .claude/skills/flaky-test-fixer && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
flaky-test-fixer
GitHub stars
836
Token cost
~1.6k tokens
SKILL.md length
887 words
Files
1
Skills in repo
7
Repo updated
First seen
Licence
Custom licence

At a glance

A skill your agent uses when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in…

  • Works in 6 steps: Re-read the current diff and state a… → Write one mechanistic sentence naming… → Before editing, search for every test… → …
  • Fixing a suspected flaky test
  • SKILL.md covers Classify once, Investigate and fix the cause, Hung jobs and Parallel investigation, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Flaky Test Fixer is an agent skill from DataDog/dd-trace-js, published by the product's own GitHub organization. Use when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in dd-trace-js. Classifies infrastructure and deterministic failures before reproduction or code search.

Its SKILL.md is about 1.6k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Testing & QA, covering Failing and flaky tests. It works with Datadog. The repository describes itself as: Datadog APM client for Node.js.

When your agent uses it

  • Fixing a suspected flaky test
  • Intermittent test result
  • Nondeterministic CI test failure
  • Test-order dependency in dd-trace-js

Example prompts

  • “/flaky-test-fixer”

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Re-read the current diff and state a one-line candidate mechanism: “X fails because Y causes Z.” Reproduce
  2. Write one mechanistic sentence naming the producer, consumer, state or event, and invalid ordering or lifetime. It
  3. Before editing, search for every test with the same violated invariant and lifecycle owner. Inventory, count, and
  4. Design the proof, then trace success, error, retry, cleanup, and concurrent paths. Fix the narrowest canonical
  5. Apply the fix to the complete cohort. Stop stray requests, close leaked resources, restore hooks, and remove shared
  6. Verify the original failure without the fix or with a deterministic regression when practical. List every changed

What it can do on your machine

Read from SKILL.md and the folder at commit 8002f70. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Flaky Test Fixer loads about 1.6k tokens when it runs. Until then it costs about 74 tokens; SKILL.md has 887 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~74
When it runs · the whole SKILL.md, loaded when a task matches
~1.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 887 words (~1,614 tokens).

“Establish whether a failure is caused by the current change, deterministic, infrastructure, or genuinely flaky. “Flaky”, “pre-existing”, and “unrelated” are conclusions that require evidence. Treat a failure on the current change as caused by that change until evidence identifies another…”

— opening of SKILL.md by DataDog, Custom licence
name
flaky-test-fixer

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .agents/skills/flaky-test-fixer of DataDog/dd-trace-js.

Open the folder on GitHubat commit 8002f70

Compare with similar skills

Flaky Test Fixer next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Flaky Test Fixer compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Flaky Test Fixer this skillDataDog/dd-trace-js836—~1.6kAutomated safety check: PassCustom licence
Dd Unblock PRDataDog/pup1k—~1.7kAutomated safety check: PassApache-2.0
Analyze Azdo BuildDataDog/dd-trace-dotnet573—~3.5kAutomated safety check: PassApache-2.0
Resolve Muzzle CIDataDog/dd-trace-java736—~3.2kAutomated safety check: PassApache-2.0
Dd Triage Flaky TestDataDog/pup1k1 repos~2.3kAutomated safety check: PassApache-2.0
Fix Broken Datadog Provider TestsDataDog/terraform-provider-datadog468—~2.4kAutomated safety check: NotesMPL-2.0

Similar skills

  • Dd Unblock PR

    DataDog/pup

    Official

    Load when investigating a failing PR CI pipeline or checking PR health.

    1k GitHub stars~1.7k tokensUpdated today
    Testing & QAAuto-check passed

  • Analyze Azdo Build

    DataDog/dd-trace-dotnet

    Official

    Analyze Azure DevOps CI build failures in dd-trace-dotnet pipeline.

    573 GitHub stars~3.5k tokensUpdated today
    Testing & QAAuto-check passed

  • Resolve Muzzle CI

    DataDog/dd-trace-java

    Official

    Diagnose and resolve dd-trace-java CI failures from a module's muzzle task or the runMuzzle aggregate.

    736 GitHub stars~3.2k tokensUpdated today
    Testing & QAAuto-check passed

  • Dd Triage Flaky Test

    DataDog/pup

    Official

    Load when investigating a specific flaky test. An agent skill from DataDog/pup.

    1k GitHub starsUsed in 1 repo~2.3k tokens
    Testing & QAAuto-check passed

  • Fix Broken Datadog Provider Tests

    DataDog/terraform-provider-datadog

    Official

    Runs an end-to-end workflow to diagnose, reproduce, fix and validate a failing integration test in the Datadog Terraform provider, ending with a draft PR.

    468 GitHub stars~2.4k tokensUpdated today
    Testing & QAAuto-check: notes

  • Unblock PR

    datadog-labs/agent-skills

    Load when investigating a failing PR CI pipeline or checking PR health.

    177 GitHub stars~2.7k tokensUpdated 4 days ago
    Testing & QAAuto-check passed

More from DataDog/dd-trace-js

  • Apm Integrations

    DataDog/dd-trace-js

    Official

    A skill your agent uses when adding, debugging, fixing, or modifying instrumentation and plugins for third-party libraries in dd-trace-js.

    836 GitHub stars~3k tokensUpdated today
    Auto-check passed

  • Llmobs Testing

    DataDog/dd-trace-js

    Official

    A skill your agent uses when writing, modifying, or debugging tests for an LLMObs plugin in dd-trace-js.

    836 GitHub stars~2k tokensUpdated today
    Auto-check passed

  • Llmobs Integration

    DataDog/dd-trace-js

    Official

    A skill your agent uses when adding, debugging, or modifying LLMObs plugins for an LLM library in dd-trace-js.

    836 GitHub stars~1.4k tokensUpdated today
    Auto-check passed

  • Serverless Integrations

    DataDog/dd-trace-js

    Official

    A skill your agent uses when adding, modifying, debugging, or reviewing dd-trace-js serverless platform integrations that create root invocation spans for AWS Lambda, Azure Functions, Google Cloud…

    836 GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Architecture Review

    DataDog/dd-trace-js

    Official

    A skill your agent uses when a dd-trace-js change introduces or substantially changes a class hierarchy, module boundary, shared helper layer, public API, or duplicated behavior across multiple types.

    836 GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Test Optimization Testing

    DataDog/dd-trace-js

    Official

    Validate v5 compatibility when adding or modifying Test Optimization or test framework integration tests in dd-trace-js.

    836 GitHub stars~492 tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Flaky Test Fixer

What does Flaky Test Fixer do?

A skill your agent uses when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in…. Flaky Test Fixer is an agent skill from DataDog/dd-trace-js, published by the product's own GitHub organization. Use when classifying, investigating, or fixing a suspected flaky test, intermittent test result, nondeterministic CI test failure, timing race, hang, or test-order dependency in dd-trace-js.

When should I use Flaky Test Fixer?

Flaky Test Fixer fits situations like: fixing a suspected flaky test; intermittent test result; nondeterministic CI test failure; test-order dependency in dd-trace-js.

How do I install Flaky Test Fixer in Claude Code?

Run `npx skills add DataDog/dd-trace-js --skill flaky-test-fixer -a claude-code`. Or copy the skill folder (.agents/skills/flaky-test-fixer in DataDog/dd-trace-js) into .claude/skills/flaky-test-fixer in your project. Claude Code loads it when a task matches its description.

How do I install Flaky Test Fixer in Codex?

Run `npx skills add DataDog/dd-trace-js --skill flaky-test-fixer -a codex`. Or copy the skill folder (.agents/skills/flaky-test-fixer in DataDog/dd-trace-js) into .agents/skills/flaky-test-fixer in your project. Codex loads it when a task matches its description.

Can I use Flaky Test Fixer in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add DataDog/dd-trace-js --skill flaky-test-fixer -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/flaky-test-fixer, .gemini/skills/flaky-test-fixer, .github/skills/flaky-test-fixer and .opencode/skills/flaky-test-fixer in your project.

What does Flaky Test Fixer need to run?

SKILL.md names no scripts, command-line tools or credentials: Flaky Test Fixer is instructions for the agent only.

Does Flaky Test Fixer access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Flaky Test Fixer safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Flaky Test Fixer use?

Flaky Test Fixer has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Flaky Test Fixer use?

About 1.6k tokens (SKILL.md is roughly 6.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Flaky Test Fixer?

Skills that share tags, products or a category with Flaky Test Fixer: Dd Unblock PR (DataDog/pup, 1k stars), Analyze Azdo Build (DataDog/dd-trace-dotnet, 573 stars), Resolve Muzzle CI (DataDog/dd-trace-java, 736 stars) and Dd Triage Flaky Test (DataDog/pup, 1k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Flaky Test Fixer?

DataDog (a GitHub organization, an official publisher) maintains it in DataDog/dd-trace-js, which has 836 GitHub stars. The repository holds 7 skills in this directory. The repository was last updated on October 7, 2026.

Source: DataDog/dd-trace-js on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.