New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Quality Engineering Flaky Triage

by HoangNguyen0403 in HoangNguyen0403/agent-skills-standard

Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine.

MITAuto-check passedTesting & QA

Install Quality Engineering Flaky Triage

skills CLI
$ npx skills add HoangNguyen0403/agent-skills-standard --skill quality-engineering-flaky-triage -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install HoangNguyen0403/agent-skills-standard quality-engineering-flaky-triage --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/HoangNguyen0403/agent-skills-standard.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/quality-engineering/quality-engineering-flaky-triage .claude/skills/quality-engineering-flaky-triage && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
quality-engineering-flaky-triage
GitHub stars
572
Token cost
~859 tokens
SKILL.md length
389 words
Files
5 (incl. references)
Skills in repo
211
Repo updated
First seen
Licence
MIT

At a glance

Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine.

  • A test is a QUARANTINECANDIDATE
  • SKILL.md covers Priority: P0 (CRITICAL), Entry, Quarantine Contract and Root-Cause Buckets, plus 6 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Fails without a code change

What it does

Quality Engineering Flaky Triage is an agent skill from HoangNguyen0403/agent-skills-standard. Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine. Use when a test is a QUARANTINECANDIDATE or fails without a code change; not for deterministic failures.

Its SKILL.md is about 860 tokens, which your agent loads only when the skill is triggered. The skill folder holds 6 other files, including reference files (for example `evals/evals.json`, `references/quarantine-ticket-template.md` and `references/reliability-math.md`).

It sits in Testing & QA, covering Root cause analysis and Failing and flaky tests. The repository describes itself as: A collection of Agent Skills Standard and Best Practice for Programming Languages, Frameworks that help our AI Agent follow best practies on frameworks and programming laguages. The licence is MIT.

When your agent uses it

  • A test is a QUARANTINECANDIDATE
  • Fails without a code change
  • Not for deterministic failures

Example prompts

  • “Use the quality-engineering-flaky-triage skill to quarantine an intermittently failing test behind a ticket with an owner and expiry, assigns a…”
  • “/quality-engineering-flaky-triage”

What it can do on your machine

Read from SKILL.md and the folder at commit b529c2d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Quality Engineering Flaky Triage loads about 859 tokens when it runs, and up to ~1.9k if it reads all its reference files. Until then it costs about 80 tokens; SKILL.md has 389 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~80
When it runs · the whole SKILL.md, loaded when a task matches
~859
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.9k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from HoangNguyen0403/agent-skills-standard at commit b529c2d, republished under its MIT licence (© HoangNguyen0403). 389 words, ~859 tokens.

Download SKILL.mdSave it as .claude/skills/quality-engineering-flaky-triage/SKILL.md (or your agent's skills folder). This skill also uses 4 other files; get the full folder from GitHub.
name
quality-engineering-flaky-triage
description
Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine. Use when a test is a QUARANTINE_CANDIDATE or fails without a code change; not for deterministic failures.
guardrail
true

Quality Engineering: Flaky Triage

Priority: P0 (CRITICAL)

Entry

Only a QUARANTINE_CANDIDATE verdict enters triage: the test fails intermittently across isolated reruns with no code change between runs. A deterministic failure is REAL_BUG_DO_NOT_HEAL and goes to dev-fix, never here.

Quarantine Contract

  • Quarantine means the test still runs, its result is reported, and it does not gate merge; it never means test.skip.
  • Every quarantined test carries a ticket with an owner and an expiry of at most 14 days. No ticket, no quarantine.
  • On expiry: fixed and un-quarantined, or expiry extended once with a written reason, or the test is deleted with the coverage gap recorded in the coverage report. Silent expiry is forbidden.
  • Record each entry in flake_quarantine[] as {test, ticket, expiry, bucket} so test-loop carries it in its handoff.

Root-Cause Buckets

ORDER_DEPENDENCE · SHARED_STATE · TIMING · ENVIRONMENT · DATA · PRODUCT_NONDETERMINISM. Assign exactly one from the evidence in Root-Cause Buckets; UNKNOWN is allowed only with the reruns that were tried.

Evidence Required

Run the test alone 10 times sequentially in the foreground. Record pass count, the failing run's artifact, and whether the failure reproduces with a fresh environment. Fewer than 10 isolated runs is not evidence; a pass on plain CI rerun is not evidence.

Un-quarantine

A test leaves quarantine only when the root cause is fixed and it passes 10 consecutive isolated green runs after the fix. Retries, longer timeouts, or a wider matcher are not fixes; they hide the bucket.

Show full SKILL.md (151 more words)Show less

Reliability Impact

Each flaky test counts against suite_reliability_pct in quality-engineering-automation-health until its root cause is fixed; quarantine removes its reds from the merge gate, not from the report. State the quarantine count and the oldest expiry next to release_confidence.

Red Flags

"just add retries: 3" · "skip it for now, we'll come back" · "it passes locally" · "extend the expiry again" — each hides a bucket instead of naming it. Stop, run the 10 isolated reruns, assign the bucket.

Anti-Patterns

  • No skip as quarantine: a skipped test reports nothing; quarantine still runs and reports.
  • No ticketless quarantine: a quarantine without owner and expiry is a permanent skip in disguise.
  • No retry as fix: retries: N is not a fix; it raises the pass rate and leaves the bucket unnamed.
  • No un-quarantine on a single green: 10 consecutive isolated green runs after the fix, or it stays.

References

© HoangNguyen0403, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 4 other files (references) in skills/quality-engineering/quality-engineering-flaky-triage of HoangNguyen0403/agent-skills-standard.

  • SKILL.md
  • evals/evals.json
  • references/quarantine-ticket-template.md
  • references/reliability-math.md
  • references/root-cause-buckets.md

Open the folder on GitHubat commit b529c2d

Compare with similar skills

Quality Engineering Flaky Triage next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Quality Engineering Flaky Triage compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Quality Engineering Flaky Triage this skillHoangNguyen0403/agent-skills-standard572—~859Automated safety check: PassMIT
Pester Failure AnalysisPowerShell/PowerShell56k—~5.1kAutomated safety check: PassMIT
Diagnoseavibebuilder/claude-prime120—~1.2kAutomated safety check: PassMIT
Diagnose a Red Rundifferent-ai/openwork24k—~779Automated safety check: PassCustom licence
Eval Triage And Improvementmicrosoft/eval-guide138—~5.9kAutomated safety check: PassMIT
cmux Package Test Bisectmanaflow-ai/cmux28k—~1.5kAutomated safety check: PassCustom licence

Similar skills

  • Pester Failure Analysis

    PowerShell/PowerShell

    Investigates failing Pester tests in PowerShell CI jobs by following a six-step workflow from pull request status to documented fix recommendations.

    56k GitHub stars~5.1k tokensUpdated yesterday
    Testing & QAAuto-check passed

  • Diagnose

    avibebuilder/claude-prime

    Investigate unexpected behavior and mysterious bugs. An agent skill from avibebuilder/claude-prime.

    120 GitHub stars~1.2k tokensUpdated 4 mo ago
    Testing & QAAuto-check passed

  • Diagnose a Red Run

    different-ai/openwork

    Classifies a failing test, typecheck or CI job before any code changes, by recording the failure and running a clean control to show whether it was already broken.

    24k GitHub stars~779 tokensUpdated today
    Testing & QAAuto-check passed

  • Eval Triage And Improvement

    microsoft/eval-guide

    Official

    A skill your agent uses when the user's Copilot Studio agent evaluations have come back and they need to interpret scores, diagnose root causes of underperforming test cases, find remediation steps…

    138 GitHub stars~5.9k tokensUpdated 3 mo ago
    Testing & QAAuto-check passed

  • cmux Package Test Bisect

    manaflow-ai/cmux

    Finds which commit broke a failing Swift package suite in the cmux repo by bisecting on CI, then judges per test whether it went stale or the code regressed.

    28k GitHub stars~1.5k tokensUpdated today
    Testing & QAAuto-check passed

  • Map Debug

    azalio/map-framework

    Structured MAP debugging via decomposer, actor, and monitor agents.

    156 GitHub stars~4.6k tokensUpdated 4 days ago
    Testing & QAAuto-check passed

More from HoangNguyen0403/agent-skills-standard

All 211 skills in this repo

  • Subagent-Driven Development

    HoangNguyen0403/agent-skills-standard

    Runs a multi-task implementation plan by sending each task to a fresh implementer subagent, reviewing it independently, then reviewing the whole branch.

    572 GitHub stars~1.3k tokensUpdated yesterday
    Auto-check passed

  • draw.io Architecture Diagramming

    HoangNguyen0403/agent-skills-standard

    Draws architecture diagrams as editable draw.io files from a JSON spec, with a fixed house style, one C4 level per diagram and evidence-tagged shapes.

    572 GitHub stars~1.3k tokensUpdated yesterday
    Auto-check passed

  • Android Navigation 3 Guide

    HoangNguyen0403/agent-skills-standard

    Implements and migrates to Jetpack Navigation 3 in Compose: NavDisplay, typed route objects, a state-list back stack, deep links, multiple back stacks and dialog scenes.

    572 GitHub stars~687 tokensUpdated yesterday
    Auto-check passed

  • Angular HttpClient Standards

    HoangNguyen0403/agent-skills-standard

    Sets rules for Angular HTTP code: functional interceptors, typed requests, services that own every call, and httpResource for reactive data loading in Angular 17+.

    572 GitHub stars~652 tokensUpdated yesterday
    Auto-check passed

  • Angular Tooling

    HoangNguyen0403/agent-skills-standard

    Angular CLI usage, code generation, build configuration, and bundle optimization.

    572 GitHub stars~743 tokensUpdated yesterday
    Auto-check passed

  • Common Code Review

    HoangNguyen0403/agent-skills-standard

    Conduct high-quality, persona-driven code reviews. An agent skill from HoangNguyen0403/agent-skills-standard.

    572 GitHub stars~772 tokensUpdated yesterday
    Auto-check passed

Categories

Questions about Quality Engineering Flaky Triage

What does Quality Engineering Flaky Triage do?

Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine. Quality Engineering Flaky Triage is an agent skill from HoangNguyen0403/agent-skills-standard. Quarantines an intermittently failing test behind a ticket with an owner and expiry, assigns a root-cause bucket from isolated reruns, and defines when the test leaves quarantine.

When should I use Quality Engineering Flaky Triage?

Quality Engineering Flaky Triage fits situations like: A test is a QUARANTINECANDIDATE; fails without a code change; not for deterministic failures.

How do I install Quality Engineering Flaky Triage in Claude Code?

Run `npx skills add HoangNguyen0403/agent-skills-standard --skill quality-engineering-flaky-triage -a claude-code`. Or copy the skill folder (skills/quality-engineering/quality-engineering-flaky-triage in HoangNguyen0403/agent-skills-standard) into .claude/skills/quality-engineering-flaky-triage in your project. Claude Code loads it when a task matches its description.

How do I install Quality Engineering Flaky Triage in Codex?

Run `npx skills add HoangNguyen0403/agent-skills-standard --skill quality-engineering-flaky-triage -a codex`. Or copy the skill folder (skills/quality-engineering/quality-engineering-flaky-triage in HoangNguyen0403/agent-skills-standard) into .agents/skills/quality-engineering-flaky-triage in your project. Codex loads it when a task matches its description.

Can I use Quality Engineering Flaky Triage in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add HoangNguyen0403/agent-skills-standard --skill quality-engineering-flaky-triage -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/quality-engineering-flaky-triage, .gemini/skills/quality-engineering-flaky-triage, .github/skills/quality-engineering-flaky-triage and .opencode/skills/quality-engineering-flaky-triage in your project.

What does Quality Engineering Flaky Triage need to run?

SKILL.md names no scripts, command-line tools or credentials: Quality Engineering Flaky Triage is instructions for the agent only.

Does Quality Engineering Flaky Triage access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Quality Engineering Flaky Triage safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Quality Engineering Flaky Triage use?

Quality Engineering Flaky Triage is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Quality Engineering Flaky Triage use?

About 859 tokens (SKILL.md is roughly 3.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 1k tokens, read only when the agent opens those files.

What are the alternatives to Quality Engineering Flaky Triage?

Skills that share tags, products or a category with Quality Engineering Flaky Triage: Pester Failure Analysis (PowerShell/PowerShell, 56k stars), Diagnose (avibebuilder/claude-prime, 120 stars), Diagnose a Red Run (different-ai/openwork, 24k stars) and Eval Triage And Improvement (microsoft/eval-guide, 138 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Quality Engineering Flaky Triage?

HoangNguyen0403 (a GitHub user) maintains it in HoangNguyen0403/agent-skills-standard, which has 572 GitHub stars. The repository holds 211 skills in this directory. The repository was last updated on October 9, 2026.

Source: HoangNguyen0403/agent-skills-standard on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.