Official agent skill

Fix Random CI Test Failure

by dotnet in dotnet/macios

Investigate and fix flaky/random CI test failures in dotnet/macios.

OfficialCustom licenceAuto-check passedTesting & QA

Install Fix Random CI Test Failure

skills CLI
$ npx skills add dotnet/macios --skill fix-random-ci-test-failure -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install dotnet/macios fix-random-ci-test-failure --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/dotnet/macios.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.github/skills/fix-random-ci-test-failure .claude/skills/fix-random-ci-test-failure && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
fix-random-ci-test-failure
GitHub stars
2.9k
Token cost
~1.3k tokens
SKILL.md length
631 words
Files
1
Skills in repo
9
Repo updated
First seen
Licence
Custom licence

At a glance

Investigate and fix flaky/random CI test failures in dotnet/macios.

  • Works in 6 steps: Gather Failure Context → Locate and Analyze the Test → Identify Root Cause Category → …
  • GitHub issues describing intermittent test failures
  • SKILL.md covers When to Use, Workflow and Key Patterns in This Repo
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Fix Random CI Test Failure is an agent skill from dotnet/macios, published by the product's own GitHub organization. Investigate and fix flaky/random CI test failures in dotnet/macios. Trigger on GitHub issues describing intermittent test failures, CI postmortem issues, or when asked to fix a flaky test. Analyzes test code, identifies root causes (shared state, environment dependencies, race conditions), and applies fixes.

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Testing & QA, covering Failing and flaky tests. It works with .NET, GitHub, C# and iOS. The repository describes itself as: .NET for iOS, Mac Catalyst, macOS, and tvOS provide open-source bindings of the Apple SDKs for use with .NET managed languages such as C.

When your agent uses it

  • GitHub issues describing intermittent test failures
  • CI postmortem issues
  • Asked to fix a flaky test

Example prompts

  • “/fix-random-ci-test-failure”

Workflow steps

6 steps, taken from the step headings in SKILL.md.

  1. Gather Failure Context
  2. Locate and Analyze the Test
  3. Identify Root Cause Category
  4. Apply the Fix
  5. If the Fix is Unclear
  6. Create the PR

What it can do on your machine

Read from SKILL.md and the folder at commit 354c2a6. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Fix Random CI Test Failure loads about 1.3k tokens when it runs. Until then it costs about 84 tokens; SKILL.md has 631 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~84
When it runs · the whole SKILL.md, loaded when a task matches
~1.3k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 631 words (~1,295 tokens).

“Investigate and fix flaky CI test failures reported in GitHub issues for dotnet/macios.”

— opening of SKILL.md by dotnet, Custom licence
name
fix-random-ci-test-failure

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .github/skills/fix-random-ci-test-failure of dotnet/macios.

Open the folder on GitHubat commit 354c2a6

Compare with similar skills

Fix Random CI Test Failure next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Fix Random CI Test Failure compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Fix Random CI Test Failure this skilldotnet/macios2.9k—~1.3kAutomated safety check: PassCustom licence
MAUI UI Test Writerdotnet/maui23k—~3kAutomated safety check: PassMIT
Release Appyannikzz/narracat-novel-agent103—~1.6kAutomated safety check: NotesAGPL-3.0
CI Fix MonitorZaxbyHub/opencode-swarm490—~551Automated safety check: PassMIT
Kane CLI Browser TestingLambdaTest/kane-cli247—~8.4kAutomated safety check: PassApache-2.0
MAUI CI Investigatordotnet/maui23k—~2kAutomated safety check: PassMIT

Similar skills

  • Official

    Writes UI tests that reproduce a GitHub issue in .NET MAUI and keeps iterating until the tests actually fail, proving they catch the bug.

    23k GitHub stars~3k tokensUpdated today
    Testing & QAAuto-check passed
  • Release App

    yannikzz/narracat-novel-agent

    Cut and publish a new NarraCat-app version — bump the version number, build the Windows x64 package in CI, package + sign + notarize the macOS build locally, and publish both platforms into one…

    103 GitHub stars~1.6k tokensUpdated yesterday
    Testing & QAAuto-check: notes
  • CI Fix Monitor

    ZaxbyHub/opencode-swarm

    Codex adapter for monitoring and fixing CI failures on opencode-swarm PRs.

    490 GitHub stars~551 tokensUpdated yesterday
    Testing & QAAuto-check passed
  • Kane CLI Browser Testing

    LambdaTest/kane-cli

    Drives a real browser through the kane-cli tool and designs requirement-linked test suites from a PRD or a plain description, with mobile and cloud-grid runs.

    247 GitHub stars~8.4k tokensUpdated 3 days ago
    Testing & QAAuto-check passed
  • Official

    Adds dotnet/maui-specific context for investigating failing PR checks and broken nightly builds: pipelines, Helix logs, binlogs and merge-readiness verdicts.

    23k GitHub stars~2k tokensUpdated today
    Testing & QAAuto-check passed
  • Official

    Attempts one alternative fix for a bug, runs the given test command against it and reports what happened, always differing from existing PR fixes.

    23k GitHub stars~8.4k tokensUpdated today
    DevelopmentAuto-check passed

More from dotnet/macios

All 9 skills in this repo
  • Code Review

    dotnet/macios

    Official

    Review dotnet/macios PRs against established rules. An agent skill from dotnet/macios.

    2.9k GitHub stars~1.7k tokensUpdated today
    Auto-check passed
  • Official

    Investigate and triage CI failures for dotnet/macios from Azure DevOps build URLs.

    2.9k GitHub stars~2.3k tokensUpdated today
    Auto-check passed
  • Official

    Update dotnet/macios to a new Xcode beta and validate it end-to-end.

    2.9k GitHub stars~1.8k tokensUpdated today
    Auto-check passed
  • Gh Stack

    dotnet/macios

    Official

    Manage stacked branches and pull requests with the gh-stack GitHub CLI extension.

    2.9k GitHub starsUsed in 3 repos~10k tokens
    Auto-check passed
  • Official

    Create C bindings for Apple frameworks in dotnet/macios. An agent skill from dotnet/macios.

    2.9k GitHub stars~7.3k tokensUpdated today
    Auto-check passed
  • Official

    Post-mortem analysis of CI failures across recent PRs in dotnet/macios.

    2.9k GitHub stars~7.8k tokensUpdated today
    Auto-check passed

Questions about Fix Random CI Test Failure

What does Fix Random CI Test Failure do?

Investigate and fix flaky/random CI test failures in dotnet/macios. Fix Random CI Test Failure is an agent skill from dotnet/macios, published by the product's own GitHub organization. Investigate and fix flaky/random CI test failures in dotnet/macios.

When should I use Fix Random CI Test Failure?

Fix Random CI Test Failure fits situations like: GitHub issues describing intermittent test failures; CI postmortem issues; asked to fix a flaky test.

How do I install Fix Random CI Test Failure in Claude Code?

Run `npx skills add dotnet/macios --skill fix-random-ci-test-failure -a claude-code`. Or copy the skill folder (.github/skills/fix-random-ci-test-failure in dotnet/macios) into .claude/skills/fix-random-ci-test-failure in your project. Claude Code loads it when a task matches its description.

How do I install Fix Random CI Test Failure in Codex?

Run `npx skills add dotnet/macios --skill fix-random-ci-test-failure -a codex`. Or copy the skill folder (.github/skills/fix-random-ci-test-failure in dotnet/macios) into .agents/skills/fix-random-ci-test-failure in your project. Codex loads it when a task matches its description.

Can I use Fix Random CI Test Failure in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add dotnet/macios --skill fix-random-ci-test-failure -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/fix-random-ci-test-failure, .gemini/skills/fix-random-ci-test-failure, .github/skills/fix-random-ci-test-failure and .opencode/skills/fix-random-ci-test-failure in your project.

What does Fix Random CI Test Failure need to run?

SKILL.md names no scripts, command-line tools or credentials: Fix Random CI Test Failure is instructions for the agent only.

Does Fix Random CI Test Failure access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Fix Random CI Test Failure safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Fix Random CI Test Failure use?

Fix Random CI Test Failure has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Fix Random CI Test Failure use?

About 1.3k tokens (SKILL.md is roughly 5.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Fix Random CI Test Failure?

Skills that share tags, products or a category with Fix Random CI Test Failure: MAUI UI Test Writer (dotnet/maui, 23k stars), Release App (yannikzz/narracat-novel-agent, 103 stars), CI Fix Monitor (ZaxbyHub/opencode-swarm, 490 stars) and Kane CLI Browser Testing (LambdaTest/kane-cli, 247 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Fix Random CI Test Failure?

dotnet (a GitHub organization, an official publisher) maintains it in dotnet/macios, which has 2,911 GitHub stars. The repository holds 9 skills in this directory. The repository was last updated on October 8, 2026.

Source: dotnet/macios on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.