Best failing and flaky tests skills, page 2

Diagnose and fix flaky tests tracked as open kind/flake issues in kubernetes-sigs/agent-sandbox — reproduce the flake, apply a minimal fix, and open a PR linking the issue.

kubernetes-sigs/agent-sandbox

Parse and analyze Visual Studio TRX test result files. An agent skill from microsoft/vstest.

microsoft/vstest

Explains Megatron-LM's CI pipeline, PR scope labels, triggering the internal GitLab CI with a dry run first, and investigating CI failures.

NVIDIA/Megatron-LM

Enforce Sentry React Native SDK test conventions for naming, structure, mocking, and fixtures with Jest.

getsentry/sentry-react-native

Runs Google Test binaries in parallel with gtest-parallel to speed up single-threaded tests, repeat flaky ones and filter specific tests.

webrtc-sdk/webrtc

After a bug is found, traces its root cause and feeds a new testable invariant back into the project spec so the bug class can't recur.

JuliusBrussee/cavekit

A skill your agent uses for ANY bug, error, crash, wrong output, loss divergence, gradient explosion, test failure, CUDA error, distributed training hang, checkpoint load failure, or unexpected…

ByteDance-Seed/VeOmni

Testing CKEditor 5 plugins in the Trilium monorepo. An agent skill from TriliumNext/Trilium.

TriliumNext/Trilium

Local Issue, pull-request, and Wiki workbench for agent skills.

Tencent/SkillHone

A skill your agent uses when the user asks to fix a bug, references a GitHub issue number, or describes an issue and wants a fix.

brunosabot/streamline-card

Testing workflow skill for finding high-value test candidates, writing focused tests, generating realistic workloads, reviewing test value, and diagnosing test-suite health.

workersio/skills

Investigate unexpected behavior and mysterious bugs. An agent skill from avibebuilder/claude-prime.

avibebuilder/claude-prime

Enforce Sentry Dart/Flutter SDK test conventions for naming, structure, and fixtures.

getsentry/sentry-dart

Runs and debugs ONNX Runtime tests: Google Test executables for C++ and unittest or pytest for Python, with filters and build-directory guidance.

microsoft/onnxruntime

Iteratively improves a PR until all review bots (Greptile, Devin, and others) are satisfied with zero unresolved comments, then fixes any CI failures.

ankitvgupta/exo

Analyze current GraalPy periodic job failures for ROTA. An agent skill from oracle/graalpython.

oracle/graalpython

Detects flaky Go tests by analyzing GitHub Actions workflow runs across the last 7 days and all PRs — covering both the run-tests job (unit/integration) and the e2e-test job (gVisor and microVM…

agent-substrate/substrate

Designs and implements testing strategies for any codebase. An agent skill from CloudAI-X/claude-workflow-v2.

CloudAI-X/claude-workflow-v2

A skill your agent uses when investigating a bug, failing test, or unexpected runtime behavior and the mcp-debugger MCP server is available — drives real step-through debuggers (breakpoints, stack…

debugmcp/mcp-debugger

Writes Vitest tests following project patterns: tests/ directories, vi.mock() for module mocking with vi.hoisted() for test-time factories, global LLM mock from src/test/setup.ts, environment…

caliber-ai-org/ai-setup

Debug applications using the dbg CLI debugger. An agent skill from theodo-group/debug-that.

theodo-group/debug-that

Investigates a failing GitHub Actions run or job for Megatron-LM, finds the root cause plus the PR and test author involved, and files a structured bug issue.

NVIDIA/Megatron-LM

Guide for diagnosing GitHub Actions test failures, extracting failed tests from runs, and creating or updating failing-test issues.

microsoft/aspire

Debug Playwright E2E test failures from GitHub Actions CI runs.

quay/quay

Version and release c15t packages with Changesets. An agent skill from c15t/c15t.

c15t/c15t

Analyze Azure DevOps CI build failures in dd-trace-dotnet pipeline.

DataDog/dd-trace-dotnet

Offload bulk judgment calls to Jev (TypeSafe's fast System One model) so Claude doesn't read, and pay for, content it only needs a verdict on.

UditAkhourii/quicksilver

Guides an agent through probing an unfamiliar project's test setup, then choosing a red-light-first testing strategy matched to the task type.

huiliyi37/Tianshu-harness

Analyzes recent CI failures on pull requests to identify flaky tests, using retry outcomes (failed attempt → green re-run) and cross-PR recurrence as evidence, and maintains a local longitudinal…

opsmill/infrahub

Runs the ONNX Runtime transformers Python tests against a GPU wheel and proves the cuDNN flash attention path was used rather than a silent fallback.

microsoft/onnxruntime

Debug and verification workflow for runtime-bundle and module-resolution regressions.

OpenHikmah/openhikmah-web

Investigate and fix flaky/random CI test failures in dotnet/macios.

dotnet/macios

A skill your agent uses when tests have race conditions, timing dependencies, or inconsistent pass/fail behavior - replaces arbitrary timeouts with condition polling to wait for actual state…

sandgardenhq/sgai

Investigate CI failures on PR via gh + Buildkite MCP or bk CLI.

MaterializeInc/materialize

Update ALLOWEDKEYWORDALIASES in ClickHouseSqlUtils.java and ENGINETOTABLETYPE in DatabaseMetaDataImpl.java from failing test output.

ClickHouse/clickhouse-java

Run tests and add Next.js version coverage for the cache handler.

trieb-work/nextjs-turbo-redis-cache

Plan, implement, and debug frontend tests: unit/integration/E2E/visual/a11y.

chongdashu/vibejam-starter-pack

Runs a reproduce, localize, hypothesize, test, fix and verify loop to find a bug's root cause, applies the minimal fix and hands off a regression test.

jsmastery-pro/skills

Adds dotnet/maui-specific context for investigating failing PR checks and broken nightly builds: pipelines, Helix logs, binlogs and merge-readiness verdicts.

dotnet/maui

Reviews a GitHub pull request for correctness, architecture, security, backward compatibility, and test coverage.

webern/cargo-readme

Run the gated test classes that plain pytest skips (slow Docker/sandbox tests, live model-provider API tests, flaky tests, trio variants).

UKGovernmentBEIS/inspect_ai

A skill your agent uses when writing or modifying UE automated tests (Automation, CQTest, Functional, Gauntlet, LowLevel) with Rider MCP available.

JasonMa0012/MooaToon

Diagnose and resolve dd-trace-java CI failures from a module's muzzle task or the runMuzzle aggregate.

DataDog/dd-trace-java

Fix failing pure-stage simulation tests that use asserttracematch() by running the test, reading the trace diff in the failure output, and updating the expected trace using tm helpers from…

pragma-org/amaru

HashQL testing strategies including compiletest (UI tests), unit tests, and snapshot tests.

hashintel/hash

Diagnoses and fixes failing GitHub Actions runs by identifying the failure, fetching only the relevant logs, finding the root cause and reproducing it locally.

ruby-git/ruby-git

Embed a local image file into an existing GitHub PR — either in the PR body or as a comment.

bikeindex/bike_index

Create C bindings for Apple frameworks in dotnet/macios. An agent skill from dotnet/macios.

dotnet/macios