Failing and flaky tests

Triage a flaky Playwright test end to end, from a Sippy signal to a written fix proposal: Sippy numbers and failing run URLs, Prow artifacts (or the access gap), the spec, a local reproduction, and…

quay/quay

Guides systematic root-cause debugging. An agent skill from abashev/vfs-s3.

abashev/vfs-s3

Investigates a failing RustPython test by comparing it with CPython, then either fixes it or gathers the details for an incompatibility report.

RustPython/RustPython

Inspect every open non-draft PR for CI failures and unresolved Cursor Bugbot findings, then fix them on the existing PR branches.

fastrepl/anarlog

Log genuine, recurring repository friction to .agents/PAPERCUTS.md — confusing setup, a flaky repo command or script, a misleading in-repo error, stale generated files, or a non-obvious gotcha that…

every-app/open-seo

Write, run, and debug WebDriverIO (WDIO) UI tests for the Ansible VS Code extension.

ansible/vscode-ansible

Diagnose and fix flaky tests tracked as open kind/flake issues in kubernetes-sigs/agent-sandbox — reproduce the flake, apply a minimal fix, and open a PR linking the issue.

kubernetes-sigs/agent-sandbox

Parse and analyze Visual Studio TRX test result files. An agent skill from microsoft/vstest.

microsoft/vstest

Build, compile, run server/client/cluster, execute unit/stateless/SQL tests, verify results, and troubleshoot build/test failures.

timeplus-io/proton

Enforce Sentry React Native SDK test conventions for naming, structure, mocking, and fixtures with Jest.

getsentry/sentry-react-native

Runs Google Test binaries in parallel with gtest-parallel to speed up single-threaded tests, repeat flaky ones and filter specific tests.

webrtc-sdk/webrtc

Testing workflow skill for finding high-value test candidates, writing focused tests, generating realistic workloads, reviewing test value, and diagnosing test-suite health.

workersio/skills

After a bug is found, traces its root cause and feeds a new testable invariant back into the project spec so the bug class can't recur.

JuliusBrussee/cavekit

A skill your agent uses for ANY bug, error, crash, wrong output, loss divergence, gradient explosion, test failure, CUDA error, distributed training hang, checkpoint load failure, or unexpected…

ByteDance-Seed/VeOmni

Local Issue, pull-request, and Wiki workbench for agent skills.

Tencent/SkillHone

A skill your agent uses when the user asks to fix a bug, references a GitHub issue number, or describes an issue and wants a fix.

brunosabot/streamline-card

Testing CKEditor 5 plugins in the Trilium monorepo. An agent skill from TriliumNext/Trilium.

TriliumNext/Trilium

Enforce Sentry Dart/Flutter SDK test conventions for naming, structure, and fixtures.

getsentry/sentry-dart

Runs and debugs ONNX Runtime tests: Google Test executables for C++ and unittest or pytest for Python, with filters and build-directory guidance.

microsoft/onnxruntime

Iteratively improves a PR until all review bots (Greptile, Devin, and others) are satisfied with zero unresolved comments, then fixes any CI failures.

ankitvgupta/exo

Detects flaky Go tests by analyzing GitHub Actions workflow runs across the last 7 days and all PRs — covering both the run-tests job (unit/integration) and the e2e-test job (gVisor and microVM…

agent-substrate/substrate

Analyze current GraalPy periodic job failures for ROTA. An agent skill from oracle/graalpython.

oracle/graalpython

Expertise in analyzing flake github issues in the flutter/flutter repository.

flutter/flutter

Analyze Azure DevOps CI build failures in dd-trace-dotnet pipeline.

DataDog/dd-trace-dotnet

Designs and implements testing strategies for any codebase. An agent skill from CloudAI-X/claude-workflow-v2.

CloudAI-X/claude-workflow-v2

A skill your agent uses when investigating a bug, failing test, or unexpected runtime behavior and the mcp-debugger MCP server is available — drives real step-through debuggers (breakpoints, stack…

debugmcp/mcp-debugger

Writes Vitest tests following project patterns: tests/ directories, vi.mock() for module mocking with vi.hoisted() for test-time factories, global LLM mock from src/test/setup.ts, environment…

caliber-ai-org/ai-setup

Debug applications using the dbg CLI debugger. An agent skill from theodo-group/debug-that.

theodo-group/debug-that

Offload bulk judgment calls to Jev (TypeSafe's fast System One model) so Claude doesn't read, and pay for, content it only needs a verdict on.

UditAkhourii/quicksilver

Guide for diagnosing GitHub Actions test failures, extracting failed tests from runs, and creating or updating failing-test issues.

microsoft/aspire

Debug Playwright E2E test failures from GitHub Actions CI runs.

quay/quay

Triage failing GitHub PR checks: list failures with gh, fetch capped Actions logs, skip non-Actions checks, and summarize root cause.

Mentra-Community/MentraOS

Version and release c15t packages with Changesets. An agent skill from c15t/c15t.

c15t/c15t

Guides an agent through probing an unfamiliar project's test setup, then choosing a red-light-first testing strategy matched to the task type.

huiliyi37/Tianshu-harness

Analyzes recent CI failures on pull requests to identify flaky tests, using retry outcomes (failed attempt → green re-run) and cross-PR recurrence as evidence, and maintains a local longitudinal…

opsmill/infrahub

Runs the ONNX Runtime transformers Python tests against a GPU wheel and proves the cuDNN flash attention path was used rather than a silent fallback.

microsoft/onnxruntime

Investigate and fix flaky/random CI test failures in dotnet/macios.

dotnet/macios

Investigate CI failures on PR via gh + Buildkite MCP or bk CLI.

MaterializeInc/materialize

Update ALLOWEDKEYWORDALIASES in ClickHouseSqlUtils.java and ENGINETOTABLETYPE in DatabaseMetaDataImpl.java from failing test output.

ClickHouse/clickhouse-java

Run tests and add Next.js version coverage for the cache handler.

trieb-work/nextjs-turbo-redis-cache

Runs a reproduce, localize, hypothesize, test, fix and verify loop to find a bug's root cause, applies the minimal fix and hands off a regression test.

jsmastery-pro/skills

Plan, implement, and debug frontend tests: unit/integration/E2E/visual/a11y.

chongdashu/vibejam-starter-pack

Structured coding workflow for non-trivial code work: debug, build features, refactor, optimize, migrate and review code through 7 steps with evidence-based quality gates.

HoangTheQuyen/think-better

Adds dotnet/maui-specific context for investigating failing PR checks and broken nightly builds: pipelines, Helix logs, binlogs and merge-readiness verdicts.

dotnet/maui

Run a local pnpm monorepo CI loop, fix failures, and stop only when the full sequence is green.

gronxb/hot-updater

Reviews a GitHub pull request for correctness, architecture, security, backward compatibility, and test coverage.

webern/cargo-readme

Run the gated test classes that plain pytest skips (slow Docker/sandbox tests, live model-provider API tests, flaky tests, trio variants).

UKGovernmentBEIS/inspect_ai

A skill your agent uses when writing or modifying UE automated tests (Automation, CQTest, Functional, Gauntlet, LowLevel) with Rider MCP available.

JasonMa0012/MooaToon