Official agent skill

Investigating CI Failures

by PostHog in PostHog/posthog

Investigates a specific CI failure to a verdict: whose fault, which commit, who wrote it, and whether it's fixed.

OfficialCustom licenceAuto-check passedTesting & QA

Install Investigating CI Failures

skills CLI
$ npx skills add PostHog/posthog --skill investigating-ci-failures -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install PostHog/posthog investigating-ci-failures --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/PostHog/posthog.git skills-src && mkdir -p .claude/skills && cp -r skills-src/products/engineering_analytics/skills/investigating-ci-failures .claude/skills/investigating-ci-failures && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
investigating-ci-failures
GitHub stars
40k
Token cost
~2.9k tokens
SKILL.md length
1,417 words
Files
2 (incl. references)
Skills in repo
254
Repo updated
First seen
Licence
Custom licence

At a glance

Investigates a specific CI failure to a verdict: whose fault, which commit, who wrote it, and whether it's fixed.

  • Who broke master
  • SKILL.md covers Start wide: what's broken…, The four failure shapes, Trunk break → culprit and Flaky → corroborate, don't guess, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Why did this test fail in CI

What it does

Investigating CI Failures is an agent skill from PostHog/posthog, published by the product's own GitHub organization. Investigates a specific CI failure to a verdict: whose fault, which commit, who wrote it, and whether it's fixed. Use for "who broke master", "why did this test fail in CI", "is this failure my PR's fault or everyone's", "is this test flaky or actually broken", "when did this failure start". Works from the engineeringanalytics warehouse views (engineeringanalyticscifailures, engineeringanalyticscijobhistory) plus the CI failure logs. Not for aggregate CI health, cost, or merge bottlenecks (use…

Its SKILL.md is about 2.9k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/investigation-queries.md`).

It sits in Testing & QA, covering Failing and flaky tests. The repository describes itself as: :hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error…

When your agent uses it

  • Who broke master
  • Why did this test fail in CI
  • Is this failure my PRs fault
  • Is this test flaky

Example prompts

  • “s fixed. Use for”
  • “why did this test fail in CI”
  • “is this failure my PR”
  • “/investigating-ci-failures”

Requirements

  • Docker

What it can do on your machine

Read from SKILL.md and the folder at commit c012c8d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Investigating CI Failures loads about 2.9k tokens when it runs, and up to ~5.1k if it reads all its reference files. Until then it costs about 164 tokens; SKILL.md has 1,417 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~164
When it runs · the whole SKILL.md, loaded when a task matches
~2.9k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~5.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,417 words (~2,851 tokens).

“The job: take one failing test or one red run and get to a verdict a developer can act on — yours / trunk-borne / flaky, and when trunk-borne: the culprit SHA, its author, the PR, and whether a fix…”

— opening of SKILL.md by PostHog, Custom licence
name
investigating-ci-failures

Read the full SKILL.md on GitHub

Files

SKILL.md and 1 other file (references) in products/engineering_analytics/skills/investigating-ci-failures of PostHog/posthog.

  • SKILL.md
  • references/investigation-queries.md

Open the folder on GitHubat commit c012c8d

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders. This page covers the copy in PostHog/posthog, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Investigating CI Failures next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Investigating CI Failures compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Investigating CI Failures this skillPostHog/posthog40k—~2.9kAutomated safety check: PassCustom licence
Swig Testswig/swig6.3k—~2.3kAutomated safety check: PassCustom licence
Triage CI FailureDataDog/datadog-agent3.8k—~2.3kAutomated safety check: PassApache-2.0
Dynamo Jira TicketDynamoDS/Dynamo2k—~1.1kAutomated safety check: PassApache-2.0
Fix Ready PRsfastrepl/anarlog9.5k—~1.4kAutomated safety check: PassMIT
Trx Analysismicrosoft/vstest969—~1.8kAutomated safety check: PassMIT

Similar skills

  • Swig Test

    swig/swig

    Run SWIG test suite for specific languages. An agent skill from swig/swig.

    6.3k GitHub stars~2.3k tokensUpdated 3 days ago
    Testing & QAAuto-check passed
  • Triage CI Failure

    DataDog/datadog-agent

    Official

    Classify a failed CI as either caused by an active incident, flakiness, or a true code regression.

    3.8k GitHub stars~2.3k tokensUpdated today
    Testing & QAAuto-check passed
  • Dynamo Jira Ticket

    DynamoDS/Dynamo

    Create structured Jira tickets for Dynamo from bug reports, failing tests, or feature requests.

    2k GitHub stars~1.1k tokensUpdated today
    Testing & QAAuto-check passed
  • Fix Ready PRs

    fastrepl/anarlog

    Inspect every open non-draft PR for CI failures and unresolved Cursor Bugbot findings, then fix them on the existing PR branches.

    9.5k GitHub stars~1.4k tokensUpdated today
    Testing & QAAuto-check passed
  • Trx Analysis

    microsoft/vstest

    Official

    Parse and analyze Visual Studio TRX test result files. An agent skill from microsoft/vstest.

    969 GitHub stars~1.8k tokensUpdated yesterday
    Testing & QAAuto-check passed
  • Wio

    workersio/skills

    Testing workflow skill for finding high-value test candidates, writing focused tests, generating realistic workloads, reviewing test value, and diagnosing test-suite health.

    204 GitHub stars~5.8k tokensUpdated 2 mo ago
    Testing & QAAuto-check passed

More from PostHog/posthog

All 254 skills in this repo
  • Authoring Log Alerts

    PostHog/posthog

    Official

    Author useful, low-noise log alerts on services in a PostHog project.

    40k GitHub stars~3k tokensUpdated today
    Auto-check passed
  • Official

    Operating procedure for the conflict-autoresolver agent: sweep open PostHog/posthog PRs that conflict with master, resolve the trivial conflicts (generated artifacts deterministically, source…

    40k GitHub stars~4.2k tokensUpdated today
    Auto-check passed
  • Official

    Help users debug PostHog Error Tracking stack-trace symbolication for any supported platform — JavaScript/TypeScript web, React Native (Hermes), Android (Proguard / R8), or iOS / macOS (dSYM).

    40k GitHub stars~2.2k tokensUpdated today
    Auto-check passed
  • Exploring Apm Traces

    PostHog/posthog

    Official

    Investigates distributed application performance using PostHog APM (OpenTelemetry span) data via MCP.

    40k GitHub stars~3.5k tokensUpdated today
    Auto-check passed
  • Exploring LLM Traces

    PostHog/posthog

    Official

    Debug and inspect LLM/AI agent traces using PostHog's MCP tools.

    40k GitHub stars~4.4k tokensUpdated today
    Auto-check passed
  • Investigate Metric

    PostHog/posthog

    Official

    Diagnose why a product metric changed (dropped, spiked, or plateaued) by orchestrating breakdowns, actors, paths, lifecycle, retention, and annotations queries.

    40k GitHub stars~1.9k tokensUpdated today
    Auto-check passed

Categories

Questions about Investigating CI Failures

What does Investigating CI Failures do?

Investigates a specific CI failure to a verdict: whose fault, which commit, who wrote it, and whether it's fixed. Investigating CI Failures is an agent skill from PostHog/posthog, published by the product's own GitHub organization. Investigates a specific CI failure to a verdict: whose fault, which commit, who wrote it, and whether it's fixed.

When should I use Investigating CI Failures?

Investigating CI Failures fits situations like: who broke master; why did this test fail in CI; is this failure my PRs fault; is this test flaky.

How do I install Investigating CI Failures in Claude Code?

Run `npx skills add PostHog/posthog --skill investigating-ci-failures -a claude-code`. Or copy the skill folder (products/engineering_analytics/skills/investigating-ci-failures in PostHog/posthog) into .claude/skills/investigating-ci-failures in your project. Claude Code loads it when a task matches its description.

How do I install Investigating CI Failures in Codex?

Run `npx skills add PostHog/posthog --skill investigating-ci-failures -a codex`. Or copy the skill folder (products/engineering_analytics/skills/investigating-ci-failures in PostHog/posthog) into .agents/skills/investigating-ci-failures in your project. Codex loads it when a task matches its description.

Can I use Investigating CI Failures in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add PostHog/posthog --skill investigating-ci-failures -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/investigating-ci-failures, .gemini/skills/investigating-ci-failures, .github/skills/investigating-ci-failures and .opencode/skills/investigating-ci-failures in your project.

What does Investigating CI Failures need to run?

SKILL.md names no scripts, command-line tools or credentials: Investigating CI Failures is instructions for the agent only. Our summary lists: Docker.

Does Investigating CI Failures access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Investigating CI Failures safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Investigating CI Failures use?

Investigating CI Failures has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Investigating CI Failures use?

About 2.9k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 2.3k tokens, read only when the agent opens those files.

What are the alternatives to Investigating CI Failures?

Skills that share tags, products or a category with Investigating CI Failures: Swig Test (swig/swig, 6.3k stars), Triage CI Failure (DataDog/datadog-agent, 3.8k stars), Dynamo Jira Ticket (DynamoDS/Dynamo, 2k stars) and Fix Ready PRs (fastrepl/anarlog, 9.5k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Investigating CI Failures?

PostHog (a GitHub organization, an official publisher) maintains it in PostHog/posthog, which has 40,209 GitHub stars. The repository holds 254 skills in this directory. The repository was last updated on October 10, 2026.

Source: PostHog/posthog on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.