Agent skill

CI Watchdog

by latitude-dev in latitude-dev/latitude-llm

Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass.

MITAuto-check passedDevOps & Cloud

Install CI Watchdog

skills CLI
$ npx skills add latitude-dev/latitude-llm --skill ci-watchdog -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install latitude-dev/latitude-llm ci-watchdog --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/latitude-dev/latitude-llm.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/ci-watchdog .claude/skills/ci-watchdog && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
ci-watchdog
GitHub stars
4.7k
Token cost
~1.6k tokens
SKILL.md length
455 words
Files
2 (incl. scripts)
Skills in repo
28
Repo updated
First seen
Licence
MIT

At a glance

Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass.

  • Works in 6 steps: Monitor - Watch PR checks until they… → Detect - Identify which checks failed → Diagnose - Fetch logs and understand the… → …
  • : - The user wants to keep an eye on CI
  • SKILL.md covers Quick Start, Core Workflow, Usage Patterns and Failure Patterns & Fixes, plus 6 more sections
  • Runs Python scripts from its folder; calls gh and python

What it does

CI Watchdog is an agent skill from latitude-dev/latitude-llm. Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass. USE THIS SKILL when: - The user wants to "keep an eye on CI" or "wait for checks to pass" - The user mentions monitoring PR status, CI status, or GitHub checks - The user asks to watch a PR until it's ready or fix failing checks - After pushing commits, the user wants to ensure CI stays green - The user mentions automated fix loops for CI failures This skill handles watching GitHub Actions (or other CI) checks…

Its SKILL.md is about 1.6k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including scripts (for example `scripts/parse_failures.py`).

It sits in DevOps & Cloud, covering Failing and flaky tests and CI/CD. It works with GitHub and GitHub Actions. The repository describes itself as: Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces. The licence is MIT.

When your agent uses it

  • : - The user wants to keep an eye on CI
  • Wait for checks to pass - The user mentions monitoring PR status
  • GitHub checks - The user asks to watch a PR until its ready
  • Fix failing checks - After pushing commits

Example prompts

  • “keep an eye on CI”
  • “wait for checks to pass”
  • “/ci-watchdog”

Requirements

  • Python 3

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Monitor - Watch PR checks until they complete or fail
  2. Detect - Identify which checks failed
  3. Diagnose - Fetch logs and understand the failure
  4. Fix - Apply appropriate fixes to the codebase
  5. Commit - Stage, commit, and push fixes
  6. Repeat - Go back to monitoring until all pass

What it can do on your machine

Read from SKILL.md and the folder at commit 87e8aa0. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/ (Python), which the agent can run.

    Shell commands in SKILL.md call:

    • gh
    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use gh, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

CI Watchdog loads about 1.6k tokens when it runs. Until then it costs about 174 tokens; SKILL.md has 455 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~174
When it runs · the whole SKILL.md, loaded when a task matches
~1.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from latitude-dev/latitude-llm at commit 87e8aa0, republished under its MIT licence (© latitude-dev). 455 words, ~1,551 tokens.

Download SKILL.mdSave it as .claude/skills/ci-watchdog/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
ci-watchdog
description
Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass. USE THIS SKILL when: - The user wants to "keep an eye on CI" or "wait for checks to pass" - The user mentions monitoring PR status, CI status, or GitHub checks - The user asks to watch a PR until it's ready or fix failing checks - After pushing commits, the user wants to ensure CI stays green - The user mentions automated fix loops for CI failures This skill handles watching GitHub Actions (or other CI) checks, detecting failures, diagnosing issues from logs, and applying fixes in a loop until all checks pass. Works with GitHub CLI (gh) and common CI systems like GitHub Actions.

CI Watchdog

Monitor a GitHub PR's CI checks continuously, automatically fix failures, and loop until everything passes.

Quick Start

bash
# Watch current PR until all checks pass (auto-fix enabled)
gh pr checks --watch --fail-fast

# Watch with auto-fix loop
ci-watchdog --fix --loop

Core Workflow

The CI watchdog follows this loop:

  1. Monitor - Watch PR checks until they complete or fail
  2. Detect - Identify which checks failed
  3. Diagnose - Fetch logs and understand the failure
  4. Fix - Apply appropriate fixes to the codebase
  5. Commit - Stage, commit, and push fixes
  6. Repeat - Go back to monitoring until all pass

Usage Patterns

Basic Watch Mode

Just monitor without fixing:

bash
gh pr checks --watch

Monitor and automatically fix issues:

LOOP:
  1. Run: gh pr checks --watch --fail-fast
  2. IF checks pass → DONE
  3. IF checks fail:
     a. Identify failed check names
     b. Fetch logs: gh run view <run-id> --log-failed
     c. Analyze error patterns
     d. Apply fixes to codebase
     e. Commit and push
     f. GOTO LOOP

Failure Patterns & Fixes

Type Errors / Lint Errors

Detection: typecheck, lint, check, pyright, tsgo failures

Common fixes:

  • Read the specific file and line from error output
  • Fix the type mismatch or syntax error
  • Remove references to deleted/renamed properties
  • Add missing imports or type annotations

Example flow:

bash
# Check failed with pyright errors in file X
python -m pyright src/path/to/file.py 2>&1 | head -30
# → Shows specific line/column errors
# → Fix the issues
# → Commit and push
Test Failures

Detection: test check failures

Common fixes:

  • Read the failing test file
  • Update test assertions to match new behavior
  • Remove obsolete test cases
  • Fix test data/setup issues

Example flow:

bash
# Tests failed
# Read the test file mentioned in error
# Update assertions or remove obsolete tests
# Commit and push
Build Failures

Detection: build, bundle, compile failures

Common fixes:

  • Check for missing dependencies
  • Fix import errors
  • Resolve circular dependencies
  • Update build configuration
Missing References

Detection: Errors about missing attributes, properties, or imports

Example:

error: Cannot access attribute "name" for class "X"
Attribute "name" is unknown

Fix:

  1. Find all references to the removed/renamed attribute
  2. Remove or update those references
  3. Check related files (processors, handlers, tests)

Reference: GitHub CLI Commands

Check Status
bash
# List current checks
gh pr checks

# Watch until complete (blocks)
gh pr checks --watch

# Watch and exit immediately on failure
gh pr checks --watch --fail-fast
View Logs
bash
# View failed check logs
gh run view <run-id> --log-failed

# View specific job
gh run view --job=<job-id>
PR Operations
bash
# View current PR
gh pr view

# Push changes
gh push

# Create PR (if needed)
gh pr create --draft --title "..." --body "..."

Iteration Guidelines

When fixing CI failures:

  1. Fix minimal changes - Don't over-fix; address just the reported error
  2. Commit after each fix - Keep commits atomic and focused
  3. Use Conventional Commits - fix(scope): description or test(scope): description
  4. Watch for cascading failures - One fix may reveal new failures
  5. Know when to stop - If stuck after 3-5 iterations, ask the user
Show full SKILL.md (163 more words)Show less

Common CI Check Names

Typical checks to watch for:

  • check / lint - General linting
  • typecheck / type-check - TypeScript/Python type checking
  • test / tests - Test suite
  • build - Build verification
  • knip - Dead code detection
  • format - Code formatting

Example Session

User: "Watch this PR and fix any issues until CI passes"

→ Start: gh pr checks --watch --fail-fast
→ Wait for completion...
→ FAILED: pyright errors in latitude_span_processor.py

→ Read the failing file
→ Identify: references to removed 'name' attribute
→ Fix: Remove the name handling code
→ Commit: "fix(telemetry): remove name handling from processor"
→ Push

→ Restart: gh pr checks --watch --fail-fast
→ Wait...
→ FAILED: test failures in capture_test.py

→ Read test file
→ Identify: tests checking ctx.name which no longer exists
→ Fix: Remove ctx.name assertions
→ Commit: "test(telemetry): update tests for removed name field"
→ Push

→ Restart: gh pr checks --watch --fail-fast
→ Wait...
→ ALL PASSED ✓
→ Done!

Edge Cases

CI Taking Too Long
  • Some checks run for 10+ minutes
  • Use --watch to avoid polling manually
  • The --fail-fast flag exits immediately on first failure
Intermittent Failures
  • Flaky tests may pass on retry
  • If same failure repeats 3+ times, it's likely real
Required vs Optional Checks
  • Some checks may be "required" for merge
  • Others may be informational only
  • Focus on fixing required checks first
No Write Access
  • If you can't push fixes, report issues to user instead
  • Provide specific fix suggestions with code snippets

Safety Guidelines

  • Never force push (--force) unless explicitly requested
  • Never rewrite history on shared branches
  • Always create new commits for fixes (don't amend)
  • If stuck on a failure you can't fix, ask the user for help
  • Don't merge the PR yourself unless explicitly asked

© latitude-dev, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (scripts) in .agents/skills/ci-watchdog of latitude-dev/latitude-llm.

  • SKILL.md
  • scripts/parse_failures.py

Open the folder on GitHubat commit 87e8aa0

Compare with similar skills

CI Watchdog next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

CI Watchdog compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
CI Watchdog this skilllatitude-dev/latitude-llm4.7k—~1.6kAutomated safety check: PassMIT
Megatron-LM CI Failure TriageNVIDIA/Megatron-LM18k—~1.6kAutomated safety check: PassApache-2.0
Parallel CI Triagespencerpauly/awesome-cursor-skills841—~793Automated safety check: PassCC0-1.0
Gh Fix CIJetBrains/skills3637 repos~953Automated safety check: PassApache-2.0
Openai Gh Fix CItrailofbits/skills-curated512—~955Automated safety check: NotesCC-BY-SA-4.0
ONNX Runtime CI Managementmicrosoft/onnxruntime22k—~4.1kAutomated safety check: PassMIT

Similar skills

  • Official

    Investigates a failing GitHub Actions run or job for Megatron-LM, finds the root cause plus the PR and test author involved, and files a structured bug issue.

    18k GitHub stars~1.6k tokensUpdated today
    DevOps & CloudAuto-check passed
  • Parallel CI Triage

    spencerpauly/awesome-cursor-skills

    When GitHub Actions fails, fetch failing job logs and assign each failing job to a separate subagent that fixes its slice of the problem in parallel.

    841 GitHub stars~793 tokensUpdated 2 mo ago
    DevOps & CloudAuto-check passed
  • Gh Fix CI

    JetBrains/skills

    Official

    A skill your agent uses when a user asks to debug or fix failing GitHub PR checks that run in GitHub Actions; use gh to inspect checks and logs, summarize failure context, draft a fix plan, and…

    363 GitHub starsUsed in 7 repos~953 tokens
    DevOps & CloudAuto-check passed
  • Openai Gh Fix CI

    trailofbits/skills-curated

    Official

    A skill your agent uses when a user asks to debug or fix failing GitHub PR checks that run in GitHub Actions; use gh to inspect checks and logs, summarize failure context, draft a fix plan, and…

    512 GitHub stars~955 tokensUpdated 2 mo ago
    DevOps & CloudAuto-check: notes
  • ONNX Runtime CI Management

    microsoft/onnxruntime

    Official

    Triggers, re-runs and unblocks the CI checks on an ONNX Runtime pull request, after diagnosing whether a failure is transient or needs a code change.

    22k GitHub stars~4.1k tokensUpdated today
    DevOps & CloudAuto-check passed
  • Diagnoses and fixes failing GitHub Actions runs by identifying the failure, fetching only the relevant logs, finding the root cause and reproducing it locally.

    1.8k GitHub stars~1.9k tokensUpdated 5 days ago
    DevOps & CloudAuto-check passed

More from latitude-dev/latitude-llm

All 28 skills in this repo
  • Better Auth Best Practices

    latitude-dev/latitude-llm

    Configure Better Auth server and client, set up database adapters, manage sessions, add plugins, and handle environment variables.

    4.7k GitHub starsUsed in 7 repos~1.6k tokens
    Auto-check passed
  • Artifact Designer

    latitude-dev/latitude-llm

    Create, validate, preview, and publish self-contained HTML artifacts.

    4.7k GitHub stars~1.1k tokensUpdated yesterday
    Auto-check passed
  • Temporal Developer

    latitude-dev/latitude-llm

    This skill should be used when the user asks to "create a Temporal workflow", "write a Temporal activity", "debug stuck workflow", "fix non-determinism error", "Temporal Python", "Temporal…

    4.7k GitHub stars~1.5k tokensUpdated yesterday
    Auto-check passed
  • Docs

    latitude-dev/latitude-llm

    Review the current conversation context and git changes, then persist durable repository knowledge into dev-docs/.md by domain and into AGENTS.md for cross-cutting repo rules.

    4.7k GitHub stars~2.5k tokensUpdated yesterday
    Auto-check passed
  • Managing Maintenance Windows

    latitude-dev/latitude-llm

    Enables or disables Latitude production maintenance mode by redirecting all publicly exposed production services to the Better Stack status page.

    4.7k GitHub stars~802 tokensUpdated yesterday
    Auto-check passed
  • Mintlify Preview

    latitude-dev/latitude-llm

    Run the public Mintlify product docs site locally for live preview.

    4.7k GitHub stars~813 tokensUpdated yesterday
    Auto-check passed

Questions about CI Watchdog

What does CI Watchdog do?

Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass. CI Watchdog is an agent skill from latitude-dev/latitude-llm. Continuously monitor GitHub PR CI checks and automatically fix failures until all checks pass.

When should I use CI Watchdog?

CI Watchdog fits situations like: : - The user wants to keep an eye on CI; wait for checks to pass - The user mentions monitoring PR status; GitHub checks - The user asks to watch a PR until its ready; fix failing checks - After pushing commits.

How do I install CI Watchdog in Claude Code?

Run `npx skills add latitude-dev/latitude-llm --skill ci-watchdog -a claude-code`. Or copy the skill folder (.agents/skills/ci-watchdog in latitude-dev/latitude-llm) into .claude/skills/ci-watchdog in your project. Claude Code loads it when a task matches its description.

How do I install CI Watchdog in Codex?

Run `npx skills add latitude-dev/latitude-llm --skill ci-watchdog -a codex`. Or copy the skill folder (.agents/skills/ci-watchdog in latitude-dev/latitude-llm) into .agents/skills/ci-watchdog in your project. Codex loads it when a task matches its description.

Can I use CI Watchdog in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add latitude-dev/latitude-llm --skill ci-watchdog -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ci-watchdog, .gemini/skills/ci-watchdog, .github/skills/ci-watchdog and .opencode/skills/ci-watchdog in your project.

What does CI Watchdog need to run?

Going by SKILL.md and its folder, CI Watchdog needs Python for the scripts in its folder and the command-line tools its instructions call (gh and python). Our summary lists: Python 3.

Does CI Watchdog access the network?

SKILL.md contains no URLs. Its commands use gh, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is CI Watchdog safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does CI Watchdog use?

CI Watchdog is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does CI Watchdog use?

About 1.6k tokens (SKILL.md is roughly 6.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to CI Watchdog?

Skills that share tags, products or a category with CI Watchdog: Megatron-LM CI Failure Triage (NVIDIA/Megatron-LM, 18k stars), Parallel CI Triage (spencerpauly/awesome-cursor-skills, 841 stars), Gh Fix CI (JetBrains/skills, 363 stars) and Openai Gh Fix CI (trailofbits/skills-curated, 512 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains CI Watchdog?

latitude-dev (a GitHub organization) maintains it in latitude-dev/latitude-llm, which has 4,712 GitHub stars. The repository holds 28 skills in this directory. The repository was last updated on October 6, 2026.

Source: latitude-dev/latitude-llm on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.