Tracking Regression Tests

What it does

When your agent uses it

• Performing specialized testing
• With phrases like track regressions
• Manage regression suite
• Validate against baseline

Example prompts

• “track regressions”
• “manage regression suite”
• “validate against baseline”
• “/tracking-regression-tests”

Requirements

• Python 3
• Compatibility (from SKILL.md): Designed for Claude Code
• Pre-approved tools (allowed-tools): Read, Write, Edit, Grep, Glob, Bash(test:regression-*)

Workflow steps

7 steps, taken from the first numbered list in SKILL.md.

1. 1Scan the codebase with Grep for bug-fix commits by searching commit messages for patterns like fix:, bugfix, closes #, or Jira ticket IDs.
2. 2For each bug-fix commit, check whether a corresponding regression test exists
3. 3Create a regression test inventory file (regression-tests.json or regression-tests.md) mapping
4. 4Tag existing regression tests with metadata for traceability
5. 5Generate a regression coverage report showing
6. 6Set up a CI check that fails the build if a bug-fix PR does not include at least one regression test.
7. 7Schedule periodic audits (weekly or per-release) to verify all regression tests still pass and remain relevant.

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

• Tool permissions

  Pre-approves these tools, so the agent can use them without asking each time:

  • Read
  • Write
  • Edit
  • Grep
  • Glob
  • Bash(test:regression-*)

  From allowed-tools in the SKILL.md frontmatter.

• Runs code

  Ships 4 files in scripts/ (Python), which the agent can run.

  From the folder's file list and the shell code blocks in SKILL.md.

• Network

  Links to these hosts (documentation or services it may open):

  • docs.pytest.org
  • junit.org
  • jestjs.io
  • martinfowler.com

  From URLs in SKILL.md, links to its own repository left out.

• Credentials

  Names no API keys, tokens, secrets or passwords.

  From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

• Compatibility

  Designed for Claude Code

  From compatibility in the SKILL.md frontmatter.

Context cost

Tracking Regression Tests loads about 1.4k tokens when it runs, and up to ~1.4k if it reads all its reference files. Until then it costs about 57 tokens; SKILL.md has 513 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it

~57

When it runs · the whole SKILL.md, loaded when a task matches

~1.4k

With references · SKILL.md plus every file in references/, read only if the agent opens them

~1.4k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 513 words, ~1,353 tokens.

name

tracking-regression-tests

description

Track and manage regression test suites across releases. Use when performing specialized testing. Trigger with phrases like "track regressions", "manage regression suite", or "validate against baseline".

allowed-tools

Read, Write, Edit, Grep, Glob, Bash(test:regression-*)

compatibility

Designed for Claude Code

version

1.26.0

author

Jeremy Longshore <jeremy@intentsolutions.io>

license

MIT

tags

testing, tracking-regression

import pytest

@pytest.mark.regression
@pytest.mark.bug("GH-1042")  # 1042 = configured value
def test_csv_export_handles_unicode_characters():
    """Regression: GH-1042 -- CSV export crashed on non-ASCII names."""
    result = export_csv([{"name": "Rene"}])
    assert "Rene" in result
    assert result.startswith("name\n")

describe('BUG-789: Cart total calculation', () => {  # 789 = configured value
  it('applies percentage discount before tax', () => {
    const cart = createCart([{ price: 100, qty: 2 }]);
    cart.applyDiscount({ type: 'percent', value: 10 });
    expect(cart.subtotal).toBe(180);
    expect(cart.tax).toBe(18); // 10% tax on discounted subtotal
  });
});

{
  "BUG-1042": {  # 1042 = configured value
    "test_file": "tests/test_export.py::test_csv_export_handles_unicode_characters",
    "severity": "high",
    "added": "2026-01-15",  # 2026 year
    "status": "passing"
  }
}

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 9 other files (scripts, references, assets) in skills/.curated/tracking-regression-tests of jeremylongshore/tons-of-skills-marketplace.

• SKILL.md
• assets/README.md
• assets/config_template.yaml
• assets/example_test_history.json
• assets/test_report_template.md
• references/README.md
• scripts/README.md
• scripts/analyze_test_history.py
• scripts/mark_test_as_regression.py
• scripts/run_regression_tests.py

Open the folder on GitHubat commit cfae287