Agent skill

Regression Test Runner

by aztfmod in aztfmod/terraform-provider-azurecaf

Run the full CI test suite (make testci), parse output, and report pass/fail with failure details.

MITAuto-check passedTesting & QA

Install Regression Test Runner

skills CLI
$ npx skills add aztfmod/terraform-provider-azurecaf --skill regression-test-runner -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install aztfmod/terraform-provider-azurecaf regression-test-runner --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/aztfmod/terraform-provider-azurecaf.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.github/skills/regression-test-runner .claude/skills/regression-test-runner && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
regression-test-runner
GitHub stars
188
Token cost
~312 tokens
SKILL.md length
70 words
Files
1
Skills in repo
22
Repo updated
First seen
Licence
MIT

At a glance

Run the full CI test suite (make testci), parse output, and report pass/fail with failure details.

  • Works in 5 steps: Run test suite → Parse results → Report → …
  • Post-build verification
  • Calls make
  • Tasks that involve Test generation

What it does

Regression Test Runner is an agent skill from aztfmod/terraform-provider-azurecaf. Run the full CI test suite (make testci), parse output, and report pass/fail with failure details. Use after code changes to verify nothing is broken. Triggers on: code changes, PR validation, post-build verification.

Its SKILL.md is about 310 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Testing & QA, covering Test generation. The repository describes itself as: Terraform provider for the Terraform platform engineering for Azure. The licence is MIT.

When your agent uses it

  • Post-build verification
  • Tasks that involve Test generation

Example prompts

  • “/regression-test-runner”

Workflow steps

5 steps, taken from the step headings in SKILL.md.

  1. Run test suite
  2. Parse results
  3. Report
  4. Coverage check
  5. Cleanup

What it can do on your machine

Read from SKILL.md and the folder at commit ac74615. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • make

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Regression Test Runner loads about 312 tokens when it runs. Until then it costs about 60 tokens; SKILL.md has 70 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~60
When it runs · the whole SKILL.md, loaded when a task matches
~312

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from aztfmod/terraform-provider-azurecaf at commit ac74615, republished under its MIT licence (© aztfmod). 70 words, ~312 tokens.

Download SKILL.mdSave it as .claude/skills/regression-test-runner/SKILL.md (or your agent's skills folder).
name
regression-test-runner
description
Run the full CI test suite (make test_ci), parse output, and report pass/fail with failure details. Use after code changes to verify nothing is broken. Triggers on: code changes, PR validation, post-build verification.

Regression Test Runner

Procedure

1. Run test suite
bash
make test_ci 2>&1 | tee /tmp/test-ci-output.txt

This runs: unit tests, coverage, resource validation, and matrix testing.

2. Parse results

Check exit code:

  • 0: All tests passed
  • Non-zero: Failures detected

Extract summary from output:

bash
grep -E "^(ok|FAIL|---)" /tmp/test-ci-output.txt
3. Report

If all tests pass:

✅ Regression tests: PASSED
   Packages: <count> passed
   Coverage: <percentage>%

If failures detected:

❌ Regression tests: FAILED
   Failed packages:
   - <package>: <failure summary>
   
   Failure details:
   <relevant test output>

Extract the specific test function names and error messages for each failure.

4. Coverage check

Extract coverage percentage:

bash
grep "coverage:" /tmp/test-ci-output.txt | tail -1

Flag if coverage drops below 95%.

5. Cleanup
bash
rm -f /tmp/test-ci-output.txt

© aztfmod, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .github/skills/regression-test-runner of aztfmod/terraform-provider-azurecaf.

Open the folder on GitHubat commit ac74615

Compare with similar skills

Regression Test Runner next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Regression Test Runner compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Regression Test Runner this skillaztfmod/terraform-provider-azurecaf188—~312Automated safety check: PassMIT
Emcaklofas/kicad-happy1.4k1 repos~2.8kAutomated safety check: PassMIT
Swig Testswig/swig6.3k—~2.3kAutomated safety check: PassCustom licence
Generate Test Cases342164796/generate-test-cases1191 repos~2.9kAutomated safety check: PassNone
Verify Cc Safety Netkenryu42/cc-safety-net1.6k—~2kAutomated safety check: PassMIT
Wioworkersio/skills190—~5.8kAutomated safety check: PassMIT

Similar skills

  • Emc

    aklofas/kicad-happy

    EMC pre-compliance risk analysis for KiCad PCB designs — 18 check categories, 44 rule IDs covering ground planes, decoupling, I/O filtering, switching harmonics, clock routing, differential pair…

    1.4k GitHub starsUsed in 1 repo~2.8k tokens
    Testing & QAAuto-check passed
  • Swig Test

    swig/swig

    Run SWIG test suite for specific languages. An agent skill from swig/swig.

    6.3k GitHub stars~2.3k tokensUpdated yesterday
    Testing & QAAuto-check passed
  • Generate Test Cases

    342164796/generate-test-cases

    自主学习型测试文档生成器。从需求文档(Markdown)生成测试用例 XMind 文件,支持持久化记忆和持续学习。当用户提到"生成测试用例"、"根据需求生成测试"时触发。

    119 GitHub starsUsed in 1 repo~2.9k tokens
    Testing & QAAuto-check passed
  • Verify Cc Safety Net

    kenryu42/cc-safety-net

    Launch and drive the real cc-safety-net CLI — the hook decision path, explain, status/doctor, logs, and the local policy GUI — against an isolated home, capturing evidence.

    1.6k GitHub stars~2k tokensUpdated today
    Testing & QAAuto-check passed
  • Wio

    workersio/skills

    Testing workflow skill for finding high-value test candidates, writing focused tests, generating realistic workloads, reviewing test value, and diagnosing test-suite health.

    190 GitHub stars~5.8k tokensUpdated 2 mo ago
    Testing & QAAuto-check passed
  • File Server

    microsoft/WindowsProtocolTestSuites

    Official

    ALWAYS LOAD THIS SKILL when working with FileServer, SMB, SMB2, SMB3, CIFS, file sharing, MS-SMB2, MS-FSCC, MS-FSA, MS-DFSC, MS-FSRVP, MS-RSVD, MS-SQOS, or any file server protocol test…

    567 GitHub stars~4.1k tokensUpdated 22 days ago
    Testing & QAAuto-check passed

More from aztfmod/terraform-provider-azurecaf

All 22 skills in this repo
  • Azure Caf Sync

    aztfmod/terraform-provider-azurecaf

    Fetch the latest CAF abbreviations page from Microsoft Learn and compare against resourceDefinition.json official.slug values.

    188 GitHub stars~464 tokensUpdated 16 days ago
    Auto-check passed
  • Changelog Update

    aztfmod/terraform-provider-azurecaf

    Update CHANGELOG.md with a new entry under the correct section.

    188 GitHub stars~642 tokensUpdated 16 days ago
    Auto-check passed
  • Docs Resource Sync

    aztfmod/terraform-provider-azurecaf

    Ensure documentation files under docs/resources/ and docs/data-sources/ reflect current resource types with accurate examples.

    188 GitHub stars~469 tokensUpdated 16 days ago
    Auto-check passed
  • Issue To Resource Spec

    aztfmod/terraform-provider-azurecaf

    Parse a 'new resource request' GitHub issue and extract the resource type, slug, and naming constraints to produce a draft resourceDefinition.json entry.

    188 GitHub stars~452 tokensUpdated 16 days ago
    Auto-check passed
  • Naming Rules Drift Check

    aztfmod/terraform-provider-azurecaf

    Re-fetch Azure naming rules for a set of resources and compare against current regex/length/scope values in resourceDefinition.json.

    188 GitHub stars~507 tokensUpdated 16 days ago
    Auto-check passed
  • Resource Bulk Import

    aztfmod/terraform-provider-azurecaf

    Accept a list of Azure resource types, batch-research each via azure-naming-research conventions, generate JSON entries, and insert all into resourceDefinition.json.

    188 GitHub stars~476 tokensUpdated 16 days ago
    Auto-check passed

Categories

Questions about Regression Test Runner

What does Regression Test Runner do?

Run the full CI test suite (make testci), parse output, and report pass/fail with failure details. Regression Test Runner is an agent skill from aztfmod/terraform-provider-azurecaf. Run the full CI test suite (make testci), parse output, and report pass/fail with failure details.

When should I use Regression Test Runner?

Regression Test Runner fits situations like: post-build verification; tasks that involve Test generation.

How do I install Regression Test Runner in Claude Code?

Run `npx skills add aztfmod/terraform-provider-azurecaf --skill regression-test-runner -a claude-code`. Or copy the skill folder (.github/skills/regression-test-runner in aztfmod/terraform-provider-azurecaf) into .claude/skills/regression-test-runner in your project. Claude Code loads it when a task matches its description.

How do I install Regression Test Runner in Codex?

Run `npx skills add aztfmod/terraform-provider-azurecaf --skill regression-test-runner -a codex`. Or copy the skill folder (.github/skills/regression-test-runner in aztfmod/terraform-provider-azurecaf) into .agents/skills/regression-test-runner in your project. Codex loads it when a task matches its description.

Can I use Regression Test Runner in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add aztfmod/terraform-provider-azurecaf --skill regression-test-runner -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/regression-test-runner, .gemini/skills/regression-test-runner, .github/skills/regression-test-runner and .opencode/skills/regression-test-runner in your project.

What does Regression Test Runner need to run?

Going by SKILL.md and its folder, Regression Test Runner needs the command-line tools its instructions call (make).

Does Regression Test Runner access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Regression Test Runner safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Regression Test Runner use?

Regression Test Runner is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Regression Test Runner use?

About 312 tokens (SKILL.md is roughly 1.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Regression Test Runner?

Skills that share tags, products or a category with Regression Test Runner: Emc (aklofas/kicad-happy, 1.4k stars), Swig Test (swig/swig, 6.3k stars), Generate Test Cases (342164796/generate-test-cases, 119 stars) and Verify Cc Safety Net (kenryu42/cc-safety-net, 1.6k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Regression Test Runner?

aztfmod (a GitHub organization) maintains it in aztfmod/terraform-provider-azurecaf, which has 188 GitHub stars. The repository holds 22 skills in this directory. The repository was last updated on September 21, 2026.

Source: aztfmod/terraform-provider-azurecaf on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.