Evaluate PR Tests
dotnet/maui
Reviews the tests added in a pull request for fix coverage, quality, edge cases and test type, and recommends lighter test types where they would do.
Review a contribution PR for safety, quality, and readiness.
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-review --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/contrib-pr-review .claude/skills/contrib-pr-review && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .claude/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-reviewType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-review --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.claude/skills/contrib-pr-review .agents/skills/contrib-pr-review && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .agents/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-review --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.claude/skills/contrib-pr-review .cursor/skills/contrib-pr-review && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .cursor/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/homeassistant-ai/ha-mcp.git --path .claude/skills/contrib-pr-review--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-review --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.claude/skills/contrib-pr-review .gemini/skills/contrib-pr-review && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .gemini/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-reviewInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .github/skills && cp -r skills-src/.claude/skills/contrib-pr-review .github/skills/contrib-pr-review && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .github/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install homeassistant-ai/ha-mcp contrib-pr-review --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/homeassistant-ai/ha-mcp.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.claude/skills/contrib-pr-review .opencode/skills/contrib-pr-review && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "contrib-pr-review" agent skill from https://github.com/homeassistant-ai/ha-mcp/tree/master/.claude/skills/contrib-pr-review into .opencode/skills/contrib-pr-review/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "contrib-pr-review", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
contrib-pr-reviewReview a contribution PR for safety, quality, and readiness.
Contrib PR Review is an agent skill from homeassistant-ai/ha-mcp. Review a contribution PR for safety, quality, and readiness. Checks for security concerns, test coverage, size appropriateness, and intent alignment. Use when reviewing external contributions.
Its SKILL.md is about 3.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering Pull requests and Test coverage. The repository describes itself as: The Unofficial and Awesome Home Assistant MCP Server. The licence is MIT.
6 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit b274a93. It shows what the files ask for, not the result of running them.
Pre-approves these tools, so the agent can use them without asking each time:
BashReadGrepGlobWebFetchFrom allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
ghjqFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use gh, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Contrib PR Review loads about 3.1k tokens when it runs. Until then it costs about 53 tokens; SKILL.md has 663 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check noted patterns worth knowing about, such as sudo or a known installer.
allowed-tools: Bash, Read, Grep, Glob, WebFetchAutomated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from homeassistant-ai/ha-mcp at commit b274a93, republished under its MIT licence (© homeassistant-ai). 663 words, ~3,053 tokens.
.claude/skills/contrib-pr-review/SKILL.md (or your agent's skills folder).Review PR #$ARGUMENTS from external contributor for safety, quality, and readiness.
PR Metadata:
!`gh pr view $ARGUMENTS --repo homeassistant-ai/ha-mcp --json author,additions,deletions,files,commits,closingIssuesReferences,isDraft,reviews,url,title,body`Contributor Stats:
!`gh api /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS --jq '{author: .user.login, user_id: .user.id}' | jq -r '.author' | xargs -I {} gh api /repos/homeassistant-ai/ha-mcp/contributors --jq '.[] | select(.login == "{}") | {login: .login, contributions: .contributions}'`Files Changed:
!`gh api /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/files --jq '.[] | {filename: .filename, status: .status, additions: .additions, deletions: .deletions, changes: .changes, patch: .patch}' | head -50`Note: Codex (chatgpt-codex-connector[bot]) and CodeRabbit (coderabbitai[bot]) both review PRs automatically. Check whether either flagged security concerns.
# Check both bots' reviews and any security-related comments.
# Their findings can be inline-only, so also fetch the pull review comments
# endpoint — review bodies and conversation comments alone can miss them.
# --paginate: both endpoints page at 30, and an iterating PR outruns that.
gh api --paginate /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/reviews --jq '.[] | select(.user.login == "chatgpt-codex-connector[bot]" or .user.login == "coderabbitai[bot]") | {author: .user.login, state: .state, body: .body}'
gh api --paginate /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/comments --jq '.[] | select(.user.login == "chatgpt-codex-connector[bot]" or .user.login == "coderabbitai[bot]") | {author: .user.login, path: .path, line: .line, body: .body}'
# CodeRabbit posts its walkthrough and summary as a top-level comment, which
# neither endpoint above returns — fetch that channel by author too.
gh api --paginate /repos/homeassistant-ai/ha-mcp/issues/$ARGUMENTS/comments --jq '.[] | select(.user.login == "chatgpt-codex-connector[bot]" or .user.login == "coderabbitai[bot]") | {author: .user.login, body: .body}'
# Keyword scan stays, for humans raising security concerns in conversation.
gh pr view $ARGUMENTS --repo homeassistant-ai/ha-mcp --json comments --jq '.comments[] | select(.body | contains("security") or contains("Security")) | {author: .author.login, body: .body}'If either bot flagged security issues:
If NO bot security flags but you notice concerning patterns:
.github/ workflow modifications with pull_request_target.claude/ agent/skill changes that could affect behaviorIf security assessment passes and PR has workflow changes or new workflows:
# Check current workflow status
gh api /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/requested_reviewers
# Enable workflows if not enabled (requires WRITE permission)
# This command may fail if already enabled - that's OK
gh api -X PUT /repos/homeassistant-ai/ha-mcp/actions/workflows/pr.yml/enable 2>/dev/null || echo "Workflows already enabled or no permission"Pre-existing tests (easier review if modified code is already tested):
# For each modified source file, check if tests exist
gh api /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/files --jq '.[] | select(.filename | startswith("src/")) | .filename' | while read file; do
basename=$(basename "$file" .py)
echo "Checking tests for: $file"
# Method 1: Look for test files by naming convention
find tests/ -name "test_${basename}.py" -o -name "test_*${basename}*.py" 2>/dev/null | head -3
# Method 2: Grep for function/class names from the modified file
# Extract function/class names and search for them in tests
grep -E '^(def|class|async def) [a-zA-Z_]' "$file" 2>/dev/null | head -5 | while read line; do
name=$(echo "$line" | sed -E 's/.*(def|class) ([a-zA-Z_][a-zA-Z0-9_]*).*/\2/')
if [ -n "$name" ]; then
grep -r "$name" tests/ 2>/dev/null | head -1
fi
done
doneNew tests added:
# Check if PR adds or modifies tests
gh api /repos/homeassistant-ai/ha-mcp/pulls/$ARGUMENTS/files --jq '.[] | select(.filename | startswith("tests/")) | {filename: .filename, status: .status, additions: .additions}'Output Test Summary:
🧪 Test Coverage:
- Pre-existing tests: ✅ Modified code has tests / ⚠️ No tests for modified code
- New tests: ✅ PR adds X test files / ⚠️ No new tests
- Assessment: [Easy/Medium/Hard to review based on test coverage]Calculate PR size and assess appropriateness:
# From metadata: additions + deletions
total_lines=$(gh pr view $ARGUMENTS --repo homeassistant-ai/ha-mcp --json additions,deletions --jq '.additions + .deletions')
echo "Total lines changed: $total_lines"
# Get contributor experience
author=$(gh pr view $ARGUMENTS --repo homeassistant-ai/ha-mcp --json author --jq -r '.author.login')
# Check 1: Contributions to this project
project_contributions=$(gh api /repos/homeassistant-ai/ha-mcp/contributors --jq ".[] | select(.login == \"$author\") | .contributions" || echo "0")
# Check 2: Total GitHub commits (overall experience)
total_commits=$(gh api /users/$author --jq '.public_repos + .total_private_repos' 2>/dev/null || echo "unknown")
echo "Contributor: $author"
echo "Project contributions: $project_contributions"
echo "GitHub experience: $total_commits repos"Assess:
First-time to project (0-2 project contributions):
500 lines: 🔴 Too large - suggest splitting
Regular contributor (3+ project contributions):
1000 lines: 🔴 Very large - suggest splitting
Experienced GitHub user (many repos/commits overall):
Output Size Summary:
📏 PR Size:
- Lines changed: [total]
- Contributor: [first-time / regular] ([X] contributions)
- Assessment: [size appropriateness]Check linked issues:
# From metadata: closingIssuesReferences
gh pr view $ARGUMENTS --repo homeassistant-ai/ha-mcp --json closingIssuesReferences --jq '.closingIssuesReferences[] | {number: .number, title: .title}'If issue linked:
If no issue linked:
Output Intent Summary:
🎯 Intent & Linkage:
- Linked issue: #X "title" / ⚠️ No issue linked
- Solves issue: ✅ Fully addresses requirements / ⚠️ Partial / ❌ Doesn't match
- Scope: ✅ Focused / ⚠️ Scope creep detectedNote: Codex and CodeRabbit provide automated code review on all PRs. This step focuses on what they cannot assess:
Breaking change assessment:
Quick checks:
# ruff and mypy run as steps of the "Fast Checks" job
gh pr checks $ARGUMENTS --repo homeassistant-ai/ha-mcp | grep "Fast Checks"
# Check for common issues in diff
gh pr diff $ARGUMENTS --repo homeassistant-ai/ha-mcp | grep -E "(TODO|FIXME|XXX|HACK)"Output Quality Summary:
✨ Code Quality:
- Architecture fit: [assessment - service layer, context engineering]
- Breaking changes: ✅ None / ⚠️ Detected - [describe what's genuinely lost]
- Bot reviews: [check if Codex or CodeRabbit flagged anything critical]After completing all steps, present a short summary of what the PR does and the review findings, then ask: "Should I post this comment to the PR?"
After completing the analysis, draft a comment for the PR following these guidelines:
Comment Length: The contributor should be able to read it in one pass: what works, what must change, and what happens next. A good-to-merge comment is shorter than a changes-needed one.
Style:
Structure for "Good to Merge":
[Positive opening line about the contribution]
[What works well - focus on functionality, tests, architecture]
[Any minor suggestions or notes - optional, technical only]
[Closing line about readiness to merge]Note: Do NOT mention security assessment in comment unless issues were found. Security checks are internal.
Structure for "Changes Needed":
[Positive opening line acknowledging the work]
[Brief summary of the issue being solved]
**[Concern 1]:**
[Short explanation + suggestion - focus on: tests, functionality, architecture, breaking changes]
**[Concern 2]:** (if applicable)
[Short explanation + suggestion]
**[Concern 3]:** (if applicable)
[Short explanation + suggestion]
[Closing line about next steps]Note: Raise security concerns with the user as soon as they are found, not in the final structured comment.
Illustrative example - Good to Merge (match the wording to the PR, not to this text):
Thanks for [feature/fix]. [One specific thing it gets right].
The implementation follows existing patterns and the [specific aspect] is well-designed. [Optional: Minor note about something noticed].
Ready to merge once CI passes.Illustrative example - Changes Needed (match the wording to the PR, not to this text):
Thanks for tackling [problem]. [Metric/impact] shows this addresses a real need.
**Test coverage:**
Missing tests for the new [feature]. Please add a unit test for its logic, and an E2E test for a new tool or for its wiring or Home Assistant behaviour. Performance tests not required.
**[Second concern if applicable]:**
[Brief explanation and request]
Once [change 1] and [change 2] are addressed, this should be good to merge.© homeassistant-ai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .claude/skills/contrib-pr-review of homeassistant-ai/ha-mcp.
Open the folder on GitHubat commit b274a93
Contrib PR Review next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Contrib PR Review this skillhomeassistant-ai/ha-mcp | 5k | — | ~3.1k | Automated safety check: Notes | MIT | |
| Evaluate PR Testsdotnet/maui | 23k | — | ~2.9k | Automated safety check: Pass | MIT | |
| Review Envoy Gateway PRenvoyproxy/gateway | 3.1k | — | ~850 | Automated safety check: Pass | Apache-2.0 | |
| Core Components Code Reviewcore-ds/core-components | 137 | — | ~5.4k | Automated safety check: Pass | MIT | |
| Open PRElite588/AUTOGPT | 103 | — | ~1.3k | Automated safety check: Pass | Custom licence | |
| Docs Syncmicrosoft/apm | 4k | — | ~3k | Automated safety check: Pass | MIT |
dotnet/maui
Reviews the tests added in a pull request for fix coverage, quality, edge cases and test type, and recommends lighter test types where they would do.
envoyproxy/gateway
Review an Envoy Gateway pull request for essential API, implementation, status, and test coverage requirements.
core-ds/core-components
Review a Pull Request or diff in the @alfalab/core-components UI library — correctness bugs, public API/breaking changes, accessibility, keyboard/focus/pointer interaction, component states…
Elite588/AUTOGPT
Open a pull request with proper PR template, test coverage, and review workflow.
microsoft/apm
A skill your agent uses whenever a pull request is opened, reopened, or synchronized in microsoft/apm to assess whether and how the documentation corpus must change to stay truthful with the…
axelixlabs/axelix
Reviews test code in GitHub pull requests for isolation, public-API contract coverage, AAA structure, and correct exception assertions.
homeassistant-ai/ha-mcp
Run bot acceptance tests to validate MCP tools work correctly from a real AI agent's perspective.
homeassistant-ai/ha-mcp
Deep analysis of a single GitHub issue with codebase exploration, implementation planning, and architectural assessment.
homeassistant-ai/ha-mcp
Implement a GitHub issue end-to-end — create a worktree branch, implement the feature with tests, create a draft PR, then iteratively resolve all CI failures and review comments until the PR is clean.
homeassistant-ai/ha-mcp
Manage your own GitHub pull requests — check CI status, inline review comments, PR-level comments, resolve review threads, fix issues, and iterate until all checks pass and threads are resolved.
homeassistant-ai/ha-mcp
Compare MCP tool behavior between target and baseline versions using pre-built and custom stories with diff-based triage.
homeassistant-ai/ha-mcp
Find merged PR authors missing from README and update the contributors list after approval
Categories
Review a contribution PR for safety, quality, and readiness. Contrib PR Review is an agent skill from homeassistant-ai/ha-mcp. Review a contribution PR for safety, quality, and readiness.
Contrib PR Review fits situations like: reviewing external contributions; tasks that involve Pull requests; tasks that involve Test coverage.
Run `npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a claude-code`. Or copy the skill folder (.claude/skills/contrib-pr-review in homeassistant-ai/ha-mcp) into .claude/skills/contrib-pr-review in your project. Claude Code loads it when a task matches its description.
Run `npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a codex`. Or copy the skill folder (.claude/skills/contrib-pr-review in homeassistant-ai/ha-mcp) into .agents/skills/contrib-pr-review in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add homeassistant-ai/ha-mcp --skill contrib-pr-review -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/contrib-pr-review, .gemini/skills/contrib-pr-review, .github/skills/contrib-pr-review and .opencode/skills/contrib-pr-review in your project.
Going by SKILL.md and its folder, Contrib PR Review needs the command-line tools its instructions call (gh and jq). Its frontmatter pre-approves these tools: Bash, Read, Grep, Glob, WebFetch.
SKILL.md contains no URLs. Its commands use gh, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.
Contrib PR Review is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 3.1k tokens (SKILL.md is roughly 12k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Contrib PR Review: Evaluate PR Tests (dotnet/maui, 23k stars), Review Envoy Gateway PR (envoyproxy/gateway, 3.1k stars), Core Components Code Review (core-ds/core-components, 137 stars) and Open PR (Elite588/AUTOGPT, 103 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
homeassistant-ai (a GitHub organization) maintains it in homeassistant-ai/ha-mcp, which has 5,015 GitHub stars. The repository holds 8 skills in this directory. The repository was last updated on October 11, 2026.
Source: homeassistant-ai/ha-mcp on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.