OpenHarness End-to-End Evals
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
分析当前分支 git 改动,检查 e2e 测试用例覆盖情况,并可补充缺失的测试用例. An agent skill from shenjingnan/xiaozhi-client.
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzer --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .claude/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .claude/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzerType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzer --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .agents/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .agents/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzer --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .cursor/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .cursor/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/shenjingnan/xiaozhi-client.git --path .agents/skills/e2e-coverage-analyzer--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzer --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .gemini/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .gemini/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzerInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .github/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .github/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install shenjingnan/xiaozhi-client e2e-coverage-analyzer --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/shenjingnan/xiaozhi-client.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/e2e-coverage-analyzer .opencode/skills/e2e-coverage-analyzer && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "e2e-coverage-analyzer" agent skill from https://github.com/shenjingnan/xiaozhi-client/tree/main/.agents/skills/e2e-coverage-analyzer into .opencode/skills/e2e-coverage-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "e2e-coverage-analyzer", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
e2e-coverage-analyzer分析当前分支 git 改动,检查 e2e 测试用例覆盖情况,并可补充缺失的测试用例. An agent skill from shenjingnan/xiaozhi-client.
E2E Coverage Analyzer is an agent skill from shenjingnan/xiaozhi-client. 分析当前分支 git 改动,检查 e2e 测试用例覆盖情况,并可补充缺失的测试用例
Its SKILL.md is about 950 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering End-to-end testing. It works with Git. The licence is MIT.
3 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit fe3c382. It shows what the files ask for, not the result of running them.
Pre-approves these tools, so the agent can use them without asking each time:
Bash(git diff:*)Bash(git --no-pager diff:*)Bash(git merge-base:*)Bash(git branch --show-current:*)Bash(ls:*)Bash(find:*)ReadGlobGrepWrite…and 1 more on the same allowed-tools line.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
gitFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use git, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
E2E Coverage Analyzer loads about 954 tokens when it runs. Until then it costs about 16 tokens; SKILL.md has 182 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from shenjingnan/xiaozhi-client at commit fe3c382, republished under its MIT licence (© shenjingnan). 182 words, ~954 tokens.
.claude/skills/e2e-coverage-analyzer/SKILL.md (or your agent's skills folder).分析当前分支相对于 main 的改动,评估 tests/e2e/ 中现有测试用例是否足以覆盖改动涉及的功能点。
git branch --show-currentgit merge-base main HEADgit --no-pager diff --name-only main...HEADgit --no-pager diff --stat main...HEADgit --no-pager diff main...HEAD!find tests/e2e -maxdepth 1 -type d ! -path tests/e2e | sort
按以下四个阶段执行,每个阶段输出清晰的中文报告。
过滤核心逻辑文件:从改动文件列表中排除以下非逻辑文件类型:
*.config.*, *.env*, tsconfig*.json, .eslintrc*, .prettierrc**.d.ts, types/*.ts, interfaces/*.ts*.md, CHANGELOG*, LICENSE*package-lock.json, pnpm-lock.yaml, yarn.lock.github/**, .gitlab-ci*, Dockerfile*, docker-compose***/*.test.ts, **/*.spec.ts, tests/**, __tests__/**保留以下类型的文件作为核心逻辑文件:
src/web/** 下的组件、页面、hooks、store、工具函数src/server/** 下的服务、路由、控制器、中间件、处理器src/ 下各模块的源码逻辑文件识别功能点:对每个核心逻辑文件,结合 git diff 的实际改动内容,分析其涉及的功能维度:
/dashboard)输出改动分析报告,格式如下:
=== 改动分析报告 ===
核心逻辑文件(共 N 个):
1. src/web/pages/Dashboard.tsx
- 涉及页面:Dashboard 页面
- 涉及功能点:新增状态卡片 X、修改表格列 Y
排除的非逻辑文件(共 M 个):
- package.json(依赖变更)
...读取所有现有 e2e 测试用例:遍历 tests/e2e/ 下每个子目录中的 test.md 文件,提取每个用例覆盖的功能点关键词。
建立映射关系:将阶段一识别的功能点与现有测试用例进行匹配。匹配规则:
输出覆盖匹配报告,格式如下:
=== 覆盖匹配报告 ===
已覆盖的功能点:
| 功能点 | 匹配测试用例 | 匹配类型 |
|--------|-------------|---------|
| Dashboard 页面加载 | 测试Dashboard页面加载 | 精确匹配 |
缺少覆盖的功能点:
| 功能点 | 涉及文件 | 风险等级 |
|--------|---------|---------|
| 新增的 XXX 功能 | src/web/components/XXX.tsx | 高 |
覆盖率总结:
- 总功能点数:N
- 已覆盖:M(X%)
- 未覆盖:K(Y%)风险等级判定标准:
根据覆盖匹配结果输出结论:
如果全部覆盖(覆盖率 100%):
=== 结论 ✅ ===
当前分支的所有改动均有对应的 e2e 测试用例覆盖:
[列出所有匹配关系]
建议:可以直接提交 PR,或在提交前运行 /e2e 执行全量测试验证。如果存在未覆盖项:
=== 结论 ⚠️ ===
当前分支存在 N 个缺少 e2e 覆盖的功能点:
[高优先级]
1. [功能点描述] — 涉及文件:xxx
[中优先级]
2. ...
是否需要为这些缺失的功能点创建新的 e2e 测试用例?
回复"是"将继续创建,回复"否"则仅保留上述报告。特殊情况处理:
当用户确认需要补充测试用例时:
确定要创建的测试用例列表:按风险等级从高到低排列。
为每个缺失的功能点创建 e2e 测试用例,遵循以下规范:
a. 目录命名:使用中文 测试<功能描述> 格式,例如:
tests/e2e/测试新功能名称/b. test.md 格式:
## 前置条件(可选)
如有特殊前置条件在此说明
## 测试步骤
1. 打开页面 http://localhost:9999/dashboard
2. 等待页面加载完成
3. [具体的操作步骤]
4. 截图(关键状态描述)
5. [验证断言]c. 编写原则:
d. 参考现有用例的风格:参考已有的测试用例写法保持一致
输出创建结果报告:
=== 测试用例创建报告 ===
已创建以下 e2e 测试用例:
1. tests/e2e/测试XXX/test.md
- 覆盖功能点:...
- 步骤数:N
创建完成后可使用以下命令执行:
/e2e tests/e2e/测试XXX/e2e 命令。© shenjingnan, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .agents/skills/e2e-coverage-analyzer of shenjingnan/xiaozhi-client.
Open the folder on GitHubat commit fe3c382
E2E Coverage Analyzer next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| E2E Coverage Analyzer this skillshenjingnan/xiaozhi-client | 341 | — | ~954 | Automated safety check: Pass | MIT | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| Nemoclaw Maintainer Fix E2E FailuresNVIDIA/NemoClaw | 23k | — | ~2.6k | Automated safety check: Pass | Apache-2.0 | |
| Releaselycorp-jp/sim-use | 1.4k | — | ~1.7k | Automated safety check: Pass | Apache-2.0 | |
| Diff-Driven Smoke TestsSkyvern-AI/skyvern | 23k | — | ~5.2k | Automated safety check: Pass | AGPL-3.0 | |
| Test Pyramidkubernetes-sigs/agent-sandbox | 4.2k | — | ~1.6k | Automated safety check: Pass | Apache-2.0 |
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
NVIDIA/NemoClaw
Continuously maintain automatic NemoClaw main E2E results through coordinated repairs.
lycorp-jp/sim-use
Cut a sim-use release end-to-end. An agent skill from lycorp-jp/sim-use.
Skyvern-AI/skyvern
Reads your git diff, writes a handful of happy-path browser smoke tests, runs them with Skyvern or Chrome DevTools MCP and posts screenshot evidence to the PR.
kubernetes-sigs/agent-sandbox
Analyze the repo's unit and E2E tests and propose rebalancing toward a test pyramid — which E2E tests (or assertions inside them) can be covered by unit tests, which unit-level gaps genuinely need…
crowdin/crowdin-api-client-js
Run end-to-end tests against the real Crowdin or Crowdin Enterprise API using credentials from .env.
shenjingnan/xiaozhi-client
GitHub 评论修复技能,用于获取 PR 的 Copilot 评论并分析修复问题. An agent skill from shenjingnan/xiaozhi-client.
shenjingnan/xiaozhi-client
文档自动生成
shenjingnan/xiaozhi-client
CI检查验证和质量保障
shenjingnan/xiaozhi-client
生成代码评审友好的 commit 信息
shenjingnan/xiaozhi-client
开发流程检查技能,确保代码修改后执行必要的质量检查
shenjingnan/xiaozhi-client
文档创建技能,用于创建标准化的项目文档
Works with
Categories
分析当前分支 git 改动,检查 e2e 测试用例覆盖情况,并可补充缺失的测试用例. An agent skill from shenjingnan/xiaozhi-client. E2E Coverage Analyzer is an agent skill from shenjingnan/xiaozhi-client.
E2E Coverage Analyzer fits situations like: tasks that involve End-to-end testing.
Run `npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a claude-code`. Or copy the skill folder (.agents/skills/e2e-coverage-analyzer in shenjingnan/xiaozhi-client) into .claude/skills/e2e-coverage-analyzer in your project. Claude Code loads it when a task matches its description.
Run `npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a codex`. Or copy the skill folder (.agents/skills/e2e-coverage-analyzer in shenjingnan/xiaozhi-client) into .agents/skills/e2e-coverage-analyzer in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add shenjingnan/xiaozhi-client --skill e2e-coverage-analyzer -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/e2e-coverage-analyzer, .gemini/skills/e2e-coverage-analyzer, .github/skills/e2e-coverage-analyzer and .opencode/skills/e2e-coverage-analyzer in your project.
Going by SKILL.md and its folder, E2E Coverage Analyzer needs the command-line tools its instructions call (git). Our summary lists: Docker. Its frontmatter pre-approves these tools: Bash(git diff:*), Bash(git --no-pager diff:*), Bash(git merge-base:*), Bash(git branch --show-current:*), Bash(ls:*), Bash(find:*), Read, Glob, Grep, Write, Bash(mkdir:*).
SKILL.md contains no URLs. Its commands use git, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
E2E Coverage Analyzer is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 954 tokens (SKILL.md is roughly 3.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with E2E Coverage Analyzer: OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars), Nemoclaw Maintainer Fix E2E Failures (NVIDIA/NemoClaw, 23k stars), Release (lycorp-jp/sim-use, 1.4k stars) and Diff-Driven Smoke Tests (Skyvern-AI/skyvern, 23k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
shenjingnan (a GitHub user) maintains it in shenjingnan/xiaozhi-client, which has 341 GitHub stars. The repository holds 16 skills in this directory. The repository was last updated on September 3, 2026.
Source: shenjingnan/xiaozhi-client on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.