OpenHarness End-to-End Evals
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
Agent skill
by GoogleCloudPlatform in GoogleCloudPlatform/spanner-migration-tool
Skill for independently generating Integration Tests and performing End-to-End QA validation for newly added Spanner Migration Tool database sources.
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smt --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .claude/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .claude/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smtType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smt --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .agents/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .agents/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smt --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .cursor/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .cursor/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/GoogleCloudPlatform/spanner-migration-tool.git --path .agents/skills/add-source-e2e-integ-test-smt--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smt --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .gemini/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .gemini/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smtInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .github/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .github/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install GoogleCloudPlatform/spanner-migration-tool add-source-e2e-integ-test-smt --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/spanner-migration-tool.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/add-source-e2e-integ-test-smt .opencode/skills/add-source-e2e-integ-test-smt && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "add-source-e2e-integ-test-smt" agent skill from https://github.com/GoogleCloudPlatform/spanner-migration-tool/tree/master/.agents/skills/add-source-e2e-integ-test-smt into .opencode/skills/add-source-e2e-integ-test-smt/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "add-source-e2e-integ-test-smt", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
add-source-e2e-integ-test-smtSkill for independently generating Integration Tests and performing End-to-End QA validation for newly added Spanner Migration Tool database sources.
Add Source E2E Integ Test Smt is an agent skill from GoogleCloudPlatform/spanner-migration-tool. Skill for independently generating Integration Tests and performing End-to-End QA validation for newly added Spanner Migration Tool database sources.
Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering End-to-end testing and Integration testing. It works with Google Cloud. The repository describes itself as: Spanner migration tool helps you migrate from your existing database/dump files to Spanner. The licence is Apache-2.0.
4 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit 345e09c. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
gonpmcurlFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use npm and curl, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Add Source E2E Integ Test Smt loads about 1.3k tokens when it runs. Until then it costs about 45 tokens; SKILL.md has 671 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from GoogleCloudPlatform/spanner-migration-tool at commit 345e09c, republished under its Apache-2.0 licence (© GoogleCloudPlatform). 671 words, ~1,298 tokens.
.claude/skills/add-source-e2e-integ-test-smt/SKILL.md (or your agent's skills folder).Description: This skill provides detailed instructions for an independent agent to construct integration tests and execute end-to-end full-stack manual testing for newly integrated database sources in the Spanner Migration Tool (SMT). Operating independently blocks confirmation bias from the original implementation agent.
CRITICAL HALT RULE: Before writing any tests, check if the user provided ALL of the following: a data-type mapping matrix file, a feature support matrix file, and a testing environment setup path (e.g., testing_execution.env). If the user did not provide these files and test credentials, you must STOP execution immediately and politely ask the user to provide them before proceeding. These files act as your Absolute Ground Truth for assertions.
If the user provided a testing_execution.env file in the workspace, it typically contains the following schema:
REMOTE_WORKSPACE_PATH=
REMOTE_EXEC_TEMPLATE=
REMOTE_SYNC_TEMPLATE=You MUST load these variables and route any physical server commands (compilation, backend boot-up, UI server) through the REMOTE_EXEC_TEMPLATE.
testing/<database>/integration_test.go file. Your tests must execute and assert the core backend database extraction CLI workflows, achieving strict testing parity with the existing MySQL ITs. Use exactly the structural mappings found in the user's provided matrix files to build your test validations.go test ./testing/... to guarantee the engine did not inadvertently break pre-existing platforms.ui/ and trigger Cypress regression suites (npm run cypress:run) to ensure new HTML/TS implementations did not poison other database UI flows.Because automated Backend ITs only test the CLI, they never test the true physical bridge to the Angular UI. You must act as a QA engineer and manually execute the scenarios across the full live stack using these 4 steps:
smt-cli web backend server (go run main.go web in the background).npm run build).testing_execution.env file. You must route all your validation commands, compiler executions, and server setups through the REMOTE_EXEC_TEMPLATE strings provided there. Do not attempt to randomly run local commands if a remote template is strictly provided.Using the credentials from your test setup, connect directly to the target database shell. Populate the physical DB with every single data type and edge-case table available from the Data-Type mapping matrix (e.g., arrays, proprietary constraints).
Assess your current Agent Tooling capabilities and execute the test:
localhost:8080, rendering the Angular SPA UI directly via your browser tools, and clicking through the direct-connection flow.curl -X POST request against the localhost:8080/connect endpoint, followed by fetching localhost:8080/convert/infoschema.Assert that the backend Go-Drivers did not panic during the extraction. Specifically assert that complex precision masking (like parsing TIMESTAMP(6) or spatial data wrappers) translated correctly on the real wire and returned a strict 200 OK on all handlers.
go build ./....[database]_testing_report.md) detailing the validation. Include:curl programmatic API simulation approach.© GoogleCloudPlatform, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .agents/skills/add-source-e2e-integ-test-smt of GoogleCloudPlatform/spanner-migration-tool.
Open the folder on GitHubat commit 345e09c
Add Source E2E Integ Test Smt next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Add Source E2E Integ Test Smt this skillGoogleCloudPlatform/spanner-migration-tool | 155 | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| E2E Testinglangflow-ai/langflow | 156k | — | ~3.3k | Automated safety check: Pass | MIT | |
| MongoDB Source Connector E2E Harnessairbytehq/airbyte | 22k | — | ~1.9k | Automated safety check: Pass | Custom licence | |
| Java SDK E2E Test with Replay Snapshotgithub/copilot-sdk | 11k | — | ~1.8k | Automated safety check: Pass | MIT | |
| Go Redis Client Test Runnerredis/go-redis | 22k | — | ~786 | Automated safety check: Pass | BSD-2-Clause |
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
langflow-ai/langflow
Write and review Playwright E2E tests for Langflow. An agent skill from langflow-ai/langflow.
airbytehq/airbyte
Starts a throwaway MongoDB 7.0 replica set and runs the Airbyte spec, check, discover and read commands against source-mongodb-v2 images for local end-to-end testing.
github/copilot-sdk
Creates a Java SDK end-to-end test for the Copilot SDK that runs against a recorded YAML snapshot through a replay proxy, so CI needs no real authentication.
redis/go-redis
Explains how to run go-redis tests: the Docker Compose stack, make targets, focusing a single Ginkgo spec, the e2e suite and the version environment variables.
airbytehq/airbyte
Starts a local PostgreSQL 16 container, loads SQL fixtures and runs the Airbyte spec, check, discover and read commands against a chosen source-postgres image.
GoogleCloudPlatform/spanner-migration-tool
This skill provides comprehensive architectural instructions for agents to safely implement entirely new database source engines into the Spanner Migration Tool (SMT).
GoogleCloudPlatform/spanner-migration-tool
Skill for helping achieve datatype and feature mapping matrix for any source against spanner.
Works with
Categories
Skill for independently generating Integration Tests and performing End-to-End QA validation for newly added Spanner Migration Tool database sources. Add Source E2E Integ Test Smt is an agent skill from GoogleCloudPlatform/spanner-migration-tool. Skill for independently generating Integration Tests and performing End-to-End QA validation for newly added Spanner Migration Tool database sources.
Add Source E2E Integ Test Smt fits situations like: tasks that involve End-to-end testing; tasks that involve Integration testing.
Run `npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a claude-code`. Or copy the skill folder (.agents/skills/add-source-e2e-integ-test-smt in GoogleCloudPlatform/spanner-migration-tool) into .claude/skills/add-source-e2e-integ-test-smt in your project. Claude Code loads it when a task matches its description.
Run `npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a codex`. Or copy the skill folder (.agents/skills/add-source-e2e-integ-test-smt in GoogleCloudPlatform/spanner-migration-tool) into .agents/skills/add-source-e2e-integ-test-smt in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add GoogleCloudPlatform/spanner-migration-tool --skill add-source-e2e-integ-test-smt -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/add-source-e2e-integ-test-smt, .gemini/skills/add-source-e2e-integ-test-smt, .github/skills/add-source-e2e-integ-test-smt and .opencode/skills/add-source-e2e-integ-test-smt in your project.
Going by SKILL.md and its folder, Add Source E2E Integ Test Smt needs the command-line tools its instructions call (go, npm and curl).
SKILL.md contains no URLs. Its commands use npm and curl, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Add Source E2E Integ Test Smt is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.3k tokens (SKILL.md is roughly 5.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Add Source E2E Integ Test Smt: OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars), E2E Testing (langflow-ai/langflow, 156k stars), MongoDB Source Connector E2E Harness (airbytehq/airbyte, 22k stars) and Java SDK E2E Test with Replay Snapshot (github/copilot-sdk, 11k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
GoogleCloudPlatform (a GitHub organization) maintains it in GoogleCloudPlatform/spanner-migration-tool, which has 155 GitHub stars. The repository holds 3 skills in this directory. The repository was last updated on October 6, 2026.
Source: GoogleCloudPlatform/spanner-migration-tool on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.