Evidence-Driven Testing
michaelshimeles/skills
Records an annotated screen recording of the agent testing an app hands-on, then posts the video and a results summary to the PR and tracker issue.
Verifies a Warp client change by pushing it to a branch and spawning a cloud agent with computer use that follows the test-warp-ui skill, only when you ask for it.
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloud --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .claude/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .claude/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .claude/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloudType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloud --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .agents/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .agents/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .agents/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloud --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .cursor/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .cursor/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/warpdotdev/warp.git --path resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloud --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .gemini/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .gemini/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloudInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .github/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .github/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .github/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install warpdotdev/warp verify-ui-change-in-cloud --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/warpdotdev/warp.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud .opencode/skills/verify-ui-change-in-cloud && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "verify-ui-change-in-cloud" agent skill from https://github.com/warpdotdev/warp/tree/master/resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud into .opencode/skills/verify-ui-change-in-cloud/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "verify-ui-change-in-cloud", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
verify-ui-change-in-cloudVerifies a Warp client change by pushing it to a branch and spawning a cloud agent with computer use that follows the test-warp-ui skill, only when you ask for it.
This is an opt-in workflow meant for local, non-sandboxed environments. After a user-facing change the agent may briefly offer it, but launches only after an explicit request or a yes, and it covers anything that changes what the user sees or experiences, such as startup behavior, config handling or migration flows, not just visual tweaks. The changes must first be pushed to a branch, since the cloud agent clones the repo into a fresh environment.
The agent checks the git remote to confirm the repo is the Warp one and stops with a warning otherwise. It then calls run_agents with a one-entry batch: a short summary, a base prompt that tells the cloud agent to read and follow the test-warp-ui skill, the Warp dev environment ID, computer use enabled, and a display name like verify-ui-change. The prompt should name the element or flow to test, any mocking or pre-seeded filesystem and app state, and the observations to report back.
5 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit f571865. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
gitcargoFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use git, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Cloud UI Change Verification loads about 1.2k tokens when it runs. Until then it costs about 87 tokens; SKILL.md has 555 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from warpdotdev/warp at commit f571865, republished under its AGPL-3.0 licence (© warpdotdev). 555 words, ~1,162 tokens.
.claude/skills/verify-ui-change-in-cloud/SKILL.md (or your agent's skills folder).Use this workflow to verify a user-facing client change by spawning a cloud agent with computer use capabilities. Do not invoke it automatically after every UI change: launch only when the user explicitly requested computer-use verification or accepted an offer to run it. After completing a user-facing change, you may briefly offer this verification; do not launch until the user says yes. This applies to any change that affects what the user sees or experiences in the running app — not just visual/UI changes, but also startup behavior, config handling, migration flows, and other client-side logic.
The cloud agent runs in a fresh environment that clones the repo. Your changes must be pushed to a branch so the cloud agent can access them.
Before spawning the cloud agent, detect which repository you are running in. Check the Git remote URL to determine the repo:
git remote get-url originVerify the remote URL contains warpdotdev/warp. If it does not, warn the user that this skill only supports the warp repository and stop.
The environment ID for the warp Dev Environment is SVhg783GBFQHk1OfdPfFU9.
Use the run_agents tool to spawn a remote cloud agent. A single-child batch (one entry in agent_run_configs) is valid.
summary: a brief declarative explanation, e.g. "Spawning a cloud agent with computer use to verify the UI change."base_prompt: include an instruction to read and follow the test-warp-ui skill, followed by the verification task (see the next section)remote.environment_id: SVhg783GBFQHk1OfdPfFU9remote.computer_use_enabled: trueagent_run_configs: a single entry with name set to a short display name such as "verify-ui-change". The per-agent prompt can be empty since base_prompt covers the task.The test-warp-ui skill is bundled, so the cloud agent has it automatically. Tell the agent to invoke it by name in the base_prompt (e.g. "Read and follow the test-warp-ui skill.").
The prompt should tell the cloud agent:
Example prompts:
I changed the settings dialog header to use a larger font and blue color.
Hardcode the settings dialog to open on launch, then describe the header text,
font size relative to other text, and color.I added a migration that symlinks config from ~/.warp into ~/.warp-preview on first launch.
The migration is gated on Channel::Preview. Before building, hardcode the migration to run
regardless of channel by removing the channel check. Also create a fake ~/.warp directory
with test files. After launching Warp, verify the symlinks were created in ~/.warp-preview.The cloud agent builds Warp with cargo run, which may not match the exact runtime conditions of your change (e.g., different channel, missing feature flags, absent preconditions). When this happens, instruct the cloud agent to temporarily hardcode the code so the build exercises the path you need to test. Common examples:
Be explicit in the prompt about what to hardcode and why — the cloud agent won't infer this on its own.
No extra surfacing step is needed — the Warp client displays the cloud agent run automatically.
© warpdotdev, AGPL-3.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud of warpdotdev/warp.
Open the folder on GitHubat commit f571865
Cloud UI Change Verification next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Cloud UI Change Verification this skillwarpdotdev/warp | 65k | — | ~1.2k | Automated safety check: Pass | AGPL-3.0 | |
| Evidence-Driven Testingmichaelshimeles/skills | 1.3k | 1 repos | ~3.9k | Automated safety check: Pass | None | |
| Parallels macOS VM Labsteipete/agent-scripts | 7.3k | — | ~1.8k | Automated safety check: Pass | MIT | |
| Electron App Screenshotkeybase/client | 9.3k | — | ~476 | Automated safety check: Pass | BSD-3-Clause | |
| Stevemikker/steve | 170 | — | ~421 | Automated safety check: Pass | None | |
| Diff-Driven Smoke TestsSkyvern-AI/skyvern | 23k | — | ~5.2k | Automated safety check: Pass | AGPL-3.0 |
michaelshimeles/skills
Records an annotated screen recording of the agent testing an app hands-on, then posts the video and a results summary to the PR and tracker issue.
steipete/agent-scripts
Uses a clean Parallels macOS VM to test GUI automation, TCC permission prompts and screenshot tools like Peekaboo, verifying results from outside the guest.
keybase/client
Takes a screenshot of a running Electron desktop app through playwright-cli over remote debugging, shrinks it and shows it so you can check the UI visually.
mikker/steve
Use the steve CLI to automate macOS apps via Accessibility APIs.
Skyvern-AI/skyvern
Reads your git diff, writes a handful of happy-path browser smoke tests, runs them with Skyvern or Chrome DevTools MCP and posts screenshot evidence to the PR.
Skyvern-AI/skyvern
Reads your git diff, decides whether the change needs browser QA, API checks or repo tests, runs that validation and reports pass or fail with evidence.
warpdotdev/warp
Builds or updates a design system in Figma from a codebase in ordered phases: discovery, variables and tokens, components, theming and documentation, with checkpoints.
warpdotdev/warp
Required groundwork before any use_figma call: the rules and reference files for running JavaScript in a Figma file through the Plugin API without common failures.
warpdotdev/warp
Authors and edits file-based Warp software factory definitions rooted at factory.yaml, covering agents, automations, scorers and webhooks, and validates them before a pull request.
warpdotdev/warp
Turns a Figma frame or component into production code that matches the design, using the Figma MCP server and the project's own design system.
warpdotdev/warp
Migrates the compatible subset of settings and global file-based MCP servers from the Warp desktop app into Warp Agent CLI without exposing credentials or state.
warpdotdev/warp
Creates project-specific design system rules from your codebase so coding agents implement Figma designs with your components, naming and tokens.
Works with
Categories
Verifies a Warp client change by pushing it to a branch and spawning a cloud agent with computer use that follows the test-warp-ui skill, only when you ask for it. This is an opt-in workflow meant for local, non-sandboxed environments. After a user-facing change the agent may briefly offer it, but launches only after an explicit request or a yes, and it covers anything that changes what the user sees or experiences, such as startup behavior, config handling or migration flows, not just visual tweaks.
Cloud UI Change Verification fits situations like: having a cloud agent visually verify a Warp UI change after you push a branch; verifying startup, config or migration behavior changes in the running client; delegating computer-use testing to a remote environment.
Run `npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a claude-code`. Or copy the skill folder (resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud in warpdotdev/warp) into .claude/skills/verify-ui-change-in-cloud in your project. Claude Code loads it when a task matches its description.
Run `npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a codex`. Or copy the skill folder (resources/channel-gated-skills/dogfood/verify-ui-change-in-cloud in warpdotdev/warp) into .agents/skills/verify-ui-change-in-cloud in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add warpdotdev/warp --skill verify-ui-change-in-cloud -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/verify-ui-change-in-cloud, .gemini/skills/verify-ui-change-in-cloud, .github/skills/verify-ui-change-in-cloud and .opencode/skills/verify-ui-change-in-cloud in your project.
Going by SKILL.md and its folder, Cloud UI Change Verification needs the command-line tools its instructions call (git and cargo). Our summary lists: The run_agents tool with a remote Warp dev environment; Changes pushed to a branch; The bundled test-warp-ui skill.
SKILL.md contains no URLs. Its commands use git, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Cloud UI Change Verification is published under the AGPL-3.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.2k tokens (SKILL.md is roughly 4.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Cloud UI Change Verification: Evidence-Driven Testing (michaelshimeles/skills, 1.3k stars), Parallels macOS VM Lab (steipete/agent-scripts, 7.3k stars), Electron App Screenshot (keybase/client, 9.3k stars) and Steve (mikker/steve, 170 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
warpdotdev (a GitHub organization) maintains it in warpdotdev/warp, which has 65,380 GitHub stars. The repository holds 46 skills in this directory. The repository was last updated on October 7, 2026.
Source: warpdotdev/warp on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.