Diff-Driven Smoke Tests
Skyvern-AI/skyvern
Reads your git diff, writes a handful of happy-path browser smoke tests, runs them with Skyvern or Chrome DevTools MCP and posts screenshot evidence to the PR.
Tests LangBot's WebUI and core flows through an automated browser and backend logs, with a routing table to reference guides per feature area.
$ npx skills add langbot-app/LangBot --skill langbot-testing -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install langbot-app/LangBot langbot-testing --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/skills/langbot-testing .claude/skills/langbot-testing && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .claude/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testingType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add langbot-app/LangBot --skill langbot-testing -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install langbot-app/LangBot langbot-testing --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/skills/langbot-testing .agents/skills/langbot-testing && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .agents/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add langbot-app/LangBot --skill langbot-testing -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install langbot-app/LangBot langbot-testing --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/skills/langbot-testing .cursor/skills/langbot-testing && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .cursor/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/langbot-app/LangBot.git --path skills/skills/langbot-testing--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add langbot-app/LangBot --skill langbot-testing -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install langbot-app/LangBot langbot-testing --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/skills/langbot-testing .gemini/skills/langbot-testing && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .gemini/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install langbot-app/LangBot langbot-testingInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add langbot-app/LangBot --skill langbot-testing -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/skills/langbot-testing .github/skills/langbot-testing && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .github/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add langbot-app/LangBot --skill langbot-testing -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install langbot-app/LangBot langbot-testing --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/langbot-app/LangBot.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/skills/langbot-testing .opencode/skills/langbot-testing && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "langbot-testing" agent skill from https://github.com/langbot-app/LangBot/tree/master/skills/skills/langbot-testing into .opencode/skills/langbot-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "langbot-testing", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
langbot-testingTests LangBot's WebUI and core flows through an automated browser and backend logs, with a routing table to reference guides per feature area.
Use it when an agent has to verify LangBot behavior through the WebUI, not just by reading code. The SKILL.md is mainly a router: general WebUI testing, pipeline Debug Chat, the Dify and local agent runners, model provider setup and test buttons, plugin install and runtime smoke tests, LangRAG knowledge bases, MCP stdio tools, performance and chaos probes, workspace release gates and known failures each point to their own reference file.
Rules keep runs reproducible: read the .env file first and use LANGBOT_FRONTEND_URL and LANGBOT_BACKEND_URL instead of fixed ports, confirm both frontend and backend are running, and run bin/lbs fixture check before fixture-heavy tests. Reusable test groups come from bin/lbs suite list and suite plan, and runner release checks run the preflight case before the full release gate so configuration blockers are separated from product failures.
For driving a live instance programmatically, a companion langbot-mcp-ops skill uses the instance's MCP endpoint on port 5300, which helps set up bots, pipelines and models as fixtures. The folder carries a large set of YAML test cases.
Read from SKILL.md and the folder at commit 40a3a94. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
LangBot Testing loads about 1k tokens when it runs, and up to ~24k if it reads all its reference files. Until then it costs about 75 tokens; SKILL.md has 416 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check noted patterns worth knowing about, such as sudo or a known installer.
- Read `../.env` first and use `LANGBOT_FRONTEND_URL` and `LANGBOT_BACKEND_URL` instead of hardcoded ports.Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from langbot-app/LangBot at commit 40a3a94, republished under its Apache-2.0 licence (© langbot-app). 416 words, ~1,004 tokens.
.claude/skills/langbot-testing/SKILL.md (or your agent's skills folder). This skill also uses 211 other files; get the full folder from GitHub.Use this skill when an agent needs to verify LangBot behavior through the WebUI instead of only reading code.
references/web-ui-testing.md.references/pipeline-debug-chat.md.references/dify-agent-runner.md.references/model-provider-testing.md.references/plugin-e2e-smoke.md.references/local-agent-runner.md.references/local-agent-runner-coverage.md.references/agent-runner-qa-workflow.md.references/agent-runner-release-gate.md.references/sandbox-skill-authoring.md.references/langrag-knowledge-base.md.references/mcp-stdio-testing.md.references/performance-reliability-testing.md.references/workspace-release-testing.md.langbot-mcp-ops skill — the instance exposes an MCP server at http://<host>:5300/mcp (reuses API keys). Useful for setting up bots/pipelines/models as test fixtures programmatically.references/troubleshooting.md.bin/lbs suite list and bin/lbs suite plan <suite-id> before manually assembling a case set.../.env first and use LANGBOT_FRONTEND_URL and LANGBOT_BACKEND_URL instead of hardcoded ports.LANGBOT_FRONTEND_URL may point to LANGBOT_DEV_FRONTEND_URL; otherwise it may point to the backend WebUI.bin/lbs fixture check before fixture-heavy MCP, RAG, multimodal, or plugin smoke tests.bin/lbs test run agent-runner-release-preflight before the full agent-runner-release-gate suite so configuration blockers are separated from product failures.Manual Readiness in bin/lbs test plan <case-id>; manual_check means the declared preconditions or setup still need operator confirmation for this run.langbot-env-setup.metrics evidence and a clear split between LangBot overhead and external provider/tool/network time.bin/lbs suite start <suite-id> to create the suite evidence root, per-case directories, and suite-start.json/suite-start.md handoff files; use bin/lbs test result <case-id> to write final per-case result.json, then run bin/lbs suite report <suite-id> --evidence-dir <dir>.pass until test result --evidence covers every value in the case's evidence_required.automation_pipeline_url_env / automation_pipeline_name_env; do not silently reuse a generic LANGBOT_PIPELINE_URL.© langbot-app, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 211 other files (references) in skills/skills/langbot-testing of langbot-app/LangBot.
Open the folder on GitHubat commit 40a3a94
LangBot Testing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| LangBot Testing this skilllangbot-app/LangBot | 18k | — | ~1k | Automated safety check: Notes | Apache-2.0 | |
| Diff-Driven Smoke TestsSkyvern-AI/skyvern | 23k | — | ~5.2k | Automated safety check: Pass | AGPL-3.0 | |
| Agentic Browser Testingpetrkindlmann/qa-skills | 165 | — | ~4.5k | Automated safety check: Pass | MIT | |
| Whole-App Health Sweepreticlehq/reticle | 1.2k | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | |
| Playwright E2E Testsonyx-dot-app/onyx | 32k | 1 repos | ~2.8k | Automated safety check: Notes | Custom licence | |
| Hands On Testktnyt/cclsp | 675 | — | ~1.7k | Automated safety check: Pass | MIT |
Skyvern-AI/skyvern
Reads your git diff, writes a handful of happy-path browser smoke tests, runs them with Skyvern or Chrome DevTools MCP and posts screenshot evidence to the PR.
petrkindlmann/qa-skills
Goal-driven E2E testing where a browser agent (Playwright MCP / computer-use) reads a natural-language goal and explores the app via the accessibility tree to assert outcomes — no pre-written script.
reticlehq/reticle
Sweeps a running web app by clicking every reachable control, then reports dead buttons, console errors, failed requests and mismatches between API data and the screen.
onyx-dot-app/onyx
Write and maintain Playwright end-to-end tests for the Onyx application.
ktnyt/cclsp
Performs manual hands-on testing of a web application using playwright-cli.
DebugBase/glance
Run E2E browser tests on any web application using Glance MCP.
langbot-app/LangBot
Guides building, debugging and testing LangBot plugins: components, SDK calls, README and locale rules, SDK pitfalls and WebSocket-based testing.
langbot-app/LangBot
Deploys and configures a LangBot instance with Docker Compose or Kubernetes, covering config.yaml, the Box sandbox runtime, the plugin runtime and the global API key.
langbot-app/LangBot
Covers developing the LangBot core backend and web UI: dev setup, repo layout, API auth types, adding endpoints, migrations and keeping the MCP server in step.
langbot-app/LangBot
Guides building, migrating and testing LangBot messaging-platform adapters for the Event-Based Agents layout, with unified event and message conversion.
langbot-app/LangBot
Manages a LangBot instance over its built-in MCP server: endpoint, API-key authentication, client config and the tool set for bots, processors and more.
langbot-app/LangBot
Browses and searches the LangBot Space marketplaces for plugins, MCP servers and skills through its read-only MCP server, authenticated with a personal access token.
Works with
Categories
Tests LangBot's WebUI and core flows through an automated browser and backend logs, with a routing table to reference guides per feature area. Use it when an agent has to verify LangBot behavior through the WebUI, not just by reading code.md is mainly a router: general WebUI testing, pipeline Debug Chat, the Dify and local agent runners, model provider setup and test buttons, plugin install and runtime smoke tests, LangRAG knowledge bases, MCP stdio tools, performance and chaos probes, workspace release gates and known failures each point to their own reference file.
LangBot Testing fits situations like: verifying the LangBot WebUI after a frontend or backend change; testing the pipeline Debug Chat or a model provider's test button; running a release preflight and gate for the agent runners; troubleshooting a failed LangBot end-to-end test.
Run `npx skills add langbot-app/LangBot --skill langbot-testing -a claude-code`. Or copy the skill folder (skills/skills/langbot-testing in langbot-app/LangBot) into .claude/skills/langbot-testing in your project. Claude Code loads it when a task matches its description.
Run `npx skills add langbot-app/LangBot --skill langbot-testing -a codex`. Or copy the skill folder (skills/skills/langbot-testing in langbot-app/LangBot) into .agents/skills/langbot-testing in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add langbot-app/LangBot --skill langbot-testing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/langbot-testing, .gemini/skills/langbot-testing, .github/skills/langbot-testing and .opencode/skills/langbot-testing in your project.
SKILL.md names no scripts, command-line tools or credentials: LangBot Testing is instructions for the agent only. Our summary lists: A running LangBot backend and frontend configured in the .env file; The bin/lbs test runner from the LangBot repository; A browser automation tool the agent can drive.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.
LangBot Testing is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1k tokens (SKILL.md is roughly 4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 23k tokens, read only when the agent opens those files.
Skills that share tags, products or a category with LangBot Testing: Diff-Driven Smoke Tests (Skyvern-AI/skyvern, 23k stars), Agentic Browser Testing (petrkindlmann/qa-skills, 165 stars), Whole-App Health Sweep (reticlehq/reticle, 1.2k stars) and Playwright E2E Tests (onyx-dot-app/onyx, 32k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
langbot-app (a GitHub organization) maintains it in langbot-app/LangBot, which has 18,043 GitHub stars. The repository holds 9 skills in this directory. The repository was last updated on October 7, 2026.
Source: langbot-app/LangBot on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.