OpenHarness End-to-End Evals
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
Setup Python virtual environment and run integration tests with gltest
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install genlayerlabs/genlayer-studio integration-tests --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/integration-tests .claude/skills/integration-tests && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .claude/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-testsType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install genlayerlabs/genlayer-studio integration-tests --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.claude/skills/integration-tests .agents/skills/integration-tests && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .agents/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install genlayerlabs/genlayer-studio integration-tests --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.claude/skills/integration-tests .cursor/skills/integration-tests && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .cursor/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/genlayerlabs/genlayer-studio.git --path .claude/skills/integration-tests--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install genlayerlabs/genlayer-studio integration-tests --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.claude/skills/integration-tests .gemini/skills/integration-tests && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .gemini/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install genlayerlabs/genlayer-studio integration-testsInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .github/skills && cp -r skills-src/.claude/skills/integration-tests .github/skills/integration-tests && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .github/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install genlayerlabs/genlayer-studio integration-tests --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/genlayerlabs/genlayer-studio.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.claude/skills/integration-tests .opencode/skills/integration-tests && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "integration-tests" agent skill from https://github.com/genlayerlabs/genlayer-studio/tree/main/.claude/skills/integration-tests into .opencode/skills/integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "integration-tests", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
integration-testsSetup Python virtual environment and run integration tests with gltest
Integration Tests is an agent skill from genlayerlabs/genlayer-studio. Setup Python virtual environment and run integration tests with gltest
Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering Integration testing. It works with Python. The repository describes itself as: An interactive sandbox to explore the GenLayer Protocol. The licence is MIT.
3 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit c940729. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
pipdocker-composecurlbrewFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use pip and curl, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Integration Tests loads about 1.1k tokens when it runs. Until then it costs about 22 tokens; SKILL.md has 181 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from genlayerlabs/genlayer-studio at commit c940729, republished under its MIT licence (© genlayerlabs). 181 words, ~1,132 tokens.
.claude/skills/integration-tests/SKILL.md (or your agent's skills folder).Setup the Python environment, start the studio, and run integration tests for GenLayer Studio.
pip install virtualenv)The studio must be running before executing integration tests.
# Stop any existing containers and rebuild
docker-compose down && docker-compose up --buildWait for all services to be healthy before proceeding.
In a separate terminal:
# Remove existing venv if present
rm -rf .venv
# Create new venv with Python 3.12
virtualenv -p python3.12 .venv
# Activate
source .venv/bin/activate
# Upgrade pip
pip install --upgrade pip
# Install all dependencies
pip install -r requirements.txt
pip install -r requirements.test.txt
pip install -r backend/requirements.txt
# Set Python path
export PYTHONPATH="$(pwd)"# Activate venv (if not already)
source .venv/bin/activate
export PYTHONPATH="$(pwd)"
# Run all integration tests (serial)
gltest --contracts-dir . tests/integration
# Run tests in parallel (4 workers) - excludes test_validators.py
gltest --contracts-dir . tests/integration -n 4 --ignore=tests/integration/test_validators.py
# Run validator CRUD tests separately (must run serially)
gltest --contracts-dir . tests/integration/test_validators.py
# Run faster with leader-only mode (skips validator consensus)
gltest --contracts-dir . tests/integration --leader-only
# Run specific test file
gltest --contracts-dir . tests/integration/test_specific.py
# Run with verbose output
gltest --contracts-dir . tests/integration -v
# Run specific test function
gltest --contracts-dir . tests/integration/test_file.py::test_function_name-n 4 to run tests in parallel with 4 workers (pytest-xdist)test_validators.py must be excluded from parallel runs (--ignore) because it tests validator CRUD operations and needs exclusive access to the validator statetest_validators.py separately after parallel tests complete# Terminal 1: Start studio
docker-compose down && docker-compose up --build
# Terminal 2: Setup and run tests
rm -rf .venv && \
virtualenv -p python3.12 .venv && \
source .venv/bin/activate && \
pip install --upgrade pip && \
pip install -r requirements.txt && \
pip install -r requirements.test.txt && \
pip install -r backend/requirements.txt && \
export PYTHONPATH="$(pwd)" && \
gltest --contracts-dir . tests/integrationsource .venv/bin/activate && export PYTHONPATH="$(pwd)" && gltest --contracts-dir . tests/integrationsource .venv/bin/activate && export PYTHONPATH="$(pwd)" && \
gltest --contracts-dir . tests/integration -n 4 --ignore=tests/integration/test_validators.py && \
gltest --contracts-dir . tests/integration/test_validators.pysource .venv/bin/activate && export PYTHONPATH="$(pwd)" && gltest --contracts-dir . tests/integration --leader-only# Check if containers are up
docker-compose ps
# Check container logs
docker-compose logs -f backendThe studio needs time to initialize. Wait for all services to be healthy:
# Watch container status
docker-compose ps
# Check backend health
curl http://localhost:4000/health# Check available Python versions
which python3.12
# On macOS with Homebrew
brew install python@3.12# Make sure venv is activated
source .venv/bin/activate
# Reinstall test dependencies
pip install -r requirements.test.txt# Ensure PYTHONPATH is set
export PYTHONPATH="$(pwd)"
# Verify from project root
pwd # Should be genlayer-studioIntegration tests may timeout if the studio is under load. Try:
# Run with leader-only for faster execution
gltest --contracts-dir . tests/integration --leader-only
# Run a single test file to isolate issues
gltest --contracts-dir . tests/integration/test_specific.py -v© genlayerlabs, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .claude/skills/integration-tests of genlayerlabs/genlayer-studio.
Open the folder on GitHubat commit c940729
Integration Tests next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Integration Tests this skillgenlayerlabs/genlayer-studio | 180 | — | ~1.1k | Automated safety check: Pass | MIT | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| Create Flet Control Integration Testsflet-dev/flet | 17k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | |
| Godot E2ERandallLiuXin/GodotMaker | 549 | 1 repos | ~3.9k | Automated safety check: Pass | Custom licence | |
| JS-in-HTML Testingliaohch3/claude-tap | 3.3k | — | ~924 | Automated safety check: Pass | MIT | |
| Run Integration Testsvalkey-io/valkey-search | 145 | — | ~511 | Automated safety check: Pass | BSD-3-Clause |
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
flet-dev/flet
A skill your agent uses when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests.
RandallLiuXin/GodotMaker
Write and run E2E (end-to-end) game tests using the godot-e2e framework.
liaohch3/claude-tap
Tests JavaScript embedded in an HTML file in two layers: pytest checks of the logic ported to Python, and Playwright runs in a real browser for the DOM.
valkey-io/valkey-search
Run or troubleshoot Valkey Search C++ and Python integration tests, including focused development runs, full-suite verification, and packaging/build or runtime failure classification.
wshobson/agents
Test Temporal workflows with pytest, time-skipping, and mocking strategies.
genlayerlabs/genlayer-studio
Debug and manage Cloudflare DNS, cache, and proxy settings using flarectl
genlayerlabs/genlayer-studio
Create GitHub pull requests by analyzing branch diff and following the project template
genlayerlabs/genlayer-studio
Monitor Discord community channel for user-reported bugs and issues
genlayerlabs/genlayer-studio
Debug GenLayer Studio deployments via ArgoCD CLI. An agent skill from genlayerlabs/genlayer-studio.
genlayerlabs/genlayer-studio
Fetch the most urgent Linear issue with tag "studio" and size XS, then fix it
genlayerlabs/genlayer-studio
Fetch, analyze, fix Sentry issues, run tests, and create PRs
Works with
Categories
Setup Python virtual environment and run integration tests with gltest. Integration Tests is an agent skill from genlayerlabs/genlayer-studio.
Integration Tests fits situations like: tasks that involve Integration testing.
Run `npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a claude-code`. Or copy the skill folder (.claude/skills/integration-tests in genlayerlabs/genlayer-studio) into .claude/skills/integration-tests in your project. Claude Code loads it when a task matches its description.
Run `npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a codex`. Or copy the skill folder (.claude/skills/integration-tests in genlayerlabs/genlayer-studio) into .agents/skills/integration-tests in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add genlayerlabs/genlayer-studio --skill integration-tests -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/integration-tests, .gemini/skills/integration-tests, .github/skills/integration-tests and .opencode/skills/integration-tests in your project.
Going by SKILL.md and its folder, Integration Tests needs the command-line tools its instructions call (pip, docker-compose, curl and brew). Our summary lists: Python 3; Docker.
SKILL.md contains no URLs. Its commands use pip and curl, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Integration Tests is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.1k tokens (SKILL.md is roughly 4.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Integration Tests: OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars), Create Flet Control Integration Tests (flet-dev/flet, 17k stars), Godot E2E (RandallLiuXin/GodotMaker, 549 stars) and JS-in-HTML Testing (liaohch3/claude-tap, 3.3k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
genlayerlabs (a GitHub organization) maintains it in genlayerlabs/genlayer-studio, which has 180 GitHub stars. The repository holds 10 skills in this directory. The repository was last updated on September 30, 2026.
Source: genlayerlabs/genlayer-studio on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.