OpenHarness End-to-End Evals
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
A skill your agent uses when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests.
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install flet-dev/flet create-flet-control-integration-tests --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .claude/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .claude/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-testsType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install flet-dev/flet create-flet-control-integration-tests --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .agents/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .agents/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install flet-dev/flet create-flet-control-integration-tests --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .cursor/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .cursor/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/flet-dev/flet.git --path .agents/skills/create-flet-control-integration-tests--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install flet-dev/flet create-flet-control-integration-tests --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .gemini/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .gemini/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install flet-dev/flet create-flet-control-integration-testsInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .github/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .github/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .github/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install flet-dev/flet create-flet-control-integration-tests --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/flet-dev/flet.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.agents/skills/create-flet-control-integration-tests .opencode/skills/create-flet-control-integration-tests && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "create-flet-control-integration-tests" agent skill from https://github.com/flet-dev/flet/tree/main/.agents/skills/create-flet-control-integration-tests into .opencode/skills/create-flet-control-integration-tests/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "create-flet-control-integration-tests", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
create-flet-control-integration-testsA skill your agent uses when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests.
Create Flet Control Integration Tests is an agent skill from flet-dev/flet. Use when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests.
Its SKILL.md is about 1.4k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA, covering Integration testing. It works with Python. The repository describes itself as: Build realtime web, mobile and desktop apps in Python only. No frontend experience required. The licence is Apache-2.0.
2 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 9748de3. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
uvFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use uv, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Create Flet Control Integration Tests loads about 1.4k tokens when it runs. Until then it costs about 54 tokens; SKILL.md has 348 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from flet-dev/flet at commit 9748de3, republished under its Apache-2.0 licence (© flet-dev). 348 words, ~1,370 tokens.
.claude/skills/create-flet-control-integration-tests/SKILL.md (or your agent's skills folder).Use this skill when adding, updating, or reviewing integration tests for a Flet control (core, material, cupertino, theme, services, types, or examples).
Use it for:
Pick the closest existing suite first:
sdk/python/packages/flet/integration_tests/controls/coresdk/python/packages/flet/integration_tests/controls/materialsdk/python/packages/flet/integration_tests/controls/cupertinosdk/python/packages/flet/integration_tests/controls/themesdk/python/packages/flet/integration_tests/controls/typessdk/python/packages/flet/integration_tests/controls/servicessdk/python/packages/flet/integration_tests/examplesPrefer adding tests to an existing file for the same control. Create a new test file only when no suitable file exists.
Do not mix loop_scope="module" and loop_scope="function" tests in the same file.
Naming convention:
test_<control>.py for module-scoped visual/stable tests (uses flet_app)test_<control>_isolated.py for function-scoped tests that require a fresh app per test (uses flet_app_function)Use fixtures from integration_tests/conftest.py:
flet_app (loop_scope="module"): best for stable visual tests and bulk screenshot tests.flet_app_function (loop_scope="function"): best for tests that mutate state and must run in a separate app each.theme_mode explicitly when visuals matterrequest.node.name can be used as screenshot key.FLET_TEST_GOLDEN=1 and re-run without golden mode.await flet_app.assert_control_screenshot(
request.node.name,
control,
)flet_app_function.assert_screenshot(
request.node.name,
await flet_app_function.page.take_screenshot(
pixel_ratio=flet_app_function.screenshots_pixel_ratio
),
)finder = await flet_app_function.tester.find_by_tooltip("Info tooltip")
assert finder.count == 1test_<control>.py)import pytest
import flet as ft
import flet.testing as ftt
@pytest.mark.asyncio(loop_scope="module")
async def test_<behavior>(flet_app: ftt.FletTestApp, request):
flet_app.page.theme_mode = ft.ThemeMode.LIGHT
await flet_app.assert_control_screenshot(
request.node.name,
ft.Container(width=240, height=80, alignment=ft.Alignment.CENTER),
)test_<control>_isolated.py)import pytest
import flet as ft
import flet.testing as ftt
@pytest.mark.asyncio(loop_scope="function")
async def test_<behavior>(flet_app_function: ftt.FletTestApp):
flet_app_function.page.add(ft.IconButton(icon=ft.Icons.INFO, tooltip="Info"))
await flet_app_function.tester.pump_and_settle()
finder = await flet_app_function.tester.find_by_tooltip("Info")
assert finder.count == 1Run one test file:
uv run pytest -s -o log_cli=true -o log_cli_level=INFO packages/flet/integration_tests/controls/core/test_control.pyRun a subset:
uv run pytest -s -o log_cli=true -o log_cli_level=INFO packages/flet/integration_tests/controls/core/test_control.py -k test_visibleGenerate or update goldens:
FLET_TEST_GOLDEN=1 uv run pytest -s -o log_cli=true -o log_cli_level=INFO packages/flet/integration_tests/controls/core/test_control.pymodule and function scope tests are in separate files.test_<control>_isolated.py naming convention.request.node.name preferred).sdk/python/packages/flet/integration_tests/README.mdsdk/python/packages/flet/integration_tests/conftest.pysdk/python/packages/flet/integration_tests/controls/core/test_control.pysdk/python/packages/flet/integration_tests/controls/core/test_control_isolated.pysdk/python/packages/flet/integration_tests/controls/core/test_layout_control.pysdk/python/packages/flet/integration_tests/examples/core/test_control.pysdk/python/examples/controls/control© flet-dev, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .agents/skills/create-flet-control-integration-tests of flet-dev/flet.
Open the folder on GitHubat commit 9748de3
Create Flet Control Integration Tests next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Create Flet Control Integration Tests this skillflet-dev/flet | 17k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| Godot E2ERandallLiuXin/GodotMaker | 549 | 1 repos | ~3.9k | Automated safety check: Pass | Custom licence | |
| JS-in-HTML Testingliaohch3/claude-tap | 3.3k | — | ~924 | Automated safety check: Pass | MIT | |
| Run Integration Testsvalkey-io/valkey-search | 145 | — | ~511 | Automated safety check: Pass | BSD-3-Clause | |
| Temporal Python Testingwshobson/agents | 40k | 11 repos | ~1.2k | Automated safety check: Pass | MIT |
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
RandallLiuXin/GodotMaker
Write and run E2E (end-to-end) game tests using the godot-e2e framework.
liaohch3/claude-tap
Tests JavaScript embedded in an HTML file in two layers: pytest checks of the logic ported to Python, and Playwright runs in a real browser for the DOM.
valkey-io/valkey-search
Run or troubleshoot Valkey Search C++ and Python integration tests, including focused development runs, full-suite verification, and packaging/build or runtime failure classification.
wshobson/agents
Test Temporal workflows with pytest, time-skipping, and mocking strategies.
s-morgan-jeffries/apple-mail-fast-mcp
A skill your agent uses when setting up, running, or debugging integration tests against real Apple Mail.
flet-dev/flet
A skill your agent uses when asked to create Flet example projects from flat .py files with main.py and pyproject.toml metadata for Gallery/MCP indexing.
flet-dev/flet
A skill your agent uses when asked to build, preview, or verify the Flet documentation website, including checking for broken links, broken images, and unresolved reST cross-references.
flet-dev/flet
A skill your agent uses when writing or reviewing Flet documentation, including Python docstrings (Google style, reST roles, admonitions), Markdown docs (cross-references, images, code examples)…
flet-dev/flet
A skill your agent uses when adding or changing deprecations for Python controls/APIs in sdk/python/packages/, including V.deprecated fields, deprecated decorators, version lifecycle, and docs…
flet-dev/flet
Create or update a Flet release announcement blog post from changelog notes, matching existing /blog style.
flet-dev/flet
A skill your agent uses whenever editing validation for Python controls in sdk/python/packages/: adding/changing constrained properties, Raises: ValueError docstrings, beforeupdate() checks, raise…
Works with
Categories
A skill your agent uses when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests. Create Flet Control Integration Tests is an agent skill from flet-dev/flet. Use when asked to create or update integration tests for any Flet control in sdk/python/packages/flet/integrationtests, including visual goldens and interactive behavior tests.
Create Flet Control Integration Tests fits situations like: asked to create; update integration tests for any Flet control in sdk/python/packages/flet/integrationtests; including visual goldens and interactive behavior tests.
Run `npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a claude-code`. Or copy the skill folder (.agents/skills/create-flet-control-integration-tests in flet-dev/flet) into .claude/skills/create-flet-control-integration-tests in your project. Claude Code loads it when a task matches its description.
Run `npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a codex`. Or copy the skill folder (.agents/skills/create-flet-control-integration-tests in flet-dev/flet) into .agents/skills/create-flet-control-integration-tests in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add flet-dev/flet --skill create-flet-control-integration-tests -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/create-flet-control-integration-tests, .gemini/skills/create-flet-control-integration-tests, .github/skills/create-flet-control-integration-tests and .opencode/skills/create-flet-control-integration-tests in your project.
Going by SKILL.md and its folder, Create Flet Control Integration Tests needs the command-line tools its instructions call (uv). Our summary lists: Python 3.
SKILL.md contains no URLs. Its commands use uv, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Create Flet Control Integration Tests is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.4k tokens (SKILL.md is roughly 5.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Create Flet Control Integration Tests: OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars), Godot E2E (RandallLiuXin/GodotMaker, 549 stars), JS-in-HTML Testing (liaohch3/claude-tap, 3.3k stars) and Run Integration Tests (valkey-io/valkey-search, 145 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
flet-dev (a GitHub organization) maintains it in flet-dev/flet, which has 17,265 GitHub stars. The repository holds 14 skills in this directory. The repository was last updated on October 7, 2026.
Source: flet-dev/flet on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.