Web Application Testing
anthropics/skills
Tests local web applications with Python Playwright scripts, checking frontend behavior, capturing screenshots and reading browser console logs.
Property-based testing (PBT) patterns with fast-check (JS/TS), Hypothesis (Python), and gopter (Go).
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install vibeeval/vibecosystem property-based-testing --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/property-based-testing .claude/skills/property-based-testing && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .claude/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testingType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install vibeeval/vibecosystem property-based-testing --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/property-based-testing .agents/skills/property-based-testing && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .agents/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install vibeeval/vibecosystem property-based-testing --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/property-based-testing .cursor/skills/property-based-testing && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .cursor/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/vibeeval/vibecosystem.git --path skills/property-based-testing--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install vibeeval/vibecosystem property-based-testing --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/property-based-testing .gemini/skills/property-based-testing && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .gemini/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install vibeeval/vibecosystem property-based-testingInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/property-based-testing .github/skills/property-based-testing && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .github/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add vibeeval/vibecosystem --skill property-based-testing -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install vibeeval/vibecosystem property-based-testing --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vibeeval/vibecosystem.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/property-based-testing .opencode/skills/property-based-testing && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "property-based-testing" agent skill from https://github.com/vibeeval/vibecosystem/tree/main/skills/property-based-testing into .opencode/skills/property-based-testing/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "property-based-testing", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
property-based-testingProperty-based testing (PBT) patterns with fast-check (JS/TS), Hypothesis (Python), and gopter (Go).
Property Based Testing is an agent skill from vibeeval/vibecosystem. Property-based testing (PBT) patterns with fast-check (JS/TS), Hypothesis (Python), and gopter (Go). Generate random inputs, define invariants, shrink failures to minimal cases. Adapted from Trail of Bits. Use when testing pure functions, parsers, serializers, state machines, or any code where example-based tests miss edge cases.
Its SKILL.md is about 2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Testing & QA. It works with Python. The repository describes itself as: AI software team for Claude Code - 138 agents, 295 skills, 73 hooks. Self-learning, multi-agent swarm, autonomous skill evolution. The licence is MIT.
Read from SKILL.md and the folder at commit 3b763b1. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
npmpipgoFrom the folder's file list and the shell code blocks in SKILL.md.
Links to these hosts (documentation or services it may open):
github.comFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Property Based Testing loads about 2k tokens when it runs. Until then it costs about 89 tokens; SKILL.md has 327 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from vibeeval/vibecosystem at commit 3b763b1, republished under its MIT licence (© vibeeval). 327 words, ~1,961 tokens.
.claude/skills/property-based-testing/SKILL.md (or your agent's skills folder).Instead of testing specific examples, define properties that must hold for ALL inputs. The framework generates hundreds of random inputs and finds the smallest failing case.
| Use Case | Property |
|---|---|
| Serialization roundtrip | deserialize(serialize(x)) === x |
| Sort function | Output is ordered AND contains same elements |
| Parser | Never crashes on any input |
| Encoder/decoder | decode(encode(x)) === x |
| State machine | Invariants hold after any sequence of operations |
| Math/financial | Associativity, commutativity, identity, bounds |
| API handler | Never returns 500 on valid input |
| Data transformation | Output schema matches specification |
npm install --save-dev fast-checkimport fc from 'fast-check'
// Property: sorting is idempotent
test('sort is idempotent', () => {
fc.assert(
fc.property(fc.array(fc.integer()), (arr) => {
const sorted = [...arr].sort((a, b) => a - b)
const sortedTwice = [...sorted].sort((a, b) => a - b)
expect(sorted).toEqual(sortedTwice)
})
)
})
// Property: serialization roundtrip
test('JSON roundtrip preserves data', () => {
fc.assert(
fc.property(fc.jsonValue(), (value) => {
expect(JSON.parse(JSON.stringify(value))).toEqual(value)
})
)
})// Generate valid email addresses
const emailArb = fc.tuple(
fc.stringOf(fc.constantFrom(...'abcdefghijklmnopqrstuvwxyz0123456789'.split('')), { minLength: 1 }),
fc.constantFrom('gmail.com', 'example.com', 'test.org')
).map(([local, domain]) => `${local}@${domain}`)
// Generate valid user objects
const userArb = fc.record({
id: fc.uuid(),
name: fc.string({ minLength: 1, maxLength: 100 }),
email: emailArb,
age: fc.integer({ min: 0, max: 150 }),
role: fc.constantFrom('admin', 'user', 'viewer')
})
// Generate valid but adversarial strings
const adversarialStringArb = fc.oneof(
fc.constant(''),
fc.constant(' '),
fc.constant('\0'),
fc.constant('<script>alert(1)</script>'),
fc.constant("Robert'); DROP TABLE users;--"),
fc.constant('../../../etc/passwd'),
fc.unicodeString(),
fc.string({ minLength: 10000, maxLength: 100000 }) // Very long
)// Test a cache against a simple Map model
class CacheModel {
private model = new Map<string, string>()
set(key: string, value: string): void { this.model.set(key, value) }
get(key: string): string | undefined { return this.model.get(key) }
delete(key: string): void { this.model.delete(key) }
size(): number { return this.model.size }
}
const cacheCommands = [
fc.tuple(fc.string(), fc.string()).map(([k, v]) => ({
check: (model: CacheModel) => true,
run: (model: CacheModel, real: Cache) => {
model.set(k, v)
real.set(k, v)
expect(real.get(k)).toBe(model.get(k))
},
toString: () => `set(${k}, ${v})`
})),
fc.string().map((k) => ({
check: (model: CacheModel) => true,
run: (model: CacheModel, real: Cache) => {
model.delete(k)
real.delete(k)
expect(real.get(k)).toBe(model.get(k))
},
toString: () => `delete(${k})`
}))
]
test('cache behaves like Map', () => {
fc.assert(
fc.property(fc.commands(cacheCommands), (cmds) => {
const model = new CacheModel()
const real = new Cache()
fc.modelRun(() => ({ model, real }), cmds)
})
)
})pip install hypothesisfrom hypothesis import given, strategies as st, settings
@given(st.lists(st.integers()))
def test_sort_preserves_length(xs):
assert len(sorted(xs)) == len(xs)
@given(st.lists(st.integers()))
def test_sort_preserves_elements(xs):
assert sorted(sorted(xs)) == sorted(xs)
@given(st.text())
def test_encode_decode_roundtrip(s):
assert s.encode('utf-8').decode('utf-8') == s
# With settings
@settings(max_examples=1000, deadline=None)
@given(st.dictionaries(st.text(), st.integers()))
def test_dict_operations(d):
import json
assert json.loads(json.dumps(d)) == dfrom hypothesis import strategies as st
# Valid email strategy
emails = st.builds(
lambda local, domain: f"{local}@{domain}",
local=st.from_regex(r'[a-z0-9]{1,20}', fullmatch=True),
domain=st.sampled_from(['gmail.com', 'example.com'])
)
# Valid user strategy
users = st.fixed_dictionaries({
'name': st.text(min_size=1, max_size=100),
'email': emails,
'age': st.integers(min_value=0, max_value=150),
'role': st.sampled_from(['admin', 'user', 'viewer'])
})go get github.com/leanovate/gopterfunc TestSortIdempotent(t *testing.T) {
properties := gopter.NewProperties(gopter.DefaultTestParameters())
properties.Property("sort is idempotent", prop.ForAll(
func(xs []int) bool {
sorted := make([]int, len(xs))
copy(sorted, xs)
sort.Ints(sorted)
sortedTwice := make([]int, len(sorted))
copy(sortedTwice, sorted)
sort.Ints(sortedTwice)
return reflect.DeepEqual(sorted, sortedTwice)
},
gen.SliceOf(gen.Int()),
))
properties.TestingRun(t)
}| Property | Definition | Example |
|---|---|---|
| Identity | f(x, identity) === x | add(x, 0) === x |
| Commutativity | f(a, b) === f(b, a) | add(a, b) === add(b, a) |
| Associativity | f(f(a, b), c) === f(a, f(b, c)) | add(add(a, b), c) === add(a, add(b, c)) |
| Idempotency | f(f(x)) === f(x) | sort(sort(xs)) === sort(xs) |
| Roundtrip | g(f(x)) === x | decode(encode(x)) === x |
| Invariant | property(f(x)) === true | length(sort(xs)) === length(xs) |
| Property | Check |
|---|---|
| No crash | Function never throws for any valid input |
| Bounded output | Output size is proportional to input size |
| No mutation | Input is not modified by the function |
| Deterministic | Same input always produces same output |
| Monotonic | If a <= b then f(a) <= f(b) |
When a property fails, the framework automatically shrinks the failing input to the smallest case that still fails:
Original failing input: [482, -1, 0, 99, -384, 7, 42, 0, -1]
Shrunk to: [1, 0]
This tells you the bug is about: handling zero in a list with other elementsTips:
{ endOnFailure: true }Inspired by Trail of Bits property-based-testing plugin.
© vibeeval, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/property-based-testing of vibeeval/vibecosystem.
Open the folder on GitHubat commit 3b763b1
Property Based Testing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Property Based Testing this skillvibeeval/vibecosystem | 531 | — | ~2k | Automated safety check: Pass | MIT | |
| Web Application Testinganthropics/skills | 180k | 51 repos | ~966 | Automated safety check: Pass | Apache-2.0 | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| Adk Verify Snippetsgoogle/adk-python | 22k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | |
| Apple Container Test RunnerRustPython/RustPython | 22k | — | ~467 | Automated safety check: Pass | MIT | |
| JSON Repair Docs Demo Local Testmangiucugna/json_repair | 5.1k | — | ~549 | Automated safety check: Pass | MIT |
anthropics/skills
Tests local web applications with Python Playwright scripts, checking frontend behavior, capturing screenshots and reading browser console logs.
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
google/adk-python
Checks that every Python code block in a Markdown file actually compiles and runs, by extracting each block to a temporary file, executing it in an isolated subprocess, and writing a pass/fail…
RustPython/RustPython
Runs RustPython tests inside a Linux container built with Apple's container CLI, so macOS users can compare Linux results with their local ones.
mangiucugna/json_repair
Runs the json_repair docs demo against a local Flask API and static server, so changes to docs/app.py or the docs UI are checked end to end before publishing.
astral-sh/ruff
A skill your agent uses when a user asks to wobble ty constraint ordering, check constraint-set or TDD ordering determinism, test reversed constraint/typevar IDs, or investigate nondeterministic ty…
vibeeval/vibecosystem
Framework for measuring and tracking agent response quality over time.
vibeeval/vibecosystem
Security-focused differential code review with blast radius analysis, risk-adaptive depth (DEEP/FOCUSED/SURGICAL), git history correlation, and structured finding format.
vibeeval/vibecosystem
A skill your agent uses when making any factual claim about the codebase — existence, absence, or behavior.
vibeeval/vibecosystem
Systematic false positive verification for security findings.
vibeeval/vibecosystem
n8n otomasyon workflow'lari. An agent skill from vibeeval/vibecosystem.
vibeeval/vibecosystem
A skill your agent uses when context compression is imminent, when resuming a session, or when preserving critical decisions across long tasks.
Works with
Categories
Property-based testing (PBT) patterns with fast-check (JS/TS), Hypothesis (Python), and gopter (Go). Property Based Testing is an agent skill from vibeeval/vibecosystem. Property-based testing (PBT) patterns with fast-check (JS/TS), Hypothesis (Python), and gopter (Go).
Property Based Testing fits situations like: testing pure functions; any code where example-based tests miss edge cases.
Run `npx skills add vibeeval/vibecosystem --skill property-based-testing -a claude-code`. Or copy the skill folder (skills/property-based-testing in vibeeval/vibecosystem) into .claude/skills/property-based-testing in your project. Claude Code loads it when a task matches its description.
Run `npx skills add vibeeval/vibecosystem --skill property-based-testing -a codex`. Or copy the skill folder (skills/property-based-testing in vibeeval/vibecosystem) into .agents/skills/property-based-testing in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add vibeeval/vibecosystem --skill property-based-testing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/property-based-testing, .gemini/skills/property-based-testing, .github/skills/property-based-testing and .opencode/skills/property-based-testing in your project.
Going by SKILL.md and its folder, Property Based Testing needs the command-line tools its instructions call (npm, pip and go). Our summary lists: Python 3; Node.js.
SKILL.md names 1 domain. As links in the text: github.com. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Property Based Testing is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 2k tokens (SKILL.md is roughly 7.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Property Based Testing: Web Application Testing (anthropics/skills, 180k stars), OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars), Adk Verify Snippets (google/adk-python, 22k stars) and Apple Container Test Runner (RustPython/RustPython, 22k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
vibeeval (a GitHub user) maintains it in vibeeval/vibecosystem, which has 531 GitHub stars. The repository holds 12 skills in this directory. The repository was last updated on August 8, 2026.
Source: vibeeval/vibecosystem on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.