Agent skill

OpenResponses Compliance Tests

by lobehub in lobehub/lobehub

Runs the official OpenResponses compliance test suite against a local or remote Response API endpoint and helps diagnose schema and authentication failures.

Custom licenceAuto-check: notesTesting & QA

Install OpenResponses Compliance Tests

skills CLI
$ npx skills add lobehub/lobehub --skill response-compliance -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install lobehub/lobehub response-compliance --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/lobehub/lobehub.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/response-compliance .claude/skills/response-compliance && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
response-compliance
GitHub stars
83k
Token cost
~996 tokens
SKILL.md length
219 words
Files
1
Skills in repo
50
Repo updated
First seen
Licence
Custom licence

At a glance

Runs the official OpenResponses compliance test suite against a local or remote Response API endpoint and helps diagnose schema and authentication failures.

  • Works in 2 steps: Run with -v to see full request/response… → Common failure patterns
  • Checking the Response API against the OpenResponses test suite
  • SKILL.md covers Quick Start, Prerequisites, Auth Modes and Test IDs, plus 4 more sections
  • Calls bun; needs API_KEY

What it does

The skill runs the official OpenResponses compliance suite against LobeHub's api/v1/responses endpoint. A script in packages/openapi clones the openresponses repository into a gitignored folder on the first run, updates it on later runs and starts its CLI test runner. Prerequisites are a dev server with ENABLE_MOCK_DEV_USER set to true and the responses route registered. Three auth modes are available: the dev mock user, an API key, or a custom header with a key.

Tests can be selected with --filter using IDs such as basic-response, streaming-response, system-prompt, tool-calling, image-input and multi-turn, each tied to an issue number. APP_URL defaults to http://localhost:3010 and API_KEY can replace the command-line flag. For debugging, run with -v to see full request and response payloads. One common failure, Failed to parse JSON, means authentication failed and the server returned an HTML redirect.

When your agent uses it

  • Checking the Response API against the OpenResponses test suite
  • Reproducing an endpoint schema failure for a single test case
  • Running the compliance tests with an API key against a remote server

Example prompts

  • “Run the OpenResponses compliance tests against my local dev server.”
  • “Run only the streaming-response and tool-calling tests with verbose output.”
  • “The tests fail with Failed to parse JSON. Work out what is wrong with the auth setup.”

Requirements

  • A running dev server with the responses route registered
  • Network access to clone the openresponses repository on the first run

Workflow steps

2 steps, taken from the first numbered list in SKILL.md.

  1. Run with -v to see full request/response payloads
  2. Common failure patterns

What it can do on your machine

Read from SKILL.md and the folder at commit 1e86647. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • bun

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • github.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

OpenResponses Compliance Tests loads about 996 tokens when it runs. Until then it costs about 28 tokens; SKILL.md has 219 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~28
When it runs · the whole SKILL.md, loaded when a task matches
~996

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NoteMentions a .env fileSKILL.md:36
    ing with `ENABLE_MOCK_DEV_USER=true` in `.env`

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 219 words (~996 tokens).

“Run the official OpenResponses compliance test suite against the local (or remote) Response API endpoint.”

— opening of SKILL.md by lobehub, Custom licence
name
response-compliance

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .agents/skills/response-compliance of lobehub/lobehub.

Open the folder on GitHubat commit 1e86647

Compare with similar skills

OpenResponses Compliance Tests next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

OpenResponses Compliance Tests compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
OpenResponses Compliance Tests this skilllobehub/lobehub83k—~996Automated safety check: NotesCustom licence
Integration Tests for pRESTprest/prest4.6k—~1.1kAutomated safety check: PassMIT
Reasoning Serialization Teststailcallhq/forgecode7.6k—~1kAutomated safety check: PassApache-2.0
Rust API Test Harnesshashgraph-online/awesome-codex-plugins1.3k—~1.7kAutomated safety check: PassMIT
API Testingpetrkindlmann/qa-skills170—~2.7kAutomated safety check: PassMIT
Create Testrundeck/rundeck6.3k—~3.2kAutomated safety check: PassApache-2.0

Similar skills

  • Guides writing and reviewing pREST Docker-based integration tests so every HTTP request is explained by step comments or table-driven descriptions.

    4.6k GitHub stars~1.1k tokensUpdated today
    Testing & QAAuto-check passed
  • Reasoning Serialization Tests

    tailcallhq/forgecode

    Checks that ReasoningConfig fields are serialized into the right provider-specific JSON for OpenRouter, Anthropic, GitHub Copilot and Codex requests.

    7.6k GitHub stars~1k tokensUpdated today
    Testing & QAAuto-check passed
  • Rust API Test Harness

    hashgraph-online/awesome-codex-plugins

    A skill your agent uses when adding, changing, testing, or debugging Rust HTTP APIs and services, especially when Codex needs black-box integration tests, random-port app startup, real database test…

    1.3k GitHub stars~1.7k tokensUpdated today
    Testing & QAAuto-check passed
  • API Testing

    petrkindlmann/qa-skills

    Test REST and GraphQL APIs with Playwright APIRequestContext, Supertest, or standalone HTTP clients.

    170 GitHub stars~2.7k tokensUpdated 4 mo ago
    Testing & QAAuto-check passed
  • Create Test

    rundeck/rundeck

    Create backend tests for Rundeck (unit, API, functional). An agent skill from rundeck/rundeck.

    6.3k GitHub stars~3.2k tokensUpdated today
    Testing & QAAuto-check passed
  • API Testing REST

    PramodDutta/qaskills

    Comprehensive RESTful API testing patterns covering HTTP methods, status codes, request/response validation, authentication, error handling, and contract testing.

    235 GitHub stars~4.9k tokensUpdated 5 days ago
    Testing & QAAuto-check passed

More from lobehub/lobehub

All 50 skills in this repo
  • Builds single-file interactive HTML prototypes rendered with the real LobeHub UI components and written as production-style React, so they can later be split into files.

    83k GitHub stars~1.6k tokensUpdated today
    Auto-check passed
  • Verifies a delivery end to end by driving the real product on a CLI, web, desktop or iOS Simulator surface, capturing evidence and publishing a round with the lh CLI.

    83k GitHub stars~9.7k tokensUpdated today
    Auto-check passed
  • Git Worktree Cleanup

    lobehub/lobehub

    Audits stale Git worktrees and branches with a bundled script, classifies each one, and deletes only after you approve the exact candidates.

    83k GitHub stars~2.8k tokensUpdated today
    Auto-check passed
  • Maintains LobeHub's model-backed alint rule set: writing rules, removing false positives against real code, deciding warn versus error and tracking token cost.

    83k GitHub stars~1.9k tokensUpdated today
    Auto-check passed
  • Guides building LobeHub builtin agent tools, from the manifest and execution runtime to executors, chat UI renders and registry wiring.

    83k GitHub stars~2.4k tokensUpdated today
    Auto-check passed
  • Explains how LobeHub client code fetches data through services, SWR store hooks and cache keys, and when to avoid useEffect fetching or duplicated state.

    83k GitHub stars~1.8k tokensUpdated today
    Auto-check passed

Categories

Questions about OpenResponses Compliance Tests

What does OpenResponses Compliance Tests do?

Runs the official OpenResponses compliance test suite against a local or remote Response API endpoint and helps diagnose schema and authentication failures. The skill runs the official OpenResponses compliance suite against LobeHub's api/v1/responses endpoint. A script in packages/openapi clones the openresponses repository into a gitignored folder on the first run, updates it on later runs and starts its CLI test runner.

When should I use OpenResponses Compliance Tests?

OpenResponses Compliance Tests fits situations like: checking the Response API against the OpenResponses test suite; reproducing an endpoint schema failure for a single test case; running the compliance tests with an API key against a remote server.

How do I install OpenResponses Compliance Tests in Claude Code?

Run `npx skills add lobehub/lobehub --skill response-compliance -a claude-code`. Or copy the skill folder (.agents/skills/response-compliance in lobehub/lobehub) into .claude/skills/response-compliance in your project. Claude Code loads it when a task matches its description.

How do I install OpenResponses Compliance Tests in Codex?

Run `npx skills add lobehub/lobehub --skill response-compliance -a codex`. Or copy the skill folder (.agents/skills/response-compliance in lobehub/lobehub) into .agents/skills/response-compliance in your project. Codex loads it when a task matches its description.

Can I use OpenResponses Compliance Tests in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add lobehub/lobehub --skill response-compliance -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/response-compliance, .gemini/skills/response-compliance, .github/skills/response-compliance and .opencode/skills/response-compliance in your project.

What does OpenResponses Compliance Tests need to run?

Going by SKILL.md and its folder, OpenResponses Compliance Tests needs the command-line tools its instructions call (bun) and credentials named API_KEY. Our summary lists: A running dev server with the responses route registered; Network access to clone the openresponses repository on the first run.

Does OpenResponses Compliance Tests access the network?

SKILL.md names 1 domain. As links in the text: github.com. This is read from the text; nothing was executed.

Is OpenResponses Compliance Tests safe to install?

Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does OpenResponses Compliance Tests use?

OpenResponses Compliance Tests has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does OpenResponses Compliance Tests use?

About 996 tokens (SKILL.md is roughly 4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to OpenResponses Compliance Tests?

Skills that share tags, products or a category with OpenResponses Compliance Tests: Integration Tests for pREST (prest/prest, 4.6k stars), Reasoning Serialization Tests (tailcallhq/forgecode, 7.6k stars), Rust API Test Harness (hashgraph-online/awesome-codex-plugins, 1.3k stars) and API Testing (petrkindlmann/qa-skills, 170 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains OpenResponses Compliance Tests?

lobehub (a GitHub organization) maintains it in lobehub/lobehub, which has 83,095 GitHub stars. The repository holds 50 skills in this directory. The repository was last updated on October 10, 2026.

Source: lobehub/lobehub on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.