Opik Verify
comet-ml/opik-mcp
Decide ship or hold for a candidate from the compare skill's numbers, against an explicit release policy — regressions, pass rate, safety-tagged cases, subgroup consistency, latency and cost…
Inspect a ChatGPT Apps MCP server codebase and generate chatgpt-app-submission.json with app info suggestions, tool hint justifications, test cases, and negative test cases, then report review-check…
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install nteract/semiotic chatgpt-app-submission --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .claude/skills && cp -r skills-src/chatgpt-app-submission .claude/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .claude/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/nteract/semiotic/tree/main/chatgpt-app-submissionType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install nteract/semiotic chatgpt-app-submission --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .agents/skills && cp -r skills-src/chatgpt-app-submission .agents/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .agents/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install nteract/semiotic chatgpt-app-submission --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/chatgpt-app-submission .cursor/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .cursor/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/nteract/semiotic.git --path chatgpt-app-submission--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install nteract/semiotic chatgpt-app-submission --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/chatgpt-app-submission .gemini/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .gemini/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install nteract/semiotic chatgpt-app-submissionInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .github/skills && cp -r skills-src/chatgpt-app-submission .github/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .github/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add nteract/semiotic --skill chatgpt-app-submission -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install nteract/semiotic chatgpt-app-submission --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/nteract/semiotic.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/chatgpt-app-submission .opencode/skills/chatgpt-app-submission && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "chatgpt-app-submission" agent skill from https://github.com/nteract/semiotic/tree/main/chatgpt-app-submission into .opencode/skills/chatgpt-app-submission/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "chatgpt-app-submission", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
chatgpt-app-submissionInspect a ChatGPT Apps MCP server codebase and generate chatgpt-app-submission.json with app info suggestions, tool hint justifications, test cases, and negative test cases, then report review-check…
Chatgpt App Submission is an agent skill from nteract/semiotic. Inspect a ChatGPT Apps MCP server codebase and generate chatgpt-app-submission.json with app info suggestions, tool hint justifications, test cases, and negative test cases, then report review-check findings and outputSchema warnings for submission review.
Its SKILL.md is about 2.8k tokens, which your agent loads only when the skill is triggered. The skill folder holds 1 other file.
It sits in Testing & QA, covering Test generation and MCP servers. It works with OpenAI and Model Context Protocol. The repository describes itself as: React data visualization library for streaming, networks, and AI-assisted development. The licence is Apache-2.0.
8 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 13e933d. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
No scripts in the folder and no shell commands in SKILL.md (its code samples are json).
From the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
modelcontextprotocol.iodevelopers.openai.comFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Chatgpt App Submission loads about 2.8k tokens when it runs. Until then it costs about 70 tokens; SKILL.md has 1,315 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from nteract/semiotic at commit 13e933d, republished under its Apache-2.0 licence (© nteract). 1,315 words, ~2,814 tokens.
.claude/skills/chatgpt-app-submission/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.Use this skill when a developer needs a chatgpt-app-submission.json file for a ChatGPT Apps submission. The file is uploaded in the Apps submission form to fill out parts of App Info, MCP Server, and Testing.
readOnlyHint, openWorldHint, and destructiveHint annotations, and whether it declares outputSchema.chatgpt-app-submission.json in the current working directory.outputSchema warnings in the final response, and explain what the developer should do with each finding before submission.Do not infer behavior from the tool name alone. Use the real tool implementation and declared annotations. If a tool calls into another module or API client, inspect enough of that path to know whether it reads, writes, deletes, sends, publishes, or changes external state.
Suggest app info from source-of-truth project metadata and the tool behavior you inspected. Keep it plain-language and submission-review-facing.
display_name: use the product or app name from repo metadata, package metadata, README, manifest, or existing configuration. Keep it short enough for the submission form.subtitle: summarize what the app does in one short functional phrase, not marketing copy. It must be 30 characters or less.description: describe concrete user value and the main workflows the tools support.category: choose one of BUSINESS, COLLABORATION, DESIGN, DEVELOPER_TOOLS, EDUCATION, ENTERTAINMENT, FINANCE, FOOD, LIFESTYLE, NEWS, PRODUCTIVITY, SHOPPING, or TRAVEL.Use the Apps SDK review meanings:
readOnlyHint: true only when the tool strictly fetches, looks up, lists, retrieves, or computes data without changing state. false if it can create, update, delete, send, enqueue, run jobs, write logs, start workflows, or otherwise mutate state.destructiveHint: true if the tool can delete, overwrite, send irreversible messages or transactions, revoke access, or perform destructive admin actions, including via some modes or parameters. Otherwise false.openWorldHint: true if the tool can change publicly visible internet state or external third-party systems, such as sending emails or messages, posting/publishing content, creating public tickets/issues, pushing code/content, or submitting external forms. false if it only operates in closed/private systems.ChatGPT Apps submissions require every tool to set all three hints explicitly. Missing or null hints are submission blockers, even if MCP clients may have protocol-level defaults.
If a hint is missing, null, or does not match the actual behavior you found in code, stop before writing the JSON and ask the developer for approval to update the MCP server source. In the approval request, list each affected tool, the missing/current hint value, the behavior you observed, and the recommended explicit hint value. If the developer approves, make the smallest source change that sets the correct hint explicitly, then generate JSON using the updated values. If the developer does not approve or the correct edit location is ambiguous, do not generate misleading JSON; report the mismatch and the blocked update.
While inspecting exposed MCP tools, record each tool whose descriptor or source definition omits outputSchema or sets it to null. Missing outputSchema is not a blocker for generating chatgpt-app-submission.json, and the submission JSON does not include output schemas.
Do not infer or invent output schemas for this warning. Use the actual MCP tool descriptor or source definition. In the final response, include a concise warning for any missing tools: Add an outputSchema so models can use this tool's results more reliably. See https://modelcontextprotocol.io/specification/draft/server/tools#tool. Include the affected tool names. If every tool declares outputSchema, do not include an outputSchema warning.
Check tool names, tool descriptions, and widget CSP metadata while inspecting the app.
If tool names, descriptions, or CSP values appear missing or inconsistent with actual behavior, prompt the developer for approval before editing source. If the developer declines or the correct edit is ambiguous, keep the generated JSON truthful and report the finding in the final response.
Generate exactly five positive test cases and exactly three negative test cases.
tools_triggered.Write exactly one JSON file named chatgpt-app-submission.json:
{
"$schema": "https://developers.openai.com/apps-sdk/schemas/chatgpt-app-submission.v1.json",
"schema_version": 1,
"app_info": {
"display_name": "Example App",
"subtitle": "Find and update records",
"description": "Example App helps users find records, inspect details, and update workspace data through ChatGPT.",
"category": "PRODUCTIVITY"
},
"tools": {
"tool_name": {
"annotations": {
"readOnlyHint": true,
"openWorldHint": false,
"destructiveHint": false
},
"justifications": {
"read_only_justification": "Only retrieves matching records and does not modify data.",
"open_world_justification": "Does not write to public internet state or third-party systems.",
"destructive_justification": "Does not delete, overwrite, revoke access, or perform irreversible actions."
}
}
},
"test_cases": [
{
"description": "Find records that match a specific user request.",
"user_prompt": "Find my open records for this week.",
"file_attachment_urls": null,
"tools_triggered": "tool_name",
"expected_output": "Returns matching records with enough detail for the user to choose the next action.",
"expected_output_url": null
}
],
"negative_test_cases": [
{
"description": "Do not trigger for unrelated calendar requests.",
"user_prompt": "What meetings do I have tomorrow?",
"file_attachment_urls": null,
"tools_triggered": null,
"expected_output": "The app should not be invoked because the request is outside its supported workflows.",
"expected_output_url": null
}
]
}$schema identifies the import file shape for editors and importers; Codex does not need to fetch it. tools is required. app_info, test_cases, and negative_test_cases are optional in the schema, but generate them whenever the repo contains enough information. Do not include review-check findings in this JSON file.
Good examples:
Only retrieves project metadata and returns it without creating or updating records.Creates a private task in the user's workspace and cannot publish content to public URLs.Deletes the selected workspace document, which cannot be recovered after confirmation.Bad examples:
readOnlyHint is true because the tool is read-only.Probably safe.The function calls client.delete_item(...) in src/server.py.Report these checks in the final response after writing chatgpt-app-submission.json. Do not write them into the JSON file.
For each finding, explain the practical next step: update source, update submission copy, narrow CSP, remove or justify a sensitive input, or manually review before submitting. If there are no findings, say that these checks did not find obvious issues from source inspection.
After writing the file, summarize the app info fields generated, number of tools covered, positive test case count, and negative test case count. Then include a Review findings section with any sensitive data solicitation, tool data use, tool naming, weak CSP findings, or missing outputSchema warnings and what to do with each one. If generation is blocked, lead with the exact missing hints or source ambiguity.
© nteract, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 1 other file in chatgpt-app-submission of nteract/semiotic.
Open the folder on GitHubat commit 13e933d
Chatgpt App Submission next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Chatgpt App Submission this skillnteract/semiotic | 2.7k | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | |
| Opik Verifycomet-ml/opik-mcp | 220 | — | ~2.8k | Automated safety check: Notes | Apache-2.0 | |
| Opik Testcomet-ml/opik-mcp | 220 | — | ~2.8k | Automated safety check: Notes | Apache-2.0 | |
| Create Test Runjeremylongshore/tons-of-skills-marketplace | 2.8k | — | ~3k | Automated safety check: Pass | MIT | |
| Agent QA Authoringvostride/agent-qa | 904 | — | ~569 | Automated safety check: Pass | Custom licence | |
| Agent QA Result Triagevostride/agent-qa | 904 | — | ~394 | Automated safety check: Pass | Custom licence |
comet-ml/opik-mcp
Decide ship or hold for a candidate from the compare skill's numbers, against an explicit release policy — regressions, pass rate, safety-tagged cases, subgroup consistency, latency and cost…
comet-ml/opik-mcp
Turn a failing Opik trace (or a described failure) into a repeatable regression check — a test-suite item with the trace's input and one or two binary assertions — so a fix can be verified by the…
jeremylongshore/tons-of-skills-marketplace
Create a Kobiton test run from a test case or suite, then offer to monitor it.
vostride/agent-qa
A skill your agent uses when creating, editing, validating, or running agent-qa tests, suites, or hooks.
vostride/agent-qa
A skill your agent uses when investigating failed agent-qa runs, inspecting artifacts, classifying failures, or comparing recent runs.
JasonMa0012/MooaToon
A skill your agent uses when writing or modifying UE automated tests (Automation, CQTest, Functional, Gauntlet, LowLevel) with Rider MCP available.
nteract/semiotic
Author a new entry for the Semiotic blog. An agent skill from nteract/semiotic.
nteract/semiotic
Review Semiotic pull requests for behavioral bugs, regressions, contract drift, and missing evidence.
nteract/semiotic
Build, repair, and verify charts in an existing Semiotic project, when Semiotic is explicitly requested, or when evaluating its documented capabilities against a visualization task.
Works with
Inspect a ChatGPT Apps MCP server codebase and generate chatgpt-app-submission.json with app info suggestions, tool hint justifications, test cases, and negative test cases, then report review-check…. Chatgpt App Submission is an agent skill from nteract/semiotic.json with app info suggestions, tool hint justifications, test cases, and negative test cases, then report review-check findings and outputSchema warnings for submission review.
Chatgpt App Submission fits situations like: tasks that involve Test generation; tasks that involve MCP servers.
Run `npx skills add nteract/semiotic --skill chatgpt-app-submission -a claude-code`. Or copy the skill folder (chatgpt-app-submission in nteract/semiotic) into .claude/skills/chatgpt-app-submission in your project. Claude Code loads it when a task matches its description.
Run `npx skills add nteract/semiotic --skill chatgpt-app-submission -a codex`. Or copy the skill folder (chatgpt-app-submission in nteract/semiotic) into .agents/skills/chatgpt-app-submission in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add nteract/semiotic --skill chatgpt-app-submission -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/chatgpt-app-submission, .gemini/skills/chatgpt-app-submission, .github/skills/chatgpt-app-submission and .opencode/skills/chatgpt-app-submission in your project.
SKILL.md names no scripts, command-line tools or credentials: Chatgpt App Submission is instructions for the agent only.
SKILL.md names 2 domains. In commands or code: modelcontextprotocol.io and developers.openai.com; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Chatgpt App Submission is published under the Apache-2.0 licence (from the LICENSE file in the skill folder). It allows redistribution, so the full SKILL.md is shown on this page.
About 2.8k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Chatgpt App Submission: Opik Verify (comet-ml/opik-mcp, 220 stars), Opik Test (comet-ml/opik-mcp, 220 stars), Create Test Run (jeremylongshore/tons-of-skills-marketplace, 2.8k stars) and Agent QA Authoring (vostride/agent-qa, 904 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
nteract (a GitHub organization) maintains it in nteract/semiotic, which has 2,714 GitHub stars. The repository holds 4 skills in this directory. The repository was last updated on October 10, 2026.
Source: nteract/semiotic on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.