SDK AI Bot Run Evaluation
Azure/azure-sdk-tools
Run Azure SDK QA bot evaluations on curated datasets locally, including a single test case.
Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing.
Install Gate Check
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install undefined-ui/second-brain-os gate-check --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .claude/skills/gate-check && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .claude/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-checkType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install undefined-ui/second-brain-os gate-check --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .agents/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .agents/skills/gate-check && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .agents/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install undefined-ui/second-brain-os gate-check --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .cursor/skills/gate-check && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .cursor/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/undefined-ui/second-brain-os.git --path plugins/agents-course/skills/gate-check--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install undefined-ui/second-brain-os gate-check --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .gemini/skills/gate-check && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .gemini/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install undefined-ui/second-brain-os gate-checkInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .github/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .github/skills/gate-check && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .github/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add undefined-ui/second-brain-os --skill gate-check -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install undefined-ui/second-brain-os gate-check --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/undefined-ui/second-brain-os.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/plugins/agents-course/skills/gate-check .opencode/skills/gate-check && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "gate-check" agent skill from https://github.com/undefined-ui/second-brain-os/tree/main/plugins/agents-course/skills/gate-check into .opencode/skills/gate-check/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "gate-check", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
gate-check- GitHub stars
- 999
- Token cost
- ~861 tokens
- SKILL.md length
- 391 words
- Files
- 1
- Skills in repo
- 23
- Repo updated
- First seen
- Licence
- MIT
At a glance
Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing.
- Works in 5 steps: Map the decisions. Read the pipeline's… → Count what each costs today. For each… → Propose the cheapest gate that can hold… → …
- The user asks to cut model costs
- SKILL.md covers Workflow and Output format
- Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
What it does
Gate Check is an agent skill from undefined-ui/second-brain-os. Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing. Use when the user asks to cut model costs or latency, says the big model handles everything, or wants a triage / routing / filter layer in front of an agent. Analysis plus an optional baseline scaffold. Do NOT use for auditing context layout (context-audit) or for building eval suites (evals-bootstrap).
Its SKILL.md is about 860 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Knowledge Management, covering LLM evaluation. The repository describes itself as: An AI second brain that maintains itself. Full guide, starter vault, agent skills and scripts for a self-organizing knowledge base in Claude Code and Obsidian. The licence is MIT.
When your agent uses it
- The user asks to cut model costs
- Says the big model handles everything
- Wants a triage / routing / filter layer in front of an agent
- Auditing context layout (context-audit)
Example prompts
- “/gate-check”
Workflow steps
5 steps, taken from the first numbered list in SKILL.md.
- Map the decisions. Read the pipeline's entry points and prompts and
- Count what each costs today. For each decision currently made by the
- Propose the cheapest gate that can hold it, in rising order of cost
- Route fail-closed. Every gate needs a confidence threshold, and doubt
- Offer the baseline scaffold. If the user wants to proceed, generate
What it can do on your machine
Read from SKILL.md and the folder at commit d6861cc. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
Network
Links to these hosts (documentation or services it may open):
undefined-ui.github.io
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Gate Check loads about 861 tokens when it runs. Until then it costs about 123 tokens; SKILL.md has 391 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from undefined-ui/second-brain-os at commit d6861cc, republished under its MIT licence (© undefined-ui). 391 words, ~861 tokens.
Download SKILL.mdSave it as
.claude/skills/gate-check/SKILL.md (or your agent's skills folder).- name
- gate-check
- description
- Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing. Use when the user asks to cut model costs or latency, says the big model handles everything, or wants a triage / routing / filter layer in front of an agent. Analysis plus an optional baseline scaffold. Do NOT use for auditing context layout (context-audit) or for building eval suites (evals-bootstrap).
Find the gates
Theory: Cheap decisions and Gate practice. An agent does two kinds of work: it writes, which needs a big model, and it decides — is this spam, which queue, does this need a person — which is a bounded question the answer to which comes from a set you already know. A gate is a cheap decision layer that sorts the stream so the expensive model only sees the items that actually need judgement.
Workflow
- Map the decisions. Read the pipeline's entry points and prompts and list every decision made before or during a model call: classification, routing, filtering, yes/no triage, priority, language, "is this even for us". Ignore the writing — only bounded decisions with a known label set.
- Count what each costs today. For each decision currently made by the big model: calls per day if known, tokens per call, and what a wrong answer costs. A decision worth one bit that burns a frontier call is the headline finding.
- Propose the cheapest gate that can hold it, in rising order of cost:
- a rule — regex, allowlist, header check: free, instant, blind to anything unanticipated; always the first layer, never the last
- a classic classifier — logistic regression or similar over simple features, trained on a few hundred labelled examples: milliseconds, fractions of a cent, and the baseline every fancier option must beat
- a small / System One model — when the input is too varied for features but the output is still a label with a confidence score
- Route fail-closed. Every gate needs a confidence threshold, and doubt goes down the safe path: unsure means escalate to the big model (or a person), never means guess. Say explicitly what each gate's unsure route is.
- Offer the baseline scaffold. If the user wants to proceed, generate
the module's thirty-minute exercise for their data: a
label.pythat samples ~200 real examples for hand-labelling, and abaseline.pythat trains the classic classifier and prints accuracy against a held-out split. Every vendor claim and small-model option must beat this number on their data before it earns a place in the pipeline.
Show full SKILL.md (39 more words)Show less
Output format
Gate check — <pipeline>
decisions found: <n>, currently on the big model: <n>
1. <decision> — <where in the code>
today: <who decides, est. cost> label set: <the labels>
gate: <rule | classifier | small model> — <why this tier>
unsure -> <escalation path>
saves: <est. calls/tokens diverted>
...Rank by savings. If a decision genuinely needs the big model — open-ended, no stable label set, wrong answers are cheap to fix — say so and leave it alone; a gate that guesses is worse than no gate.
© undefined-ui, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
Just SKILL.md in plugins/agents-course/skills/gate-check of undefined-ui/second-brain-os.
Open the folder on GitHubat commit d6861cc
Compare with similar skills
Gate Check next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Gate Check this skillundefined-ui/second-brain-os | 999 | — | ~861 | Automated safety check: Pass | MIT | |
| SDK AI Bot Run EvaluationAzure/azure-sdk-tools | 134 | — | ~1.1k | Automated safety check: Notes | MIT | |
| Qmdalsk1992/CloddsBot | 2.9k | 3 repos | ~1.2k | Automated safety check: Pass | MIT | |
| Gitnexus CLIaws-samples/sample-kolya-br-proxy | 106 | 10 repos | ~822 | Automated safety check: Pass | MIT-0 | |
| Ragu BuildRaguTeam/RAGU | 135 | — | ~3.8k | Automated safety check: Notes | MIT | |
| Analyze Id Eval Rankingopen-thoughts/OpenThoughts-Agent | 301 | — | ~3.1k | Automated safety check: Pass | Apache-2.0 |
Similar skills
- Official
Qmd
alsk1992/CloddsBot
Local hybrid search for markdown notes and docs. An agent skill from alsk1992/CloddsBot.
- Official
Gitnexus CLI
aws-samples/sample-kolya-br-proxy
A skill your agent uses when the user needs to run GitNexus CLI commands like analyze/index a repo, check status, clean the index, generate a wiki, or list indexed repos.
Ragu Build
RaguTeam/RAGU
Interview the user about their RAGU use case, select an appropriate RAGU pipeline, and generate a validated ragubuild.yaml plus a runnable build<name.py script.
Analyze Id Eval Ranking
open-thoughts/OpenThoughts-Agent
Given a list of models (HF name stubs) that have valid agentic ID eval scores in Supabase, build a ranking table: raw per-benchmark accuracy on the 3 ID benchmarks (SWE-Bench-100…
Using Mineecho Skills
Health-Yang/MineEcho
技能系统导航。当用户询问"你能做什么"、"有什么功能"、"有什么技能"或不确定如何完成某个任务时，使用此技能列出所有可用技能并建议最合适的技能。此技能是每个对话开始时默认加载的，用于技能发现。
More from undefined-ui/second-brain-os
All 23 skills in this repoContext Audit
undefined-ui/second-brain-os
Audit an agent's context layout against the four places: system prompt, tools, history, tail.
Evals Bootstrap
undefined-ui/second-brain-os
Scaffold a first eval suite for an agent: mine real failures into cases, write behavioural checks over traces, and generate the runner.
Goal Test
undefined-ui/second-brain-os
Turn a vague task into a testable definition of done and generate an executable goal-test script for it, optionally with a bounded retry loop around a headless agent.
Harness Audit
undefined-ui/second-brain-os
Audit an agent's harness against the four rings: containment, guides, sensors, permissions.
Second Brain Chat Import
undefined-ui/second-brain-os
Triage an exported chat history into what to ingest, what to archive and what to delete, with a privacy pass first.
Second Brain Graph
undefined-ui/second-brain-os
Analyse the vault's link graph and report on its shape: orphan rate, average degree, components, hubs, bridges and clusters, with what each number means for retrieval.
Related
Categories
Questions about Gate Check
What does Gate Check do?
Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing. Gate Check is an agent skill from undefined-ui/second-brain-os. Find the decisions in a pipeline that do not need the expensive model and propose the gate for each: a rule, a classic classifier, or a small model, with fail-closed routing.
When should I use Gate Check?
Gate Check fits situations like: the user asks to cut model costs; says the big model handles everything; wants a triage / routing / filter layer in front of an agent; auditing context layout (context-audit).
How do I install Gate Check in Claude Code?
Run `npx skills add undefined-ui/second-brain-os --skill gate-check -a claude-code`. Or copy the skill folder (plugins/agents-course/skills/gate-check in undefined-ui/second-brain-os) into .claude/skills/gate-check in your project. Claude Code loads it when a task matches its description.
How do I install Gate Check in Codex?
Run `npx skills add undefined-ui/second-brain-os --skill gate-check -a codex`. Or copy the skill folder (plugins/agents-course/skills/gate-check in undefined-ui/second-brain-os) into .agents/skills/gate-check in your project. Codex loads it when a task matches its description.
Can I use Gate Check in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add undefined-ui/second-brain-os --skill gate-check -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/gate-check, .gemini/skills/gate-check, .github/skills/gate-check and .opencode/skills/gate-check in your project.
What does Gate Check need to run?
SKILL.md names no scripts, command-line tools or credentials: Gate Check is instructions for the agent only.
Does Gate Check access the network?
SKILL.md names 1 domain. As links in the text: undefined-ui.github.io. This is read from the text; nothing was executed.
Is Gate Check safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Gate Check use?
Gate Check is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Gate Check use?
About 861 tokens (SKILL.md is roughly 3.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Gate Check?
Skills that share tags, products or a category with Gate Check: SDK AI Bot Run Evaluation (Azure/azure-sdk-tools, 134 stars), Qmd (alsk1992/CloddsBot, 2.9k stars), Gitnexus CLI (aws-samples/sample-kolya-br-proxy, 106 stars) and Ragu Build (RaguTeam/RAGU, 135 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Gate Check?
undefined-ui (a GitHub user) maintains it in undefined-ui/second-brain-os, which has 999 GitHub stars. The repository holds 23 skills in this directory. The repository was last updated on September 29, 2026.
Source: undefined-ui/second-brain-os on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.