Agent skill

Opentraces Skill Verifier

by JayFarei in JayFarei/opentraces

Author a trace-grounded, CALIBRATED verifier for one skill, two ways: an interactive ALIGNMENT SESSION (manual) or AUTOVERIFY (the agent self-aligns to the skill's goal).

Custom licenceAuto-check passedEducation

Install Opentraces Skill Verifier

skills CLI
$ npx skills add JayFarei/opentraces --skill opentraces-skill-verifier -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install JayFarei/opentraces opentraces-skill-verifier --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/JayFarei/opentraces.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skill/verifier-creator .claude/skills/opentraces-skill-verifier && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
opentraces-skill-verifier
GitHub stars
100
Token cost
~1.6k tokens
SKILL.md length
778 words
Files
1
Skills in repo
13
Repo updated
First seen
Licence
Custom licence

At a glance

Author a trace-grounded, CALIBRATED verifier for one skill, two ways: an interactive ALIGNMENT SESSION (manual) or AUTOVERIFY (the agent self-aligns to the skill's goal).

  • Works in 8 steps: ORIENT — read_skill_definition(skill):… → list_candidates(skill) — evidence +… → get_skill_examples(skill, episodes=...)… → …
  • Autoverify a verifier/rubric for a skill
  • SKILL.md covers Trust boundary (read first), Two modes, Criterion vocabulary and The loop (both modes), plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Opentraces Skill Verifier is an agent skill from JayFarei/opentraces. Author a trace-grounded, CALIBRATED verifier for one skill, two ways: an interactive ALIGNMENT SESSION (manual) or AUTOVERIFY (the agent self-aligns to the skill's goal). Use this skill when asked to build, align, calibrate, or autoverify a verifier/rubric for a skill. The agent proposes a rubric; the factory scores it against evidence + labels; a human approves promotion.

Its SKILL.md is about 1.6k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Education, covering Quizzes and assessments. It works with Git. The repository describes itself as: A local-first evidence layer for agent work, capturing what the agent sees, does, and changes.

When your agent uses it

  • Autoverify a verifier/rubric for a skill
  • Tasks that involve Quizzes and assessments

Example prompts

  • “/opentraces-skill-verifier”

Workflow steps

8 steps, taken from the first numbered list in SKILL.md.

  1. ORIENT — read_skill_definition(skill): read the TARGET skill's goal. In MANUAL mode,
  2. list_candidates(skill) — evidence + which markers are deficient + calibration
  3. get_skill_examples(skill, episodes=...) — real example vs counterexample trace refs.
  4. Author the rubric
  5. Judge the semantic criteria (agent): for each agent criterion × trace,
  6. Label (manual): record_human_label(package_dir, ..., label=0|1, human_confirm=True) —
  7. calibrate_rubric(rubric, episodes=...) — per-criterion precision/recall/discrimination,
  8. score_rubric / present for approval — only on calibrated/provisional. The headline

What it can do on your machine

Read from SKILL.md and the folder at commit 354755d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Opentraces Skill Verifier loads about 1.6k tokens when it runs. Until then it costs about 100 tokens; SKILL.md has 778 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~100
When it runs · the whole SKILL.md, loaded when a task matches
~1.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 778 words (~1,650 tokens).

“A skill verifier is a calibrated rubric, not a checklist. The reframe that governs everything here:”

— opening of SKILL.md by JayFarei, Custom licence
name
opentraces-skill-verifier

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skill/verifier-creator of JayFarei/opentraces.

Open the folder on GitHubat commit 354755d

Compare with similar skills

Opentraces Skill Verifier next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Opentraces Skill Verifier compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Opentraces Skill Verifier this skillJayFarei/opentraces100—~1.6kAutomated safety check: PassCustom licence
Researcherkrzysztofdudek/ResearcherSkill265—~5.5kAutomated safety check: WarnMIT
Darwin SkillHHU3637kr/skills1451 repos~2.2kAutomated safety check: PassNone
DeepTutor CLIHKUDS/DeepTutor41k—~2.8kAutomated safety check: PassApache-2.0
AI Engineering Placement Quizrohitg00/ai-engineering-from-scratch66k—~2kAutomated safety check: PassMIT
Codebase to Coursezarazhangrui/codebase-to-course5.7k—~4.4kAutomated safety check: PassNone

Similar skills

  • Researcher

    krzysztofdudek/ResearcherSkill

    A skill your agent uses when user wants to optimize or tune something measurable through repeated experiments — "make X faster", "improve [metric]", "find best config", "iterate overnight", "run…

    265 GitHub stars~5.5k tokensUpdated 5 days ago
    EducationAuto-check: warnings
  • Darwin Skill

    HHU3637kr/skills

    Darwin Skill (达尔文.skill): autonomous skill optimizer inspired by Karpathy's autoresearch.

    145 GitHub starsUsed in 1 repo~2.2k tokens
    Agent WorkflowsAuto-check passed
  • DeepTutor CLI

    HKUDS/DeepTutor

    Teaches the agent to set up and run DeepTutor from the command line: chat and capabilities, knowledge bases, partners, memory, sessions, notebooks and the server or Web app.

    41k GitHub stars~2.8k tokensUpdated 2 days ago
    EducationAuto-check passed
  • AI Engineering Placement Quiz

    rohitg00/ai-engineering-from-scratch

    Runs a 10-question quiz across five areas to place a learner in the AI Engineering from Scratch curriculum, so they skip what they already know.

    66k GitHub stars~2k tokensUpdated today
    EducationAuto-check passed
  • Codebase to Course

    zarazhangrui/codebase-to-course

    Turns a codebase into an interactive single-page HTML course for non-technical learners, with scroll modules, animated diagrams, quizzes and plain-English code translations.

    5.7k GitHub stars~4.4k tokensUpdated 6 mo ago
    EducationAuto-check passed
  • AI Engineering Phase Quiz

    rohitg00/ai-engineering-from-scratch

    Quizzes you on a completed phase of the AI Engineering from Scratch course, taking a phase number or name and mapping it to that phase's directory.

    66k GitHub stars~2.1k tokensUpdated today
    EducationAuto-check passed

More from JayFarei/opentraces

All 13 skills in this repo
  • Opentraces Marketing

    JayFarei/opentraces

    Generate branded marketing screenshots of opentraces CLI commands — wordmark + CLI card + caption + wallpaper, filename-stamped and auto-copied to the clipboard.

    100 GitHub stars~2.3k tokensUpdated 4 days ago
    Auto-check passed
  • Docs Update

    JayFarei/opentraces

    Synchronize all documentation surfaces after code changes. An agent skill from JayFarei/opentraces.

    100 GitHub stars~4.6k tokensUpdated 4 days ago
    Auto-check passed
  • Deploy Site

    JayFarei/opentraces

    Land every site-related fix on main, deploy opentraces.ai to Vercel production, and verify it works across all pages (desktop + mobile) and the email-capture flow, fixing and re-deploying until green.

    100 GitHub stars~4.3k tokensUpdated 4 days ago
    Auto-check passed
  • Gitsync

    JayFarei/opentraces

    Sync both git repos in this project: opentraces (root) and closedtraces (kb/).

    100 GitHub stars~589 tokensUpdated 4 days ago
    Auto-check passed
  • New Plan

    JayFarei/opentraces

    Create a new plan document in kb/plans/ for the opentraces project.

    100 GitHub stars~2k tokensUpdated 4 days ago
    Auto-check passed
  • PR Intent Summary V1

    JayFarei/opentraces

    Per-commit trace lineage rows for a branch context, deterministic.

    100 GitHub stars~534 tokensUpdated 4 days ago
    Auto-check passed

Works with

Categories

Questions about Opentraces Skill Verifier

What does Opentraces Skill Verifier do?

Author a trace-grounded, CALIBRATED verifier for one skill, two ways: an interactive ALIGNMENT SESSION (manual) or AUTOVERIFY (the agent self-aligns to the skill's goal). Opentraces Skill Verifier is an agent skill from JayFarei/opentraces. Author a trace-grounded, CALIBRATED verifier for one skill, two ways: an interactive ALIGNMENT SESSION (manual) or AUTOVERIFY (the agent self-aligns to the skill's goal).

When should I use Opentraces Skill Verifier?

Opentraces Skill Verifier fits situations like: autoverify a verifier/rubric for a skill; tasks that involve Quizzes and assessments.

How do I install Opentraces Skill Verifier in Claude Code?

Run `npx skills add JayFarei/opentraces --skill opentraces-skill-verifier -a claude-code`. Or copy the skill folder (skill/verifier-creator in JayFarei/opentraces) into .claude/skills/opentraces-skill-verifier in your project. Claude Code loads it when a task matches its description.

How do I install Opentraces Skill Verifier in Codex?

Run `npx skills add JayFarei/opentraces --skill opentraces-skill-verifier -a codex`. Or copy the skill folder (skill/verifier-creator in JayFarei/opentraces) into .agents/skills/opentraces-skill-verifier in your project. Codex loads it when a task matches its description.

Can I use Opentraces Skill Verifier in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add JayFarei/opentraces --skill opentraces-skill-verifier -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/opentraces-skill-verifier, .gemini/skills/opentraces-skill-verifier, .github/skills/opentraces-skill-verifier and .opencode/skills/opentraces-skill-verifier in your project.

What does Opentraces Skill Verifier need to run?

SKILL.md names no scripts, command-line tools or credentials: Opentraces Skill Verifier is instructions for the agent only.

Does Opentraces Skill Verifier access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Opentraces Skill Verifier safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Opentraces Skill Verifier use?

Opentraces Skill Verifier has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Opentraces Skill Verifier use?

About 1.6k tokens (SKILL.md is roughly 6.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Opentraces Skill Verifier?

Skills that share tags, products or a category with Opentraces Skill Verifier: Researcher (krzysztofdudek/ResearcherSkill, 265 stars), Darwin Skill (HHU3637kr/skills, 145 stars), DeepTutor CLI (HKUDS/DeepTutor, 41k stars) and AI Engineering Placement Quiz (rohitg00/ai-engineering-from-scratch, 66k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Opentraces Skill Verifier?

JayFarei (a GitHub user) maintains it in JayFarei/opentraces, which has 100 GitHub stars. The repository holds 13 skills in this directory. The repository was last updated on October 6, 2026.

Source: JayFarei/opentraces on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.