Agent skill

Cross Validation

by chekusu in chekusu/wanman

CEO checks consistency of agent outputs during post-completion review

Apache-2.0Auto-check passedData & Analytics

Install Cross Validation

skills CLI
$ npx skills add chekusu/wanman --skill cross-validation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install chekusu/wanman cross-validation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/chekusu/wanman.git skills-src && mkdir -p .claude/skills && cp -r skills-src/packages/core/skills/cross-validation .claude/skills/cross-validation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
cross-validation
GitHub stars
688
Token cost
~824 tokens
SKILL.md length
230 words
Files
1
Skills in repo
6
Repo updated
First seen
Licence
Apache-2.0

At a glance

CEO checks consistency of agent outputs during post-completion review

  • Works in 4 steps: Collect All Output Files → Extract Key Facts → Compare for Consistency → …
  • Tasks that involve Machine learning
  • SKILL.md covers When to Execute, Validation Process, Authoritative Document Priority and Common Inconsistency Patterns, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Cross Validation is an agent skill from chekusu/wanman. CEO checks consistency of agent outputs during post-completion review

Its SKILL.md is about 820 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Machine learning. The repository describes itself as: wanman is an open-source agent matrix runtime inspired by Japanese one-man trains. It lets human users step back into an observer role while local agent runtimes coordinate… The licence is Apache-2.0.

When your agent uses it

  • Tasks that involve Machine learning

Example prompts

  • “/cross-validation”

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Collect All Output Files
  2. Extract Key Facts
  3. Compare for Consistency
  4. Handle Inconsistencies

What it can do on your machine

Read from SKILL.md and the folder at commit d3a8138. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are bash).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Cross Validation loads about 824 tokens when it runs. Until then it costs about 22 tokens; SKILL.md has 230 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~22
When it runs · the whole SKILL.md, loaded when a task matches
~824

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from chekusu/wanman at commit d3a8138, republished under its Apache-2.0 licence (© chekusu). 230 words, ~824 tokens.

Download SKILL.mdSave it as .claude/skills/cross-validation/SKILL.md (or your agent's skills folder).
name
cross-validation
description
CEO checks consistency of agent outputs during post-completion review

Output Consistency Validation

When to Execute

After wanman task list shows all tasks with status=done, perform output consistency validation before inspecting artifact data.

Validation Process

Step 1: Collect All Output Files
bash
# List all agent output files
find /workspace/agents -name "*.md" -o -name "*.html" | grep -v CLAUDE.md | sort
Step 2: Extract Key Facts

Extract the following key information from each file:

Fact TypeExample
Brand name"COFFEE TO"
Tagline"Coffee to, begin."
Address2-XX-XX Kamimeguro, Meguro-ku, Tokyo
Business hours8:00 - 20:00
Opening date2026.4.1
Menu pricesDrip Coffee ¥500
Instagram handle@coffee.to.nakameguro
Color HEX values#2D1B0E, #F5E6D3
Step 3: Compare for Consistency

Cross-check file by file:

Brand guide (marketing) brand name  ←→  Website (dev) brand name
Brand guide tagline                 ←→  Poster (marketing) tagline
Brand guide colors                  ←→  Website CSS colors
Financial report pricing            ←→  Website menu prices
Poster opening date                 ←→  Social media content date
Poster address                      ←→  Website address
Step 4: Handle Inconsistencies

When inconsistencies are found, defer to the earliest completed authoritative document (usually the brand guide) and create a correction task:

bash
# Example: website brand name does not match brand guide
wanman task create "Fix website brand name: unify the brand name on the website from 'KAWA' to 'COFFEE TO' as specified in the brand guide. Update all brand names, taglines, and Instagram handles in index.html. Reference: /workspace/agents/output/marketing/brand-design.md" --assign dev --priority 1

Authoritative Document Priority

When information conflicts, follow this order of precedence:

  1. Brand guide — Brand name, tagline, visual style
  2. Financial report — Prices, cost data
  3. Market research — Competitor data, market data
  4. Website/posters — Must align with the above (not a source of truth)

Common Inconsistency Patterns

PatternCauseFix
Website brand name differs from brand guideDev started website before brand design was completeCreate correction task for dev
Poster prices differ from financial pricingMarketing and finance worked independentlyDefer to finance, fix the poster
Social media dates differ from poster datesSame agent produced outputs at different timesUnify to the latest confirmed date

Preventive Measures

When creating tasks, use --after to declare dependencies:

bash
# Brand design must be completed first
brand_id=$(wanman task create "Brand design" --assign marketing --priority 1 | grep -o '[a-f0-9-]\{36\}')

# Website development depends on brand design
wanman task create "Website development: based on the brand guide..." --assign dev --priority 5 --after $brand_id

# Poster design also depends on brand design
wanman task create "Opening poster: based on the brand guide..." --assign marketing --priority 4 --after $brand_id

© chekusu, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in packages/core/skills/cross-validation of chekusu/wanman.

Open the folder on GitHubat commit d3a8138

Compare with similar skills

Cross Validation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Cross Validation compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Cross Validation this skillchekusu/wanman688—~824Automated safety check: PassApache-2.0
Scikit LearnzLanqing/codex-claude-academic-skills4.6k17 repos~3.9kAutomated safety check: PassBSD-3-Clause
Senior Data ScientistRaidriar7170/hermes-skilleval1256 repos~1.4kAutomated safety check: PassMIT
Agentic Kaggle WorkflowFrankS-IntelLab/agentic-kaggle-skill188—~4kAutomated safety check: PassMIT
Retention Analysisliangdabiao/claude-data-analysis-ultra-main2901 repos~1.3kAutomated safety check: NotesNone
Geomlitalo-goncalves/geoML109—~4.2kAutomated safety check: PassGPL-3.0

Similar skills

  • Scikit Learn

    zLanqing/codex-claude-academic-skills

    Machine learning in Python with scikit-learn. An agent skill from zLanqing/codex-claude-academic-skills.

    4.6k GitHub starsUsed in 17 repos~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Senior Data Scientist

    Raidriar7170/hermes-skilleval

    World-class data science skill for statistical modeling, experimentation, causal inference, and advanced analytics.

    125 GitHub starsUsed in 6 repos~1.4k tokens
    Data & AnalyticsAuto-check passed
  • Agentic Kaggle Workflow

    FrankS-IntelLab/agentic-kaggle-skill

    Takes a Kaggle competition from rules and validation design through baselines, ensembling and notebook architecture to a scored submission.

    188 GitHub stars~4k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed
  • Retention Analysis

    liangdabiao/claude-data-analysis-ultra-main

    Analyze user retention and churn using survival analysis, cohort analysis, and machine learning.

    290 GitHub starsUsed in 1 repo~1.3k tokens
    Data & AnalyticsAuto-check: notes
  • Geoml

    italo-goncalves/geoML

    Working knowledge of the geoML Python package (github.com/italo-goncalves/geoML): variational Gaussian processes for spatial data, implicit geological modelling, block models, drillhole data…

    109 GitHub stars~4.2k tokensUpdated 5 days ago
    Data & AnalyticsAuto-check passed
  • Radiomics ML

    Aperivue/medsci-skills

    A skill your agent uses when building or auditing a radiomics or tabular clinical-ML prediction model with a classical learner (LASSO, SVM, random forest, XGBoost and similar).

    329 GitHub starsUsed in 1 repo~2.7k tokens
    Data & AnalyticsAuto-check passed

More from chekusu/wanman

  • Artifact Naming

    chekusu/wanman

    Naming conventions for artifact kind and path, ensuring data can be aggregated and analyzed

    688 GitHub stars~1.1k tokensUpdated 3 mo ago
    Auto-check passed
  • Artifact Quality

    chekusu/wanman

    Quality standards for structured deliverables, ensuring data is verifiable and traceable

    688 GitHub stars~519 tokensUpdated 3 mo ago
    Auto-check passed
  • Research Methodology

    chekusu/wanman

    Methodology for market research and data collection, ensuring data quality and source traceability

    688 GitHub stars~533 tokensUpdated 3 mo ago
    Auto-check passed
  • Wanman CLI

    chekusu/wanman

    wanman CLI command reference — inter-agent communication, task management, artifact storage

    688 GitHub stars~891 tokensUpdated 3 mo ago
    Auto-check passed
  • Workspace Conventions

    chekusu/wanman

    File and output conventions for agent workspaces. An agent skill from chekusu/wanman.

    688 GitHub stars~357 tokensUpdated 3 mo ago
    Auto-check passed

Questions about Cross Validation

What does Cross Validation do?

CEO checks consistency of agent outputs during post-completion review. Cross Validation is an agent skill from chekusu/wanman.

When should I use Cross Validation?

Cross Validation fits situations like: tasks that involve Machine learning.

How do I install Cross Validation in Claude Code?

Run `npx skills add chekusu/wanman --skill cross-validation -a claude-code`. Or copy the skill folder (packages/core/skills/cross-validation in chekusu/wanman) into .claude/skills/cross-validation in your project. Claude Code loads it when a task matches its description.

How do I install Cross Validation in Codex?

Run `npx skills add chekusu/wanman --skill cross-validation -a codex`. Or copy the skill folder (packages/core/skills/cross-validation in chekusu/wanman) into .agents/skills/cross-validation in your project. Codex loads it when a task matches its description.

Can I use Cross Validation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add chekusu/wanman --skill cross-validation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/cross-validation, .gemini/skills/cross-validation, .github/skills/cross-validation and .opencode/skills/cross-validation in your project.

What does Cross Validation need to run?

SKILL.md names no scripts, command-line tools or credentials: Cross Validation is instructions for the agent only.

Does Cross Validation access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Cross Validation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Cross Validation use?

Cross Validation is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Cross Validation use?

About 824 tokens (SKILL.md is roughly 3.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Cross Validation?

Skills that share tags, products or a category with Cross Validation: Scikit Learn (zLanqing/codex-claude-academic-skills, 4.6k stars), Senior Data Scientist (Raidriar7170/hermes-skilleval, 125 stars), Agentic Kaggle Workflow (FrankS-IntelLab/agentic-kaggle-skill, 188 stars) and Retention Analysis (liangdabiao/claude-data-analysis-ultra-main, 290 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Cross Validation?

chekusu (a GitHub organization) maintains it in chekusu/wanman, which has 688 GitHub stars. The repository holds 6 skills in this directory. The repository was last updated on June 14, 2026.

Source: chekusu/wanman on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.