Agent skill

Eeg Model Evaluation Leakage

by Drchronx in Drchronx/ai-agent-research-starter-kit

Audit EEG/BCI model evaluation and prevent data leakage. An agent skill from Drchronx/ai-agent-research-starter-kit.

Custom licenceAuto-check passedData & Analytics

Install Eeg Model Evaluation Leakage

skills CLI
$ npx skills add Drchronx/ai-agent-research-starter-kit --skill eeg-model-evaluation-leakage -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install Drchronx/ai-agent-research-starter-kit eeg-model-evaluation-leakage --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/Drchronx/ai-agent-research-starter-kit.git skills-src && mkdir -p .claude/skills && cp -r skills-src/'本地Skills功能分类库/15_BCI脑电智能建模Skills/eeg-model-evaluation-leakage' .claude/skills/eeg-model-evaluation-leakage && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
eeg-model-evaluation-leakage
GitHub stars
137
Token cost
~413 tokens
SKILL.md length
142 words
Files
3 (incl. scripts)
Skills in repo
36
Repo updated
First seen
Licence
Custom licence

At a glance

Audit EEG/BCI model evaluation and prevent data leakage. An agent skill from Drchronx/ai-agent-research-starter-kit.

  • Works in 6 steps: Identify all possible leakage paths:… → Match validation split to claim:… → Require nested CV when tuning… → …
  • Subject-wise splits
  • SKILL.md covers Inputs, Workflow, Hard Constraints and Output
  • Runs Python scripts from its folder

What it does

Eeg Model Evaluation Leakage is an agent skill from Drchronx/ai-agent-research-starter-kit. Audit EEG/BCI model evaluation and prevent data leakage. Use for subject-wise splits, session-wise splits, trial-window leakage, nested cross-validation, permutation tests, confidence intervals, chance level, repeated runs, class imbalance, and reproducible EEG ML evaluation.

Its SKILL.md is about 410 tokens, which your agent loads only when the skill is triggered. The skill folder holds 4 other files, including scripts (for example `agents/openai.yaml` and `scripts/create_bci_evaluation_audit.py`).

It sits in Data & Analytics, covering Machine learning. The repository describes itself as: AI Agent 科研全流程教学包,能教学生从零部署 Codex、Claude Code、OpenClaw、Hermes 等 Agent,学会使用 Skills、飞书、AMiner、AI4Scholar、Zotero、Obsidian…

When your agent uses it

  • Subject-wise splits
  • Session-wise splits
  • Trial-window leakage
  • Nested cross-validation

Example prompts

  • “/eeg-model-evaluation-leakage”

Requirements

  • Python 3

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Identify all possible leakage paths: preprocessing, filtering, normalization, feature selection, windows, augmentation, hyperparameters…
  2. Match validation split to claim: within-subject, cross-session, cross-subject, or online.
  3. Require nested CV when tuning hyperparameters.
  4. Compute appropriate metrics: balanced accuracy, AUC, F1, confusion matrix, kappa, ITR when relevant.
  5. Estimate uncertainty with subject-level confidence intervals or paired tests.
  6. Run permutation or label-shuffle tests when needed.

What it can do on your machine

Read from SKILL.md and the folder at commit aab1133. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/ (Python), which the agent can run.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Eeg Model Evaluation Leakage loads about 413 tokens when it runs. Until then it costs about 76 tokens; SKILL.md has 142 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~76
When it runs · the whole SKILL.md, loaded when a task matches
~413

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 142 words (~413 tokens).

“Use this skill before trusting any EEG/BCI accuracy number.”

— opening of SKILL.md by Drchronx, Custom licence
name
eeg-model-evaluation-leakage

Read the full SKILL.md on GitHub

Files

SKILL.md and 2 other files (scripts) in 本地Skills功能分类库/15_BCI脑电智能建模Skills/eeg-model-evaluation-leakage of Drchronx/ai-agent-research-starter-kit.

  • SKILL.md
  • agents/openai.yaml
  • scripts/create_bci_evaluation_audit.py

Open the folder on GitHubat commit aab1133

Compare with similar skills

Eeg Model Evaluation Leakage next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Eeg Model Evaluation Leakage compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Eeg Model Evaluation Leakage this skillDrchronx/ai-agent-research-starter-kit137—~413Automated safety check: PassCustom licence
Scikit LearnzLanqing/codex-claude-academic-skills4.7k16 repos~3.9kAutomated safety check: PassBSD-3-Clause
Agentic Kaggle WorkflowFrankS-IntelLab/agentic-kaggle-skill188—~4kAutomated safety check: PassMIT
Senior Data ScientistRaidriar7170/hermes-skilleval1255 repos~1.4kAutomated safety check: PassMIT
Geomlitalo-goncalves/geoML109—~4.6kAutomated safety check: PassGPL-3.0
QuantMind Training Config Generatorqusong0627/QuantMind1.7k—~1.5kAutomated safety check: PassAGPL-3.0

Similar skills

  • Scikit Learn

    zLanqing/codex-claude-academic-skills

    Machine learning in Python with scikit-learn. An agent skill from zLanqing/codex-claude-academic-skills.

    4.7k GitHub starsUsed in 16 repos~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Agentic Kaggle Workflow

    FrankS-IntelLab/agentic-kaggle-skill

    Takes a Kaggle competition from rules and validation design through baselines, ensembling and notebook architecture to a scored submission.

    188 GitHub stars~4k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed
  • Senior Data Scientist

    Raidriar7170/hermes-skilleval

    World-class data science skill for statistical modeling, experimentation, causal inference, and advanced analytics.

    125 GitHub starsUsed in 5 repos~1.4k tokens
    Data & AnalyticsAuto-check passed
  • Geoml

    italo-goncalves/geoML

    Working knowledge of the geoML Python package (github.com/italo-goncalves/geoML): variational Gaussian processes for spatial data, implicit geological modelling, block models, drillhole data…

    109 GitHub stars~4.6k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed
  • Turns a plain-language model training request into a validated QuantMind training config file that can be imported from the Model Training page.

    1.7k GitHub stars~1.5k tokensUpdated today
    Data & AnalyticsAuto-check passed
  • Retention Analysis

    liangdabiao/claude-data-analysis-ultra-main

    Analyze user retention and churn using survival analysis, cohort analysis, and machine learning.

    290 GitHub stars~1.3k tokensUpdated 5 mo ago
    Data & AnalyticsAuto-check: notes

More from Drchronx/ai-agent-research-starter-kit

All 36 skills in this repo
  • Literature Reviewer Skill

    Drchronx/ai-agent-research-starter-kit

    Build high-quality literature reviews from a research topic using a 10-phase workflow.

    137 GitHub stars~2.5k tokensUpdated 4 mo ago
    Auto-check passed
  • Scenario Experiment Analysis

    Drchronx/ai-agent-research-starter-kit

    Analyze scenario/vignette experiment datasets for behavioral research.

    137 GitHub stars~1.1k tokensUpdated 4 mo ago
    Auto-check passed
  • Scenario Experiment Benchmark Mining

    Drchronx/ai-agent-research-starter-kit

    Mine and synthesize real top-journal scenario/vignette experiment patterns for behavioral research.

    137 GitHub stars~1.1k tokensUpdated 4 mo ago
    Auto-check passed
  • Web Browsing

    Drchronx/ai-agent-research-starter-kit

    Browse and summarize websites, extract content from URLs, search the web for information.

    137 GitHub stars~593 tokensUpdated 4 mo ago
    Auto-check passed
  • Multi Source Data Integration Extraction

    Drchronx/ai-agent-research-starter-kit

    Automatically merge scattered Excel and CSV files, normalize column names, and extract structured tables from PDF, HTML, TXT, or Markdown documents.

    137 GitHub stars~671 tokensUpdated 4 mo ago
    Auto-check passed
  • Scientific Slides

    Drchronx/ai-agent-research-starter-kit

    Build slide decks and presentations for research talks using Nano Banana Pro AI.

    137 GitHub stars~9.8k tokensUpdated 4 mo ago
    Auto-check: notes

Questions about Eeg Model Evaluation Leakage

What does Eeg Model Evaluation Leakage do?

Audit EEG/BCI model evaluation and prevent data leakage. An agent skill from Drchronx/ai-agent-research-starter-kit. Eeg Model Evaluation Leakage is an agent skill from Drchronx/ai-agent-research-starter-kit. Audit EEG/BCI model evaluation and prevent data leakage.

When should I use Eeg Model Evaluation Leakage?

Eeg Model Evaluation Leakage fits situations like: subject-wise splits; session-wise splits; trial-window leakage; nested cross-validation.

How do I install Eeg Model Evaluation Leakage in Claude Code?

Run `npx skills add Drchronx/ai-agent-research-starter-kit --skill eeg-model-evaluation-leakage -a claude-code`. Or copy the skill folder (本地Skills功能分类库/15_BCI脑电智能建模Skills/eeg-model-evaluation-leakage in Drchronx/ai-agent-research-starter-kit) into .claude/skills/eeg-model-evaluation-leakage in your project. Claude Code loads it when a task matches its description.

How do I install Eeg Model Evaluation Leakage in Codex?

Run `npx skills add Drchronx/ai-agent-research-starter-kit --skill eeg-model-evaluation-leakage -a codex`. Or copy the skill folder (本地Skills功能分类库/15_BCI脑电智能建模Skills/eeg-model-evaluation-leakage in Drchronx/ai-agent-research-starter-kit) into .agents/skills/eeg-model-evaluation-leakage in your project. Codex loads it when a task matches its description.

Can I use Eeg Model Evaluation Leakage in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add Drchronx/ai-agent-research-starter-kit --skill eeg-model-evaluation-leakage -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/eeg-model-evaluation-leakage, .gemini/skills/eeg-model-evaluation-leakage, .github/skills/eeg-model-evaluation-leakage and .opencode/skills/eeg-model-evaluation-leakage in your project.

What does Eeg Model Evaluation Leakage need to run?

Going by SKILL.md and its folder, Eeg Model Evaluation Leakage needs Python for the scripts in its folder. Our summary lists: Python 3.

Does Eeg Model Evaluation Leakage access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Eeg Model Evaluation Leakage safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Eeg Model Evaluation Leakage use?

Eeg Model Evaluation Leakage has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Eeg Model Evaluation Leakage use?

About 413 tokens (SKILL.md is roughly 1.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Eeg Model Evaluation Leakage?

Skills that share tags, products or a category with Eeg Model Evaluation Leakage: Scikit Learn (zLanqing/codex-claude-academic-skills, 4.7k stars), Agentic Kaggle Workflow (FrankS-IntelLab/agentic-kaggle-skill, 188 stars), Senior Data Scientist (Raidriar7170/hermes-skilleval, 125 stars) and Geoml (italo-goncalves/geoML, 109 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Eeg Model Evaluation Leakage?

Drchronx (a GitHub user) maintains it in Drchronx/ai-agent-research-starter-kit, which has 137 GitHub stars. The repository holds 36 skills in this directory. The repository was last updated on May 19, 2026.

Source: Drchronx/ai-agent-research-starter-kit on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.