Agent skill

Assessment Validity Checker

by GarethManning in GarethManning/education-agent-skills

Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives.

Custom licenceAuto-check passedEducation

Install Assessment Validity Checker

skills CLI
$ npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install GarethManning/education-agent-skills assessment-validity-checker --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/GarethManning/education-agent-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/curriculum-assessment/assessment-validity-checker .claude/skills/assessment-validity-checker && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
assessment-validity-checker
GitHub stars
840
Token cost
~4.9k tokens
SKILL.md length
1,690 words
Files
1
Skills in repo
160
Repo updated
First seen
Licence
Custom licence

At a glance

Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives.

  • Works in 5 steps: MAJOR: Construct-irrelevant variance… → MAJOR: Construct-irrelevant variance… → MODERATE: Construct underrepresentation.… → …
  • Quality-assuring assessments before deployment
  • SKILL.md covers What This Skill Does, Evidence Foundation, Input Schema and Prompt, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Assessment Validity Checker is an agent skill from GarethManning/education-agent-skills. Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives. Use when reviewing or quality-assuring assessments before deployment.

Its SKILL.md is about 4.9k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Education, covering Lesson planning. The repository describes itself as: 165 evidence-grounded AI skills for teachers, school leaders and EdTech builders—pedagogy, learning science, curriculum, assessment and regeneration. Claude, Codex and Hermes.

When your agent uses it

  • Quality-assuring assessments before deployment
  • Tasks that involve Lesson planning

Example prompts

  • “/assessment-validity-checker”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. MAJOR: Construct-irrelevant variance from visual design. 30% of marks assess design skill, not geography. This means the assessment score…
  2. MAJOR: Construct-irrelevant variance from presentation. 30% of marks assess public speaking, disadvantaging EAL, anxious, and…
  3. MODERATE: Construct underrepresentation. Effects of climate change are not assessed despite being in the intended learning. Explanation of…
  4. MODERATE: Low reliability. "Visually appealing" is subjective. Presentation marks lack a rubric. Content marks don't distinguish quality…
  5. MINOR: Consequential validity. Mark weighting incentivises decoration over learning.

What it can do on your machine

Read from SKILL.md and the folder at commit 6bbbce4. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Assessment Validity Checker loads about 4.9k tokens when it runs. Until then it costs about 50 tokens; SKILL.md has 1,690 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~50
When it runs · the whole SKILL.md, loaded when a task matches
~4.9k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,690 words (~4,918 tokens).

“Evaluates a proposed assessment against three dimensions: validity (does it measure what it claims to measure?), reliability (would different markers agree on the score?), and authenticity (is the task meaningful and does it require genuine demonstration of the intended learning?)…”

— opening of SKILL.md by GarethManning, Custom licence
name
assessment-validity-checker
disable-model-invocation
false
user-invocable
true
effort
medium
skill_id
curriculum-assessment/assessment-validity-checker
skill_name
Assessment Validity Checker
domain
curriculum-assessment
version
1.0
evidence_strength
strong
evidence_sources
Wiliam (2011) — Embedded Formative Assessment, Messick (1989) — Validity in educational measurement: a unified validity framework, Kane (2006) — Validation as…
output_schema.type
object

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/curriculum-assessment/assessment-validity-checker of GarethManning/education-agent-skills.

Open the folder on GitHubat commit 6bbbce4

Compare with similar skills

Assessment Validity Checker next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Assessment Validity Checker compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Assessment Validity Checker this skillGarethManning/education-agent-skills840—~4.9kAutomated safety check: PassCustom licence
K-12 Core Literacy Lesson DesignTHU-MAIC/OpenMAIC40k—~2.4kAutomated safety check: PassMIT
Zone of Proximal Development Practice LessonsTHU-MAIC/OpenMAIC40k—~1.1kAutomated safety check: PassMIT
Curriculum PlannerTHU-MAIC/OpenMAIC40k—~2.8kAutomated safety check: PassMIT
Deep Interactive Course DesignTHU-MAIC/OpenMAIC40k—~681Automated safety check: PassMIT
Learndair-ai/dair-academy-plugins6142 repos~1.3kAutomated safety check: PassMIT

Similar skills

  • Designs a Chinese K-12 classroom for one OpenMAIC stage around the core-literacy model, using authentic tasks, performance assessment and observable evidence.

    40k GitHub stars~2.4k tokensUpdated today
    EducationAuto-check passed
  • Designs a review-and-practice lesson around an independent first attempt, targeted feedback, supported practice, a fresh independent check and a next step.

    40k GitHub stars~1.1k tokensUpdated today
    EducationAuto-check passed
  • Curriculum Planner

    THU-MAIC/OpenMAIC

    Plans a multi-classroom series such as a seven-day course, clarifies the brief in rounds, gets sign-off on the full lesson list, then builds each stage in a shared folder.

    40k GitHub stars~2.8k tokensUpdated today
    EducationAuto-check passed
  • Plans online courses so learners manipulate simulations, diagrams, code, games or 3D scenes on most pages, with slides only for the opening and the close.

    40k GitHub stars~681 tokensUpdated today
    EducationAuto-check passed
  • Learn

    dair-ai/dair-academy-plugins

    Help a user learn a topic through adaptive tutoring, lesson planning, practice, retrieval checks, explanations, study guides, or exercises.

    614 GitHub starsUsed in 2 repos~1.3k tokens
    EducationAuto-check passed
  • Turns a concept or lesson material into a Feynman-style classroom where learners explain first, find their smallest gap, rebuild the idea and apply it somewhere new.

    40k GitHub stars~955 tokensUpdated today
    EducationAuto-check passed

More from GarethManning/education-agent-skills

All 160 skills in this repo
  • Academic Language Sentence Frame Generator

    GarethManning/education-agent-skills

    Generate tiered sentence frames for academic tasks that scaffold language production across proficiency levels.

    840 GitHub stars~5.1k tokensUpdated 1 mo ago
    Auto-check passed
  • Adaptive Hint Sequence Designer

    GarethManning/education-agent-skills

    Generate a cascading hint sequence for a problem type, revealing progressively without giving answers.

    840 GitHub stars~5.4k tokensUpdated 1 mo ago
    Auto-check passed
  • Agency Circles For Systems Action

    GarethManning/education-agent-skills

    Map control, influence, and concern after systems analysis. An agent skill from GarethManning/education-agent-skills.

    840 GitHub stars~2.3k tokensUpdated 1 mo ago
    Auto-check passed
  • Agency Scaffold Generator

    GarethManning/education-agent-skills

    Generate scaffolds that gradually increase student choice, voice, and ownership within a learning task.

    840 GitHub stars~5.6k tokensUpdated 1 mo ago
    Auto-check passed
  • AI Expertise Interrogation Designer

    GarethManning/education-agent-skills

    Design a Funhouse Mirror activity where students use their own domain expertise to detect AI distortions, omissions, and overconfidence.

    840 GitHub stars~5.8k tokensUpdated 1 mo ago
    Auto-check passed
  • AI Feedback Design Principles

    GarethManning/education-agent-skills

    Audit and redesign AI-generated feedback for pedagogical quality, timing, and learning impact.

    840 GitHub stars~5.8k tokensUpdated 1 mo ago
    Auto-check passed

Categories

Questions about Assessment Validity Checker

What does Assessment Validity Checker do?

Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives. Assessment Validity Checker is an agent skill from GarethManning/education-agent-skills. Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives.

When should I use Assessment Validity Checker?

Assessment Validity Checker fits situations like: quality-assuring assessments before deployment; tasks that involve Lesson planning.

How do I install Assessment Validity Checker in Claude Code?

Run `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -a claude-code`. Or copy the skill folder (skills/curriculum-assessment/assessment-validity-checker in GarethManning/education-agent-skills) into .claude/skills/assessment-validity-checker in your project. Claude Code loads it when a task matches its description.

How do I install Assessment Validity Checker in Codex?

Run `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -a codex`. Or copy the skill folder (skills/curriculum-assessment/assessment-validity-checker in GarethManning/education-agent-skills) into .agents/skills/assessment-validity-checker in your project. Codex loads it when a task matches its description.

Can I use Assessment Validity Checker in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add GarethManning/education-agent-skills --skill assessment-validity-checker -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/assessment-validity-checker, .gemini/skills/assessment-validity-checker, .github/skills/assessment-validity-checker and .opencode/skills/assessment-validity-checker in your project.

What does Assessment Validity Checker need to run?

SKILL.md names no scripts, command-line tools or credentials: Assessment Validity Checker is instructions for the agent only.

Does Assessment Validity Checker access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Assessment Validity Checker safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Assessment Validity Checker use?

Assessment Validity Checker has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Assessment Validity Checker use?

About 4.9k tokens (SKILL.md is roughly 20k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Assessment Validity Checker?

Skills that share tags, products or a category with Assessment Validity Checker: K-12 Core Literacy Lesson Design (THU-MAIC/OpenMAIC, 40k stars), Zone of Proximal Development Practice Lessons (THU-MAIC/OpenMAIC, 40k stars), Curriculum Planner (THU-MAIC/OpenMAIC, 40k stars) and Deep Interactive Course Design (THU-MAIC/OpenMAIC, 40k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Assessment Validity Checker?

GarethManning (a GitHub user) maintains it in GarethManning/education-agent-skills, which has 840 GitHub stars. The repository holds 160 skills in this directory. The repository was last updated on August 28, 2026.

Source: GarethManning/education-agent-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.