New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

AI Engineering Phase Quiz

by rohitg00 in rohitg00/ai-engineering-from-scratch

Quizzes you on a completed phase of the AI Engineering from Scratch course, taking a phase number or name and mapping it to that phase's directory.

MITAuto-check passedEducation

Install AI Engineering Phase Quiz

skills CLI
$ npx skills add rohitg00/ai-engineering-from-scratch --skill check-understanding -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install rohitg00/ai-engineering-from-scratch check-understanding --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/rohitg00/ai-engineering-from-scratch.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/check-understanding .claude/skills/check-understanding && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
check-understanding
GitHub stars
66k
Token cost
~2.1k tokens
SKILL.md length
1,053 words
Files
1
Skills in repo
16
Repo updated
First seen
Licence
MIT

At a glance

Quizzes you on a completed phase of the AI Engineering from Scratch course, taking a phase number or name and mapping it to that phase's directory.

  • Works in 8 steps: Resolve the Phase → Read the Phase Content → Generate 8 Questions → …
  • Checking your knowledge after finishing a phase of the AI Engineering from Scratch course
  • SKILL.md covers Activation, Input, Phase Map and Procedure, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

The skill activates on phrases such as quiz me on phase 2, check my understanding of transformers, or the /check-understanding command with a phase argument. It accepts a phase number from 0 to 19 or a phase name, and when none is given it asks which of the 20 phases to test and lists them. A phase map ties each number and alias, such as dl, cv, nlp, rl or mcp, to a directory under phases/ and a phase name.

The phases run from setup and tooling through math foundations, ML fundamentals, deep learning, computer vision, NLP, speech and audio, transformers, generative AI, reinforcement learning, LLMs from scratch, LLM engineering, multimodal AI, tools and protocols, agent engineering, autonomous systems, multi-agent systems, infrastructure, and ethics and safety, to capstone projects. Resolving the phase is the first step of the procedure that follows.

When your agent uses it

  • Checking your knowledge after finishing a phase of the AI Engineering from Scratch course
  • Deciding whether you are ready for the next phase
  • Reviewing a single topic area such as transformers or reinforcement learning

Example prompts

  • “Quiz me on phase 3.”
  • “Check my understanding of transformers.”
  • “/check-understanding deep-learning”
  • “Am I ready for the next phase after finishing computer vision?”

Requirements

  • A local copy of the AI Engineering from Scratch course repository

Workflow steps

8 steps, taken from the step headings in SKILL.md.

  1. Resolve the Phase
  2. Read the Phase Content
  3. Generate 8 Questions
  4. Present Questions One at a Time
  5. Track and Score
  6. Show Results
  7. Wrong Answer Breakdown
  8. What Next?

What it can do on your machine

Read from SKILL.md and the folder at commit cdfd9df. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

AI Engineering Phase Quiz loads about 2.1k tokens when it runs. Until then it costs about 46 tokens; SKILL.md has 1,053 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~46
When it runs · the whole SKILL.md, loaded when a task matches
~2.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from rohitg00/ai-engineering-from-scratch at commit cdfd9df, republished under its MIT licence (© rohitg00). 1,053 words, ~2,052 tokens.

Download SKILL.mdSave it as .claude/skills/check-understanding/SKILL.md (or your agent's skills folder).
name
check-understanding
description
Phase quiz for AI Engineering from Scratch. Trigger with "quiz me", "test phase", "check my understanding", "do I know phase 3", or `/check-understanding <phase>`.
version
1.0.0

Check Understanding

Test your knowledge of a completed phase from the AI Engineering from Scratch course.

Activation

This skill activates when the user says things like:

  • /check-understanding 3 or /check-understanding deep-learning
  • "quiz me on phase 2"
  • "test phase 1"
  • "check my understanding of transformers"
  • "do I know phase 3"
  • "am I ready for the next phase"

Input

Accepts a phase number (0-19) or a phase name as argument. If no argument is provided, ask the user which phase they want to be tested on by listing all 20 phases.

Phase Map

Map the argument to the correct phase directory under phases/:

InputDirectoryPhase Name
0, setup, tooling00-setup-and-toolingSetup & Tooling
1, math, math-foundations01-math-foundationsMath Foundations
2, ml, ml-fundamentals02-ml-fundamentalsML Fundamentals
3, deep-learning, dl03-deep-learning-coreDeep Learning Core
4, cv, computer-vision, vision04-computer-visionComputer Vision
5, nlp05-nlp-foundations-to-advancedNLP -- Foundations to Advanced
6, speech, audio06-speech-and-audioSpeech & Audio
7, transformers07-transformers-deep-diveTransformers Deep Dive
8, generative, gen-ai, genai08-generative-aiGenerative AI
9, rl, reinforcement-learning09-reinforcement-learningReinforcement Learning
10, llms, llm, llms-from-scratch10-llms-from-scratchLLMs from Scratch
11, llm-engineering, llm-eng11-llm-engineeringLLM Engineering
12, multimodal12-multimodal-aiMultimodal AI
13, tools, protocols, mcp13-tools-and-protocolsTools & Protocols
14, agents, agent-engineering14-agent-engineeringAgent Engineering
15, autonomous15-autonomous-systemsAutonomous Systems
16, multi-agent, swarms16-multi-agent-and-swarmsMulti-Agent & Swarms
17, infrastructure, production, infra17-infrastructure-and-productionInfrastructure & Production
18, ethics, safety, alignment18-ethics-safety-alignmentEthics, Safety & Alignment
19, capstone, projects19-capstone-projectsCapstone Projects

Procedure

Step 1: Resolve the Phase

Parse the argument. If it is a number, validate it is between 0 and 19 inclusive. If the number is out of range, tell the user: "Phase [N] does not exist. Valid phases are 0-19." and show the full list for them to pick from. If it is a name or keyword, look it up in the Phase Map above. If the keyword does not match any entry in the map, tell the user: "Unknown phase '[keyword]'. Pick from the list below:" and present all 20 phases. If no argument is provided, ask the user to pick from the full list.

Step 2: Read the Phase Content

If the repo is cloned (a phases/ directory exists in or above the current directory), find all lesson directories under phases/<phase-dir>/ and read each lesson's docs/en.md. If it is not cloned, get the phase's lesson list from the Contents section of the README (fetch https://raw.githubusercontent.com/rohitg00/ai-engineering-from-scratch/main/README.md), then fetch each lesson's docs/en.md from the same raw base URL. These documents contain the teaching material you will generate questions from.

Read as many lesson docs as needed to cover the full breadth of the phase. If a phase has many lessons (15+), prioritize reading a representative spread: first few, middle, and last few.

Step 3: Generate 8 Questions

Create exactly 8 multiple-choice questions drawn from the lesson content you just read:

Questions 1-4: Conceptual (What/Why) These test understanding of ideas, definitions, and reasoning. Examples:

  • "What is the purpose of X?"
  • "Why does Y happen when Z?"
  • "Which statement best describes the relationship between A and B?"
  • "What problem does X solve?"

Questions 5-8: Practical (How/Build) These test applied knowledge and implementation awareness. Examples:

  • "How would you implement X?"
  • "Which approach correctly solves Y?"
  • "What is the correct order of steps to build Z?"
  • "If you observe X during training, what should you do?"

Each question must have exactly 4 answer options labeled A, B, C, and D. Exactly one option is correct. The wrong options should be plausible but clearly incorrect to someone who studied the material.

Tag each question with the specific lesson it draws from (e.g., "Lesson 03: Matrix Transformations").

Step 4: Present Questions One at a Time

Use the AskUserQuestion tool (or equivalent interactive prompt) to present each question individually. Format:

text
Question 1/8 (Conceptual) -- from Lesson 03: Matrix Transformations

What is the geometric interpretation of an eigenvalue?

A) The angle of rotation applied by the matrix
B) The factor by which the eigenvector is scaled during transformation
C) The determinant of the transformation matrix
D) The rank of the matrix after transformation

Wait for the user's answer before moving to the next question.

Show full SKILL.md (425 more words)Show less
Answer isolation

Keep the correct option and explanation private until the learner answers the current question. Never use a real answer letter, a likely answer, or the generated answer distribution in a reply-format hint. When a plain-text hint is needed, use exactly: Reply with one letter: <A|B|C|D>.

Step 5: Track and Score

Keep a running tally:

  • Total correct out of 8
  • For each wrong answer, record: the question number, the user's answer, the correct answer, and which lesson it came from
Step 6: Show Results

After all 8 questions, display the score and grade:

7-8 correct: Mastered If the phase is 19 (Capstone Projects): "You have mastered Phase 19, the final phase." Add "Congratulations, you have completed the entire curriculum." only when you can verify the rest of the curriculum is done (a LEARNING.md in the current directory whose Path table shows Phases 0-18 as Done or Skip); a single phase quiz does not prove full completion. Otherwise: "You have a strong grasp of Phase N. You are ready to move on to Phase N+1: [next phase name]."

5-6 correct: Almost "Solid foundation. Review these specific areas before moving on:" Then list the lessons tied to the missed questions.

3-4 correct: Developing "You are building understanding but need to revisit some lessons:" Then list each missed question with the lesson to re-read.

0-2 correct: Start Over "This phase needs more time. Work through the lessons again from the beginning, focusing on:" Then list all missed topics.

Step 7: Wrong Answer Breakdown

For every question the user got wrong, show:

text
Question N: [question text, abbreviated]
Your answer: B
Correct answer: C -- [the correct option text]
Why: [1-2 sentence explanation of why C is correct]
Review: Lesson NN -- [lesson name] (phases/<phase-dir>/NN-<lesson-slug>/docs/en.md)
Step 8: What Next?

End by offering three choices:

  1. Retake this quiz -- generate a fresh set of 8 questions from the same phase
  2. Try another phase -- pick a different phase to test
  3. Explain a topic -- ask about any concept from the questions you missed

Wait for the user's choice and act accordingly.

Rules

  • Avoid repeating questions on retakes until the question pool is exhausted. Once exhausted, reshuffle or rephrase questions for subsequent retakes.
  • Questions must be directly grounded in the lesson docs, not general knowledge.
  • Do not show the correct answer until after the user responds.
  • Do not include literal answer letters in examples of how the learner should reply; use <A|B|C|D> as the placeholder.
  • Keep question text concise. One or two sentences max.
  • Wrong options must be plausible. No joke answers.
  • If a phase has no lesson docs written yet (no en.md files found), tell the user: "Phase N does not have lesson content yet. Pick a completed phase to quiz on."

© rohitg00, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/check-understanding of rohitg00/ai-engineering-from-scratch.

Open the folder on GitHubat commit cdfd9df

Compare with similar skills

AI Engineering Phase Quiz next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

AI Engineering Phase Quiz compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
AI Engineering Phase Quiz this skillrohitg00/ai-engineering-from-scratch66k—~2.1kAutomated safety check: PassMIT
Generate Verifiers Envadithya-s-k/FineEnvs4561 repos~2.3kAutomated safety check: PassApache-2.0
Agent Prompt Quality Barmastra-ai/mastra29k—~2kAutomated safety check: PassCustom licence
Laya Integrationwdobry/laya-playground183—~3.2kAutomated safety check: PassMIT
Advanced Evaluationguanyang/open-agent-hub9772 repos~4.2kAutomated safety check: PassMIT
Agentic Evalgithub/awesome-copilot40k3 repos~1.5kAutomated safety check: PassMIT

Similar skills

  • Generate Verifiers Env

    adithya-s-k/FineEnvs

    Builds a Verifiers (PrimeIntellect) variant of an RL environment.

    456 GitHub starsUsed in 1 repo~2.3k tokens
    EducationAuto-check passed

  • Agent Prompt Quality Bar

    mastra-ai/mastra

    Universal quality bar and final audit rubric for any agent system prompt.

    29k GitHub stars~2k tokensUpdated today
    AI & LLM EngineeringAuto-check passed

  • Laya Integration

    wdobry/laya-playground

    Add fast, local, typed decisions to any project with Laya, an open-source non-generative decision model (pip install laya).

    183 GitHub stars~3.2k tokensUpdated 18 days ago
    EducationAuto-check passed

  • Advanced Evaluation

    guanyang/open-agent-hub

    This skill should be used for advanced LLM evaluation: LLM-as-judge systems, direct scoring, pairwise comparison, rubric calibration, evaluator bias mitigation, confidence scoring, and automated…

    977 GitHub starsUsed in 2 repos~4.2k tokens
    AI & LLM EngineeringAuto-check passed

  • Agentic Eval

    github/awesome-copilot

    Official

    Patterns and techniques for evaluating and improving AI agent outputs.

    40k GitHub starsUsed in 3 repos~1.5k tokens
    AI & LLM EngineeringAuto-check passed

  • 01 Auto Arena

    agentscope-ai/OpenJudge

    Automatically evaluate and compare multiple AI models or agents without pre-existing test data.

    870 GitHub stars~2.5k tokensUpdated 28 days ago
    EducationAuto-check passed

More from rohitg00/ai-engineering-from-scratch

All 16 skills in this repo

  • Skill Release Gate

    rohitg00/ai-engineering-from-scratch

    Evaluates an Agent Skill bundle before release for structure, trigger quality, artifact improvement, script correctness, safety, installed-tree integrity and host portability.

    66k GitHub stars~1k tokensUpdated today
    Auto-check passed

  • AI Engineering Placement Quiz

    rohitg00/ai-engineering-from-scratch

    Runs a 10-question quiz across five areas to place a learner in the AI Engineering from Scratch curriculum, so they skip what they already know.

    66k GitHub stars~2k tokensUpdated today
    Auto-check passed

  • AI Engineering Project Tutor

    rohitg00/ai-engineering-from-scratch

    Tutors a learner through one stage of a hands-on AI engineering project per session: lesson, prediction, code, grader run and reflection, with hints but never full solutions.

    66k GitHub stars~1.6k tokensUpdated today
    Auto-check passed

  • Claude Certification Tutor

    rohitg00/ai-engineering-from-scratch

    Guides a learner through one of four independent Claude certification tracks with onboarding, lessons, practice labs, mock exams and remediation.

    66k GitHub stars~3k tokensUpdated today
    Auto-check passed

  • AI Engineering Course Guide

    rohitg00/ai-engineering-from-scratch

    Routes a topic, question or bug to the exact lessons in the AI Engineering from Scratch curriculum and suggests the next command to run.

    66k GitHub stars~1.7k tokensUpdated today
    Auto-check passed

  • AI Engineering Course Tutor

    rohitg00/ai-engineering-from-scratch

    Teaches the next lesson of the AI Engineering from Scratch curriculum in the terminal, quizzes you at the end and records your progress.

    66k GitHub stars~2.2k tokensUpdated today
    Auto-check passed

Categories

Questions about AI Engineering Phase Quiz

What does AI Engineering Phase Quiz do?

Quizzes you on a completed phase of the AI Engineering from Scratch course, taking a phase number or name and mapping it to that phase's directory. The skill activates on phrases such as quiz me on phase 2, check my understanding of transformers, or the /check-understanding command with a phase argument. It accepts a phase number from 0 to 19 or a phase name, and when none is given it asks which of the 20 phases to test and lists them.

When should I use AI Engineering Phase Quiz?

AI Engineering Phase Quiz fits situations like: checking your knowledge after finishing a phase of the AI Engineering from Scratch course; deciding whether you are ready for the next phase; reviewing a single topic area such as transformers or reinforcement learning.

How do I install AI Engineering Phase Quiz in Claude Code?

Run `npx skills add rohitg00/ai-engineering-from-scratch --skill check-understanding -a claude-code`. Or copy the skill folder (skills/check-understanding in rohitg00/ai-engineering-from-scratch) into .claude/skills/check-understanding in your project. Claude Code loads it when a task matches its description.

How do I install AI Engineering Phase Quiz in Codex?

Run `npx skills add rohitg00/ai-engineering-from-scratch --skill check-understanding -a codex`. Or copy the skill folder (skills/check-understanding in rohitg00/ai-engineering-from-scratch) into .agents/skills/check-understanding in your project. Codex loads it when a task matches its description.

Can I use AI Engineering Phase Quiz in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add rohitg00/ai-engineering-from-scratch --skill check-understanding -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/check-understanding, .gemini/skills/check-understanding, .github/skills/check-understanding and .opencode/skills/check-understanding in your project.

What does AI Engineering Phase Quiz need to run?

SKILL.md names no scripts, command-line tools or credentials: AI Engineering Phase Quiz is instructions for the agent only. Our summary lists: A local copy of the AI Engineering from Scratch course repository.

Does AI Engineering Phase Quiz access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is AI Engineering Phase Quiz safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does AI Engineering Phase Quiz use?

AI Engineering Phase Quiz is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does AI Engineering Phase Quiz use?

About 2.1k tokens (SKILL.md is roughly 8.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to AI Engineering Phase Quiz?

Skills that share tags, products or a category with AI Engineering Phase Quiz: Generate Verifiers Env (adithya-s-k/FineEnvs, 456 stars), Agent Prompt Quality Bar (mastra-ai/mastra, 29k stars), Laya Integration (wdobry/laya-playground, 183 stars) and Advanced Evaluation (guanyang/open-agent-hub, 977 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains AI Engineering Phase Quiz?

rohitg00 (a GitHub user) maintains it in rohitg00/ai-engineering-from-scratch, which has 65,983 GitHub stars. The repository holds 16 skills in this directory. The repository was last updated on October 9, 2026.

Source: rohitg00/ai-engineering-from-scratch on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.