Agent skill

Spot AI Mistakes

by mohitagw15856 in mohitagw15856/pm-claude-skills

Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors.

MITAuto-check passedResearch & Science

Install Spot AI Mistakes

skills CLI
$ npx skills add mohitagw15856/pm-claude-skills --skill spot-ai-mistakes -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install mohitagw15856/pm-claude-skills spot-ai-mistakes --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/mohitagw15856/pm-claude-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/spot-ai-mistakes .claude/skills/spot-ai-mistakes && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
spot-ai-mistakes
GitHub stars
1.4k
Token cost
~1.2k tokens
SKILL.md length
649 words
Files
1
Skills in repo
1,348
Repo updated
First seen
Licence
MIT

At a glance

Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors.

  • Works in 5 steps: Map failures to your use. The failure… → Learn the tells. Each failure has… → Watch the confidence trap. AI's tone is… → …
  • Asked how do I know when AI is wrong
  • SKILL.md covers What This Skill Produces, Required Inputs, Framework: Know The Patterns,… and Output Format, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Spot AI Mistakes is an agent skill from mohitagw15856/pm-claude-skills. Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors. Use when asked how do I know when AI is wrong, what are AI's common mistakes, how do I catch AI errors, or where does AI mess up. Produces the failure patterns most relevant to how you use AI (hallucinated facts, fake citations, outdated info, sycophancy, math slips, missed nuance), the tells that give each away, a quick check for the ones that…

Its SKILL.md is about 1.2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Research & Science, covering Citation management. The repository describes itself as: 1255 professional Agent Skills for Claude, ChatGPT, Gemini, Cursor & Codex — PRDs, postmortems, leases, medical bills, layoffs, go-bags, new countries. Plain markdown, MIT, in… The licence is MIT.

When your agent uses it

  • Asked how do I know when AI is wrong
  • What are AIs common mistakes
  • How do I catch AI errors
  • Where does AI mess up

Example prompts

  • “/spot-ai-mistakes”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Map failures to your use. The failure modes that matter depend on how you use AI — a coder cares about wrong APIs, a researcher about fake…
  2. Learn the tells. Each failure has signals: fabricated citations look oddly specific and un-Google-able; hallucinations spike on…
  3. Watch the confidence trap. AI's tone is uniform whether it's right or inventing — so confidence is not a signal of correctness. Judge by…
  4. Check the dangerous ones fast. For the errors that would actually hurt, a quick independent check (a source, a second tool, testing it)…
  5. Calibrate trust per domain. Trust AI more where it's reliable for you and less where it isn't — calibrated, not blanket trust or blanket…

What it can do on your machine

Read from SKILL.md and the folder at commit 1cbf1f0. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Spot AI Mistakes loads about 1.2k tokens when it runs. Until then it costs about 163 tokens; SKILL.md has 649 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~163
When it runs · the whole SKILL.md, loaded when a task matches
~1.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from mohitagw15856/pm-claude-skills at commit 1cbf1f0, republished under its MIT licence (© mohitagw15856). 649 words, ~1,213 tokens.

Download SKILL.mdSave it as .claude/skills/spot-ai-mistakes/SKILL.md (or your agent's skills folder).
name
spot-ai-mistakes
description
Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors. Use when asked how do I know when AI is wrong, what are AI's common mistakes, how do I catch AI errors, or where does AI mess up. Produces the failure patterns most relevant to how you use AI (hallucinated facts, fake citations, outdated info, sycophancy, math slips, missed nuance), the tells that give each away, a quick check for the ones that would hurt you, and a calibrated trust level — so you develop the instinct to catch AI's errors before they cost you.

Spot AI Mistakes

AI fails in patterned, learnable ways — it invents citations, states outdated facts with total confidence, agrees with whatever you imply, and fumbles arithmetic while sounding certain. Once you know the patterns and their tells, you catch most errors on sight. This maps the failure modes most relevant to how you use AI, the signs that give each away, and a fast check for the ones that would actually hurt — building the instinct so confident-wrong stops catching you off guard.

What This Skill Produces

  • The failure patterns that matter for you — the specific ways AI goes wrong in your use (hallucinated facts, fabricated citations/quotes, outdated info, sycophancy, arithmetic slips, false precision, missed nuance, confident guessing)
  • The tells for each — the signals that give a mistake away (suspiciously specific sources, confidence on recent/niche topics, agreeing too readily, round-number math)
  • A fast check for the dangerous ones — a quick way to catch the errors that would actually cost you, without over-checking everything
  • A calibrated trust level — where AI is reliable for your uses and where it isn't, so trust is earned per-domain not blanket
  • The instinct, built — the habit of pattern-matching for these tells as you read AI output

Required Inputs

Ask for these if not provided:

  • How you use AI — the domains and tasks (points at which failure modes matter most)
  • A past miss — a time AI got something wrong on you, if you have one (great teacher)
  • The stakes — what a missed error would cost in your use
  • Your trust level now — where you're too trusting or too skeptical

Framework: Know The Patterns, Read The Tells

  1. Map failures to your use. The failure modes that matter depend on how you use AI — a coder cares about wrong APIs, a researcher about fake citations, a student about outdated facts. Focus on yours.
  2. Learn the tells. Each failure has signals: fabricated citations look oddly specific and un-Google-able; hallucinations spike on recent/niche topics; sycophancy shows as agreeing right after you hint at a preference; math errors hide in confident round numbers.
  3. Watch the confidence trap. AI's tone is uniform whether it's right or inventing — so confidence is not a signal of correctness. Judge by pattern and verification, never by how sure it sounds.
  4. Check the dangerous ones fast. For the errors that would actually hurt, a quick independent check (a source, a second tool, testing it) — don't over-verify the low-stakes stuff.
  5. Calibrate trust per domain. Trust AI more where it's reliable for you and less where it isn't — calibrated, not blanket trust or blanket suspicion.
Show full SKILL.md (220 more words)Show less

Output Format

AI mistake-spotting: for [how you use it]

Failure patterns that matter for you: [the specific ones — e.g. fake citations, outdated facts, sycophancy, math slips]. Tells for each: [pattern → the signal that gives it away]. The confidence trap: tone is uniform whether right or wrong — never trust by how sure it sounds. Fast check for the dangerous ones: [quick verification for the errors that would cost you]. Your calibrated trust: [reliable for X / verify hard for Y].

Quality Checks

  • Focuses on the failure modes relevant to the person's use
  • Gives concrete tells for each pattern
  • Warns that confident tone isn't a correctness signal
  • Provides a fast check scaled to stakes
  • Calibrates trust per-domain, not blanket

Anti-Patterns

  • A generic list of AI failures with no tells or relevance.
  • Trusting confident tone as a sign it's right.
  • Blanket distrust that makes AI useless, or blanket trust that gets you burned.
  • Over-verifying everything instead of the dangerous ones.
  • No calibration to where AI is actually reliable for you.

Example Trigger Phrases

  • "How do I know when AI is making something up?"
  • "What are the common ways AI gets things wrong?"
  • "How do I catch AI errors before they bite me?"
  • "Where does AI tend to mess up in [my kind of work]?"
  • "Teach me to spot when an AI answer is unreliable."

© mohitagw15856, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/spot-ai-mistakes of mohitagw15856/pm-claude-skills.

Open the folder on GitHubat commit 1cbf1f0

Compare with similar skills

Spot AI Mistakes next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Spot AI Mistakes compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Spot AI Mistakes this skillmohitagw15856/pm-claude-skills1.4k—~1.2kAutomated safety check: PassMIT
Content Research Writerweapp-tailwindcss/weapp-tailwindcss1.9k25 repos~3.5kAutomated safety check: PassMIT
Systematic Review ScreenerImbad0202/academic-research-skills51k—~8.4kAutomated safety check: PassCustom licence
NetworkxzLanqing/codex-claude-academic-skills4.7k15 repos~3.2kAutomated safety check: PassBSD-3-Clause
Literature Reviewneflibata-feng/MyArxiv-Agent12620 repos~5.9kAutomated safety check: NotesMIT
Openalex Databaseneflibata-feng/MyArxiv-Agent12612 repos~3kAutomated safety check: PassCustom licence

Similar skills

  • Content Research Writer

    weapp-tailwindcss/weapp-tailwindcss

    Assists in writing high-quality content by conducting research, adding citations, improving hooks, iterating on outlines, and providing real-time feedback on each section.

    1.9k GitHub starsUsed in 25 repos~3.5k tokens
    Research & ScienceAuto-check passed
  • Systematic Review Screener

    Imbad0202/academic-research-skills

    Screens records for systematic, scoping and rapid reviews against fixed eligibility rules, using two blinded AI reviewers and a third adjudicator, with traceable PRISMA counts.

    51k GitHub stars~8.4k tokensUpdated yesterday
    Research & ScienceAuto-check passed
  • Networkx

    zLanqing/codex-claude-academic-skills

    Comprehensive toolkit for creating, analyzing, and visualizing complex networks and graphs in Python.

    4.7k GitHub starsUsed in 15 repos~3.2k tokens
    Research & ScienceAuto-check passed
  • Literature Review

    neflibata-feng/MyArxiv-Agent

    Conduct comprehensive, systematic literature reviews using multiple academic databases (PubMed, arXiv, bioRxiv, Semantic Scholar, etc.).

    126 GitHub starsUsed in 20 repos~5.9k tokens
    Research & ScienceAuto-check: notes
  • Openalex Database

    neflibata-feng/MyArxiv-Agent

    Query and analyze scholarly literature using the OpenAlex database.

    126 GitHub starsUsed in 12 repos~3k tokens
    Research & ScienceAuto-check passed
  • Citation Verification Guide

    Galaxy-Dawn/claude-scholar

    Reference guidance for checking every citation in academic writing against canonical sources such as DOI, arXiv, CrossRef and Semantic Scholar, to catch fake or wrong references.

    5.7k GitHub starsUsed in 2 repos~1.9k tokens
    Research & ScienceAuto-check passed

More from mohitagw15856/pm-claude-skills

All 1,348 skills in this repo
  • Car Tco

    mohitagw15856/pm-claude-skills

    Compare the total cost of car ownership across buy-new, buy-used, lease, and keep-your-current-car — depreciation, insurance, maintenance ramp, and fuel over a real horizon, not just the monthly…

    1.4k GitHub stars~1.1k tokensUpdated 2 days ago
    Auto-check passed
  • Cs Health Scorecard

    mohitagw15856/pm-claude-skills

    Build a customer health scorecard for a specific account. An agent skill from mohitagw15856/pm-claude-skills.

    1.4k GitHub stars~2.4k tokensUpdated 2 days ago
    Auto-check passed
  • Exit Waterfall

    mohitagw15856/pm-claude-skills

    Compute who gets what at each exit price from a cap table — liquidation preferences, conversion points, and where the founders' share collapses.

    1.4k GitHub stars~1.1k tokensUpdated 2 days ago
    Auto-check passed
  • Feature Prioritisation

    mohitagw15856/pm-claude-skills

    Apply prioritisation frameworks (RICE, MoSCoW, Kano, ICE, Opportunity Scoring) to rank features and backlog items.

    1.4k GitHub stars~2k tokensUpdated 2 days ago
    Auto-check passed
  • Fire Number

    mohitagw15856/pm-claude-skills

    Compute a financial-independence (FIRE) target and years-to-reach with every assumption labeled as an assumption — plus a sensitivity table instead of a single false-precision answer.

    1.4k GitHub stars~1.1k tokensUpdated 2 days ago
    Auto-check passed
  • Freelance Rate

    mohitagw15856/pm-claude-skills

    Derive a freelance day/hourly rate backwards from target income, honest billable utilization, overhead, and the self-employment tax premium — the arithmetic that proves a rate is not salary÷2000.

    1.4k GitHub stars~1.2k tokensUpdated 2 days ago
    Auto-check passed

Questions about Spot AI Mistakes

What does Spot AI Mistakes do?

Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors. Spot AI Mistakes is an agent skill from mohitagw15856/pm-claude-skills. Learn to recognize where and how AI tends to go wrong — the specific failure patterns — so you catch its mistakes on sight instead of getting burned by confident errors.

When should I use Spot AI Mistakes?

Spot AI Mistakes fits situations like: asked how do I know when AI is wrong; what are AIs common mistakes; how do I catch AI errors; where does AI mess up.

How do I install Spot AI Mistakes in Claude Code?

Run `npx skills add mohitagw15856/pm-claude-skills --skill spot-ai-mistakes -a claude-code`. Or copy the skill folder (skills/spot-ai-mistakes in mohitagw15856/pm-claude-skills) into .claude/skills/spot-ai-mistakes in your project. Claude Code loads it when a task matches its description.

How do I install Spot AI Mistakes in Codex?

Run `npx skills add mohitagw15856/pm-claude-skills --skill spot-ai-mistakes -a codex`. Or copy the skill folder (skills/spot-ai-mistakes in mohitagw15856/pm-claude-skills) into .agents/skills/spot-ai-mistakes in your project. Codex loads it when a task matches its description.

Can I use Spot AI Mistakes in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add mohitagw15856/pm-claude-skills --skill spot-ai-mistakes -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/spot-ai-mistakes, .gemini/skills/spot-ai-mistakes, .github/skills/spot-ai-mistakes and .opencode/skills/spot-ai-mistakes in your project.

What does Spot AI Mistakes need to run?

SKILL.md names no scripts, command-line tools or credentials: Spot AI Mistakes is instructions for the agent only.

Does Spot AI Mistakes access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Spot AI Mistakes safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Spot AI Mistakes use?

Spot AI Mistakes is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Spot AI Mistakes use?

About 1.2k tokens (SKILL.md is roughly 4.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Spot AI Mistakes?

Skills that share tags, products or a category with Spot AI Mistakes: Content Research Writer (weapp-tailwindcss/weapp-tailwindcss, 1.9k stars), Systematic Review Screener (Imbad0202/academic-research-skills, 51k stars), Networkx (zLanqing/codex-claude-academic-skills, 4.7k stars) and Literature Review (neflibata-feng/MyArxiv-Agent, 126 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Spot AI Mistakes?

mohitagw15856 (a GitHub user) maintains it in mohitagw15856/pm-claude-skills, which has 1,434 GitHub stars. The repository holds 1,348 skills in this directory. The repository was last updated on October 9, 2026.

Source: mohitagw15856/pm-claude-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.