Agent skill

Forecast Accuracy Review

by davila7 in davila7/claude-code-templates

Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest.

MITAuto-check passedData & Analytics

Install Forecast Accuracy Review

skills CLI
$ npx skills add davila7/claude-code-templates --skill forecast-accuracy-review -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install davila7/claude-code-templates forecast-accuracy-review --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/davila7/claude-code-templates.git skills-src && mkdir -p .claude/skills && cp -r skills-src/cli-tool/components/skills/operations/forecast-accuracy-review .claude/skills/forecast-accuracy-review && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
forecast-accuracy-review
GitHub stars
33k
Token cost
~884 tokens
SKILL.md length
413 words
Files
1
Skills in repo
479
Repo updated
First seen
Licence
MIT

At a glance

Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest.

  • Works in 6 steps: Profile the demand first. Per SKU… → Set the benchmarks. Naive (last period)… → Backtest rolling-origin. One-step-ahead… → …
  • The user mentions forecast accuracy
  • SKILL.md covers Required data, Workflow, Pitfalls to check explicitly and Output format
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Forecast Accuracy Review is an agent skill from davila7/claude-code-templates. Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest. Use when the user mentions forecast accuracy, MAPE, demand planning performance, tahmin doğruluğu, talep tahmini, or asks whether a forecasting process or tool is worth it. Differentiator - judges the process (value added vs doing nothing), not just the model.

Its SKILL.md is about 880 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Forecasting and time series and Trading and backtesting. The repository describes itself as: CLI tool for configuring and monitoring Claude Code. The licence is MIT.

When your agent uses it

  • The user mentions forecast accuracy
  • Demand planning performance
  • Tahmin doğruluğu
  • Asks whether a forecasting process

Example prompts

  • “/forecast-accuracy-review”

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

  1. Profile the demand first. Per SKU compute mean, CV and zero-period share; classify smooth / erratic / intermittent / lumpy (defaults: CV…
  2. Set the benchmarks. Naive (last period) always; seasonal naive when 2+ full seasons exist. These are non-negotiable controls.
  3. Backtest rolling-origin. One-step-ahead forecasts for each of the last 6+ periods, expanding window, using only data before each origin. A…
  4. Score with honest metrics
  5. Deliver the FVA verdict. FVA = WMAPE(naive) - WMAPE(candidate), per segment and overall. Negative FVA means the process destroys value…
  6. Validate. Recompute WMAPE for one model directly from the raw backtest rows and confirm it matches the table before presenting.

What it can do on your machine

Read from SKILL.md and the folder at commit c0ca7da. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • github.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Forecast Accuracy Review loads about 884 tokens when it runs. Until then it costs about 106 tokens; SKILL.md has 413 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~106
When it runs · the whole SKILL.md, loaded when a task matches
~884

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from davila7/claude-code-templates at commit c0ca7da, republished under its MIT licence (© davila7). 413 words, ~884 tokens.

Download SKILL.mdSave it as .claude/skills/forecast-accuracy-review/SKILL.md (or your agent's skills folder).
name
forecast-accuracy-review
description
Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest. Use when the user mentions forecast accuracy, MAPE, demand planning performance, tahmin doğruluğu, talep tahmini, or asks whether a forecasting process or tool is worth it. Differentiator - judges the process (value added vs doing nothing), not just the model.

Forecast Accuracy Review

A forecast is only worth what it adds over the free alternative: shipping last period's number. Every review must answer "how many points does this process add over naive?" before any model discussion.

Required data

Per-SKU demand history at the planning bucket (usually monthly): sku, period, qty. If evaluating an existing forecast, also the forecast values with their creation dates (to avoid hindsight leakage). 18+ periods per SKU for a meaningful backtest; flag SKUs with less.

Workflow

  1. Profile the demand first. Per SKU compute mean, CV and zero-period share; classify smooth / erratic / intermittent / lumpy (defaults: CV 0.5 and 1.0 boundaries, intermittency at >25% zero periods - state them, adjust to natural breaks). Accuracy expectations differ by class; never report one blended number alone.
  2. Set the benchmarks. Naive (last period) always; seasonal naive when 2+ full seasons exist. These are non-negotiable controls.
  3. Backtest rolling-origin. One-step-ahead forecasts for each of the last 6+ periods, expanding window, using only data before each origin. A single train/test split is one lucky draw - do not accept it.
  4. Score with honest metrics:
    • WMAPE = sum(|error|) / sum(actual) - the volume-weighted headline
    • Bias = sum(error) / sum(actual) - direction; a fine WMAPE with persistent bias is quietly building excess stock or stockouts
    • MAPE only as a footnote, and always disclose how many zero-actual periods it dropped
  5. Deliver the FVA verdict. FVA = WMAPE(naive) - WMAPE(candidate), per segment and overall. Negative FVA means the process destroys value - say it plainly.
  6. Validate. Recompute WMAPE for one model directly from the raw backtest rows and confirm it matches the table before presenting.
Show full SKILL.md (151 more words)Show less

Pitfalls to check explicitly

  • MAPE with zeros: undefined on zero-actual periods; silently dropping them fakes precision on intermittent SKUs.
  • MAPE asymmetry rewards under-forecasting (errors capped at 100% below, unbounded above).
  • Aggregation mix: a good total can hide terrible A-item accuracy; always show the value-weighted cut.
  • Lumpy segments: if WMAPE > ~100%, the honest recommendation is an inventory-policy answer (buffers, MTO), not a better model.
  • Hindsight leakage: forecasts must predate actuals; check timestamps when auditing an existing process.

Output format

  1. Scoreboard table: model x (WMAPE, bias, MAPE-footnote), sorted by WMAPE
  2. FVA statement: "the process adds/destroys X points vs naive" - overall and per segment
  3. Segment table (pattern x best approach)
  4. Two or three recommendation sentences tied to segments, not globals

Worked example with five baseline models and charts: https://github.com/gulmezeren2-byte/forecast-accuracy-lab


Source: industrial-engineering-ai-skills by Eren Gulmez (MIT). The full method pack - entry skill, role agents, data-hygiene rules and artifact templates - lives there.

© davila7, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in cli-tool/components/skills/operations/forecast-accuracy-review of davila7/claude-code-templates.

Open the folder on GitHubat commit c0ca7da

Compare with similar skills

Forecast Accuracy Review next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Forecast Accuracy Review compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Forecast Accuracy Review this skilldavila7/claude-code-templates33k—~884Automated safety check: PassMIT
Longbridge Quanthelsome/folio2711 repos~1.6kAutomated safety check: PassMIT
Quant Statistical MethodsHKUDS/Vibe-Trading35k—~4kAutomated safety check: PassMIT
Walk Forward Validationagiprolabs/claude-trading-skills410—~2.2kAutomated safety check: PassMIT
Forecastingericrisco/rsc-harness180—~2.8kAutomated safety check: PassMIT
Options Spread Conviction EngineLeoYeAI/openclaw-master-skills2.2k—~5.7kAutomated safety check: NotesMIT

Similar skills

  • Longbridge Quant

    helsome/folio

    Quantitative strategy frameworks: pairs trading/cointegration, volatility regime strategies, seasonality/calendar effects, multi-factor models (IC/IR), factor research and screening, correlation…

    271 GitHub starsUsed in 1 repo~1.6k tokens
    Data & AnalyticsAuto-check passed
  • Quant Statistical Methods

    HKUDS/Vibe-Trading

    Guides your agent through unit-root, cointegration, GARCH, bootstrap and regression-diagnostic tests on financial time series, using a tested helper module.

    35k GitHub stars~4k tokensUpdated today
    Data & AnalyticsAuto-check passed
  • Walk Forward Validation

    agiprolabs/claude-trading-skills

    Walk-forward validation framework for trading strategies and ML models with time-series-aware splits, overfit detection, and regime-aware validation

    410 GitHub stars~2.2k tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed
  • Forecasting

    ericrisco/rsc-harness

    A skill your agent uses when projecting history forward — sales, demand, units, revenue, signups, traffic — into a defensible number with an error band: method by data shape, rolling-origin…

    180 GitHub stars~2.8k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed
  • Options Spread Conviction Engine

    LeoYeAI/openclaw-master-skills

    Multi-regime options spread analysis engine with quantitative rigor.

    2.2k GitHub stars~5.7k tokensUpdated 2 mo ago
    Data & AnalyticsAuto-check: notes
  • Regime

    jackson-video-resources/markov-hedge-fund-method

    Detect the market regime (Bull / Bear / Sideways) for ANY asset and turn it into a tradeable signal or a risk filter.

    484 GitHub stars~1.6k tokensUpdated 4 mo ago
    Business, Finance & HRAuto-check passed

More from davila7/claude-code-templates

All 479 skills in this repo
  • Perplexity Web Search

    davila7/claude-code-templates

    Runs web-grounded searches through Perplexity's Sonar models over OpenRouter for current events, recent literature and cited facts beyond the model's training cutoff.

    33k GitHub starsUsed in 11 repos~3.5k tokens
    Auto-check: notes
  • Neuropixels Data Analysis

    davila7/claude-code-templates

    Analyzes Neuropixels recordings from SpikeGLX or Open Ephys through preprocessing, drift correction, Kilosort4 spike sorting, quality metrics and curation.

    33k GitHub starsUsed in 9 repos~2.8k tokens
    Auto-check passed
  • Scientific Venue Templates

    davila7/claude-code-templates

    Supplies LaTeX templates and formatting rules for journals, conferences, posters, and grant proposals, then can check a draft against them.

    33k GitHub starsUsed in 9 repos~5.1k tokens
    Auto-check: notes
  • Brand Voice Content Creator

    davila7/claude-code-templates

    Analyzes a brand's existing writing to lock in a consistent voice, then builds SEO blog posts and platform-specific social content around it.

    33k GitHub starsUsed in 3 repos~1.9k tokens
    Auto-check passed
  • CAPA Officer

    davila7/claude-code-templates

    Guides corrective and preventive action (CAPA) work in a quality management system, from initiation and root cause analysis through effectiveness verification.

    33k GitHub starsUsed in 1 repo~2k tokens
    Auto-check passed
  • Fda Consultant Specialist

    davila7/claude-code-templates

    Senior FDA consultant and specialist for medical device companies including HIPAA compliance and requirement management.

    33k GitHub starsUsed in 1 repo~2.7k tokens
    Auto-check passed

Questions about Forecast Accuracy Review

What does Forecast Accuracy Review do?

Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest. Forecast Accuracy Review is an agent skill from davila7/claude-code-templates. Evaluate demand-forecast quality honestly - WMAPE, bias and Forecast Value Added against a naive benchmark over a rolling-origin backtest.

When should I use Forecast Accuracy Review?

Forecast Accuracy Review fits situations like: the user mentions forecast accuracy; demand planning performance; tahmin doğruluğu; asks whether a forecasting process.

How do I install Forecast Accuracy Review in Claude Code?

Run `npx skills add davila7/claude-code-templates --skill forecast-accuracy-review -a claude-code`. Or copy the skill folder (cli-tool/components/skills/operations/forecast-accuracy-review in davila7/claude-code-templates) into .claude/skills/forecast-accuracy-review in your project. Claude Code loads it when a task matches its description.

How do I install Forecast Accuracy Review in Codex?

Run `npx skills add davila7/claude-code-templates --skill forecast-accuracy-review -a codex`. Or copy the skill folder (cli-tool/components/skills/operations/forecast-accuracy-review in davila7/claude-code-templates) into .agents/skills/forecast-accuracy-review in your project. Codex loads it when a task matches its description.

Can I use Forecast Accuracy Review in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add davila7/claude-code-templates --skill forecast-accuracy-review -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/forecast-accuracy-review, .gemini/skills/forecast-accuracy-review, .github/skills/forecast-accuracy-review and .opencode/skills/forecast-accuracy-review in your project.

What does Forecast Accuracy Review need to run?

SKILL.md names no scripts, command-line tools or credentials: Forecast Accuracy Review is instructions for the agent only.

Does Forecast Accuracy Review access the network?

SKILL.md names 1 domain. As links in the text: github.com. This is read from the text; nothing was executed.

Is Forecast Accuracy Review safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Forecast Accuracy Review use?

Forecast Accuracy Review is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Forecast Accuracy Review use?

About 884 tokens (SKILL.md is roughly 3.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Forecast Accuracy Review?

Skills that share tags, products or a category with Forecast Accuracy Review: Longbridge Quant (helsome/folio, 271 stars), Quant Statistical Methods (HKUDS/Vibe-Trading, 35k stars), Walk Forward Validation (agiprolabs/claude-trading-skills, 410 stars) and Forecasting (ericrisco/rsc-harness, 180 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Forecast Accuracy Review?

davila7 (a GitHub user) maintains it in davila7/claude-code-templates, which has 32,512 GitHub stars. The repository holds 479 skills in this directory. The repository was last updated on October 10, 2026.

Source: davila7/claude-code-templates on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.