Agent skill

Probast Quality Assessment For Prediction Model Studies

by aipoch in aipoch/medical-research-skills

Assess bias in medical prediction model studies using PROBAST tool.

MITAuto-check passedDocuments & Office

Install Probast Quality Assessment For Prediction Model Studies

skills CLI
$ npx skills add aipoch/medical-research-skills --skill probast-quality-assessment-for-prediction-model-studies -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install aipoch/medical-research-skills probast-quality-assessment-for-prediction-model-studies --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/'scientific-skills/Data Analysis/probast-quality-assessment-for-prediction-model-studies' .claude/skills/probast-quality-assessment-for-prediction-model-studies && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
probast-quality-assessment-for-prediction-model-studies
GitHub stars
1.9k
Token cost
~1.2k tokens
SKILL.md length
579 words
Files
4 (incl. scripts, references)
Skills in repo
578
Repo updated
First seen
Licence
MIT

At a glance

Assess bias in medical prediction model studies using PROBAST tool.

  • Works in 4 steps: Extract Metadata → Assess Risk Domains (Parallel) → Determine Overall Risk → …
  • User wants to evaluate the quality
  • SKILL.md covers When to Use, Key Features, Dependencies and Example Usage, plus 3 more sections
  • Runs Python scripts from its folder; calls python

What it does

Probast Quality Assessment For Prediction Model Studies is an agent skill from aipoch/medical-research-skills. Assess bias in medical prediction model studies using PROBAST tool. Use when user wants to evaluate the quality or risk of bias of a medical paper (text or PDF).

Its SKILL.md is about 1.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 5 other files, including scripts and reference files (for example `probast-quality-assessment-for-prediction-model-studies_audit_result_v1.json`, `references/probast_prompts.md` and `scripts/extract_pdf.py`).

It sits in Documents & Office, covering PDF and Data analysis. The repository describes itself as: Hundreds of agent skills for medical research, including protocol design, data analysis, evidence insights, and academic writing. The licence is MIT.

When your agent uses it

  • User wants to evaluate the quality
  • Risk of bias of a medical paper (text

Example prompts

  • “/probast-quality-assessment-for-prediction-model-studies”

Requirements

  • Python 3

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Extract Metadata
  2. Assess Risk Domains (Parallel)
  3. Determine Overall Risk
  4. Format Output

What it can do on your machine

Read from SKILL.md and the folder at commit 686e09d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/ (Python), which the agent can run.

    Shell commands in SKILL.md call:

    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Probast Quality Assessment For Prediction Model Studies loads about 1.2k tokens when it runs, and up to ~3.5k if it reads all its reference files. Until then it costs about 54 tokens; SKILL.md has 579 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~54
When it runs · the whole SKILL.md, loaded when a task matches
~1.2k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~3.5k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from aipoch/medical-research-skills at commit 686e09d, republished under its MIT licence (© aipoch). 579 words, ~1,231 tokens.

Download SKILL.mdSave it as .claude/skills/probast-quality-assessment-for-prediction-model-studies/SKILL.md (or your agent's skills folder). This skill also uses 3 other files; get the full folder from GitHub.
name
probast-quality-assessment-for-prediction-model-studies
description
Assess bias in medical prediction model studies using PROBAST tool. Use when user wants to evaluate the quality or risk of bias of a medical paper (text or PDF).
license
MIT
author
AIPOCH

Source: https://github.com/aipoch/medical-research-skills

PROBAST Quality Assessment

This skill evaluates the risk of bias in medical prediction model studies using the PROBAST (Prediction model Risk Of Bias ASsessment Tool) framework. It analyzes the full text of a paper across four domains: Participants, Predictors, Outcome, and Analysis.

When to Use

  • Use this skill when you need assess bias in medical prediction model studies using probast tool. use when user wants to evaluate the quality or risk of bias of a medical paper (text or pdf) in a reproducible workflow.
  • Use this skill when a data analytics task needs a packaged method instead of ad-hoc freeform output.
  • Use this skill when the user expects a concrete deliverable, validation step, or file-based result.
  • Use this skill when scripts/extract_pdf.py is the most direct path to complete the request.
  • Use this skill when you need the probast-quality-assessment for prediction model studies package behavior rather than a generic answer.

Key Features

  • Scope-focused workflow aligned to: Assess bias in medical prediction model studies using PROBAST tool. Use when user wants to evaluate the quality or risk of bias of a medical paper (text or PDF).
  • Packaged executable path(s): scripts/extract_pdf.py.
  • Reference material available in references/ for task-specific guidance.
  • Structured execution path designed to keep outputs consistent and reviewable.

Dependencies

  • Python: 3.10+. Repository baseline for current packaged skills.
  • Third-party packages: not explicitly version-pinned in this skill package. Add pinned versions if this skill needs stricter environment control.

Example Usage

bash
cd "20260316/scientific-skills/Data Analytics/probast-quality-assessment-for-prediction-model-studies"
python -m py_compile scripts/extract_pdf.py
python scripts/extract_pdf.py --help

Example run plan:

  1. Confirm the user input, output path, and any required config values.
  2. Edit the in-file CONFIG block or documented parameters if the script uses fixed settings.
  3. Run python scripts/extract_pdf.py with the validated inputs.
  4. Review the generated output and return the final artifact with any assumptions called out.

Implementation Details

See ## Workflow above for related details.

  • Execution model: validate the request, choose the packaged workflow, and produce a bounded deliverable.
  • Input controls: confirm the source files, scope limits, output format, and acceptance criteria before running any script.
  • Primary implementation surface: scripts/extract_pdf.py.
  • Reference guidance: references/ contains supporting rules, prompts, or checklists.
  • Parameters to clarify first: input path, output path, scope filters, thresholds, and any domain-specific constraints.
  • Output discipline: keep results reproducible, identify assumptions explicitly, and avoid undocumented side effects.
Show full SKILL.md (208 more words)Show less

Workflow

To perform the assessment, follow this sequence of operations using the prompts defined in references/probast_prompts.md.

Step 1: Extract Metadata

Extract the first author and year from the paper.

  • Prompt: Use "1. Metadata Extraction" from references/probast_prompts.md.
Step 2: Assess Risk Domains (Parallel)

Assess the risk of bias for each of the four domains. For each domain, use the corresponding prompt to generate a risk rating (Low/High/Unclear) and detailed reasoning.

  • Domain 1 (Participants): Use "2. Domain 1: Participants" from references/probast_prompts.md.
  • Domain 2 (Predictors): Use "3. Domain 2: Predictors" from references/probast_prompts.md.
  • Domain 3 (Outcome): Use "4. Domain 3: Outcome" from references/probast_prompts.md.
  • Domain 4 (Analysis): Use "5. Domain 4: Analysis" from references/probast_prompts.md.
Step 3: Determine Overall Risk

Combine the risk ratings from the four domains to determine the overall risk of bias.

  • Input: The risk ratings (Low/High/Unclear) from Domains 1-4.
  • Prompt: Use "6. Overall Risk Assessment" from references/probast_prompts.md.
Step 4: Format Output

Generate a final JSON report containing the risk ratings for all domains and the overall assessment.

  • Input: The results from Steps 1-3.
  • Prompt: Use "7. JSON Extraction" from references/probast_prompts.md.
  • Output Format: A JSON object matching the study_risk_of_bias_schema.

Helper Scripts

PDF Text Extraction

When the user provides a PDF file path, use extract_pdf.py to extract the text content before assessment:

© aipoch, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 3 other files (scripts, references) in scientific-skills/Data Analysis/probast-quality-assessment-for-prediction-model-studies of aipoch/medical-research-skills.

  • SKILL.md
  • probast-quality-assessment-for-prediction-model-studies_audit_result_v1.json
  • references/probast_prompts.md
  • scripts/extract_pdf.py

Open the folder on GitHubat commit 686e09d

Compare with similar skills

Probast Quality Assessment For Prediction Model Studies next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Probast Quality Assessment For Prediction Model Studies compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Probast Quality Assessment For Prediction Model Studies this skillaipoch/medical-research-skills1.9k—~1.2kAutomated safety check: PassMIT
Mathmodel SkillhandsomeZR-netizen/mathmodel-skill292—~2.5kAutomated safety check: PassMIT
Find Skillsfastclaw-ai/fastclaw1.4k—~2.3kAutomated safety check: WarnCustom licence
Latchshot Page Capturegithub/awesome-copilot40k—~1.3kAutomated safety check: PassMIT
Pie Chart Data AnalysisMichaelYang-lyx/AIDABench1111 repos~964Automated safety check: PassNone
Codebookbrycewang-stanford/Auto-Empirical-Research-Skills4.6k—~527Automated safety check: NotesCustom licence

Similar skills

  • Mathmodel Skill

    handsomeZR-netizen/mathmodel-skill

    CUMCM 国赛、MCM/ICM 美赛与电工杯数学建模竞赛的端到端协作工作流。Use when a user explicitly works on one of these modeling contests or asks to run/review a modeling-competition paper from problem selection through modeling…

    292 GitHub stars~2.5k tokensUpdated 15 days ago
    Documents & OfficeAuto-check passed
  • Find Skills

    fastclaw-ai/fastclaw

    Run this BEFORE any package install (pip / npm / apt / brew / cargo / gem / go install) you would otherwise execute via the exec tool — including when the user asks for a deliverable that needs…

    1.4k GitHub stars~2.3k tokensUpdated yesterday
    Documents & OfficeAuto-check: warnings
  • Latchshot Page Capture

    github/awesome-copilot

    Official

    A skill your agent uses when a user needs a screenshot, website thumbnail, full-page capture, or PDF of a public HTTP(S) webpage saved as a local artifact through Latchshot, including report, QA…

    40k GitHub stars~1.3k tokensUpdated 2 days ago
    Documents & OfficeAuto-check passed
  • Pie Chart Data Analysis

    MichaelYang-lyx/AIDABench

    对多Sheet Excel或CSV数据进行分类汇总统计,自动识别关键字段并生成包含占比、数值及美化饼图的可下载分析报告。

    111 GitHub starsUsed in 1 repo~964 tokens
    Documents & OfficeAuto-check passed
  • Codebook

    brycewang-stanford/Auto-Empirical-Research-Skills

    Auto-generates a Markdown codebook from a dataset (CSV, DTA, Excel, Parquet) with types and summary statistics.

    4.6k GitHub stars~527 tokensUpdated 6 days ago
    Documents & OfficeAuto-check: notes
  • Research Data Auto Analysis Plotting

    Drchronx/ai-agent-research-starter-kit

    Automatically analyze research datasets and generate publication-ready statistical tables, correlation figures, grouped comparison plots, and regression diagnostics.

    139 GitHub stars~463 tokensUpdated 4 mo ago
    Documents & OfficeAuto-check passed

More from aipoch/medical-research-skills

All 578 skills in this repo
  • Academic Poster Generator

    aipoch/medical-research-skills

    Complete workflow for generating academic research posters from PDF literature; use when you need to extract paper content from PDFs and produce a LaTeX-based poster…

    1.9k GitHub stars~2.2k tokensUpdated 24 days ago
    Auto-check passed
  • Diagnostic Study Quality Assessment Quadas

    aipoch/medical-research-skills

    Analyzes clinical diagnostic accuracy studies for bias using the QUADAS-2 tool.

    1.9k GitHub stars~1.4k tokensUpdated 24 days ago
    Auto-check passed
  • Exploratory Data Analysis

    aipoch/medical-research-skills

    Perform comprehensive exploratory data analysis on scientific data files across 200+ file formats.

    1.9k GitHub stars~3.7k tokensUpdated 24 days ago
    Auto-check passed
  • Iso Certification

    aipoch/medical-research-skills

    A toolkit for preparing ISO 13485:2016 certification documentation for medical device QMS.

    1.9k GitHub stars~1.8k tokensUpdated 24 days ago
    Auto-check passed
  • Journal Skills

    aipoch/medical-research-skills

    Recommends target journals for manuscript submission by analyzing the paper topic/abstract and the journal distribution of similar PubMed literature; use when users ask for journal…

    1.9k GitHub stars~1.7k tokensUpdated 24 days ago
    Auto-check passed
  • Latex Posters

    aipoch/medical-research-skills

    Creates academic-poster writing packages for LaTeX using beamerposter, tikzposter, or baposter.

    1.9k GitHub stars~1.3k tokensUpdated 24 days ago
    Auto-check passed

Questions about Probast Quality Assessment For Prediction Model Studies

What does Probast Quality Assessment For Prediction Model Studies do?

Assess bias in medical prediction model studies using PROBAST tool. Probast Quality Assessment For Prediction Model Studies is an agent skill from aipoch/medical-research-skills. Assess bias in medical prediction model studies using PROBAST tool.

When should I use Probast Quality Assessment For Prediction Model Studies?

Probast Quality Assessment For Prediction Model Studies fits situations like: user wants to evaluate the quality; risk of bias of a medical paper (text.

How do I install Probast Quality Assessment For Prediction Model Studies in Claude Code?

Run `npx skills add aipoch/medical-research-skills --skill probast-quality-assessment-for-prediction-model-studies -a claude-code`. Or copy the skill folder (scientific-skills/Data Analysis/probast-quality-assessment-for-prediction-model-studies in aipoch/medical-research-skills) into .claude/skills/probast-quality-assessment-for-prediction-model-studies in your project. Claude Code loads it when a task matches its description.

How do I install Probast Quality Assessment For Prediction Model Studies in Codex?

Run `npx skills add aipoch/medical-research-skills --skill probast-quality-assessment-for-prediction-model-studies -a codex`. Or copy the skill folder (scientific-skills/Data Analysis/probast-quality-assessment-for-prediction-model-studies in aipoch/medical-research-skills) into .agents/skills/probast-quality-assessment-for-prediction-model-studies in your project. Codex loads it when a task matches its description.

Can I use Probast Quality Assessment For Prediction Model Studies in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add aipoch/medical-research-skills --skill probast-quality-assessment-for-prediction-model-studies -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/probast-quality-assessment-for-prediction-model-studies, .gemini/skills/probast-quality-assessment-for-prediction-model-studies, .github/skills/probast-quality-assessment-for-prediction-model-studies and .opencode/skills/probast-quality-assessment-for-prediction-model-studies in your project.

What does Probast Quality Assessment For Prediction Model Studies need to run?

Going by SKILL.md and its folder, Probast Quality Assessment For Prediction Model Studies needs Python for the scripts in its folder and the command-line tools its instructions call (python). Our summary lists: Python 3.

Does Probast Quality Assessment For Prediction Model Studies access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Probast Quality Assessment For Prediction Model Studies safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Probast Quality Assessment For Prediction Model Studies use?

Probast Quality Assessment For Prediction Model Studies is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Probast Quality Assessment For Prediction Model Studies use?

About 1.2k tokens (SKILL.md is roughly 4.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 2.3k tokens, read only when the agent opens those files.

What are the alternatives to Probast Quality Assessment For Prediction Model Studies?

Skills that share tags, products or a category with Probast Quality Assessment For Prediction Model Studies: Mathmodel Skill (handsomeZR-netizen/mathmodel-skill, 292 stars), Find Skills (fastclaw-ai/fastclaw, 1.4k stars), Latchshot Page Capture (github/awesome-copilot, 40k stars) and Pie Chart Data Analysis (MichaelYang-lyx/AIDABench, 111 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Probast Quality Assessment For Prediction Model Studies?

aipoch (a GitHub organization) maintains it in aipoch/medical-research-skills, which has 1,937 GitHub stars. The repository holds 578 skills in this directory. The repository was last updated on September 17, 2026.

Source: aipoch/medical-research-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.