Agent skill

Scholar Evaluation

by aipoch in aipoch/medical-research-skills

Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment.

MITAuto-check passedDocuments & Office

Install Scholar Evaluation

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .claude/skills/scholar-evaluation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .claude/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .agents/skills/scholar-evaluation && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .agents/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .cursor/skills/scholar-evaluation && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .cursor/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/aipoch/medical-research-skills.git --path 'scientific-skills/Evidence Insight/scholar-evaluation'

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .gemini/skills/scholar-evaluation && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .gemini/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .github/skills/scholar-evaluation && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .github/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install aipoch/medical-research-skills scholar-evaluation --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/aipoch/medical-research-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/'scientific-skills/Evidence Insight/scholar-evaluation' .opencode/skills/scholar-evaluation && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "scholar-evaluation" agent skill from https://github.com/aipoch/medical-research-skills/tree/main/scientific-skills/Evidence%20Insight/scholar-evaluation into .opencode/skills/scholar-evaluation/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scholar-evaluation", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: scholar-evaluation
GitHub stars: 2k
Token cost: ~932 tokens
SKILL.md length: 366 words
Files: 7 (incl. scripts, references)
Skills in repo: 567
Repo updated: Sep 17, 2026
First seen: Oct 7, 2026
Licence: MIT

At a glance

Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment.

Works in 4 steps: Extract text (run this first for file… → Create a scores JSON (example:… → Compute the weighted/aggregate score → …
The user provides a PDF/DOCX/TXT file
SKILL.md covers When to Use, Key Features, Dependencies and Example Usage, plus 1 more section
Runs Python scripts from its folder; calls python and pip

What it does

Scholar Evaluation is an agent skill from aipoch/medical-research-skills. Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment.

Its SKILL.md is about 930 tokens, which your agent loads only when the skill is triggered. The skill folder holds 8 other files, including scripts and reference files (for example `references/evaluation_framework.md`, `scholar-evaluation_audit_result_v1.json` and `scores.json`).

It sits in Documents & Office, covering Word documents, Peer review and PDF. It works with Microsoft Word. The repository describes itself as: Hundreds of agent skills for medical research, including protocol design, data analysis, evidence insights, and academic writing. The licence is MIT.

When your agent uses it

The user provides a PDF/DOCX/TXT file
Pasted text and requests critique
Quality assessment

Example prompts

“Use the scholar-evaluation skill to implement the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a…”
“/scholar-evaluation”

Requirements

Python 3

Workflow steps

4 steps, taken from the first numbered list in SKILL.md.

Extract text (run this first for file inputs)
Create a scores JSON (example: scores.json)
Compute the weighted/aggregate score
Use the extracted text plus the rubric to generate the evaluation report

What it can do on your machine

Read from SKILL.md and the folder at commit 686e09d. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Ships 2 files in scripts/ (Python), which the agent can run.
Shell commands in SKILL.md call:
- python
- pip
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md. Its commands use pip, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Scholar Evaluation loads about 932 tokens when it runs, and up to ~1.5k if it reads all its reference files. Until then it costs about 52 tokens; SKILL.md has 366 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~52
When it runs · the whole SKILL.md, loaded when a task matches: ~932
With references · SKILL.md plus every file in references/, read only if the agent opens them: ~1.5k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from aipoch/medical-research-skills at commit 686e09d, republished under its MIT licence (© aipoch). 366 words, ~932 tokens.

Download SKILL.mdSave it as .claude/skills/scholar-evaluation/SKILL.md (or your agent's skills folder). This skill also uses 6 other files; get the full folder from GitHub.

name: scholar-evaluation
description: Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment.
license: MIT
author: AIPOCH

Source: https://github.com/aipoch/medical-research-skills

When to Use

Evaluate a research paper, thesis, or proposal and produce a structured critique with scores.
Generate actionable revision recommendations across core academic writing dimensions.
Compare multiple drafts/versions of a manuscript using consistent rubric-based scoring.
Assess submission readiness (e.g., for a conference/journal) and identify major weaknesses.
Review a document provided as a PDF/DOCX/TXT file when the user expects automatic text extraction.

Key Features

Automatic text extraction from PDF/DOCX/TXT via scripts/extract_text.py (intended as the first step for file inputs).
ScholarEval rubric with 8 evaluation dimensions (see references/evaluation_framework.md).
Per-dimension scoring (1–5) with qualitative feedback and concrete recommendations.
Weighted score calculation via scripts/calculate_scores.py from a JSON score file.
Produces a final report summarizing strengths, weaknesses, and next steps.

Dependencies

Python 3.10+
See requirements.txt for pinned Python package versions (install via pip install -r requirements.txt).

Example Usage

A) Evaluate a PDF/DOCX/TXT file (end-to-end)

Extract text (run this first for file inputs):

bash

python scripts/extract_text.py "paper.pdf"

Create a scores JSON (example: scores.json):

json

{
  "problem_formulation": 4,
  "literature_review": 3,
  "methodology": 4,
  "data_quality": 3,
  "analysis": 4,
  "results": 3,
  "writing_quality": 4,
  "citations": 3
}

Compute the weighted/aggregate score:

bash

python scripts/calculate_scores.py --scores scores.json

Use the extracted text plus the rubric to generate the evaluation report:

Apply the 8-dimension criteria from references/evaluation_framework.md
Provide per-dimension justification, then summarize strengths/risks and prioritized revisions

B) Evaluate pasted text (no extraction)

If the user pastes text directly (e.g., abstract, full paper text), skip extraction and evaluate immediately using the 8 dimensions and the 1–5 scale.

Implementation Details

Show full SKILL.md (152 more words)Show less

File ingestion protocol (for PDF/DOCX/TXT)

For any user-provided file, run:

bash

python scripts/extract_text.py "<filename-or-path>"

The extraction script is designed to locate the file even if the full path is not provided.
Use the extracted plain text as the sole input to the evaluation rubric and scoring.

Evaluation dimensions (8)

The framework evaluates:

Problem Formulation
Literature Review
Methodology
Data Quality
Analysis
Results
Writing Quality
Citations

Detailed criteria and guidance are defined in:

references/evaluation_framework.md

Scoring scale (1–5)

1 — Poor: Major flaws; not usable as-is.
2 — Weak: Significant issues; major revision required.
3 — Average: Acceptable baseline; improvement needed.
4 — Good: Strong overall; minor issues.
5 — Excellent: High quality; clear impact and rigor.

Score calculation

Raw per-dimension scores are stored in a JSON file and passed to:
bash
```
python scripts/calculate_scores.py --scores <path_to_scores_json>
```
The script computes an aggregate score (and any configured weighting logic) based on the provided metrics.

Files

SKILL.md and 6 other files (scripts, references) in scientific-skills/Evidence Insight/scholar-evaluation of aipoch/medical-research-skills.

SKILL.md
references/evaluation_framework.md
requirements.txt
scholar-evaluation_audit_result_v1.json
scores.json
scripts/calculate_scores.py
scripts/extract_text.py

Open the folder on GitHubat commit 686e09d

Compare with similar skills

Scholar Evaluation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Scholar Evaluation compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Scholar Evaluation this skillaipoch/medical-research-skills	2k	—	~932	Automated safety check: Pass	MIT	21 days ago
AI Review SkillNeuroDong/Ai-Review	626	—	~2.5k	Automated safety check: Pass	MIT	1 mo ago
Paper CovertGRIND-Lab-Core/night_owl_research_agent	106	—	~2.1k	Automated safety check: Notes	None	5 mo ago
MarkitdownImCa0/just-laws	781	14 repos	~3.2k	Automated safety check: Notes	MIT	yesterday
Gzh Designisjiamu/gzh-design-skill	3.9k	1 repos	~2.2k	Automated safety check: Pass	AGPL-3.0	5 days ago
GenOffice Document CLIgenspark-ai/genoffice	8.9k	—	~19k	Automated safety check: Pass	Apache-2.0	today

Similar skills

AI Review Skill
NeuroDong/Ai-Review
Generates structured AI paper reviews (SoT style) for LaTeX, PDF, and Word manuscripts.
626 GitHub stars~2.5k tokensUpdated 1 mo ago
Documents & OfficeAuto-check passed
Paper Covert
GRIND-Lab-Core/night_owl_research_agent
Converts the final Markdown manuscript from paper-draft / paper-review-loop into a submission package for the target venue — modular LaTeX (one file per section), compiled PDF, and Word .docx.
106 GitHub stars~2.1k tokensUpdated 5 mo ago
Documents & OfficeAuto-check: notes
Markitdown
ImCa0/just-laws
Convert files and office documents to Markdown. An agent skill from ImCa0/just-laws.
781 GitHub starsUsed in 14 repos~3.2k tokens
Documents & OfficeAuto-check: notes
Gzh Design
isjiamu/gzh-design-skill
微信公众号文章排版引擎，将 Markdown 转换为可直接粘贴到公众号编辑器的 HTML。主题风格从 references/theme-index.md 注册的自定义主题库中选取，自动章节编号、关键词下划线标记、引言卡片、目录导航、代码块、图片/GIF、作者签名。支持 Markdown / Word(.docx) / PDF / 纯文本输入（非 Markdown…
3.9k GitHub starsUsed in 1 repo~2.2k tokens
Documents & OfficeAuto-check passed
GenOffice Document CLI
genspark-ai/genoffice
Creates, converts, reads and edits real pptx, xlsx, docx and PDF files locally through the genoffice command line.
8.9k GitHub stars~19k tokensUpdated today
Documents & OfficeAuto-check passed
Translate Book
deusyu/translate-book
Translate books (PDF/DOCX/EPUB) into any language using parallel sub-agents.
2.1k GitHub stars~5.5k tokensUpdated 14 days ago
Documents & OfficeAuto-check: notes

Questions about Scholar Evaluation

What does Scholar Evaluation do?

Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment. Scholar Evaluation is an agent skill from aipoch/medical-research-skills. Implements the ScholarEval framework to evaluate scholarly documents; trigger when the user provides a PDF/DOCX/TXT file or pasted text and requests critique, scoring, or quality assessment.

When should I use Scholar Evaluation?

Scholar Evaluation fits situations like: the user provides a PDF/DOCX/TXT file; pasted text and requests critique; quality assessment.

How do I install Scholar Evaluation in Claude Code?

Run `npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a claude-code`. Or copy the skill folder (scientific-skills/Evidence Insight/scholar-evaluation in aipoch/medical-research-skills) into .claude/skills/scholar-evaluation in your project. Claude Code loads it when a task matches its description.

How do I install Scholar Evaluation in Codex?

Run `npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a codex`. Or copy the skill folder (scientific-skills/Evidence Insight/scholar-evaluation in aipoch/medical-research-skills) into .agents/skills/scholar-evaluation in your project. Codex loads it when a task matches its description.

Can I use Scholar Evaluation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add aipoch/medical-research-skills --skill scholar-evaluation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/scholar-evaluation, .gemini/skills/scholar-evaluation, .github/skills/scholar-evaluation and .opencode/skills/scholar-evaluation in your project.

What does Scholar Evaluation need to run?

Going by SKILL.md and its folder, Scholar Evaluation needs Python for the scripts in its folder and the command-line tools its instructions call (python and pip). Our summary lists: Python 3.

Does Scholar Evaluation access the network?

SKILL.md contains no URLs. Its commands use pip, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Scholar Evaluation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Scholar Evaluation use?

Scholar Evaluation is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Scholar Evaluation use?

About 932 tokens (SKILL.md is roughly 3.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 534 tokens, read only when the agent opens those files.

What are the alternatives to Scholar Evaluation?

Skills that share tags, products or a category with Scholar Evaluation: AI Review Skill (NeuroDong/Ai-Review, 626 stars), Paper Covert (GRIND-Lab-Core/night_owl_research_agent, 106 stars), Markitdown (ImCa0/just-laws, 781 stars) and Gzh Design (isjiamu/gzh-design-skill, 3.9k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Scholar Evaluation?

aipoch (a GitHub organization) maintains it in aipoch/medical-research-skills, which has 1,974 GitHub stars. The repository holds 567 skills in this directory. The repository was last updated on September 17, 2026.

Source: aipoch/medical-research-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Install Scholar Evaluation

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

When to Use

Key Features

Dependencies

Example Usage

A) Evaluate a PDF/DOCX/TXT file (end-to-end)

B) Evaluate pasted text (no extraction)

Implementation Details

File ingestion protocol (for PDF/DOCX/TXT)

Evaluation dimensions (8)

Scoring scale (1–5)

Score calculation

Files

Compare with similar skills

Similar skills

More from aipoch/medical-research-skills

Related

Questions about Scholar Evaluation