Agent skill

Paper Critique Framework

by wentorai in wentorai/research-plugins

Structured framework for writing peer review reports and paper critiques

MITAuto-check passedResearch & Science

Install Paper Critique Framework

skills CLI
$ npx skills add wentorai/research-plugins --skill paper-critique-framework -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install wentorai/research-plugins paper-critique-framework --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/research/paper-review/paper-critique-framework .claude/skills/paper-critique-framework && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
paper-critique-framework
GitHub stars
298
Used in
1 other repo
Token cost
~1.8k tokens
SKILL.md length
526 words
Files
1
Skills in repo
405
Repo updated
First seen
Licence
MIT

At a glance

Structured framework for writing peer review reports and paper critiques

  • Tasks that involve Peer review
  • SKILL.md covers Overview, The Three-Pass Review Method, Review Report Structure and Assessment Criteria by Dimension, plus 4 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Paper Critique Framework is an agent skill from wentorai/research-plugins. Structured framework for writing peer review reports and paper critiques

Its SKILL.md is about 1.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Research & Science, covering Peer review. The repository describes itself as: 350+ academic research skills, MCP configs, and plugins for Research-Claw and AI agents. The licence is MIT.

When your agent uses it

  • Tasks that involve Peer review

Example prompts

  • “/paper-critique-framework”

What it can do on your machine

Read from SKILL.md and the folder at commit bf44b3c. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are markdown).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • neurips.cc
    • aclrollingreview.org

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Paper Critique Framework loads about 1.8k tokens when it runs. Until then it costs about 24 tokens; SKILL.md has 526 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~24
When it runs · the whole SKILL.md, loaded when a task matches
~1.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from wentorai/research-plugins at commit bf44b3c, republished under its MIT licence (© wentorai). 526 words, ~1,806 tokens.

Download SKILL.mdSave it as .claude/skills/paper-critique-framework/SKILL.md (or your agent's skills folder).
name
paper-critique-framework
description
Structured framework for writing peer review reports and paper critiques

Paper Critique and Peer Review Framework

Overview

Writing constructive peer reviews is a core academic skill. This framework provides a systematic approach to evaluating manuscripts — from initial read-through to the final referee report. It covers what reviewers should assess, how to structure feedback, and how to calibrate between different review outcomes (accept, revise, reject). Applicable to conference papers, journal articles, and internal lab reviews.

The Three-Pass Review Method

Pass 1: Orientation (15-20 minutes)

Read only these elements:

  • Title, abstract, and keywords
  • Introduction (first and last paragraphs)
  • Section headings and figure captions
  • Conclusion

After Pass 1, answer:

□ What is the main claim?
□ What type of contribution? (empirical, theoretical, system, survey)
□ Is it within the venue's scope?
□ Does the abstract accurately represent the content?
□ Initial impression: novel or incremental?
Pass 2: Detailed Read (60-90 minutes)

Read the full paper. Annotate as you go:

markdown
Annotation symbols:
  ? = I don't understand this
  ! = This is interesting / strong point
  X = I disagree / see a problem
  → = This needs more evidence or justification
  ≈ = This is similar to [existing work] — check novelty

Focus on:

  • Claims vs. evidence: Is every major claim supported by data?
  • Methodology: Are the methods appropriate for the research question?
  • Experimental design: Are baselines fair? Are ablations sufficient?
  • Figures and tables: Do they support the narrative? Are they readable?
  • Writing quality: Is it clear, concise, and well-organized?
Pass 3: Verification (30-60 minutes)

For papers you're seriously evaluating:

  • Check key references — do they say what the authors claim?
  • Verify mathematical derivations (spot-check, not exhaustive)
  • Examine statistical claims (p-values, confidence intervals, effect sizes)
  • Check for cherry-picking in results (only best runs? selected metrics?)
  • Look for missing baselines that should have been compared

Review Report Structure

markdown
## Summary (3-5 sentences)
[Describe what the paper does, the approach, and the main finding.
 Demonstrate that you understood the paper.]

## Strengths (bulleted list)
- S1: [Specific strength with evidence from the paper]
- S2: [Another strength]
- S3: [Another strength]

## Weaknesses (bulleted list, ordered by severity)
- W1 (Major): [Specific weakness + why it matters + suggestion to fix]
- W2 (Major): [Another major weakness]
- W3 (Minor): [A less critical issue]
- W4 (Minor): [Another minor issue]

## Questions for Authors
- Q1: [Something you'd like clarified]
- Q2: [A concern that the authors might be able to address]

## Detailed Comments
[Page/line-specific comments, typos, suggestions]

## Overall Assessment
Recommendation: [Strong Accept / Accept / Weak Accept / Borderline /
                  Weak Reject / Reject / Strong Reject]
Confidence: [High / Medium / Low]

Assessment Criteria by Dimension

DimensionQuestions to AskWeight
NoveltyIs the idea new? Is the contribution beyond incremental?High
SignificanceWould this matter to the community? Does it advance the field?High
SoundnessAre the methods correct? Are conclusions supported?High
ClarityIs it well-written? Can it be understood and reproduced?Medium
CompletenessAre related works covered? Are experiments thorough?Medium
ReproducibilityCould someone replicate this? Code/data available?Medium
Calibration Guide
Strong Accept: Significant contribution, technically sound, well-written.
  Would be a highlight of the venue.

Accept: Solid contribution with minor issues. Advances the field.
  Worth publishing as-is or with minor revisions.

Weak Accept: Has merit but notable weaknesses. Contribution is real but modest.
  Borderline for this venue; would be accepted at a less selective venue.

Borderline: Equal arguments for and against. Significant weaknesses offset
  by some novelty. Depends on other reviews.

Weak Reject: Interesting direction but fundamental issues not addressed.
  Major revisions needed that likely require a new submission cycle.

Reject: Significant problems in novelty, soundness, or relevance.
  Not suitable for this venue even with revisions.

Strong Reject: Fundamental flaws. Clearly below threshold.
Show full SKILL.md (240 more words)Show less

Common Review Pitfalls to Avoid

PitfallBetter Approach
"The writing needs improvement" (vague)Give 2-3 specific examples with suggested fixes
Rejecting for not solving YOUR problemEvaluate the paper on its own stated goals
Demanding impossible experimentsSuggest feasible improvements within scope
Ignoring supplementary materialCheck appendix — authors may have addressed your concern
Being harsh without being constructiveEvery weakness should include a suggestion for improvement
Reviewing too quicklyBlock dedicated time; a rushed review harms both authors and science
Citing only your own work as "missing"Only cite if genuinely relevant, not self-promotion

Reviewing Different Paper Types

Empirical Papers
  • Are datasets described completely? (Size, source, splits, preprocessing)
  • Are baselines appropriate and fairly tuned?
  • Statistical significance: error bars, multiple runs, significance tests
  • Ablation studies: which components contribute to the gain?
Systems Papers
  • Is the system actually built and evaluated (not just designed)?
  • Performance at scale: latency, throughput, resource usage
  • Comparison with existing systems (not just algorithms)
  • Deployment experience or case studies
Survey/Position Papers
  • Coverage: are major relevant works included?
  • Taxonomy: is the organizational framework useful and complete?
  • Analysis: does the survey add value beyond listing papers?
  • Recency: are the most recent advances covered?

Ethics Considerations

markdown
During review, check:
□ Are human subjects involved? Was IRB/ethics approval obtained?
□ Are there potential harms from the technology described?
□ Is the data collection ethical? (Consent, privacy, bias)
□ Are dual-use concerns addressed? (Misuse potential)
□ Are limitations and societal implications discussed?

References

  • Smith, R. (2006). "Peer review: a flawed process at the heart of science and journals." Journal of the Royal Society of Medicine, 99(4), 178-182.
  • NeurIPS Reviewer Guidelines
  • ACL Reviewer Tutorial
  • Cormode, G. (2009). "How NOT to review a paper." ACM SIGMOD Record, 37(4), 100-104.

© wentorai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/research/paper-review/paper-critique-framework of wentorai/research-plugins.

Open the folder on GitHubat commit bf44b3c

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in wentorai/research-plugins, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Paper Critique Framework next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Paper Critique Framework compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Paper Critique Framework this skillwentorai/research-plugins2981 repos~1.8kAutomated safety check: PassMIT
Peer Reviewspacering-net/codeg3.9k17 repos~5.9kAutomated safety check: NotesMIT
Scholar Evaluationspacering-net/codeg3.9k11 repos~3.2kAutomated safety check: PassMIT
Academic Paper Writing PipelineImbad0202/academic-research-skills51k—~16kAutomated safety check: PassCustom licence
Academic Paper ReviewerImbad0202/academic-research-skills51k—~11kAutomated safety check: PassCustom licence
Peer ReviewK-Dense-AI/claude-scientific-writer2.4k2 repos~3.1kAutomated safety check: NotesMIT

Similar skills

  • Peer Review

    spacering-net/codeg

    Structured manuscript/grant review with checklist-based evaluation.

    3.9k GitHub starsUsed in 17 repos~5.9k tokens
    Research & ScienceAuto-check: notes
  • Scholar Evaluation

    spacering-net/codeg

    Systematically evaluate scholarly work using the ScholarEval framework, providing structured assessment across research quality dimensions including problem formulation, methodology, analysis, and…

    3.9k GitHub starsUsed in 11 repos~3.2k tokens
    Research & ScienceAuto-check passed
  • Academic Paper Writing Pipeline

    Imbad0202/academic-research-skills

    Runs a 12-agent pipeline that plans, drafts, cites, reviews and formats academic papers, with modes for revision, rebuttals, abstracts and citation checks.

    51k GitHub stars~16k tokensUpdated yesterday
    Research & ScienceAuto-check passed
  • Academic Paper Reviewer

    Imbad0202/academic-research-skills

    Simulates a journal peer review of a manuscript with a five-seat reviewer panel, an editorial synthesizer and several review modes.

    51k GitHub stars~11k tokensUpdated yesterday
    Research & ScienceAuto-check passed
  • Peer Review

    K-Dense-AI/claude-scientific-writer

    Prepare evidence-bounded, constructive peer-review drafts and structured manuscript assessments.

    2.4k GitHub starsUsed in 2 repos~3.1k tokens
    Research & ScienceAuto-check: notes
  • Academic Research Pipeline

    Imbad0202/academic-research-skills

    Orchestrates a ten-stage academic workflow from research to finished manuscript, including integrity checks, two rounds of peer review and revision.

    51k GitHub stars~15k tokensUpdated yesterday
    Research & ScienceAuto-check passed

More from wentorai/research-plugins

All 405 skills in this repo
  • Abstract Writing Guide

    wentorai/research-plugins

    Craft structured research abstracts that maximize clarity and journal acceptance

    298 GitHub starsUsed in 1 repo~1.7k tokens
    Auto-check passed
  • Academic Citation Manager

    wentorai/research-plugins

    Manage academic citations across BibTeX, APA, MLA, and Chicago formats

    298 GitHub starsUsed in 1 repo~2.7k tokens
    Auto-check passed
  • Academic Paper Summarizer

    wentorai/research-plugins

    Summarize academic papers with structured extraction of key elements

    298 GitHub starsUsed in 1 repo~1.4k tokens
    Auto-check passed
  • Academic Study Methods

    wentorai/research-plugins

    Evidence-based study techniques for academic learning and retention

    298 GitHub starsUsed in 1 repo~1.8k tokens
    Auto-check passed
  • Academic Tone Guide

    wentorai/research-plugins

    Adjust writing tone and register for academic audiences and venues

    298 GitHub starsUsed in 1 repo~1.9k tokens
    Auto-check passed
  • Academic Translation Guide

    wentorai/research-plugins

    Academic translation, post-editing, and Chinglish correction guide

    298 GitHub starsUsed in 1 repo~1.6k tokens
    Auto-check passed

Questions about Paper Critique Framework

What does Paper Critique Framework do?

Structured framework for writing peer review reports and paper critiques. Paper Critique Framework is an agent skill from wentorai/research-plugins.

When should I use Paper Critique Framework?

Paper Critique Framework fits situations like: tasks that involve Peer review.

How do I install Paper Critique Framework in Claude Code?

Run `npx skills add wentorai/research-plugins --skill paper-critique-framework -a claude-code`. Or copy the skill folder (skills/research/paper-review/paper-critique-framework in wentorai/research-plugins) into .claude/skills/paper-critique-framework in your project. Claude Code loads it when a task matches its description.

How do I install Paper Critique Framework in Codex?

Run `npx skills add wentorai/research-plugins --skill paper-critique-framework -a codex`. Or copy the skill folder (skills/research/paper-review/paper-critique-framework in wentorai/research-plugins) into .agents/skills/paper-critique-framework in your project. Codex loads it when a task matches its description.

Can I use Paper Critique Framework in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add wentorai/research-plugins --skill paper-critique-framework -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/paper-critique-framework, .gemini/skills/paper-critique-framework, .github/skills/paper-critique-framework and .opencode/skills/paper-critique-framework in your project.

What does Paper Critique Framework need to run?

SKILL.md names no scripts, command-line tools or credentials: Paper Critique Framework is instructions for the agent only.

Does Paper Critique Framework access the network?

SKILL.md names 2 domains. As links in the text: neurips.cc and aclrollingreview.org. This is read from the text; nothing was executed.

Is Paper Critique Framework safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Paper Critique Framework use?

Paper Critique Framework is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Paper Critique Framework use?

About 1.8k tokens (SKILL.md is roughly 7.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Paper Critique Framework?

Skills that share tags, products or a category with Paper Critique Framework: Peer Review (spacering-net/codeg, 3.9k stars), Scholar Evaluation (spacering-net/codeg, 3.9k stars), Academic Paper Writing Pipeline (Imbad0202/academic-research-skills, 51k stars) and Academic Paper Reviewer (Imbad0202/academic-research-skills, 51k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Paper Critique Framework?

wentorai (a GitHub user) maintains it in wentorai/research-plugins, which has 298 GitHub stars. The repository holds 405 skills in this directory. The repository was last updated on June 19, 2026.

Source: wentorai/research-plugins on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.