Agent skill

Arxiv Paper Processor

by wentorai in wentorai/research-plugins

Process and analyze arXiv papers systematically for research workflows

Install Arxiv Paper Processor

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .claude/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .claude/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .agents/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .agents/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .cursor/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .cursor/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/wentorai/research-plugins.git --path skills/literature/search/arxiv-paper-processor

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .gemini/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .gemini/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .github/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .github/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install wentorai/research-plugins arxiv-paper-processor --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/wentorai/research-plugins.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/literature/search/arxiv-paper-processor .opencode/skills/arxiv-paper-processor && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "arxiv-paper-processor" agent skill from https://github.com/wentorai/research-plugins/tree/main/skills/literature/search/arxiv-paper-processor into .opencode/skills/arxiv-paper-processor/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "arxiv-paper-processor", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: arxiv-paper-processor
GitHub stars: 298
Used in: 1 other repo
Token cost: ~1.5k tokens
SKILL.md length: 525 words
Files: 1
Skills in repo: 405
Repo updated: Jun 19, 2026
First seen: Oct 7, 2026
Licence: MIT

At a glance

Process and analyze arXiv papers systematically for research workflows

Works in 6 steps: Identify the main .tex file (look for… → Resolve \input{} and \include{}… → Extract sections using \section{},… → …
Tasks that involve Academic paper search
SKILL.md covers Overview, Paper Retrieval and Download, Content Extraction Pipeline and Analysis and Integration, plus 1 more section
Calls wget, docker and curl; reaches export.arxiv.org and arxiv.org

What it does

Arxiv Paper Processor is an agent skill from wentorai/research-plugins. Process and analyze arXiv papers systematically for research workflows

Its SKILL.md is about 1.5k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Research & Science, covering Academic paper search, LaTeX and PDF. It works with arXiv and LaTeX. The repository describes itself as: 350+ academic research skills, MCP configs, and plugins for Research-Claw and AI agents. The licence is MIT.

When your agent uses it

Tasks that involve Academic paper search
Tasks that involve LaTeX
Tasks that involve PDF

Example prompts

“/arxiv-paper-processor”

Requirements

Python 3
Docker

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

Identify the main .tex file (look for \documentclass or \begin{document})
Resolve \input{} and \include{} directives to build the complete document
Extract sections using \section{}, \subsection{} markers
Extract equations from equation, align, gather environments
Parse \cite{} commands and cross-reference with the .bib file
Extract figure captions from \caption{} commands

What it can do on your machine

Read from SKILL.md and the folder at commit bf44b3c. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
- wget
- docker
- curl
From the folder's file list and the shell code blocks in SKILL.md.
Network
Hosts in commands or code, which the agent is likely to contact:
- export.arxiv.org
- arxiv.org
Also links to:
- info.arxiv.org
- github.com
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Arxiv Paper Processor loads about 1.5k tokens when it runs. Until then it costs about 23 tokens; SKILL.md has 525 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~23
When it runs · the whole SKILL.md, loaded when a task matches: ~1.5k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from wentorai/research-plugins at commit bf44b3c, republished under its MIT licence (© wentorai). 525 words, ~1,459 tokens.

Download SKILL.mdSave it as .claude/skills/arxiv-paper-processor/SKILL.md (or your agent's skills folder).

name: arxiv-paper-processor
description: Process and analyze arXiv papers systematically for research workflows

arXiv Paper Processor

Overview

The arXiv Paper Processor skill provides a complete pipeline for downloading, parsing, and analyzing arXiv papers programmatically. While the arXiv API provides metadata, researchers often need to work with the full text—extracting sections, equations, figures, and references for deeper analysis.

This skill covers the entire processing chain: retrieving papers by ID or search query, downloading PDF and LaTeX source files, extracting structured content, and producing analysis-ready outputs. It is particularly valuable for researchers conducting large-scale literature analysis, building training datasets from academic text, or automating evidence extraction for systematic reviews.

The pipeline handles common challenges in academic PDF processing including multi-column layouts, mathematical notation, table extraction, and reference parsing. It integrates with tools like GROBID for PDF parsing and can work directly with arXiv LaTeX sources for higher-fidelity extraction.

Paper Retrieval and Download

Fetching by arXiv ID

The most reliable method is to fetch papers by their arXiv identifier:

python

import urllib.request
import feedparser

# Fetch metadata via Atom feed
arxiv_id = "2301.07041"
url = f"http://export.arxiv.org/api/query?id_list={arxiv_id}"
response = urllib.request.urlopen(url)
feed = feedparser.parse(response.read())

entry = feed.entries[0]
title = entry.title
abstract = entry.summary
authors = [a.name for a in entry.authors]
pdf_url = entry.links[1].href  # PDF link

Downloading Source Files

arXiv stores LaTeX source files for most papers. These provide much richer structure than PDFs:

bash

# Download LaTeX source (typically a .tar.gz)
wget https://arxiv.org/e-print/2301.07041 -O paper_source.tar.gz
tar -xzf paper_source.tar.gz -C paper_source/

Source files contain the original .tex files, figures, bibliography files, and any custom style files. Parsing LaTeX directly gives you access to section structure, equations in their original notation, citation keys, and figure captions without the ambiguity of PDF extraction.

Batch Download Guidelines

When downloading multiple papers, respect arXiv's usage policies:

Limit requests to 1 per 3 seconds for API calls
Use the arXiv bulk data access (S3 or GCS) for large-scale processing (1000+ papers)
Cache all downloaded files locally and check before re-downloading
Include a descriptive User-Agent header in your HTTP requests

Content Extraction Pipeline

PDF Extraction with GROBID

For papers where only PDF is available, use GROBID (GeneRation Of BIbliographic Data) for structured extraction:

bash

# Run GROBID as a local service
docker run --rm -p 8070:8070 grobid/grobid:0.8.0

# Process a PDF
curl -X POST "http://localhost:8070/api/processFulltextDocument" \
  -F "input=@paper.pdf" \
  -F "consolidateHeader=1" \
  -F "consolidateCitations=1" \
  > paper_tei.xml

GROBID outputs TEI-XML with structured sections including:

Header metadata (title, authors, affiliations, abstract)
Body text with section hierarchy
Equations (as MathML or raw text)
Figure and table references
Parsed bibliography entries with DOIs where available

Show full SKILL.md (203 more words)Show less

LaTeX Source Parsing

When LaTeX source is available, parse it directly for higher fidelity:

Identify the main .tex file (look for \documentclass or \begin{document})
Resolve \input{} and \include{} directives to build the complete document
Extract sections using \section{}, \subsection{} markers
Extract equations from equation, align, gather environments
Parse \cite{} commands and cross-reference with the .bib file
Extract figure captions from \caption{} commands

Structured Output Schema

Produce a standardized JSON output for each processed paper:

json

{
  "arxiv_id": "2301.07041",
  "title": "Paper Title",
  "authors": ["Author One", "Author Two"],
  "abstract": "...",
  "sections": [
    {"heading": "Introduction", "level": 1, "text": "..."},
    {"heading": "Related Work", "level": 1, "text": "..."}
  ],
  "equations": ["E = mc^2", "..."],
  "figures": [{"id": "fig1", "caption": "..."}],
  "references": [{"key": "smith2020", "title": "...", "doi": "..."}],
  "processed_date": "2026-03-10"
}

Analysis and Integration

Once papers are processed into structured format, several downstream analyses become possible:

Section-level search: Search across the methods sections of hundreds of papers to find specific techniques.
Equation extraction: Build a database of mathematical formulations used in your subfield.
Citation graph construction: Map which papers cite which, using extracted reference lists.
Terminology tracking: Monitor how specific terms evolve in usage frequency over time.
Dataset identification: Extract mentions of datasets and benchmarks from experimental sections.

Integrate processed outputs with your reference manager by generating BibTeX entries enriched with extracted metadata, or feed structured JSON into a local search index for full-text retrieval across your paper collection.

References

arXiv API: https://info.arxiv.org/help/api/index.html
GROBID: https://github.com/kermitt2/grobid
GPT Paper Assistant: https://github.com/tatsu-lab/gpt_paper_assistant
arXiv bulk data access: https://info.arxiv.org/help/bulk_data/index.html

Files

Just SKILL.md in skills/literature/search/arxiv-paper-processor of wentorai/research-plugins.

Open the folder on GitHubat commit bf44b3c

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in wentorai/research-plugins, which our catalogue first saw on October 7, 2026.

brycewang-stanford/Auto-Empirical-Research-Skillsskills/43-wentorai-research-plugins/skills/literature/search/arxiv-paper-processor

Compare with similar skills

Arxiv Paper Processor next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Arxiv Paper Processor compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Arxiv Paper Processor this skillwentorai/research-plugins	298	1 repos	~1.5k	Automated safety check: Pass	MIT	3 mo ago
Paper2htmlcnfjlhj/ai-collab-playbook	453	—	~2.4k	Automated safety check: Pass	None	25 days ago
Paper OrchestraAr9av/PaperOrchestra	677	1 repos	~3.5k	Automated safety check: Pass	Custom licence	18 days ago
Section Writing AgentAr9av/PaperOrchestra	677	1 repos	~3.3k	Automated safety check: Pass	Custom licence	18 days ago
SearchMuuuun/luxas	1.2k	—	~2.3k	Automated safety check: Warn	MIT	1 mo ago
Oleafly Pre SubmissionOleafly/Oleafly	209	—	~2.9k	Automated safety check: Pass	MIT	today

Similar skills

Paper2html
cnfjlhj/ai-collab-playbook
A skill your agent uses when turning an academic paper PDF/arXiv/OpenReview page/local LaTeX source into a single-file Chinese HTML deep-reading page, especially when the user wants a Cheat-Sheet…
453 GitHub stars~2.4k tokensUpdated 25 days ago
Documents & OfficeAuto-check passed
Paper Orchestra
Ar9av/PaperOrchestra
Orchestrate the full PaperOrchestra (Song et al., 2026, arXiv:2604.05018) five-agent pipeline to turn unstructured research materials (idea, experimental log, LaTeX template, conference guidelines…
677 GitHub starsUsed in 1 repo~3.5k tokens
Research & ScienceAuto-check passed
Section Writing Agent
Ar9av/PaperOrchestra
Step 4 of the PaperOrchestra pipeline (arXiv:2604.05018). An agent skill from Ar9av/PaperOrchestra.
677 GitHub starsUsed in 1 repo~3.3k tokens
Research & ScienceAuto-check passed
Search
Muuuun/luxas
Unified academic paper search, citation chains, paper download (arXiv LaTeX/PDF, Sci-Hub), figure extraction from papers, LaTeX source reading, BibTeX fetching, web search, and browser automation…
1.2k GitHub stars~2.3k tokensUpdated 1 mo ago
Research & ScienceAuto-check: warnings
Oleafly Pre Submission
Oleafly/Oleafly
Run a pre-flight pass over the project before uploading to arXiv or a venue, and write a pass or fail checklist.
209 GitHub stars~2.9k tokensUpdated today
Research & ScienceAuto-check passed
Anmath Submission
franklee16/academic-research-skills
A skill your agent uses when running the final pre-submission preflight for an Annals of Mathematics manuscript — AMS-LaTeX compile, theorem environments, abstract and MSC, references, arXiv…
223 GitHub starsUsed in 1 repo~1.1k tokens
Research & ScienceAuto-check passed

Questions about Arxiv Paper Processor

What does Arxiv Paper Processor do?

Process and analyze arXiv papers systematically for research workflows. Arxiv Paper Processor is an agent skill from wentorai/research-plugins.

When should I use Arxiv Paper Processor?

Arxiv Paper Processor fits situations like: tasks that involve Academic paper search; tasks that involve LaTeX; tasks that involve PDF.

How do I install Arxiv Paper Processor in Claude Code?

Run `npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a claude-code`. Or copy the skill folder (skills/literature/search/arxiv-paper-processor in wentorai/research-plugins) into .claude/skills/arxiv-paper-processor in your project. Claude Code loads it when a task matches its description.

How do I install Arxiv Paper Processor in Codex?

Run `npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a codex`. Or copy the skill folder (skills/literature/search/arxiv-paper-processor in wentorai/research-plugins) into .agents/skills/arxiv-paper-processor in your project. Codex loads it when a task matches its description.

Can I use Arxiv Paper Processor in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add wentorai/research-plugins --skill arxiv-paper-processor -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/arxiv-paper-processor, .gemini/skills/arxiv-paper-processor, .github/skills/arxiv-paper-processor and .opencode/skills/arxiv-paper-processor in your project.

What does Arxiv Paper Processor need to run?

Going by SKILL.md and its folder, Arxiv Paper Processor needs the command-line tools its instructions call (wget, docker and curl). Our summary lists: Python 3; Docker.

Does Arxiv Paper Processor access the network?

SKILL.md names 4 domains. In commands or code: export.arxiv.org and arxiv.org; the agent is likely to contact these when it follows the instructions. As links in the text: info.arxiv.org and github.com. This is read from the text; nothing was executed.

Is Arxiv Paper Processor safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Arxiv Paper Processor use?

Arxiv Paper Processor is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Arxiv Paper Processor use?

About 1.5k tokens (SKILL.md is roughly 5.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Arxiv Paper Processor?

Skills that share tags, products or a category with Arxiv Paper Processor: Paper2html (cnfjlhj/ai-collab-playbook, 453 stars), Paper Orchestra (Ar9av/PaperOrchestra, 677 stars), Section Writing Agent (Ar9av/PaperOrchestra, 677 stars) and Search (Muuuun/luxas, 1.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Arxiv Paper Processor?

wentorai (a GitHub user) maintains it in wentorai/research-plugins, which has 298 GitHub stars. The repository holds 405 skills in this directory. The repository was last updated on June 19, 2026.

Source: wentorai/research-plugins on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Install Arxiv Paper Processor

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

arXiv Paper Processor

Overview

Paper Retrieval and Download

Fetching by arXiv ID

Downloading Source Files

Batch Download Guidelines

Content Extraction Pipeline

PDF Extraction with GROBID

LaTeX Source Parsing

Structured Output Schema

Analysis and Integration

References

Files

Used in 1 other repository

Compare with similar skills

Similar skills

More from wentorai/research-plugins

Related

Questions about Arxiv Paper Processor