Local Knowledge Base Retriever
ConardLi/rag-skill
Answers questions from a local knowledge base folder by walking hierarchical index files and searching with grep, pdfplumber and pandas instead of loading whole files.
A skill your agent uses when the user wants to process new papers, patents, theses, documents, or proceedings from inbox queues into the knowledge base, run the ingest pipeline, or rebuild indexes.
$ npx skills add ZimoLiao/scholaraio --skill ingest -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install ZimoLiao/scholaraio ingest --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/ingest .claude/skills/ingest && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .claude/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingestType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add ZimoLiao/scholaraio --skill ingest -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install ZimoLiao/scholaraio ingest --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.claude/skills/ingest .agents/skills/ingest && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .agents/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add ZimoLiao/scholaraio --skill ingest -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install ZimoLiao/scholaraio ingest --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.claude/skills/ingest .cursor/skills/ingest && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .cursor/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/ZimoLiao/scholaraio.git --path .claude/skills/ingest--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add ZimoLiao/scholaraio --skill ingest -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install ZimoLiao/scholaraio ingest --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.claude/skills/ingest .gemini/skills/ingest && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .gemini/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install ZimoLiao/scholaraio ingestInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add ZimoLiao/scholaraio --skill ingest -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .github/skills && cp -r skills-src/.claude/skills/ingest .github/skills/ingest && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .github/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add ZimoLiao/scholaraio --skill ingest -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install ZimoLiao/scholaraio ingest --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/ZimoLiao/scholaraio.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.claude/skills/ingest .opencode/skills/ingest && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "ingest" agent skill from https://github.com/ZimoLiao/scholaraio/tree/main/.claude/skills/ingest into .opencode/skills/ingest/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ingest", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
ingestA skill your agent uses when the user wants to process new papers, patents, theses, documents, or proceedings from inbox queues into the knowledge base, run the ingest pipeline, or rebuild indexes.
Ingest is an agent skill from ZimoLiao/scholaraio. Use when the user wants to process new papers, patents, theses, documents, or proceedings from inbox queues into the knowledge base, run the ingest pipeline, or rebuild indexes.
Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Documents & Office, covering Email management, Intellectual property and Knowledge bases. It works with Microsoft Excel. The repository describes itself as: Scholar All-In-One: A research infrastructure for AI agents. The licence is MIT.
2 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 777628b. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
pipFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use pip, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Ingest loads about 1.3k tokens when it runs. Until then it costs about 46 tokens; SKILL.md has 428 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from ZimoLiao/scholaraio at commit 777628b, republished under its MIT licence (© ZimoLiao). 428 words, ~1,330 tokens.
.claude/skills/ingest/SKILL.md (or your agent's skills folder).将 inbox 中的 PDF、Office 文档(DOCX/XLSX/PPTX)或 Markdown 文件处理入库。支持论文、专利、学位论文、一般文档和论文集(proceedings)。
| 格式 | 放入目录 | 处理方式 |
|---|---|---|
.pdf | data/spool/inbox/ 或 data/spool/inbox-doc/ | MinerU 转 Markdown |
.pdf / .md | data/spool/inbox-patent/ | 专利文献(按公开号去重) |
.pdf / .md | data/spool/inbox-proceedings/ | 论文集准备流程(先生成 proceeding.md + split_candidates.json) |
.docx .xlsx .pptx | data/spool/inbox-doc/ | MarkItDown 转 Markdown |
.md | 任意 inbox | 直接入库(跳过转换) |
根据用户意图选择预设:
ingest 预设(= mineru, extract, dedup, ingest, embed, index)full 预设(= mineru, extract, dedup, ingest, toc, l3, embed, index)reindex 预设(= embed, index)enrich 预设(= toc, l3, embed, index)注意:
inbox-doc/始终使用专用步骤office_convert, mineru, extract_doc, ingest,不受 preset 影响。inbox-patent/和inbox-thesis/也有各自的固定流程。preset 中的 papers 级步骤(toc, l3)和 global 级步骤(embed, index)在处理完所有 inbox 后统一执行。
执行流水线命令:
scholaraio pipeline <preset> [--dry-run] [--no-api] [--force] [--inspect]可用预设:full | ingest | enrich | reindex
常用选项:
--dry-run — 预览处理,不写文件--no-api — 离线模式,跳过外部 API 查询--force — 强制重新处理(toc/l3 等步骤)--inspect — 展示处理详情--steps STEPS — 自定义步骤序列(逗号分隔),如 --steps toc,l3,index--list — 列出所有可用步骤和预设pipeline 当前会依次处理五个 inbox 目录:
data/spool/inbox/ — 普通论文(有 DOI 才入库,无 DOI 且非 thesis 转 pending)data/spool/inbox-thesis/ — 学位论文(跳过 DOI 去重,自动标记 thesis)data/spool/inbox-patent/ — 专利文献(按公开号去重,自动标记 patent,跳过 DOI 去重)data/spool/inbox-doc/ — 非论文文档(技术报告、讲义、Word/Excel/PPT、标准文档等,跳过 DOI 去重,LLM 生成标题/摘要)data/spool/inbox-proceedings/ — 论文集(强制按 proceedings 处理;普通 data/spool/inbox/ 不会当作 proceedings)旧版 data/inbox* 与 data/pending/ 是迁移输入,不是当前正常 runtime 输入。先运行 scholaraio migrate upgrade --migration-id <id> --confirm,再执行入库流程。
论文类的 Stage-1 元数据提取由 ingest.extractor 控制:
regex:纯正则,最快,不调用 LLMauto:正则优先,关键字段缺失时再调用 LLMrobust:正则 + LLM 双跑,校正 OCR 错误并处理多 DOI 情况(默认)llm:纯 LLM 提取论文集(proceedings)采用半自动两阶段流程:
scholaraio pipeline ingest 只负责把 PDF/MD 转成 configured proceedings library(fresh 默认 data/libraries/proceedings/<Volume>/proceeding.md),并生成 split_candidates.jsonsplit_candidates.json 并生成 split_plan.jsonscholaraio proceedings apply-split <proceeding_dir> <split_plan.json><Volume>/papers/<Paper>/scholaraio proceedings build-clean-candidates <proceeding_dir>clean_candidates.json,用于汇总每个 child paper 的开头窗口、heading、缺失字段和结构信号clean_plan.jsonscholaraio proceedings apply-clean <proceeding_dir> <clean_plan.json>keep / rename / reclassify / drop# Comment 2.、假 # Reporter ...Office 文件处理流程(data/spool/inbox-doc/ 中的 DOCX/XLSX/PPTX):
step_office_convert(MarkItDown)→ 转换为 <stem>.mdstep_extract_doc(LLM 生成标题/摘要)step_ingest(写入 configured papers library,fresh 默认 data/libraries/papers/)pip install 'markitdown[docx,pptx,xlsx]'专利文献处理逻辑(data/spool/inbox-patent/):
paper_type: patent无 DOI 论文的处理逻辑:
data/spool/inbox-thesis/ → 直接标记为 thesis 并入库data/spool/inbox-doc/ → 标记为 document 类型,LLM 生成标题和摘要后入库data/spool/inbox/ → LLM 分析判断是否 thesisdata/spool/pending/ 待人工确认超长 PDF 会在 MinerU 转换前按需自动切分后合并:
chunk_page_limit(默认 >100 页)>600 页 和 >200MB 两个限制,并在仅超大小时估算更安全的分片页数config.translate.auto_translate: true,只要本次 pipeline 包含 inbox 步骤并成功入库新论文,系统会在 papers 阶段自动插入 translate,位置在 embed/index 之前:translate.target_lang用户说:"我放了几篇新论文到 inbox,帮我入库"
→ 执行 pipeline ingest
用户说:"把这个网页/在线 PDF 直接收进库里" → 先用当前 Agent 的原生网页读取能力获取内容;只有用户明确要求持久化时,才把可审查的正文保存为受支持的 inbox 文件并走正常 ingest 流程
用户说:"我在校园网/机构网,帮我从 DOI 或出版社页面下载正版论文 PDF"
→ 使用 scholaraio fetch-pdf <doi-or-url> --direct;如果要马上入库,加 --ingest。这个命令只利用用户当前合法访问上下文,不做访问绕过,也不需要 Paper Fetch Skill 或 PDF 转换功能。
用户说:"把新论文全部处理完,包括提取目录和结论"
→ 执行 pipeline full
用户说:"我有几份技术报告放在 inbox-doc 里了"
→ 执行 pipeline ingest(pipeline 自动处理五个 inbox 目录)
用户说:"我把一个 Word 文档放进 inbox-doc 了"
→ 执行 pipeline ingest(自动用 MarkItDown 转换 DOCX)
用户说:"我有几篇专利放在 inbox-patent 了"
→ 执行 pipeline ingest(自动处理五个 inbox 目录,专利按公开号去重)
用户说:"我有一本文集放在 inbox-proceedings 里"
→ 先执行 pipeline ingest,等生成 split_candidates.json 后由 agent 审阅,再执行 scholaraio proceedings apply-split ...
用户说:"重新建索引"
→ 执行 pipeline reindex
© ZimoLiao, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .claude/skills/ingest of ZimoLiao/scholaraio.
Open the folder on GitHubat commit 777628b
Ingest next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Ingest this skillZimoLiao/scholaraio | 577 | — | ~1.3k | Automated safety check: Pass | MIT | |
| Local Knowledge Base RetrieverConardLi/rag-skill | 715 | 2 repos | ~1.7k | Automated safety check: Pass | None | |
| aai-cli Microsoft 365aai-labs/agent-barn | 109 | — | ~1.2k | Automated safety check: Pass | Apache-2.0 | |
| Tencent DocsLeoYeAI/openclaw-master-skills | 2.2k | — | ~3k | Automated safety check: Pass | MIT | |
| Knowledge Ingestevolution-foundation/evo-nexus | 545 | — | ~922 | Automated safety check: Pass | Custom licence | |
| Paper2patent7toCR/paper2patent | 654 | — | ~2.5k | Automated safety check: Pass | MIT |
ConardLi/rag-skill
Answers questions from a local knowledge base folder by walking hierarchical index files and searching with grep, pdfplumber and pandas instead of loading whole files.
aai-labs/agent-barn
Guides work with Outlook, OneDrive, SharePoint, Teams, Excel, To Do and Planner through aai-cli's Microsoft Graph commands, starting from which service owns the data.
LeoYeAI/openclaw-master-skills
Tencent Docs - Provides complete Tencent Docs operations. An agent skill from LeoYeAI/openclaw-master-skills.
evolution-foundation/evo-nexus
Upload a file (PDF, DOCX, PPTX, XLSX, HTML, EPUB, image) or URL to the Knowledge base.
7toCR/paper2patent
Turn an academic paper (PDF, LaTeX, pasted text, thesis chapter or technical disclosure) into a Chinese invention patent application draft — 说明书摘要、摘要附图、权利要求书、说明书、说明书附图 — delivered as DOCX/PDF with…
infometa/workbuddyskills
Review contracts for risk (scenarios C5/C6) — background assessment before signing (counterparty qualification, transaction-mode legality, contract-form fit, special procedures) and clause-by-clause…
ZimoLiao/scholaraio
A skill your agent uses when the user wants to create or inspect DOCX, PPTX, or XLSX files, generate a downloadable Office deliverable, or verify its structure and layout warnings with scholaraio…
ZimoLiao/scholaraio
A skill your agent uses when the user needs help choosing or organizing an academic-writing workflow by deliverable, stage, or format, including review articles, guided reading, paper sections, PPT…
ZimoLiao/scholaraio
A skill your agent uses when the user wants to browse arXiv preprints, search arXiv directly, fetch a PDF by arXiv ID or URL, or send a preprint into the ScholarAIO ingest pipeline.
ZimoLiao/scholaraio
A skill your agent uses when working on bioinformatics workflows such as alignment, variant calling, phylogenetics, or protein-structure analysis, especially across BLAST, minimap2, samtools…
ZimoLiao/scholaraio
A skill your agent uses when the user wants to verify citations in AI-generated or human-written text against the local knowledge base and catch hallucinated, wrong, or missing references.
ZimoLiao/scholaraio
A skill your agent uses when the user wants diagrams, flowcharts, architecture visuals, data relationships, timelines, concept maps, Mermaid, Graphviz, drawio, or polished paper figures generated…
Works with
A skill your agent uses when the user wants to process new papers, patents, theses, documents, or proceedings from inbox queues into the knowledge base, run the ingest pipeline, or rebuild indexes. Ingest is an agent skill from ZimoLiao/scholaraio. Use when the user wants to process new papers, patents, theses, documents, or proceedings from inbox queues into the knowledge base, run the ingest pipeline, or rebuild indexes.
Ingest fits situations like: the user wants to process new papers; proceedings from inbox queues into the knowledge base; run the ingest pipeline; rebuild indexes.
Run `npx skills add ZimoLiao/scholaraio --skill ingest -a claude-code`. Or copy the skill folder (.claude/skills/ingest in ZimoLiao/scholaraio) into .claude/skills/ingest in your project. Claude Code loads it when a task matches its description.
Run `npx skills add ZimoLiao/scholaraio --skill ingest -a codex`. Or copy the skill folder (.claude/skills/ingest in ZimoLiao/scholaraio) into .agents/skills/ingest in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add ZimoLiao/scholaraio --skill ingest -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ingest, .gemini/skills/ingest, .github/skills/ingest and .opencode/skills/ingest in your project.
Going by SKILL.md and its folder, Ingest needs the command-line tools its instructions call (pip). Our summary lists: Python 3.
SKILL.md contains no URLs. Its commands use pip, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Ingest is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.3k tokens (SKILL.md is roughly 5.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Ingest: Local Knowledge Base Retriever (ConardLi/rag-skill, 715 stars), aai-cli Microsoft 365 (aai-labs/agent-barn, 109 stars), Tencent Docs (LeoYeAI/openclaw-master-skills, 2.2k stars) and Knowledge Ingest (evolution-foundation/evo-nexus, 545 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
ZimoLiao (a GitHub user) maintains it in ZimoLiao/scholaraio, which has 577 GitHub stars. The repository holds 43 skills in this directory. The repository was last updated on September 25, 2026.
Source: ZimoLiao/scholaraio on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.