Agent skill

Batch Research

by miantiao-me in miantiao-me/aigc-weekly

批量数据采集技能,负责分批并发调度 researcher agent 抓取所有数据源. An agent skill from miantiao-me/aigc-weekly.

AGPL-3.0Auto-check passed

Install Batch Research

skills CLI
$ npx skills add miantiao-me/aigc-weekly --skill batch-research -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install miantiao-me/aigc-weekly batch-research --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/miantiao-me/aigc-weekly.git skills-src && mkdir -p .claude/skills && cp -r skills-src/agent/.opencode/skills/batch-research .claude/skills/batch-research && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
batch-research
GitHub stars
562
Token cost
~883 tokens
SKILL.md length
160 words
Files
1
Skills in repo
3
Repo updated
First seen
Licence
AGPL-3.0

At a glance

批量数据采集技能,负责分批并发调度 researcher agent 抓取所有数据源. An agent skill from miantiao-me/aigc-weekly.

  • Works in 5 steps: 准备阶段 → 分批策略 → 并发调度 → …
  • SKILL.md covers 核心职责, 工作流程 and 约束与注意事项
  • Reaches news.ycombinator.com and drafts.miantiao.me

What it does

Batch Research is an agent skill from miantiao-me/aigc-weekly. 批量数据采集技能,负责分批并发调度 researcher agent 抓取所有数据源。

Its SKILL.md is about 880 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It works with Cloudflare and Payload CMS. The repository describes itself as: Agili 的 AIGC 周刊 - 一个由 Agentic AI Agent 驱动的 AIGC(人工智能生成内容)精选周刊。 The licence is AGPL-3.0.

Example prompts

  • “/batch-research”

Workflow steps

5 steps, taken from the step headings in SKILL.md.

  1. 准备阶段
  2. 分批策略
  3. 并发调度
  4. 日志记录
  5. 汇总报告

What it can do on your machine

Read from SKILL.md and the folder at commit c789b52. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are javascript and yaml).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • news.ycombinator.com
    • drafts.miantiao.me
    • solidot.org
    • anthropic.com
    • claude.com
    • baoyu.io

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Batch Research loads about 883 tokens when it runs. Until then it costs about 15 tokens; SKILL.md has 160 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~15
When it runs · the whole SKILL.md, loaded when a task matches
~883

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from miantiao-me/aigc-weekly at commit c789b52, republished under its AGPL-3.0 licence (© miantiao-me). 160 words, ~883 tokens.

Download SKILL.mdSave it as .claude/skills/batch-research/SKILL.md (or your agent's skills folder).
name
batch-research
description
批量数据采集技能,负责分批并发调度 researcher agent 抓取所有数据源。

Batch Research 技能

此技能用于指导 /weekly 命令如何高效、分批、并发地从多个数据源采集信息。

核心职责

作为批量调度器,负责:

  1. 解析数据源列表
  2. 生成所有待抓取 URL
  3. 分批并发调用 researcher agent
  4. 汇总结果生成报告

工作流程

Step 1: 准备阶段
  1. 读取数据源:从 .opencode/REFERENCE.md 获取完整数据源列表
  2. 生成 URL 列表:
    • 静态 URL:直接使用
    • 动态 URL(Hacker News):使用 generateHNUrls(start_date, end_date)
javascript
import { generateHNUrls } from '.opencode/utils.mjs'

// Hacker News - 每天一个 URL
const hnUrls = generateHNUrls(start_date, end_date)
// 返回: [
//   "https://news.ycombinator.com/front?day=2026-03-22",
//   "https://news.ycombinator.com/front?day=2026-03-23",
//   ...
// ]
Step 2: 分批策略

将所有 URL 按优先级分为 3 批,每批 10-12 个 URL:

批次数据源类型来源
Batch 1Important ResourcesREFERENCE.md 中 "Important Resources" 部分
Batch 2Blogs & WebsitesREFERENCE.md 中 "Blogs & Websites" 部分
Batch 3KOL & InfluencersREFERENCE.md 中 "KOL & Influencers" 部分
Step 3: 并发调度
并发配置
参数值说明
max_parallel5每轮最大并发数
batch_interval3s批次间等待时间
domain_rate_limit2 req/domain同域名限流
调度规则

对每个批次:

  1. 分轮执行:将批次内 URL 按 max_parallel 分轮(如 12 个 URL 分 3 轮:5 + 5 + 2)
  2. 轮内并发:同时启动该轮所有 researcher agent
  3. 等待完成:等待当前轮所有 researcher 返回结果
  4. 进入下一轮:当前轮全部完成后,等待 batch_interval,再启动下一轮
  5. 批次完成后:进入下一个批次

调用 researcher 的参数格式:

yaml
url: https://news.ycombinator.com/front?day=2026-03-22
source_name: Hacker News
week_id: Y26W12
start_date: 2026-03-22
end_date: 2026-03-28
current_date: 2026-03-25
timezone: UTC+0

并发调用示例(伪代码):

# Batch 1: Important Resources
并行调用:
  - researcher(url: "https://news.ycombinator.com/front?day=2026-03-22", source_name: "Hacker News")
  - researcher(url: "https://news.ycombinator.com/front?day=2026-03-23", source_name: "Hacker News")
  - researcher(url: "https://drafts.miantiao.me/", source_name: "Miantiao Drafts")
  - researcher(url: "https://www.solidot.org/search?tid=151", source_name: "Solidot")
  - ...

等待 Batch 1 全部完成

# Batch 2: Blogs & Websites
并行调用:
  - researcher(url: "https://www.anthropic.com/engineering", source_name: "Anthropic Engineering")
  - researcher(url: "https://claude.com/blog", source_name: "Claude Blog")
  - ...

等待 Batch 2 全部完成

# Batch 3: KOL & Influencers
并行调用:
  - researcher(url: "https://baoyu.io/", source_name: "Baoyu")
  - ...

等待 Batch 3 全部完成
Step 4: 日志记录

所有日志统一写入 logs/weekly-{week_id}.log,仅用于人类审计,不作为恢复依据。

日志格式:

[2026-03-25T12:34:56Z] [PHASE1] [INFO] 开始抓取 Hacker News
[2026-03-25T12:35:10Z] [PHASE1] [OK] Hacker News - 5 篇文章
[2026-03-25T12:35:15Z] [PHASE1] [FAIL] daily.dev - 429 Too Many Requests (retried 2)

日志级别:

级别用途
INFO阶段/任务开始
OK任务成功(含文章数)
FAIL任务失败(含错误原因和重试次数)
Step 5: 汇总报告

所有批次完成后,在日志末尾生成汇总:

[2026-03-25T12:45:00Z] [PHASE1] [SUMMARY] 总数据源: 30 | 成功: 27 (X篇) | 失败: 3

约束与注意事项

  • 全量抓取:必须抓取所有数据源,不能跳过
  • 批次顺序:必须按批次顺序执行,等待当前批次完成后再进入下一批
  • 错误隔离:单个 researcher 失败不影响其他
  • 重试由 researcher 处理:本技能不负责重试,由 researcher 自行处理
  • 进入下一阶段前:必须完成所有批次的抓取

© miantiao-me, AGPL-3.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in agent/.opencode/skills/batch-research of miantiao-me/aigc-weekly.

Open the folder on GitHubat commit c789b52

Compare with similar skills

Batch Research next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Batch Research compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Batch Research this skillmiantiao-me/aigc-weekly562—~883Automated safety check: PassAGPL-3.0
Logseq Server Usage Statslogseq/logseq45k—~550Automated safety check: PassAGPL-3.0
SearchMuuuun/luxas1.2k—~2.3kAutomated safety check: WarnMIT
Gitnexus ExplorerTommy-yw/RunbookHermes5463 repos~1.8kAutomated safety check: PassMIT
Cf Crawldavila7/claude-code-templates32k—~2.6kAutomated safety check: NotesMIT
Record PR Demopayloadcms/payload45k—~1kAutomated safety check: PassMIT

Similar skills

  • Collect, interpret, and troubleshoot db-sync server usage stats (total users/graphs, active users/graphs in N days, created-today metrics) using the deps/db-sync scripts and D1 schema.

    45k GitHub stars~550 tokensUpdated today
    Knowledge ManagementAuto-check passed
  • Search

    Muuuun/luxas

    Unified academic paper search, citation chains, paper download (arXiv LaTeX/PDF, Sci-Hub), figure extraction from papers, LaTeX source reading, BibTeX fetching, web search, and browser automation…

    1.2k GitHub stars~2.3k tokensUpdated 1 mo ago
    Research & ScienceAuto-check: warnings
  • Gitnexus Explorer

    Tommy-yw/RunbookHermes

    Index a codebase with GitNexus and serve an interactive knowledge graph via web UI + Cloudflare tunnel.

    546 GitHub starsUsed in 3 repos~1.8k tokens
    Knowledge ManagementAuto-check passed
  • Cf Crawl

    davila7/claude-code-templates

    Crawl entire websites using Cloudflare Browser Rendering /crawl API.

    32k GitHub stars~2.6k tokensUpdated today
    Knowledge ManagementAuto-check: notes
  • Record PR Demo

    payloadcms/payload

    A skill your agent uses when a Payload pull request needs a concise visual walkthrough for reviewers.

    45k GitHub stars~1k tokensUpdated yesterday
    DevelopmentAuto-check passed
  • Cloudflare Browser Rendering

    cloudflare/moltworker

    Official

    Drives headless Chrome through Cloudflare Browser Rendering over a CDP WebSocket to take screenshots, navigate and scrape pages, and record multi-page videos.

    10k GitHub stars~742 tokensUpdated 5 mo ago
    Productivity & AutomationAuto-check passed

More from miantiao-me/aigc-weekly

  • Publish Weekly

    miantiao-me/aigc-weekly

    使用 Payload REST API 将周刊写入 CMS(发布为草稿),通过 users API Key 认证. An agent skill from miantiao-me/aigc-weekly.

    562 GitHub stars~719 tokensUpdated 18 days ago
    Auto-check passed
  • Chinese Writing

    miantiao-me/aigc-weekly

    专注科技周刊的中文写作与审稿技能指南,指导大模型生成与审核清晰、克制、无 AI 味的高质量周刊内容. An agent skill from miantiao-me/aigc-weekly.

    562 GitHub stars~1.2k tokensUpdated 18 days ago
    Auto-check passed

Questions about Batch Research

What does Batch Research do?

批量数据采集技能,负责分批并发调度 researcher agent 抓取所有数据源. An agent skill from miantiao-me/aigc-weekly. Batch Research is an agent skill from miantiao-me/aigc-weekly.

How do I install Batch Research in Claude Code?

Run `npx skills add miantiao-me/aigc-weekly --skill batch-research -a claude-code`. Or copy the skill folder (agent/.opencode/skills/batch-research in miantiao-me/aigc-weekly) into .claude/skills/batch-research in your project. Claude Code loads it when a task matches its description.

How do I install Batch Research in Codex?

Run `npx skills add miantiao-me/aigc-weekly --skill batch-research -a codex`. Or copy the skill folder (agent/.opencode/skills/batch-research in miantiao-me/aigc-weekly) into .agents/skills/batch-research in your project. Codex loads it when a task matches its description.

Can I use Batch Research in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add miantiao-me/aigc-weekly --skill batch-research -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/batch-research, .gemini/skills/batch-research, .github/skills/batch-research and .opencode/skills/batch-research in your project.

What does Batch Research need to run?

SKILL.md names no scripts, command-line tools or credentials: Batch Research is instructions for the agent only.

Does Batch Research access the network?

SKILL.md names 6 domains. In commands or code: news.ycombinator.com, drafts.miantiao.me, solidot.org, anthropic.com, claude.com and baoyu.io; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.

Is Batch Research safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Batch Research use?

Batch Research is published under the AGPL-3.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Batch Research use?

About 883 tokens (SKILL.md is roughly 3.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Batch Research?

Skills that share tags, products or a category with Batch Research: Logseq Server Usage Stats (logseq/logseq, 45k stars), Search (Muuuun/luxas, 1.2k stars), Gitnexus Explorer (Tommy-yw/RunbookHermes, 546 stars) and Cf Crawl (davila7/claude-code-templates, 32k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Batch Research?

miantiao-me (a GitHub user) maintains it in miantiao-me/aigc-weekly, which has 562 GitHub stars. The repository holds 3 skills in this directory. The repository was last updated on September 21, 2026.

Source: miantiao-me/aigc-weekly on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.