Agent skill

Common Fetcher

by huangruiteng in huangruiteng/CS-Notes

统一采集框架 - 支持 RSS/Web/API，207+ 采集源，AI 评分/分类/摘要. An agent skill from huangruiteng/CS-Notes.

MITAuto-check passed

Install Common Fetcher

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .claude/skills/common-fetcher && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .claude/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .agents/skills/common-fetcher && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .agents/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .cursor/skills/common-fetcher && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .cursor/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/huangruiteng/CS-Notes.git --path .trae/openclaw-skills/common-fetcher

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .gemini/skills/common-fetcher && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .gemini/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .github/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .github/skills/common-fetcher && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .github/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add huangruiteng/CS-Notes --skill common-fetcher -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install huangruiteng/CS-Notes common-fetcher --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/huangruiteng/CS-Notes.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.trae/openclaw-skills/common-fetcher .opencode/skills/common-fetcher && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "common-fetcher" agent skill from https://github.com/huangruiteng/CS-Notes/tree/master/.trae/openclaw-skills/common-fetcher into .opencode/skills/common-fetcher/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "common-fetcher", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: common-fetcher
GitHub stars: 4k
Token cost: ~932 tokens
SKILL.md length: 176 words
Files: 3
Skills in repo: 39
Repo updated: Oct 8, 2026
First seen: Oct 7, 2026
Licence: MIT

At a glance

统一采集框架 - 支持 RSS/Web/API，207+ 采集源，AI 评分/分类/摘要. An agent skill from huangruiteng/CS-Notes.

Works in 5 steps: Fork 项目 → 创建特性分支 → 提交改动 → …
SKILL.md covers 功能特性, 支持的行业, 使用方法 and 架构设计, plus 6 more sections
Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Common Fetcher is an agent skill from huangruiteng/CS-Notes. 统一采集框架 - 支持 RSS/Web/API，207+ 采集源，AI 评分/分类/摘要

Its SKILL.md is about 930 tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files (for example `.clawhub/origin.json` and `_meta.json`).

The licence is MIT.

Example prompts

“/common-fetcher”

Requirements

Node.js

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

Fork 项目
创建特性分支
提交改动
推送到分支
创建 Pull Request

What it can do on your machine

Read from SKILL.md and the folder at commit f7b4e92. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md (its code samples are typescript, bash and json).
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Common Fetcher loads about 932 tokens when it runs. Until then it costs about 15 tokens; SKILL.md has 176 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~15
When it runs · the whole SKILL.md, loaded when a task matches: ~932

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from huangruiteng/CS-Notes at commit f7b4e92, republished under its MIT licence (© huangruiteng). 176 words, ~932 tokens.

Download SKILL.mdSave it as .claude/skills/common-fetcher/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.

name: common-fetcher
description: 统一采集框架 - 支持 RSS/Web/API，207+ 采集源，AI 评分/分类/摘要
version: 1.0.0

Common-Fetcher

统一采集框架，为 AI Agent 提供强大的信息采集能力。

功能特性

🕸️ 多源支持: RSS、网页抓取、API 集成
📊 大规模: 207+ 预配置采集源
🤖 AI 处理: 自动评分、分类、摘要生成
⚡ 高性能: <600ms/30 篇文章
✅ 高可靠: 100% 成功率（已验证解析器）

支持的行业

🏭 煤炭行业（27 个采集源）

国家级：发改委、能源局等 6 个
省级：4 个
市级：3 个
数据平台：4 个
企业自媒体：10 个

🏠 房地产行业（23 个采集源）

国家级：住建部、央行等 5 个
省级：1 个
市级：3 个
数据平台：4 个
企业自媒体：10 个

🤖 AI 技术（129 个采集源）

RSS 源：90 个（Hacker News, MIT Tech Review 等）
网站/自媒体：39 个

使用方法

CLI 方式

bash

# 抓取煤炭行业数据
common-fetcher --industry coal --output daily.md

# 抓取房地产行业数据
common-fetcher --industry realestate --output daily.md

# 抓取 AI 技术数据
common-fetcher --industry ai --output daily.md

# 自定义采集源
common-fetcher --config custom-sources.json --output daily.md

Node.js API

typescript

import { CommonFetcher } from 'common-fetcher';

const fetcher = new CommonFetcher({
  industry: 'coal',
  maxArticles: 50,
  timeout: 15000,
});

const result = await fetcher.fetch();
console.log(`成功抓取 ${result.totalArticles} 篇文章`);

OpenClaw 集成

在 openclaw.json 中配置：

json

{
  "skills": {
    "common-fetcher": {
      "enabled": true,
      "industry": "coal",
      "schedule": "0 8 * * *"
    }
  }
}

架构设计

┌─────────────────────────────────────────┐
│         Common-Fetcher                  │
├─────────────────────────────────────────┤
│ Source Layer (采集源层)                  │
│ ├─ RSS 源                                │
│ ├─ 网页源                                │
│ └─ API 源                                │
├─────────────────────────────────────────┤
│ Fetcher Layer (抓取层)                   │
│ ├─ RSS Fetcher (并发 + 超时)             │
│ ├─ Web Scraper (cheerio)                 │
│ └─ Cache Manager                         │
├─────────────────────────────────────────┤
│ Processor Layer (处理层)                 │
│ ├─ 去重 (标题/URL 哈希)                   │
│ ├─ 时间过滤                              │
│ ├─ AI 评分/分类                          │
│ └─ AI 摘要                              │
├─────────────────────────────────────────┤
│ Output Layer (输出层)                    │
│ ├─ Markdown 报告                          │
│ ├─ JSON 数据                             │
│ └─ 多渠道推送                            │
└─────────────────────────────────────────┘

性能指标

解析器	文章数/次	耗时	成功率
观点地产网	30 篇	605ms	100%
煤炭资源网	30 篇	455ms	100%
房天下	17 篇	579ms	100%
MIT Tech Review	9 篇	393ms	100%
总计	86 篇/次	~2s	100%

配置说明

采集源配置

在 config/ 目录下管理采集源：

coal-sources.json - 煤炭行业采集源
realestate-sources.json - 房地产行业采集源
ai-sources.json - AI 技术采集源

解析器开发

自定义解析器参考 src/parsers/ 目录：

typescript

export function parseGuandian(html: string, baseUrl: string): Article[] {
  // 解析逻辑
}

开发计划

已实现 ✅

4 层架构设计
6 个解析器（4 个生产就绪）
207 个采集源配置
CLI 工具
Node.js API

进行中 🔄

浏览器控制（Playwright）
AI 验证挑战自动解决
缓存机制

计划中 ⏳

更多行业支持
分布式抓取
实时监控告警

贡献指南

欢迎提交 Issue 和 PR！

Fork 项目
创建特性分支
提交改动
推送到分支
创建 Pull Request

许可证

MIT License

联系方式

GitHub: [你的 GitHub]
Moltbook: ClawdOpenClaw20260223
Email: [你的邮箱]

Common-Fetcher - 为 AI Agent 提供强大的信息采集能力 🕸️

Files

SKILL.md and 2 other files in .trae/openclaw-skills/common-fetcher of huangruiteng/CS-Notes.

SKILL.md
.clawhub/origin.json
_meta.json

Open the folder on GitHubat commit f7b4e92

Compare with similar skills

Common Fetcher next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Common Fetcher compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Common Fetcher this skillhuangruiteng/CS-Notes	4k	—	~932	Automated safety check: Pass	MIT	2 days ago
CommonlyTeam-Commonly/commonly	1.4k	—	~2.9k	Automated safety check: Pass	Apache-2.0	yesterday
Imaging Data CommonsK-Dense-AI/scientific-agent-skills	48k	1 repos	~7.8k	Automated safety check: Pass	MIT	6 days ago
Ii Commonssickn33/agentic-awesome-skills	47k	1 repos	~1.1k	Automated safety check: Pass	Apache-2.0	2 days ago
Dubai Weather Fetchershanraisshan/claude-code-best-practice	67k	—	~397	Automated safety check: Pass	MIT	today
Dubai Time Fetchershanraisshan/claude-code-best-practice	67k	—	~155	Automated safety check: Pass	MIT	today

Similar skills

Commonly
Team-Commonly/commonly
You are a member of a Commonly workspace — a shared space where humans and AI agents from any origin collaborate in pods (chat rooms with memory).
1.4k GitHub stars~2.9k tokensUpdated yesterday
Agent WorkflowsAuto-check passed
Imaging Data Commons
K-Dense-AI/scientific-agent-skills
Queries and downloads public cancer imaging data from NCI Imaging Data Commons.
48k GitHub starsUsed in 1 repo~7.8k tokens
DatabasesAuto-check passed
Ii Commons
sickn33/agentic-awesome-skills
Deterministic search across arXiv, PubMed/PMC, and US policy corpora with daily freshness cutoffs.
47k GitHub starsUsed in 1 repo~1.1k tokens
Research & ScienceAuto-check passed
Dubai Weather Fetcher
shanraisshan/claude-code-best-practice
Reads the current temperature in Dubai from the Open-Meteo API with a single web fetch and returns it in Celsius or Fahrenheit.
67k GitHub stars~397 tokensUpdated today
Productivity & AutomationAuto-check passed
Dubai Time Fetcher
shanraisshan/claude-code-best-practice
Instructions for fetching current Dubai time via bash command
67k GitHub stars~155 tokensUpdated today
Productivity & AutomationAuto-check passed
Skill Rss Aggregator
ZJU-REAL/Easel
RSS/Newsletter 聚合：订阅一批博主/媒体/Newsletter 的 RSS/Atom 源，拉取最新条目，按关键词与时间窗过滤、去重、按时间排序，产出选题/资讯摘要。当用户说"RSS""订阅源" "聚合资讯""追更博主""Newsletter""看看最近有什么新文章""汇总这些源的更新""feed"时使用。
3.4k GitHub stars~397 tokensUpdated 2 days ago
Writing & ContentAuto-check passed

More from huangruiteng/CS-Notes

All 39 skills in this repo

CLI Creator
huangruiteng/CS-Notes
Build a composable CLI for Codex from API docs, an OpenAPI spec, existing curl examples, an SDK, a web app, an admin tool, or a local script.
4k GitHub starsUsed in 2 repos~2.7k tokens
Auto-check passed
Codex Thread Heartbeat
huangruiteng/CS-Notes
Inspect and manage guarded Codex App-native or launchd heartbeats for Codex main control threads.
4k GitHub stars~1.5k tokensUpdated 2 days ago
Auto-check passed
Slack
huangruiteng/CS-Notes
A skill your agent uses when you need to control Slack from Clawdbot via the slack tool, including reacting to messages or pinning/unpinning items in Slack channels or DMs.
4k GitHub starsUsed in 10 repos~578 tokens
Auto-check passed
Codex Thread Reader
huangruiteng/CS-Notes
Locate and read a Codex thread by a codex thread link, thread id, or rollout path across all local CODEXHOME directories (~/.codex, ~/.codex-gpt, ...).
4k GitHub stars~1.4k tokensUpdated 2 days ago
Auto-check passed
Research Material Scout
huangruiteng/CS-Notes
A skill your agent uses when the user asks Codex to research, find learning materials, process "素材：" links, "请你读" / "精读" a material, build a material radar, or use SenSight-like broad information…
4k GitHub stars~8.3k tokensUpdated 2 days ago
Auto-check passed
GitHub
huangruiteng/CS-Notes
Interact with GitHub using the gh CLI. An agent skill from huangruiteng/CS-Notes.
4k GitHub starsUsed in 27 repos~279 tokens
Auto-check passed

Questions about Common Fetcher

What does Common Fetcher do?

统一采集框架 - 支持 RSS/Web/API，207+ 采集源，AI 评分/分类/摘要. An agent skill from huangruiteng/CS-Notes. Common Fetcher is an agent skill from huangruiteng/CS-Notes.

How do I install Common Fetcher in Claude Code?

Run `npx skills add huangruiteng/CS-Notes --skill common-fetcher -a claude-code`. Or copy the skill folder (.trae/openclaw-skills/common-fetcher in huangruiteng/CS-Notes) into .claude/skills/common-fetcher in your project. Claude Code loads it when a task matches its description.

How do I install Common Fetcher in Codex?

Run `npx skills add huangruiteng/CS-Notes --skill common-fetcher -a codex`. Or copy the skill folder (.trae/openclaw-skills/common-fetcher in huangruiteng/CS-Notes) into .agents/skills/common-fetcher in your project. Codex loads it when a task matches its description.

Can I use Common Fetcher in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add huangruiteng/CS-Notes --skill common-fetcher -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/common-fetcher, .gemini/skills/common-fetcher, .github/skills/common-fetcher and .opencode/skills/common-fetcher in your project.

What does Common Fetcher need to run?

SKILL.md names no scripts, command-line tools or credentials: Common Fetcher is instructions for the agent only. Our summary lists: Node.js.

Does Common Fetcher access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Common Fetcher safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Common Fetcher use?

Common Fetcher is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Common Fetcher use?

About 932 tokens (SKILL.md is roughly 3.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Common Fetcher?

Skills that share tags, products or a category with Common Fetcher: Commonly (Team-Commonly/commonly, 1.4k stars), Imaging Data Commons (K-Dense-AI/scientific-agent-skills, 48k stars), Ii Commons (sickn33/agentic-awesome-skills, 47k stars) and Dubai Weather Fetcher (shanraisshan/claude-code-best-practice, 67k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Common Fetcher?

huangruiteng (a GitHub user) maintains it in huangruiteng/CS-Notes, which has 4,001 GitHub stars. The repository holds 39 skills in this directory. The repository was last updated on October 8, 2026.

Source: huangruiteng/CS-Notes on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Install Common Fetcher

Facts

At a glance

What it does

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

Common-Fetcher

功能特性

支持的行业

🏭 煤炭行业（27 个采集源）

🏠 房地产行业（23 个采集源）

🤖 AI 技术（129 个采集源）

使用方法

CLI 方式

Node.js API

OpenClaw 集成

架构设计

性能指标

配置说明

采集源配置

解析器开发

开发计划

已实现 ✅

进行中 🔄

计划中 ⏳

贡献指南

许可证

联系方式

Files

Compare with similar skills

Similar skills

More from huangruiteng/CS-Notes

Questions about Common Fetcher