Agent skill

Feedgrab

by iBigQiang in iBigQiang/feedgrab

Universal content grabber — fetch any URL and return structured Markdown.

MITAuto-check passedMedia & Creative

Install Feedgrab

skills CLI
$ npx skills add iBigQiang/feedgrab --skill feedgrab -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install iBigQiang/feedgrab feedgrab --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/iBigQiang/feedgrab.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/feedgrab .claude/skills/feedgrab && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
feedgrab
GitHub stars
614
Token cost
~2k tokens
SKILL.md length
748 words
Files
1
Skills in repo
5
Repo updated
First seen
Licence
MIT

At a glance

Universal content grabber — fetch any URL and return structured Markdown.

  • Works in 3 steps: Fetch Content → Locate Output File → Read and Present
  • User provides a URL and wants its content extracted
  • SKILL.md covers Trigger, Prerequisites Check, Supported Platforms and Pipeline, plus 3 more sections
  • Calls pip; needs GITHUB_TOKEN and FEISHU_APP_SECRET

What it does

Feedgrab is an agent skill from iBigQiang/feedgrab. Universal content grabber — fetch any URL and return structured Markdown. Supports X/Twitter, WeChat, Xiaohongshu, YouTube, GitHub, LinuxDo/IDCFlare/Discourse, Feishu/Lark, KDocs, FlowUs, Youdao Note, Zhihu, Bilibili (with subtitle transcription), Xiaoyuzhou podcasts, Ximalaya podcasts, Telegram, HackerNews, Medium, Reddit, Weibo, Douyin, Zsxq (Knowledge Planet), RSS, 300+ paywall news sites, and any web page. Use when user provides a URL and wants its content extracted.

Its SKILL.md is about 2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Media & Creative, covering Messaging and chat bots and Transcription. It works with X (Twitter), Feishu (Lark), WeChat and GitHub. The repository describes itself as: Universal content grabber — fetch, normalize, and digest content from 7+ platforms (WeChat, XHS, X/Twitter, YouTube, Bilibili, Telegram, RSS). The licence is MIT.

When your agent uses it

  • User provides a URL and wants its content extracted
  • Tasks that involve Messaging and chat bots
  • Tasks that involve Transcription

Example prompts

  • “/feedgrab”

Requirements

  • Python 3
  • A credential in GITHUB_TOKEN
  • A credential in FEISHU_APP_SECRET

Workflow steps

3 steps, taken from the step headings in SKILL.md.

  1. Fetch Content
  2. Locate Output File
  3. Read and Present

What it can do on your machine

Read from SKILL.md and the folder at commit 04291ba. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • pip

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use pip, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • GITHUB_TOKEN
    • FEISHU_APP_SECRET
    • GROQ_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Feedgrab loads about 2k tokens when it runs. Until then it costs about 121 tokens; SKILL.md has 748 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~121
When it runs · the whole SKILL.md, loaded when a task matches
~2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from iBigQiang/feedgrab at commit 04291ba, republished under its MIT licence (© iBigQiang). 748 words, ~1,982 tokens.

Download SKILL.mdSave it as .claude/skills/feedgrab/SKILL.md (or your agent's skills folder).
name
feedgrab
description
Universal content grabber — fetch any URL and return structured Markdown. Supports X/Twitter, WeChat, Xiaohongshu, YouTube, GitHub, LinuxDo/IDCFlare/Discourse, Feishu/Lark, KDocs, FlowUs, Youdao Note, Zhihu, Bilibili (with subtitle transcription), Xiaoyuzhou podcasts, Ximalaya podcasts, Telegram, HackerNews, Medium, Reddit, Weibo, Douyin, Zsxq (Knowledge Planet), RSS, 300+ paywall news sites, and any web page. Use when user provides a URL and wants its content extracted.

feedgrab — Universal Content Grabber

Give it a URL, get back structured Markdown. Supports 17+ platforms with deep extraction.

Trigger

Activate when user provides a URL and wants content fetched/extracted/read:

  • /feedgrab <URL>
  • "Grab this article"
  • "Read this tweet/post"
  • "抓取这个链接"
  • Any URL from supported platforms

Prerequisites Check

Before fetching, verify feedgrab is installed:

bash
which feedgrab 2>/dev/null || command -v feedgrab 2>/dev/null

If NOT installed, tell the user:

feedgrab is not installed. Run `/feedgrab-setup` or manually:
  pip install feedgrab[all]
  feedgrab setup

Then stop — do not proceed without feedgrab.

Supported Platforms

PlatformURL PatternMethod
X/Twitterx.com/*/status/*, twitter.com/*GraphQL → FxTwitter → Syndication → oEmbed → Jina → Playwright
WeChat (微信公众号)mp.weixin.qq.com/*Playwright JS evaluate → Jina
Xiaohongshu (小红书)xiaohongshu.com/explore/*, xhslink.com/*API (xhshow) → Pinia Store injection → Jina → Playwright
YouTubeyoutube.com/watch?v=*, youtu.be/*, ShortsInnerTube API → yt-dlp subtitles → Groq Whisper
GitHubgithub.com/*/*REST API (Chinese README priority + subdirectory scan)
LinuxDo / Discourselinux.do/t/*Discourse topic JSON API → CDP → Playwright in-page fetch → Jina
IDCFlare / Discourseidcflare.com/t/*Discourse topic JSON API → CDP → Playwright in-page fetch → Jina
Feishu/Lark (飞书)feishu.cn/docx/*, feishu.cn/wiki/*Open API → CDP → Playwright PageMain → Jina
KDocs (金山文档)kdocs.cn/l/*Playwright ProseMirror DOM (virtual scroll + CDP)
FlowUs (息流)flowus.cn/share/*, flowus.cn/*/<uuid>HTTP API → CDP/Launch browser → Jina; online signed images or local attachments
Youdao Note (有道云笔记)share.note.youdao.com/*JSON API → Playwright iframe → Jina
Zhihu (知乎)zhihu.com/question/*/answer/*, zhuanlan.zhihu.com/p/*API v4 → Playwright CDP/DOM → Jina
Bilibili (B站)bilibili.com/video/*, b23.tv/*API metadata + 3-tier subtitle fallback (v2 → WBI v2 → Whisper)
Xiaoyuzhou (小宇宙)xiaoyuzhoufm.com/episode/*SSR __NEXT_DATA__ + Groq Whisper transcription
Ximalaya (喜马拉雅)ximalaya.com/sound/*, m.ximalaya.com/sound/*Web Revision API + canPlay degradation + Groq Whisper
Telegramt.me/*Telethon
HackerNewsnews.ycombinator.com/item?id=*Firebase API v0 (item.json + first-layer comments + hn top/new/best/ask/show/jobs list batch)
Mediummedium.com/*, *.medium.com/*Jina Reader → JSON-LD articleBody → Stealth Browser; user/publication batch via RSS
Redditreddit.com/r/*/comments/*, redd.it/*old.reddit.com .json + self-UA → CDP → Stealth Playwright + saved session → Jina (REDDIT_REPLY_MODE=top/tree/all; batch/search via reddit-sub / reddit-so)
Weiboweibo.com/*, weibo.cn/*, m.weibo.cn/status/*m.weibo.cn /statuses/show + container/getIndex + SSR $render_data fallback (SUB cookie optional)
Douyin (抖音)douyin.com/video/*, v.douyin.com/* (short link)CDP → Stealth Playwright + saved session → SSR RENDER_DATA → Jina (browser-side signing, no algorithm break)
Zsxq (知识星球)articles.zsxq.com/id_*.html, wx.zsxq.com/group/*/topic/*, t.zsxq.com/* (short)HTTP cookie (articles SSR HTML / api.zsxq.com topic JSON) → CDP → Stealth Playwright → Jina (auth-walled, login required)
RSSRSS/Atom feed URLsfeedparser
Paywall news (300+)NYT/WSJ/FT/Economist/Bloomberg...JSON-LD → Googlebot/Bingbot UA → AMP → EU IP → archive.today → Google Cache → Jina
Any web pageAny other URLJSON-LD pre-scan → Jina Reader fallback

Pipeline

Step 1: Fetch Content
bash
feedgrab "$ARGUMENTS"

The CLI auto-detects the platform and routes to the appropriate fetcher.

Step 2: Locate Output File

feedgrab saves output to OUTPUT_DIR (default: ./output/). Check the CLI output for the saved file path, typically:

  • output/X/author_date:title.md
  • output/mpweixin/author_date:title.md
  • output/XHS/author_date:title.md
  • output/YouTube/author_date:title.md
  • output/GitHub/author_date:title.md
  • output/LinuxDo/author_date:title.md
  • output/IDCFlare/author_date:title.md
  • output/Feishu/author_date:title.md
  • output/KDocs/author_date:title.md
  • output/FlowUs/author_date:title.md
  • output/NoteYouDao/author_date:title.md
  • output/Zhihu/author_date:title.md
  • output/Bilibili/author_date:title.md
  • output/Xiaoyuzhou/author_date:title.md
  • output/Ximalaya/author_date:title.md
  • output/Web/author_date:title.md (paywall / generic pages)
Step 3: Read and Present

Read the output .md file and present the content to the user. The file includes:

  • YAML front matter (title, source, author, published, likes, tags, etc.)
  • Full article/tweet/post content in Markdown
  • Images (as remote URLs or local paths if media download is enabled)
Show full SKILL.md (292 more words)Show less

Clipboard Mode

If the user says "grab from clipboard" or the URL contains & (which breaks PowerShell):

bash
feedgrab clip

This reads the URL from the system clipboard.

Error Handling

ErrorSolution
feedgrab: command not foundRun /feedgrab-setup
Cookie expired / 401 / 403feedgrab login <platform> to refresh
Jina timeout (30s)feedgrab auto-retries with Playwright
Rate limit (429)feedgrab auto-rotates cookies if configured
OUTPUT_DIR not setfeedgrab setup to configure

Tips

  • For Twitter deep extraction (views, bookmarks, threads): configure cookies via feedgrab login twitter
  • For WeChat articles: no login needed for single articles
  • For Xiaohongshu: pip install xhshow for API mode (faster, no browser needed)
  • For GitHub: set GITHUB_TOKEN for higher rate limits (5000/hr vs 60/hr)
  • For LinuxDo / Discourse: feedgrab login linuxdo if the topic is private or the site requires a browser session / Cloudflare cookie
  • For IDCFlare / Discourse: feedgrab login idcflare if the topic is private or the site requires a browser session / Cloudflare cookie
  • For Discourse forums: default reply mode is OP + topic-author follow-up replies only; switch with LINUXDO_REPLY_MODE / IDCFLARE_REPLY_MODE (author / all / none)
  • For Reddit: use REDDIT_REPLY_MODE=tree for nested replies or REDDIT_REPLY_MODE=all for extra morechildren expansion; use /feedgrab-batch for reddit-so search
  • For Feishu: set FEISHU_APP_ID + FEISHU_APP_SECRET for Open API access
  • For KDocs: feedgrab login kdocs to save session (or enable KDOCS_CDP_ENABLED=true to reuse running Chrome)
  • For FlowUs: feedgrab login flowus for paid/private docs; default images use signed online URLs, set FLOWUS_DOWNLOAD_IMAGES=true for local attachments
  • For Zhihu: feedgrab login zhihu to save session (enables full answer content)
  • For Bilibili subtitles: free tier (player/v2 + WBI) works out of the box; set BILIBILI_SUBTITLE_WHISPER=true for Whisper fallback on videos without subtitles
  • For Xiaoyuzhou / Ximalaya: set GROQ_API_KEY for Whisper transcription (free tier = metadata + shownotes only)
  • For paywall sites: PAYWALL_ENABLED=true by default, no extra config
  • Run feedgrab doctor to diagnose issues

© iBigQiang, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/feedgrab of iBigQiang/feedgrab.

Open the folder on GitHubat commit 04291ba

Compare with similar skills

Feedgrab next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Feedgrab compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Feedgrab this skilliBigQiang/feedgrab614—~2kAutomated safety check: PassMIT
Video Downloaderkangarooking/kangarooking-skills661—~8.3kAutomated safety check: PassNone
Agent ReachEdisonChenAI/agent-reach1101 repos~1.3kAutomated safety check: PassMIT
Lingzaoatian-create/lingzao-skill2961 repos~8.8kAutomated safety check: PassMIT
Ra Video DownloadPluviobyte/rnskill1.6k—~861Automated safety check: NotesCustom licence
Last30days CnJesseovo/last30days-skill-cn1.9k—~2.4kAutomated safety check: NotesMIT

Similar skills

  • Video Downloader

    kangarooking/kangarooking-skills

    Download or open videos and recover platform captions, audio transcripts, keyframes, screen text, visual facts, and editing observations as a plain multimodaltranscript.md.

    661 GitHub stars~8.3k tokensUpdated 1 mo ago
    Media & CreativeAuto-check passed
  • Agent Reach

    EdisonChenAI/agent-reach

    Use the internet: search, read, and interact with 13+ platforms including Twitter/X, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu (小红书), Douyin (抖音), WeChat Articles (微信公众号), LinkedIn, Boss直聘…

    110 GitHub starsUsed in 1 repo~1.3k tokens
    Productivity & AutomationAuto-check passed
  • Lingzao

    atian-create/lingzao-skill

    Use Lingzao creator-content tools for Xiaohongshu/XHS, Douyin, and WeChat official-account public content.

    296 GitHub starsUsed in 1 repo~8.8k tokens
    Media & CreativeAuto-check passed
  • Ra Video Download

    Pluviobyte/rnskill

    Download source video or audio from Douyin, YouTube, Bilibili, Twitter/X, Xiaohongshu, and other yt-dlp-supported URLs into the content-creation workspace.

    1.6k GitHub stars~861 tokensUpdated 18 days ago
    Media & CreativeAuto-check: notes
  • Last30days Cn

    Jesseovo/last30days-skill-cn

    Research what Chinese internet users actually said in the last 30 days across Weibo, Xiaohongshu (RED), Bilibili, Zhihu, Douyin, WeChat public accounts, Baidu and Toutiao: engagement-weighted…

    1.9k GitHub stars~2.4k tokensUpdated 2 days ago
    Productivity & AutomationAuto-check: notes
  • Content Collector

    vigorX777/content-collector-skill

    Collect social media content (X/Twitter, WeChat, Jike, Reddit, etc.) into Feishu bitable.

    240 GitHub stars~2k tokensUpdated 6 mo ago
    Productivity & AutomationAuto-check passed

More from iBigQiang/feedgrab

  • Analyzer

    iBigQiang/feedgrab

    Content Analyzer — any content (URL, text, transcript) into structured analysis report with actionable insights.

    614 GitHub stars~1k tokensUpdated 1 mo ago
    Auto-check passed
  • Feedgrab Batch

    iBigQiang/feedgrab

    Batch content grabber — bulk fetch bookmarks, user tweets, search results, author notes, wiki pages, subreddit posts, and more from X/Twitter, Xiaohongshu, Reddit, WeChat, YouTube, Feishu, Zhihu.

    614 GitHub stars~1.8k tokensUpdated 1 mo ago
    Auto-check passed
  • Video

    iBigQiang/feedgrab

    Video & Podcast Digest — send a video/podcast link, get full transcript + structured summary.

    614 GitHub stars~1.6k tokensUpdated 1 mo ago
    Auto-check passed
  • Feedgrab Setup

    iBigQiang/feedgrab

    Install and configure feedgrab — the universal content grabber.

    614 GitHub stars~1.4k tokensUpdated 1 mo ago
    Auto-check: warnings

Questions about Feedgrab

What does Feedgrab do?

Universal content grabber — fetch any URL and return structured Markdown. Feedgrab is an agent skill from iBigQiang/feedgrab. Universal content grabber — fetch any URL and return structured Markdown.

When should I use Feedgrab?

Feedgrab fits situations like: user provides a URL and wants its content extracted; tasks that involve Messaging and chat bots; tasks that involve Transcription.

How do I install Feedgrab in Claude Code?

Run `npx skills add iBigQiang/feedgrab --skill feedgrab -a claude-code`. Or copy the skill folder (skills/feedgrab in iBigQiang/feedgrab) into .claude/skills/feedgrab in your project. Claude Code loads it when a task matches its description.

How do I install Feedgrab in Codex?

Run `npx skills add iBigQiang/feedgrab --skill feedgrab -a codex`. Or copy the skill folder (skills/feedgrab in iBigQiang/feedgrab) into .agents/skills/feedgrab in your project. Codex loads it when a task matches its description.

Can I use Feedgrab in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add iBigQiang/feedgrab --skill feedgrab -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/feedgrab, .gemini/skills/feedgrab, .github/skills/feedgrab and .opencode/skills/feedgrab in your project.

What does Feedgrab need to run?

Going by SKILL.md and its folder, Feedgrab needs the command-line tools its instructions call (pip) and credentials named GITHUB_TOKEN, FEISHU_APP_SECRET and GROQ_API_KEY. Our summary lists: Python 3; A credential in GITHUB_TOKEN; A credential in FEISHU_APP_SECRET.

Does Feedgrab access the network?

SKILL.md contains no URLs. Its commands use pip, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Feedgrab safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Feedgrab use?

Feedgrab is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Feedgrab use?

About 2k tokens (SKILL.md is roughly 7.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Feedgrab?

Skills that share tags, products or a category with Feedgrab: Video Downloader (kangarooking/kangarooking-skills, 661 stars), Agent Reach (EdisonChenAI/agent-reach, 110 stars), Lingzao (atian-create/lingzao-skill, 296 stars) and Ra Video Download (Pluviobyte/rnskill, 1.6k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Feedgrab?

iBigQiang (a GitHub user) maintains it in iBigQiang/feedgrab, which has 614 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on September 8, 2026.

Source: iBigQiang/feedgrab on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.