New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Web Scraper

by charlie-chann in charlie-chann/ai-agent-langgraph-main

网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集. An agent skill from charlie-chann/ai-agent-langgraph-main.

No licenceAuto-check passedData & Analytics

Install Web Scraper

skills CLI
$ npx skills add charlie-chann/ai-agent-langgraph-main --skill web-scraper -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install charlie-chann/ai-agent-langgraph-main web-scraper --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/charlie-chann/ai-agent-langgraph-main.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/web-scraper .claude/skills/web-scraper && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
web-scraper
GitHub stars
114
Token cost
~431 tokens
SKILL.md length
84 words
Files
1
Skills in repo
8
Repo updated
First seen
Licence
None found

At a glance

网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集. An agent skill from charlie-chann/ai-agent-langgraph-main.

  • Works in 4 steps: Tavily extract（推荐，最简单） → Puppeteer（无头浏览器） → Cheerio（静态页面解析） → …
  • Tasks that involve Web scraping
  • SKILL.md covers 使用场景, 工具, 常用 CSS 选择器 and 工作流, plus 2 more sections
  • Calls node and npm

What it does

Web Scraper is an agent skill from charlie-chann/ai-agent-langgraph-main. 网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集。

Its SKILL.md is about 430 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Web scraping. It works with Puppeteer.

When your agent uses it

  • Tasks that involve Web scraping

Example prompts

  • “/web-scraper”

Requirements

  • Node.js

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Tavily extract（推荐，最简单）
  2. Puppeteer（无头浏览器）
  3. Cheerio（静态页面解析）
  4. fetch + 正则（最轻量）

What it can do on your machine

Read from SKILL.md and the folder at commit 3953a8f. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • node
    • npm

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use npm, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Web Scraper loads about 431 tokens when it runs. Until then it costs about 16 tokens; SKILL.md has 84 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~16
When it runs · the whole SKILL.md, loaded when a task matches
~431

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 84 words (~431 tokens).

name
web-scraper

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/web-scraper of charlie-chann/ai-agent-langgraph-main.

Open the folder on GitHubat commit 3953a8f

Compare with similar skills

Web Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Web Scraper compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Web Scraper this skillcharlie-chann/ai-agent-langgraph-main114—~431Automated safety check: PassNone
Chrome Devtoolseinverne/dotfiles1211 repos~1.6kAutomated safety check: NotesApache-2.0
Optimize Button Patternsduckduckgo/tracker-radar-collector169—~1.6kAutomated safety check: PassCustom licence
Apify CLIapify/apify-cli256—~1.5kAutomated safety check: PassApache-2.0
Brd Browser Debugbrightdata/skills264—~2kAutomated safety check: PassMIT
CrawleeLeoYeAI/openclaw-master-skills2.2k—~4.7kAutomated safety check: PassMIT

Similar skills

  • Chrome Devtools

    einverne/dotfiles

    Browser automation, debugging, and performance analysis using Puppeteer CLI scripts.

    121 GitHub starsUsed in 1 repo~1.6k tokens
    Data & AnalyticsAuto-check: notes

  • Optimize Button Patterns

    duckduckgo/tracker-radar-collector

    Iteratively improves cookie-popup button regex patterns in button-patterns.js against labelled-button-texts.csv.

    169 GitHub stars~1.6k tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed

  • Apify CLI

    apify/apify-cli

    Official

    Patterns for invoking the Apify CLI (apify) from agents. An agent skill from apify/apify-cli.

    256 GitHub stars~1.5k tokensUpdated today
    Data & AnalyticsAuto-check passed

  • Brd Browser Debug

    brightdata/skills

    Debug Bright Data Scraping Browser sessions using the Browser Sessions API.

    264 GitHub stars~2k tokensUpdated 3 days ago
    Data & AnalyticsAuto-check passed

  • Crawlee

    LeoYeAI/openclaw-master-skills

    Expert guide for building web scrapers and crawlers using Crawlee (JavaScript/TypeScript and Python).

    2.2k GitHub stars~4.7k tokensUpdated 2 mo ago
    Data & AnalyticsAuto-check passed

  • Firecrawl Migration Deep Dive

    jeremylongshore/tons-of-skills-marketplace

    Migrate a custom Puppeteer, Playwright, Cheerio, or third-party scraping workload to Firecrawl v2 with parity, policy, cost, and rollback evidence.

    2.8k GitHub stars~1.1k tokensUpdated today
    Data & AnalyticsAuto-check passed

More from charlie-chann/ai-agent-langgraph-main

All 8 skills in this repo

  • Content Harvester

    charlie-chann/ai-agent-langgraph-main

    多源内容采集专家。能从网页、RSS、Tavily搜索、Twitter抓取内容。适用于：信息收集、竞品监控、行业动态追踪。

    114 GitHub stars~233 tokensUpdated 27 days ago
    Auto-check passed

  • Content Publisher

    charlie-chann/ai-agent-langgraph-main

    内容发布专家。将整理好的内容发布到Twitter、博客、飞书等平台。支持多平台适配. An agent skill from charlie-chann/ai-agent-langgraph-main.

    114 GitHub stars~259 tokensUpdated 27 days ago
    Auto-check passed

  • Content Summarizer

    charlie-chann/ai-agent-langgraph-main

    内容摘要与改写专家。将长文、网页、PDF、视频内容提炼为结构化摘要。适用于：信息压缩、快速阅读、内容复用. An agent skill from charlie-chann/ai-agent-langgraph-main.

    114 GitHub stars~219 tokensUpdated 27 days ago
    Auto-check passed

  • Content Aggregator

    charlie-chann/ai-agent-langgraph-main

    内容聚合与报告生成专家。将多个来源的信息整合为一份综合报告、简报、日报。

    114 GitHub stars~369 tokensUpdated 27 days ago
    Auto-check passed

  • Content Organizer

    charlie-chann/ai-agent-langgraph-main

    内容整理与归档专家。将采集的碎片信息分类、标注、关联，形成可检索的知识库。

    114 GitHub stars~254 tokensUpdated 27 days ago
    Auto-check passed

  • Deep Research

    charlie-chann/ai-agent-langgraph-main

    深度调研专家。针对特定主题进行系统性信息挖掘、交叉验证、形成报告。

    114 GitHub stars~336 tokensUpdated 27 days ago
    Auto-check passed

Works with

Categories

Questions about Web Scraper

What does Web Scraper do?

网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集. An agent skill from charlie-chann/ai-agent-langgraph-main. Web Scraper is an agent skill from charlie-chann/ai-agent-langgraph-main.

When should I use Web Scraper?

Web Scraper fits situations like: tasks that involve Web scraping.

How do I install Web Scraper in Claude Code?

Run `npx skills add charlie-chann/ai-agent-langgraph-main --skill web-scraper -a claude-code`. Or copy the skill folder (skills/web-scraper in charlie-chann/ai-agent-langgraph-main) into .claude/skills/web-scraper in your project. Claude Code loads it when a task matches its description.

How do I install Web Scraper in Codex?

Run `npx skills add charlie-chann/ai-agent-langgraph-main --skill web-scraper -a codex`. Or copy the skill folder (skills/web-scraper in charlie-chann/ai-agent-langgraph-main) into .agents/skills/web-scraper in your project. Codex loads it when a task matches its description.

Can I use Web Scraper in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add charlie-chann/ai-agent-langgraph-main --skill web-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/web-scraper, .gemini/skills/web-scraper, .github/skills/web-scraper and .opencode/skills/web-scraper in your project.

What does Web Scraper need to run?

Going by SKILL.md and its folder, Web Scraper needs the command-line tools its instructions call (node and npm). Our summary lists: Node.js.

Does Web Scraper access the network?

SKILL.md contains no URLs. Its commands use npm, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Web Scraper safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Web Scraper use?

No licence was found for Web Scraper or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Web Scraper use?

About 431 tokens (SKILL.md is roughly 1.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Web Scraper?

Skills that share tags, products or a category with Web Scraper: Chrome Devtools (einverne/dotfiles, 121 stars), Optimize Button Patterns (duckduckgo/tracker-radar-collector, 169 stars), Apify CLI (apify/apify-cli, 256 stars) and Brd Browser Debug (brightdata/skills, 264 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Web Scraper?

charlie-chann (a GitHub user) maintains it in charlie-chann/ai-agent-langgraph-main, which has 114 GitHub stars. The repository holds 8 skills in this directory. The repository was last updated on September 13, 2026.

Source: charlie-chann/ai-agent-langgraph-main on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.