New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Scrape

by davila7 in davila7/claude-code-templates

Scrape any webpage as clean markdown via Bright Data Web Unlocker API.

MITAuto-check passedData & Analytics

Install Scrape

skills CLI
$ npx skills add davila7/claude-code-templates --skill scrape -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install davila7/claude-code-templates scrape --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/davila7/claude-code-templates.git skills-src && mkdir -p .claude/skills && cp -r skills-src/cli-tool/components/skills/web-data/scrape .claude/skills/scrape && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
scrape
GitHub stars
32k
Token cost
~392 tokens
SKILL.md length
108 words
Files
2 (incl. scripts)
Skills in repo
477
Repo updated
First seen
Licence
MIT

At a glance

Scrape any webpage as clean markdown via Bright Data Web Unlocker API.

  • Tasks that involve Web scraping
  • SKILL.md covers Setup, Usage, Output Format and Features, plus 1 more section
  • Runs Shell scripts from its folder; calls bash; needs BRIGHTDATA_API_KEY

What it does

Scrape is an agent skill from davila7/claude-code-templates. Scrape any webpage as clean markdown via Bright Data Web Unlocker API. Bypasses bot detection and CAPTCHA. Requires BRIGHTDATAAPIKEY and BRIGHTDATAUNLOCKERZONE environment variables.

Its SKILL.md is about 390 tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including scripts (for example `scripts/scrape.sh`).

It sits in Data & Analytics, covering Web scraping. It works with Bright Data. The repository describes itself as: CLI tool for configuring and monitoring Claude Code. The licence is MIT.

When your agent uses it

  • Tasks that involve Web scraping

Example prompts

  • “/scrape”

Requirements

  • A Bash shell
  • A credential in BRIGHTDATA_API_KEY

What it can do on your machine

Read from SKILL.md and the folder at commit 14680ec. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/ (Shell), which the agent can run.

    Shell commands in SKILL.md call:

    • bash

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • brightdata.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • BRIGHTDATA_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Scrape loads about 392 tokens when it runs. Until then it costs about 48 tokens; SKILL.md has 108 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~48
When it runs · the whole SKILL.md, loaded when a task matches
~392

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from davila7/claude-code-templates at commit 14680ec, republished under its MIT licence (© davila7). 108 words, ~392 tokens.

Download SKILL.mdSave it as .claude/skills/scrape/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
scrape
description
Scrape any webpage as clean markdown via Bright Data Web Unlocker API. Bypasses bot detection and CAPTCHA. Requires BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE environment variables.

Bright Data - Web Scraper

Scrape any webpage and get clean markdown content using Bright Data's Web Unlocker API. Automatically bypasses bot detection and CAPTCHA.

Setup

1. Get your API Key: Get a key from Bright Data Dashboard.

2. Create a Web Unlocker zone: Create a zone at brightdata.com/cp by clicking "Add" (top-right), selecting "Unlocker zone".

3. Set environment variables:

bash
export BRIGHTDATA_API_KEY="your-api-key"
export BRIGHTDATA_UNLOCKER_ZONE="your-zone-name"

Usage

bash
bash scripts/scrape.sh "url"

Parameters:

  • url (required): The webpage URL to scrape

Examples:

bash
# Scrape a news article
bash scripts/scrape.sh "https://example.com/article"

# Scrape a product page
bash scripts/scrape.sh "https://shop.example.com/product/123"

Output Format

Returns clean markdown content extracted from the webpage:

markdown
# Page Title

Main content of the page converted to markdown format...

## Section Heading

More content...

Features

  • Bot Detection Bypass: Automatically handles anti-bot measures
  • CAPTCHA Solving: Bypasses CAPTCHA challenges
  • Clean Markdown: Returns well-formatted markdown content
  • JavaScript Rendering: Handles JavaScript-heavy pages

Dependencies

  • curl - For API requests

© davila7, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (scripts) in cli-tool/components/skills/web-data/scrape of davila7/claude-code-templates.

  • SKILL.md
  • scripts/scrape.sh

Open the folder on GitHubat commit 14680ec

Compare with similar skills

Scrape next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Scrape compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Scrape this skilldavila7/claude-code-templates32k—~392Automated safety check: PassMIT
Data Feedsbrightdata/skills264—~2.2kAutomated safety check: PassMIT
Bright Data Best Practicesbrightdata/skills2641 repos~3.6kAutomated safety check: PassMIT
Scrapebrightdata/skills264—~1.2kAutomated safety check: PassMIT
Searchbrightdata/skills264—~1.5kAutomated safety check: PassMIT
Brd Browser Debugbrightdata/skills264—~2kAutomated safety check: PassMIT

Similar skills

  • Data Feeds

    brightdata/skills

    Extract structured data from 40+ supported platforms (Amazon, LinkedIn, Instagram, TikTok, Facebook, YouTube, Reddit, and more) via the Bright Data CLI (bdata pipelines).

    264 GitHub stars~2.2k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Bright Data Best Practices

    brightdata/skills

    Build production-ready Bright Data integrations with best practices baked in.

    264 GitHub starsUsed in 1 repo~3.6k tokens
    Data & AnalyticsAuto-check passed

  • Scrape

    brightdata/skills

    Scrape web content as clean markdown/HTML/JSON via the Bright Data CLI (bdata scrape).

    264 GitHub stars~1.2k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Search

    brightdata/skills

    Search the web via the Bright Data CLI — bdata search for Google/Bing/Yandex SERP, bdata discover for intent-ranked semantic results.

    264 GitHub stars~1.5k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Brd Browser Debug

    brightdata/skills

    Debug Bright Data Scraping Browser sessions using the Browser Sessions API.

    264 GitHub stars~2k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Brightdata SDK

    brightdata/skills

    Web data extraction and discovery using the Bright Data Python SDK.

    264 GitHub stars~5.2k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

More from davila7/claude-code-templates

All 477 skills in this repo

  • Perplexity Web Search

    davila7/claude-code-templates

    Runs web-grounded searches through Perplexity's Sonar models over OpenRouter for current events, recent literature and cited facts beyond the model's training cutoff.

    32k GitHub starsUsed in 12 repos~3.5k tokens
    Auto-check: notes

  • Neuropixels Data Analysis

    davila7/claude-code-templates

    Analyzes Neuropixels recordings from SpikeGLX or Open Ephys through preprocessing, drift correction, Kilosort4 spike sorting, quality metrics and curation.

    32k GitHub starsUsed in 10 repos~2.8k tokens
    Auto-check passed

  • Scientific Venue Templates

    davila7/claude-code-templates

    Supplies LaTeX templates and formatting rules for journals, conferences, posters, and grant proposals, then can check a draft against them.

    32k GitHub starsUsed in 9 repos~5.1k tokens
    Auto-check: notes

  • Brand Voice Content Creator

    davila7/claude-code-templates

    Analyzes a brand's existing writing to lock in a consistent voice, then builds SEO blog posts and platform-specific social content around it.

    32k GitHub starsUsed in 3 repos~1.9k tokens
    Auto-check passed

  • CAPA Officer

    davila7/claude-code-templates

    Guides corrective and preventive action (CAPA) work in a quality management system, from initiation and root cause analysis through effectiveness verification.

    32k GitHub starsUsed in 1 repo~2k tokens
    Auto-check passed

  • Fda Consultant Specialist

    davila7/claude-code-templates

    Senior FDA consultant and specialist for medical device companies including HIPAA compliance and requirement management.

    32k GitHub starsUsed in 1 repo~2.7k tokens
    Auto-check passed

Works with

Categories

Questions about Scrape

What does Scrape do?

Scrape any webpage as clean markdown via Bright Data Web Unlocker API. Scrape is an agent skill from davila7/claude-code-templates. Scrape any webpage as clean markdown via Bright Data Web Unlocker API.

When should I use Scrape?

Scrape fits situations like: tasks that involve Web scraping.

How do I install Scrape in Claude Code?

Run `npx skills add davila7/claude-code-templates --skill scrape -a claude-code`. Or copy the skill folder (cli-tool/components/skills/web-data/scrape in davila7/claude-code-templates) into .claude/skills/scrape in your project. Claude Code loads it when a task matches its description.

How do I install Scrape in Codex?

Run `npx skills add davila7/claude-code-templates --skill scrape -a codex`. Or copy the skill folder (cli-tool/components/skills/web-data/scrape in davila7/claude-code-templates) into .agents/skills/scrape in your project. Codex loads it when a task matches its description.

Can I use Scrape in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add davila7/claude-code-templates --skill scrape -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/scrape, .gemini/skills/scrape, .github/skills/scrape and .opencode/skills/scrape in your project.

What does Scrape need to run?

Going by SKILL.md and its folder, Scrape needs a shell for the scripts in its folder, the command-line tools its instructions call (bash) and credentials named BRIGHTDATA_API_KEY. Our summary lists: A Bash shell; A credential in BRIGHTDATA_API_KEY.

Does Scrape access the network?

SKILL.md names 1 domain. As links in the text: brightdata.com. This is read from the text; nothing was executed.

Is Scrape safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Scrape use?

Scrape is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Scrape use?

About 392 tokens (SKILL.md is roughly 1.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Scrape?

Skills that share tags, products or a category with Scrape: Data Feeds (brightdata/skills, 264 stars), Bright Data Best Practices (brightdata/skills, 264 stars), Scrape (brightdata/skills, 264 stars) and Search (brightdata/skills, 264 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Scrape?

davila7 (a GitHub user) maintains it in davila7/claude-code-templates, which has 32,463 GitHub stars. The repository holds 477 skills in this directory. The repository was last updated on October 8, 2026.

Source: davila7/claude-code-templates on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.