Scrapling
Cedriccmh/claude-code-skill-scrapling
使用 scrapling 进行网页抓取和数据提取。根据目标网站特征自动选择最佳 Fetcher， 生成并执行 Python 脚本完成任务。Use when: (1) 抓取/爬取网页内容或数据（scrape, crawl, fetch page, extract data） (2) 需要绕过 Cloudflare/WAF 等反爬保护 (3) 登录后抓取受保护页面 (4) 解析已有 HTML…
Веб-скрапинг через Scrape.do. An agent skill from artwist-polyakov/polyakov-claude-skills.
Install Scrapedo Web Scraper
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .claude/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .claude/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraperType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .agents/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .agents/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .cursor/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .cursor/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/artwist-polyakov/polyakov-claude-skills.git --path plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .gemini/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .gemini/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraperInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .github/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .github/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install artwist-polyakov/polyakov-claude-skills scrapedo-web-scraper --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/artwist-polyakov/polyakov-claude-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper .opencode/skills/scrapedo-web-scraper && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "scrapedo-web-scraper" agent skill from https://github.com/artwist-polyakov/polyakov-claude-skills/tree/main/plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper into .opencode/skills/scrapedo-web-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "scrapedo-web-scraper", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
scrapedo-web-scraper- GitHub stars
- 208
- Token cost
- ~251 tokens
- SKILL.md length
- 42 words
- Files
- 5 (incl. scripts)
- Skills in repo
- 21
- Repo updated
- First seen
- Licence
- MIT
At a glance
Веб-скрапинг через Scrape.do. An agent skill from artwist-polyakov/polyakov-claude-skills.
- Tasks that involve Web scraping
- SKILL.md covers Использование, Из Python and Результат
- Runs Python scripts from its folder; calls python
What it does
Scrapedo Web Scraper is an agent skill from artwist-polyakov/polyakov-claude-skills. Веб-скрапинг через Scrape.do. Обходит блокировки и CAPTCHA. АВТОМАТИЧЕСКИ используй при ошибках WebFetch: 403, 401, 429, timeout, access denied, Cloudflare block.
Its SKILL.md is about 250 tokens, which your agent loads only when the skill is triggered. The skill folder holds 6 other files, including scripts (for example `config/README.md` and `scripts/scrape.py`).
It sits in Data & Analytics, covering Web scraping. It works with Cloudflare. The repository describes itself as: Набор скиллов для Claude. The licence is MIT.
When your agent uses it
- Tasks that involve Web scraping
Example prompts
- “/scrapedo-web-scraper”
Requirements
- Python 3
What it can do on your machine
Read from SKILL.md and the folder at commit 8bbeead. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Ships 1 file in scripts/ (Python), which the agent can run.
Shell commands in SKILL.md call:
python
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Scrapedo Web Scraper loads about 251 tokens when it runs. Until then it costs about 46 tokens; SKILL.md has 42 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
SKILL.md
The full file from artwist-polyakov/polyakov-claude-skills at commit 8bbeead, republished under its MIT licence (© artwist-polyakov). 42 words, ~251 tokens.
Download SKILL.mdSave it as
.claude/skills/scrapedo-web-scraper/SKILL.md (or your agent's skills folder). This skill also uses 4 other files; get the full folder from GitHub.- name
- scrapedo-web-scraper
- description
- Веб-скрапинг через Scrape.do. Обходит блокировки и CAPTCHA. АВТОМАТИЧЕСКИ используй при ошибках WebFetch: 403, 401, 429, timeout, access denied, Cloudflare block.
Scrape.do Web Scraper
Скрапинг веб-страниц через Scrape.do API. Используй когда обычный fetch не работает (блокировка, JavaScript).
Использование
# Получить текст страницы
python scripts/scrape.py https://example.com
# Получить HTML
python scripts/scrape.py --html https://example.comИз Python
from scripts.scrape import fetch_via_scrapedo
result = fetch_via_scrapedo('https://example.com')
if result['success']:
print(result['content']) # текст
# result['html'] — оригинальный HTML
else:
print(result['content']) # описание ошибкиРезультат
- Успех: текст страницы (или HTML с
--html) - Ошибка: понятное сообщение (нет токена / лимит / недоступно)
Если вернулась ошибка — страница недоступна через этот метод.
© artwist-polyakov, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
SKILL.md and 4 other files (scripts) in plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper of artwist-polyakov/polyakov-claude-skills.
- SKILL.md
- .gitignore
- config/README.md
- config/token.txt.example
- scripts/scrape.py
Open the folder on GitHubat commit 8bbeead
Compare with similar skills
Scrapedo Web Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Scrapedo Web Scraper this skillartwist-polyakov/polyakov-claude-skills | 208 | — | ~251 | Automated safety check: Pass | MIT | |
| ScraplingCedriccmh/claude-code-skill-scrapling | 446 | — | ~1.1k | Automated safety check: Pass | MIT | |
| Anti Bot Analyzerrevfactory/harness-100 | 1.3k | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | |
| News9600dev/mmr | 131 | — | ~6.1k | Automated safety check: Pass | Custom licence | |
| ScraplingTommy-yw/RunbookHermes | 546 | 3 repos | ~2.3k | Automated safety check: Pass | MIT | |
| Scraplingarchibate/dotfiles-opencode | 108 | 1 repos | ~4.9k | Automated safety check: Warn | BSD-3-Clause |
Similar skills
Anti Bot Analyzer
revfactory/harness-100
A skill for analyzing website anti-bot defense mechanisms and developing legitimate evasion strategies.
News
9600dev/mmr
Fetch, search, and summarize financial news articles via the local scraper service (~/dev/scraper) at http://127.0.0.1:8089.
Scrapling
Tommy-yw/RunbookHermes
Web scraping with Scrapling - HTTP fetching, stealth browser automation, Cloudflare bypass, and spider crawling via CLI and Python.
Scrapling
archibate/dotfiles-opencode
Scrape web pages using Scrapling with anti-bot bypass (like Cloudflare Turnstile), stealth headless browsing, spiders framework, adaptive scraping, and JavaScript rendering.
Web Scraper
LeoYeAI/openclaw-master-skills
Intelligent web scraper that fetches any URL and returns clean Markdown content.
More from artwist-polyakov/polyakov-claude-skills
All 21 skills in this repoAgent Deck Sessions
artwist-polyakov/polyakov-claude-skills
Launches, monitors and collects results from child AI agent sessions with the agent-deck terminal session manager.
Crawl4AI SEO Site Crawler
artwist-polyakov/polyakov-claude-skills
Crawls a site with Crawl4AI to audit titles, meta tags, H1s, canonicals, navigation and internal links, and to compare landing pages and competitor sites.
GitHub Pages Publisher
artwist-polyakov/polyakov-claude-skills
Publishes already-built static pages to a GitHub Pages repo under a year, year-month and slug folder layout, optimizes large images and returns the public URL.
Perplexity Search and Research
artwist-polyakov/polyakov-claude-skills
Shell scripts for web search and research through the Perplexity API: raw results, cited answers, background deep research and page fetching, with results cached on disk.
Sourcecraft Publisher
artwist-polyakov/polyakov-claude-skills
Publish static page artifacts to SourceCraft Sites (Yandex infrastructure, works in Russia), with advisory image optimization and an original-image path.
X/Twitter Research via Grok
artwist-polyakov/polyakov-claude-skills
Searches X/Twitter through the xAI Grok API to build digests, trend reports and thread analysis, meant to surface post ideas for a Telegram channel.
Related
Works with
Categories
Questions about Scrapedo Web Scraper
What does Scrapedo Web Scraper do?
Веб-скрапинг через Scrape.do. An agent skill from artwist-polyakov/polyakov-claude-skills. Scrapedo Web Scraper is an agent skill from artwist-polyakov/polyakov-claude-skills.do.
When should I use Scrapedo Web Scraper?
Scrapedo Web Scraper fits situations like: tasks that involve Web scraping.
How do I install Scrapedo Web Scraper in Claude Code?
Run `npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a claude-code`. Or copy the skill folder (plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper in artwist-polyakov/polyakov-claude-skills) into .claude/skills/scrapedo-web-scraper in your project. Claude Code loads it when a task matches its description.
How do I install Scrapedo Web Scraper in Codex?
Run `npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a codex`. Or copy the skill folder (plugins/scrapedo-web-scraper/skills/scrapedo-web-scraper in artwist-polyakov/polyakov-claude-skills) into .agents/skills/scrapedo-web-scraper in your project. Codex loads it when a task matches its description.
Can I use Scrapedo Web Scraper in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/scrapedo-web-scraper, .gemini/skills/scrapedo-web-scraper, .github/skills/scrapedo-web-scraper and .opencode/skills/scrapedo-web-scraper in your project.
What does Scrapedo Web Scraper need to run?
Going by SKILL.md and its folder, Scrapedo Web Scraper needs Python for the scripts in its folder and the command-line tools its instructions call (python). Our summary lists: Python 3.
Does Scrapedo Web Scraper access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Scrapedo Web Scraper safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
What licence does Scrapedo Web Scraper use?
Scrapedo Web Scraper is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Scrapedo Web Scraper use?
About 251 tokens (SKILL.md is roughly 1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Scrapedo Web Scraper?
Skills that share tags, products or a category with Scrapedo Web Scraper: Scrapling (Cedriccmh/claude-code-skill-scrapling, 446 stars), Anti Bot Analyzer (revfactory/harness-100, 1.3k stars), News (9600dev/mmr, 131 stars) and Scrapling (Tommy-yw/RunbookHermes, 546 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Scrapedo Web Scraper?
artwist-polyakov (a GitHub user) maintains it in artwist-polyakov/polyakov-claude-skills, which has 208 GitHub stars. The repository holds 21 skills in this directory. The repository was last updated on October 8, 2026.
Source: artwist-polyakov/polyakov-claude-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.