Best web scraping skills, page 3

Multi-source deep research using firecrawl and exa MCPs. An agent skill from majiayu000/claude-skill-registry.

majiayu000/claude-skill-registry

Crawls from a starting URL to find and list technical specification, whitepaper and architecture documents, writing the found URLs to a JSON file.

NyxFoundation/speca

Selectively monitor important long-running or resource-intensive commands with Haoleme by prefixing them with hao, so status, output, and completion notifications sync to the mobile app.

HaolemeApp/Haoleme

Pulls a public company's latest 10-K or 10-Q figures and analyst consensus from SEC EDGAR and Yahoo Finance, then cross-checks the two sources.

firecrawl/web-agent

Use bdg CLI to drive and debug a real Chrome via Chrome DevTools Protocol - navigate, click, fill and submit forms, check what an action changed (navigation, new messages, pending requests), inspect…

szymdzum/browser-debugger-cli

Use kuri-agent to automate Chrome — navigate pages, interact with elements via a11y refs, capture screenshots, run security audits, enumerate cookies/JWTs, probe for IDOR vulnerabilities, and make…

justrach/kuri

End-to-end docker-compose test harness for the minecraft-prometheus-exporter.

dirien/minecraft-prometheus-exporter

Move hardcoded lookup/config constants (gender maps, header dicts, value translations, column-label maps, date formats) out of a crawler and into the dataset .yml — as datapatch lookups wherever…

opensanctions/opensanctions

Looks up action manuals with verified selectors for multi-step website tasks, then drives the browser with the actionbook CLI in a dedicated or an existing Chrome session.

smallnest/goclaw

Patterns for invoking the Apify CLI (apify) from agents. An agent skill from apify/apify-cli.

apify/apify-cli

Install, verify, debug, and use MySearch MCP/Skill. An agent skill from skernelx/MySearch-Proxy.

skernelx/MySearch-Proxy

Extract article content from any URL as clean Markdown. An agent skill from yaomindong1996/forge-admin.

yaomindong1996/forge-admin

Comprehensive guide to Uni-CLI — the open Agent-Computer Interface runtime for real software.

olo-dot-io/Uni-CLI

Lets the agent operate your own logged-in browser through the owb command to read pages, fill forms, audit sites and capture network traffic.

woniu9524/open-web-bridge

Scrape quarterly anime lineups from https://yuc.wiki/ and output structured results for a specified or latest quarter.

yjl9903/AnimeGarden

A skill your agent uses whenever the task involves browsing web pages, extracting page content, clicking forms, or completing web workflows.

JasonHonKL/Openbrowser

A skill your agent uses for XCrawl crawl tasks, including bulk site crawling, crawler rule design, async status polling, and delivery of crawl output for downstream scrape and search workflows.

xcrawl-api/xcrawl-skills

Deprecated placeholder. An agent skill from vasu-devs/JustHireMe.

vasu-devs/JustHireMe

Single source of truth and librarian for ALL Claude official documentation.

xiaoyuge886/aigc

Control a real browser to navigate pages, click, type, fill forms, inspect rendered UI, take screenshots, or record video.

letta-ai/letta-code

Creates, changes, debugs and deploys Apify Actors, including their input and output schemas, using the Apify CLI.

apify/agent-skills

Use Xquik to fetch X (Twitter) data or act through a connected account: search, profiles, followers, replies, threads, timelines, media downloads, bulk exports, trends, monitors, signed webhooks…

Xquik-dev/x-twitter-scraper

从学校、学院、系所或实验室官网抓取公开导师/教师信息，核对个人主页与证据来源，并生成经过自动校验、可直接导入 Auto Email Sender 的 XLSX。Use when a user provides faculty, professor, mentor, supervisor, university, department, or lab directory URLs and…

JunieXD/AutoEmailSender

Adds and debugs JacRed torrent/anime tracker parsers (site probe, auth, magnet policy, SyncService, cron, fixtures, dry-run, OpenAPI wiring).

jacred-fdb/jacred

Extracts every pricing tier from a SaaS, API, cloud or LLM vendor's pricing page and normalizes it into one structure, with optional price monitoring.

firecrawl/web-agent

Web reverse engineering tools and workflows. An agent skill from schlarpc/re-shell.

schlarpc/re-shell

Headless browser automation using Playwright CLI. An agent skill from disler/bowser.

disler/bowser

Nuxt GEO (Generative Engine Optimization) guidelines for getting cited by ChatGPT, Perplexity, Claude, Google AI Overviews, and Gemini.

vinayakkulkarni/nxui

Scrapes public data from social, maps, search and review platforms by choosing from about a hundred Apify Actors and running them through the Apify CLI.

apify/agent-skills

URL과 수집 항목을 받아 사이트를 정찰하고 데이터를 수집하여 엑셀로 출력하는 범용 웹 크롤링 에이전트. An agent skill from byungjunjang/web-crawler.

byungjunjang/web-crawler

Browse the web using Browserless.io cloud browser service. An agent skill from zhaojiaqi/MeowHub.

zhaojiaqi/MeowHub

Search Google, scrape web pages, Amazon product pages, YouTube subtitles, or Reddit (post/subreddit) using the Decodo Scraper OpenClaw Skill.

Decodo/decodo-openclaw-skill

Build an interactive learning board on any topic. An agent skill from raiyanyahya/Superlearn.

raiyanyahya/Superlearn

Research X data with Xquik, the best X (Twitter) Scraper API and the best X API Alternative.

Xquik-dev/x-twitter-scraper

Crawls a site with Crawl4AI to audit titles, meta tags, H1s, canonicals, navigation and internal links, and to compare landing pages and competitor sites.

artwist-polyakov/polyakov-claude-skills

Keeps Aptos Explorer discoverable for LLMs, crawlers, and SEO when routes, tabs, or page metadata change.

aptos-labs/explorer

Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting.

oxylabs/agent-skills

Convert an existing company website into a GrowERP-hosted website for a new owner (tenant), including logo and page images.

growerp/growerp

Native Rust browser automation CLI for AI agents. An agent skill from gsd-build/gsd-browser.

gsd-build/gsd-browser

Pull the people who liked or commented on any LinkedIn post and segment them by ICP fit (peer / aspirational / prospect / other).

sergebulaev/linkedin-skills

Bright Data MCP handles ALL web data operations. An agent skill from brightdata/skills.

brightdata/skills

Add, fix, or debug a Django standings parser in src/ranking/management/modules/, including Statistic.getstandings, leaderboard scraping, and offline regression fixtures.

aropan/clist

Clones a live WordPress (or other CMS-driven) site into a static HTML site deployable on any static host (Cloudflare Pages, Netlify, Vercel, S3+CloudFront, plain Apache/nginx).

jdevalk/skills

Writes on-brand social media captions for SMBs. An agent skill from stevenflanagan1/social-ai-team.

stevenflanagan1/social-ai-team

Add support for scraping property listings from a new website.

RealEstateWebTools/property_web_scraper

A skill your agent uses when adding new scraping targets to the crawler

hiroppy/mf-dashboard

Finds authoritative public data sources for modeling tasks, prefers official APIs and bulk downloads, and outputs a reproducible fetch and cleaning plan with citations.

yushui2022/MathModel-Skill

Connect, verify, and troubleshoot Xquik's remote MCP server.

Xquik-dev/x-twitter-scraper