Topic · Data & Analytics
Best web scraping skills, page 16
Web scraping skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 721 | 721.Brightdata Web scraping and search via Bright Data API. An agent skill from sundial-org/awesome-openclaw-skills. | sundial-org/ | 663 | — | ~334 | Automated safety check: Pass | No licence | 7 mo ago |
| 722 | 722.Glue Diagnostics A skill your agent uses to investigate and troubleshoot AWS Glue problems by analyzing ETL jobs, crawlers, connections, Data Catalog, DPU utilization, Spark execution, and job bookmarks following… | Kilo-Org/ | 190 | — | ~2k | Automated safety check: Pass | MIT | 9 days ago |
| 723 | 723.Firecrawl Scrape pages, crawl public sites, map URLs, and run JSON-schema extraction through managed or self-hosted Firecrawl. | HybridAIOne/ | 158 | — | ~2.2k | Automated safety check: Pass | MIT | today |
| 724 | 724.Firecrawl Search, scrape, and interact with the web via the Firecrawl CLI. | CraftOS-dev/ | 392 | — | ~3.2k | Automated safety check: Notes | MIT | today |
| 725 | 725.C Browser Headless browser automation — navigate pages, click elements, fill forms, take screenshots, scrape content using agent-browser or playwright-cli. | daxaur/ | 174 | — | ~383 | Automated safety check: Pass | MIT | 4 mo ago |
| 726 | Scrapes a Substack Notes page and exports engagement data to a formatted .xlsx file. | mohitagw15856/ | 1.4k | — | ~1.9k | Automated safety check: Pass | MIT | today |
| 727 | Multi-platform e-commerce competitor analysis skill that automatically scrapes product data from Amazon, Temu, Shopee and generates comprehensive analysis reports using AI. | aAAaqwq/ | 105 | — | ~2.6k | Automated safety check: Notes | MIT | 10 days ago |
| 728 | 728.Crawlberg Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. | hashgraph-online/ | 1.2k | — | ~3.4k | Automated safety check: Pass | MIT | today |
| 729 | 729.Kreuzcrawl Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server. | hashgraph-online/ | 1.2k | — | ~2k | Automated safety check: Pass | MIT | today |
| 730 | A skill your agent uses when the user wants a single page rendered as clean Markdown plus structured metadata. | hashgraph-online/ | 1.2k | — | ~1.2k | Automated safety check: Pass | Apache-2.0 | today |
| 731 | A skill your agent uses when the user wants a single page rendered as clean Markdown plus structured metadata. | hashgraph-online/ | 1.2k | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | today |
| 732 | 732.Serving The API A skill your agent uses when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST. | hashgraph-online/ | 1.2k | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | today |
| 733 | 733.Shots Generate, revise, translate, and manage App Store marketing screenshots and app icon candidates through the hosted Shots MCP tools. | hashgraph-online/ | 1.2k | — | ~2.4k | Automated safety check: Pass | MIT | today |
| 734 | 734.Firecrawl Search, scrape, and interact with the web via the Firecrawl CLI. | hashgraph-online/ | 1.2k | — | ~1.8k | Automated safety check: Notes | Apache-2.0 | today |
| 735 | 735.Product Page SEO Optimize AEM Edge Delivery Services commerce product pages for search engine crawling and indexing. | adobe/ | 196 | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | today |
| 736 | 736.Junta Leiloeiros Skill: Leiloeiros das Juntas Comerciais do Brasil workflow skill. | diegosouzapw/ | 159 | — | ~3.7k | Automated safety check: Pass | MIT | 3 mo ago |
| 737 | 737.Yandex Direct [RU: интеграция Яндекс.Директ API v5 — кампании, ставки, отчёты, автостратегии, песочница] Yandex.Direct API v5 — JSON over HTTPS, OAuth Bearer + Client-Login for agencies… | VKirill/ | 122 | — | ~5.8k | Automated safety check: Notes | MIT | yesterday |
| 738 | 738.Web Scraper Scrape web pages, crawl sites, extract structured data, and capture screenshots through SandBase. | sandbaseai/ | 201 | — | ~746 | Automated safety check: Pass | Apache-2.0 | 11 days ago |
| 739 | Find and enrich B2B leads from Booking.com - hotels, apartments, and vacation rentals - and pull each host's or property manager's real contact details (email, phone, company name, registration… | apify/ | 264 | — | ~2.3k | Automated safety check: Pass | Apache-2.0 | 15 days ago |
| 740 | 740.Serpapi SerpApi search engine results API via curl. An agent skill from nicepkg/ai-workflow. | nicepkg/ | 285 | — | ~1.4k | Automated safety check: Pass | MIT | 8 mo ago |
| 741 | 741.Social Listening A skill your agent uses when you need to turn a supplied set of comments, DMs, reviews, community posts, or call notes into an evidence-backed picture of what people ask, resist, and repeat. | Ootto-AI/ | 112 | — | ~882 | Automated safety check: Pass | MIT | 1 mo ago |
| 742 | 742.Brightdata Progressive four-tier URL content scraping with automatic fallback strategy. | Microck/ | 403 | — | ~1.4k | Automated safety check: Pass | Unknown | 1 mo ago |
| 743 | 743.Algo SEO Crawl Implement a web crawler pipeline covering URL discovery, fetching, parsing, and storage. | asgard-ai-platform/ | 241 | — | ~993 | Automated safety check: Pass | MIT | 4 mo ago |
| 744 | 744.Browser Tools Security wrapper over the upstream agent-browser skill, adding URL blocklisting, rate limiting, robots.txt enforcement, and scraping guardrails. | yonatangross/ | 289 | — | ~6.1k | Automated safety check: Pass | MIT | today |
| 745 | 745.Pp Context Dev Printing Press CLI for Context.dev. An agent skill from mvanhorn/printing-press-library. | mvanhorn/ | 2.1k | — | ~4.3k | Automated safety check: Notes | Apache-2.0 | today |
| 746 | 746.Pp Firecrawl Printing Press CLI for Firecrawl. An agent skill from mvanhorn/printing-press-library. | mvanhorn/ | 2.1k | — | ~2.2k | Automated safety check: Notes | Apache-2.0 | today |
| 747 | Enterprise-grade browser automation using WebDriver protocol. | aiskillstore/ | 430 | — | ~1.5k | Automated safety check: Notes | No licence | today |
| 748 | 748.Firecrawl Firecrawl handles all web operations with superior accuracy, speed, and LLM-optimized output. | aiskillstore/ | 430 | 1 repo | ~2.6k | Automated safety check: Pass | No licence | today |
| 749 | Create Firecrawl monitors that watch pages, sites, or web search results and send change alerts by email or webhook. | aiskillstore/ | 430 | 1 repo | ~4.6k | Automated safety check: Pass | No licence | today |
| 750 | 750.Firecrawl 2 Web scraping and crawling with Firecrawl API. An agent skill from sundial-org/awesome-openclaw-skills. | sundial-org/ | 663 | — | ~698 | Automated safety check: Pass | No licence | 7 mo ago |
| 751 | 751.Serper Google search via Serper API with full page content extraction. | sundial-org/ | 663 | — | ~1.6k | Automated safety check: Notes | No licence | 7 mo ago |
| 752 | Find a direct path to structured data through ready-made workflows, data APIs, and indexes. | firecrawl/ | 116 | — | ~1.6k | Automated safety check: Pass | ISC | yesterday |
| 753 | Configure static outbound IP addresses for Google Cloud Run jobs/services. | divinevideo/ | 266 | — | ~1.5k | Automated safety check: Pass | MPL-2.0 | today |
| 754 | Fix rsky-pds createRecord/putRecord hanging indefinitely with no error logs. | divinevideo/ | 266 | — | ~1.1k | Automated safety check: Pass | MPL-2.0 | today |
| 755 | A skill your agent uses when handling research ethics, transparency, and data sharing for a New Media & Society (NM&S) manuscript — consent and anonymization, the ethics of scraping and platform… | brycewang-stanford/ | 1.2k | — | ~1.6k | Automated safety check: Pass | MIT | 11 days ago |
| 756 | When the user wants to choose or optimize rendering strategy for SEO. | kostja94/ | 1k | — | ~1.6k | Automated safety check: Pass | MIT | 2 days ago |
| 757 | 757.Coffee Chat Generate a personalized coffee chat playbook for networking conversations. | LeoYeAI/ | 2.2k | — | ~6.6k | Automated safety check: Pass | MIT | 2 mo ago |
| 758 | 758.Firecrawl Firecrawl API integration with managed authentication. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~6.2k | Automated safety check: Pass | MIT | 2 mo ago |
| 759 | 759.Firecrawl MCP Auto-generated skill for firecrawl-mcp tools via OneKey Gateway. | LeoYeAI/ | 2.2k | — | ~7.4k | Automated safety check: Pass | MIT | 2 mo ago |
| 760 | 760.Init Kb Initialize or update a knowledge base for a project, business, or client. | LeoYeAI/ | 2.2k | — | ~7k | Automated safety check: Pass | MIT | 2 mo ago |
| 761 | 761.Extract Crawl an existing website (capped, multi-page) and seed stardust/current/ with PRODUCT.md, DESIGN.md, DESIGN.json, a per-page inventory, and the consolidated brand surface — the captured design… | adobe/ | 196 | — | ~11k | Automated safety check: Pass | Apache-2.0 | today |
| 762 | Extract clean, de-noised job-posting data from LinkedIn, Indeed, Glassdoor, and 20+ boards in one Apify run — deduplicated across boards, with likely ghost jobs and reposts flagged (heuristic, not… | apify/ | 264 | — | ~5.5k | Automated safety check: Pass | Apache-2.0 | 15 days ago |
| 763 | Answer classic system design problems as constraint-to-solution sketches and coach interview practice: URL shortener, rate limiter, news feed, chat, notification, autocomplete, crawler, unique id. | HoangNguyen0403/ | 571 | — | ~1.1k | Automated safety check: Pass | MIT | today |
| 764 | Browser automation via Playwright for web testing, screenshots, form filling, scraping, and verification. | ArabelaTso/ | 253 | — | ~930 | Automated safety check: Pass | Apache-2.0 | 1 mo ago |
| 765 | Clean and extract the main body content from a webpage URL. An agent skill from OpenMinis/MinisSkills. | OpenMinis/ | 444 | — | ~564 | Automated safety check: Pass | MIT | today |
| 766 | Assesses lawful basis for AI training data processing per EDPB April 2025 report on LLMs and general-purpose AI. | mukul975/ | 295 | — | ~3.7k | Automated safety check: Pass | Apache-2.0 | 6 mo ago |
| 767 | 767.Steel Browser Use this skill by default for browser or web tasks that can run in the cloud: site navigation, scraping, structured extraction, screenshots/PDFs, form flows, and anti-bot-sensitive automation. | aiskillstore/ | 430 | — | ~2k | Automated safety check: Pass | No licence | today |
| 768 | 768.Tiktok API A TikTok API alternative on fetcher.sh — pay-per-call in USDC via x402, or prepaid credits with a Bearer key, no login and no app review. | aiskillstore/ | 430 | — | ~2k | Automated safety check: Pass | No licence | today |
