Topic · Data & Analytics
Best web scraping skills, page 12
Web scraping skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 529 | Веб-скрапинг через Scrape.do. An agent skill from artwist-polyakov/polyakov-claude-skills. | artwist-polyakov/ | 206 | — | ~251 | Automated safety check: Pass | MIT | 15 days ago |
| 530 | 530.Adhx Fetch any X/Twitter post as clean LLM-friendly JSON. An agent skill from majiayu000/claude-skill-registry. | majiayu000/ | 666 | 3 repos | ~1.1k | Automated safety check: Pass | MIT | today |
| 531 | Understand audience demographics, preferences, behavior patterns, and engagement quality across Facebook, Instagram, YouTube, and TikTok. | majiayu000/ | 666 | 3 repos | ~1.2k | Automated safety check: Notes | MIT | today |
| 532 | Scrape reviews, ratings, and brand mentions from multiple platforms using Apify Actors. | majiayu000/ | 666 | 3 repos | ~1.1k | Automated safety check: Notes | MIT | today |
| 533 | Track engagement metrics, measure campaign ROI, and analyze content performance across Instagram, Facebook, YouTube, and TikTok. | majiayu000/ | 666 | 3 repos | ~1.1k | Automated safety check: Notes | MIT | today |
| 534 | 534.Apify Ecommerce Extract product data, prices, reviews, and seller information from any e-commerce platform using Apify's E-commerce Scraping Tool. | majiayu000/ | 666 | 3 repos | ~2.3k | Automated safety check: Notes | MIT | today |
| 535 | Find and evaluate influencers for brand partnerships, verify authenticity, and track collaboration performance across Instagram, Facebook, YouTube, and TikTok. | majiayu000/ | 666 | 3 repos | ~1.1k | Automated safety check: Notes | MIT | today |
| 536 | Analyze market conditions, geographic opportunities, pricing, consumer behavior, and product validation across Google Maps, Facebook, Instagram, Booking.com, and TripAdvisor. | majiayu000/ | 666 | 3 repos | ~1.2k | Automated safety check: Notes | MIT | today |
| 537 | Discover and track emerging trends across Google Trends, Instagram, Facebook, YouTube, and TikTok to inform content strategy. | majiayu000/ | 666 | 3 repos | ~1.2k | Automated safety check: Notes | MIT | today |
| 538 | Actorization converts existing software into reusable serverless applications compatible with the Apify platform. | majiayu000/ | 666 | 3 repos | ~1.7k | Automated safety check: Pass | MIT | today |
| 539 | Scrape leads from multiple platforms using Apify Actors. An agent skill from majiayu000/claude-skill-registry. | majiayu000/ | 666 | 3 repos | ~1.1k | Automated safety check: Notes | MIT | today |
| 540 | What to do when a tool fails, an API hits a rate limit, or a site blocks scraping. | borski/ | 688 | — | ~1.6k | Automated safety check: Pass | MIT | 3 days ago |
| 541 | 541.Post Engagers Extract people who engage (comment, react, repost) on a LinkedIn post, enrich their profile / email / company data, and land them in a local SQLite CRM (content.db → crm.db) as the source of truth. | extruct-ai/ | 109 | — | ~2k | Automated safety check: Pass | No licence | 10 days ago |
| 542 | 公众号搜索爬虫 — 通过关键词搜索微信公众号文章，终端表格展示（标题/作者/阅读/点赞/分享/收藏/发布时间/文章链接），自动导出 CSV 并生成交互式 HTML 报告。当用户需要搜索、爬取或浏览公众号文章时使用；也适用于行业热点追踪、竞品内容分析、素材灵感搜集等场景。 | redfox-data/ | 425 | — | ~845 | Automated safety check: Pass | No licence | today |
| 543 | 543.Twitter X Hub Skill for reading and writing Twitter/X data with Python + UV, with zero third-party dependencies (pure standard library), by directly passing the authtoken + ct0 cookies for authentication. | OpenMinis/ | 444 | — | ~2.9k | Automated safety check: Pass | MIT | today |
| 544 | 544.Xiaohongshu Hub Skill for reading and writing Xiaohongshu (XHS) data using Python + UV. | OpenMinis/ | 444 | — | ~2.7k | Automated safety check: Pass | MIT | today |
| 545 | 545.Reddit 2 Read and search Reddit posts via web scraping of old.reddit.com. | sundial-org/ | 663 | — | ~734 | Automated safety check: Pass | No licence | 7 mo ago |
| 546 | Produce pre-meeting lead intelligence briefs with Firecrawl. | firecrawl/ | 116 | — | ~580 | Automated safety check: Pass | ISC | yesterday |
| 547 | Extract market, financial, earnings, industry, and company metrics with Firecrawl. | firecrawl/ | 116 | — | ~559 | Automated safety check: Pass | ISC | yesterday |
| 548 | Alert by webhook/email on web changes — use for "monitor/watch/track/alert me when": recurring checks on known URLs (prefer over repeated one-off scrapes) or web-wide watches for new results… | firecrawl/ | 116 | — | ~1.4k | Automated safety check: Pass | ISC | yesterday |
| 549 | 549.Firecrawl QA QA test a live website with Firecrawl browser and scrape evidence. | firecrawl/ | 116 | — | ~587 | Automated safety check: Pass | ISC | yesterday |
| 550 | Find and synthesize research papers, whitepapers, PDFs, technical reports, and academic sources with Firecrawl Research, using semantic paper search, related-paper expansion, and in-body… | firecrawl/ | 116 | — | ~1.8k | Automated safety check: Pass | ISC | yesterday |
| 551 | 551.Firecrawl Search Find web sources with query-relevant page excerpts and optional full-page content, and discover workflows, data APIs, and indexes. | firecrawl/ | 116 | — | ~2.8k | Automated safety check: Pass | ISC | yesterday |
| 552 | Audit a website's SEO with Firecrawl. An agent skill from firecrawl/skills. | firecrawl/ | 116 | — | ~648 | Automated safety check: Pass | ISC | yesterday |
| 553 | 553.Firecrawl Shop Research products across the web with Firecrawl and produce a shopping recommendation or cart-ready summary. | firecrawl/ | 116 | — | ~573 | Automated safety check: Pass | ISC | yesterday |
| 554 | Extract any website's design system into an agent-ready DESIGN.md using Firecrawl scrape evidence. | firecrawl/ | 116 | — | ~1.9k | Automated safety check: Pass | ISC | yesterday |
| 555 | This skill should be used when the user requests to research topics using FireCrawl, enrich notes with web sources, search and scrape information, or write scientific/academic papers. | glebis/ | 389 | — | ~2.2k | Automated safety check: Notes | MIT | 12 days ago |
| 556 | Anti-SEO deep consumer research tool. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~5.9k | Automated safety check: Pass | MIT | 2 mo ago |
| 557 | Create and manage persistent Browserbase cloud browser sessions with authentication persistence. | LeoYeAI/ | 2.2k | — | ~6k | Automated safety check: Pass | MIT | 2 mo ago |
| 558 | LinkedIn integration via Unipile's official Node.js SDK. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~4.1k | Automated safety check: Notes | MIT | 2 mo ago |
| 559 | 559.Data Collection A skill your agent uses when collecting data for a research project, downloading time series, building a dataset, accessing economic or social data APIs, or scraping data from a non-API source. | brycewang-stanford/ | 4.5k | — | ~975 | Automated safety check: Pass | Unknown | 3 days ago |
| 560 | 560.Web Scraping Web scraping and internet search patterns. An agent skill from cohen-liel/hivemind. | cohen-liel/ | 110 | — | ~2k | Automated safety check: Pass | Apache-2.0 | 5 mo ago |
| 561 | A skill your agent uses when scraping public Twitter/X timelines or lists through Nitter-style mirrors with axios and Playwright fallback, including anti-bot challenge handling and pagination limits. | swyxio/ | 175 | — | ~3.5k | Automated safety check: Pass | MIT | 3 days ago |
| 562 | Evaluate YC batch companies for investment — scrapes the YC directory, researches each company and its founders (work history, LinkedIn, website), assesses founder-company fit, and exports to Google… | majiayu000/ | 666 | 2 repos | ~6k | Automated safety check: Pass | MIT | today |
| 563 | Scrape Product Hunt trending products using Apify. An agent skill from majiayu000/claude-skill-registry. | majiayu000/ | 666 | 2 repos | ~421 | Automated safety check: Pass | MIT | today |
| 564 | Guide for implementing Cloudflare Browser Rendering - a headless browser automation API for screenshots, PDFs, web scraping, and testing. | einverne/ | 121 | — | ~4.9k | Automated safety check: Pass | GPL-3.0 | 29 days ago |
| 565 | 565.Web Scraper Browse websites and extract structured information. An agent skill from skrun-dev/skrun. | skrun-dev/ | 210 | — | ~310 | Automated safety check: Pass | MIT | 15 days ago |
| 566 | Cloudflare Browser Rendering with Puppeteer/Playwright. An agent skill from secondsky/claude-skills. | secondsky/ | 227 | — | ~4k | Automated safety check: Pass | MIT | 10 days ago |
| 567 | Run outcome-focused Firecrawl workflows that produce deliverables such as research reports, literature reviews over published papers, SEO audits, QA reports, lead lists, knowledge bases, website… | firecrawl/ | 116 | — | ~1.3k | Automated safety check: Pass | ISC | yesterday |
| 568 | Monitor paste sites like Pastebin and GitHub Gists for leaked credentials, API keys, and sensitive data dumps using automated scraping and keyword matching to detect breaches early. | mukul975/ | 34k | — | ~3.7k | Automated safety check: Warn | Apache-2.0 | 1 mo ago |
| 569 | 569.Jina Extract content from URLs and search with Jina. An agent skill from refly-ai/refly-skills. | refly-ai/ | 204 | — | ~461 | Automated safety check: Pass | No licence | 2 mo ago |
| 570 | 570.Crawlee Expert guide for building web scrapers and crawlers using Crawlee (JavaScript/TypeScript and Python). | LeoYeAI/ | 2.2k | — | ~4.7k | Automated safety check: Pass | MIT | 2 mo ago |
| 571 | 571.Firecrawl Scrape and crawl websites with Firecrawl: scrape a page, start a crawl, check crawl status, map a site, search the web. | Anil-matcha/ | 1.3k | — | ~557 | Automated safety check: Pass | MIT | 3 days ago |
| 572 | Get structured Yandex search results without an official API key using the Apify Yandex Search Scraper Actor (johnvc/Scrape-Yandex). | apify/ | 264 | — | ~2.1k | Automated safety check: Pass | MIT | 16 days ago |
| 573 | Configure CI/CD pipelines for Apify Actor builds and deployments. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | today |
| 574 | Diagnose and fix common Apify Actor and API errors. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~1.3k | Automated safety check: Pass | MIT | today |
| 575 | Build a complete web scraping Actor with Crawlee and deploy to Apify. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | today |
| 576 | Manage Apify datasets, key-value stores, and request queues programmatically, and orchestrate multi-Actor pipelines. | jeremylongshore/ | 2.8k | — | ~1.8k | Automated safety check: Pass | MIT | today |
