Search
Web scraping
Skills
Sort:BestMost starsTrending todayTrending this weekTrending this monthNewestRecently updatedName
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 529 | Browser automation - control browser sessions, scrape pages, and run AI agents | gooseworks-ai/ | 1.2k | 1 repo | ~2.5k | Automated safety check: Pass | MIT | 2 days ago |
| 530 | Extract structured data from web pages using AI. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~1.9k | Automated safety check: Pass | MIT | 2 days ago |
| 531 | Generate a personal voice guide for X (Twitter) and/or LinkedIn by scanning a user's past posts and iteratively refining with sample-and-feedback loops. | gooseworks-ai/ | 1.2k | 1 repo | ~2.1k | Automated safety check: Pass | MIT | 2 days ago |
| 532 | Get Instagram profiles, posts, and reels. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~584 | Automated safety check: Pass | MIT | 2 days ago |
| 533 | Research LinkedIn profiles and write personalized messages for any LinkedIn message type — connection requests, InMails, DMs, message requests, post comments, and comment replies. | gooseworks-ai/ | 1.2k | 1 repo | ~3.4k | Automated safety check: Notes | MIT | 2 days ago |
| 534 | 534.Linkedin Scraper Get LinkedIn profiles, company pages, and posts. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~640 | Automated safety check: Pass | MIT | 2 days ago |
| 535 | Comprehensive SEO footprint analysis. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~2.8k | Automated safety check: Pass | MIT | 2 days ago |
| 536 | Web scraping with structured data extraction - define your output schema | gooseworks-ai/ | 1.2k | 1 repo | ~1.5k | Automated safety check: Pass | MIT | 2 days ago |
| 537 | Monitor Twitter/X, Reddit, LinkedIn, and Hacker News for trending narratives, viral posts, and hot-button topics in your space. | gooseworks-ai/ | 1.2k | 1 repo | ~2.5k | Automated safety check: Pass | MIT | 2 days ago |
| 538 | Web scraping, crawling, and AI-powered answer extraction at scale | gooseworks-ai/ | 1.2k | 1 repo | ~3.1k | Automated safety check: Pass | MIT | 2 days ago |
| 539 | 539.Competitor Intel Competitor intelligence system. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~1.8k | Automated safety check: Pass | MIT | 2 days ago |
| 540 | Set up and run ongoing competitive intelligence monitoring for a client. | gooseworks-ai/ | 1.2k | 1 repo | ~995 | Automated safety check: Pass | MIT | 2 days ago |
| 541 | 541.Industry Scanner Daily industry intelligence scanner. An agent skill from gooseworks-ai/goose-skills. | gooseworks-ai/ | 1.2k | 1 repo | ~3.6k | Automated safety check: Pass | MIT | 2 days ago |
| 542 | Aggregate customer feedback from multiple sources — support tickets, NPS comments, Slack messages, G2 reviews, call transcripts, survey responses — into a unified VoC report with theme clustering… | gooseworks-ai/ | 1.2k | 1 repo | ~2.4k | Automated safety check: Pass | MIT | 2 days ago |
| 543 | What to do when a tool fails, an API hits a rate limit, or a site blocks scraping. | borski/ | 688 | — | ~1.6k | Automated safety check: Pass | MIT | 6 days ago |
| 544 | 544.Post Engagers Extract people who engage (comment, react, repost) on a LinkedIn post, enrich their profile / email / company data, and land them in a local SQLite CRM (content.db → crm.db) as the source of truth. | extruct-ai/ | 109 | — | ~2k | Automated safety check: Pass | No licence | 13 days ago |
| 545 | 公众号搜索爬虫 — 通过关键词搜索微信公众号文章，终端表格展示（标题/作者/阅读/点赞/分享/收藏/发布时间/文章链接），自动导出 CSV 并生成交互式 HTML 报告。当用户需要搜索、爬取或浏览公众号文章时使用；也适用于行业热点追踪、竞品内容分析、素材灵感搜集等场景。 | redfox-data/ | 427 | — | ~845 | Automated safety check: Pass | No licence | yesterday |
| 546 | 546.Twitter X Hub Skill for reading and writing Twitter/X data with Python + UV, with zero third-party dependencies (pure standard library), by directly passing the authtoken + ct0 cookies for authentication. | OpenMinis/ | 446 | — | ~2.9k | Automated safety check: Pass | MIT | 3 days ago |
| 547 | 547.Xiaohongshu Hub Skill for reading and writing Xiaohongshu (XHS) data using Python + UV. | OpenMinis/ | 446 | — | ~2.7k | Automated safety check: Pass | MIT | 3 days ago |
| 548 | Produce pre-meeting lead intelligence briefs with Firecrawl. | firecrawl/ | 117 | — | ~580 | Automated safety check: Pass | ISC | 3 days ago |
| 549 | Extract market, financial, earnings, industry, and company metrics with Firecrawl. | firecrawl/ | 117 | — | ~559 | Automated safety check: Pass | ISC | 3 days ago |
| 550 | Alert by webhook/email on web changes — use for "monitor/watch/track/alert me when": recurring checks on known URLs (prefer over repeated one-off scrapes) or web-wide watches for new results… | firecrawl/ | 117 | — | ~1.4k | Automated safety check: Pass | ISC | 3 days ago |
| 551 | 551.Firecrawl QA QA test a live website with Firecrawl browser and scrape evidence. | firecrawl/ | 117 | — | ~587 | Automated safety check: Pass | ISC | 3 days ago |
| 552 | Find and synthesize research papers, whitepapers, PDFs, technical reports, and academic sources with Firecrawl Research, using semantic paper search, related-paper expansion, and in-body… | firecrawl/ | 117 | — | ~1.8k | Automated safety check: Pass | ISC | 3 days ago |
| 553 | 553.Firecrawl Search Find web sources with query-relevant page excerpts and optional full-page content, and discover workflows, data APIs, and indexes. | firecrawl/ | 117 | — | ~3k | Automated safety check: Pass | ISC | 3 days ago |
| 554 | Audit a website's SEO with Firecrawl. An agent skill from firecrawl/skills. | firecrawl/ | 117 | — | ~648 | Automated safety check: Pass | ISC | 3 days ago |
| 555 | 555.Firecrawl Shop Research products across the web with Firecrawl and produce a shopping recommendation or cart-ready summary. | firecrawl/ | 117 | — | ~573 | Automated safety check: Pass | ISC | 3 days ago |
| 556 | Extract any website's design system into an agent-ready DESIGN.md using Firecrawl scrape evidence. | firecrawl/ | 117 | — | ~1.9k | Automated safety check: Pass | ISC | 3 days ago |
| 557 | This skill should be used when the user requests to research topics using FireCrawl, enrich notes with web sources, search and scrape information, or write scientific/academic papers. | glebis/ | 391 | — | ~2.2k | Automated safety check: Notes | MIT | 3 days ago |
| 558 | 558.Reddit 2 Read and search Reddit posts via web scraping of old.reddit.com. | sundial-org/ | 663 | — | ~734 | Automated safety check: Pass | No licence | 7 mo ago |
| 559 | Analyze competitor strategies, content, pricing, ads, and market positioning across Google Maps, Booking.com, Facebook, Instagram, YouTube, and TikTok. | aAAaqwq/ | 105 | 3 repos | ~1.3k | Automated safety check: Notes | MIT | 3 days ago |
| 560 | Anti-SEO deep consumer research tool. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~5.9k | Automated safety check: Pass | MIT | 2 mo ago |
| 561 | Create and manage persistent Browserbase cloud browser sessions with authentication persistence. | LeoYeAI/ | 2.2k | — | ~6k | Automated safety check: Pass | MIT | 2 mo ago |
| 562 | LinkedIn integration via Unipile's official Node.js SDK. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~4.1k | Automated safety check: Notes | MIT | 2 mo ago |
| 563 | 563.Data Collection A skill your agent uses when collecting data for a research project, downloading time series, building a dataset, accessing economic or social data APIs, or scraping data from a non-API source. | brycewang-stanford/ | 4.6k | — | ~975 | Automated safety check: Pass | Unknown | 6 days ago |
| 564 | 564.Web Scraping Web scraping and internet search patterns. An agent skill from cohen-liel/hivemind. | cohen-liel/ | 110 | — | ~2k | Automated safety check: Pass | Apache-2.0 | 5 mo ago |
| 565 | A skill your agent uses when scraping public Twitter/X timelines or lists through Nitter-style mirrors with axios and Playwright fallback, including anti-bot challenge handling and pagination limits. | swyxio/ | 176 | — | ~3.5k | Automated safety check: Pass | MIT | 6 days ago |
| 566 | 566.Web Scraper Browse websites and extract structured information. An agent skill from skrun-dev/skrun. | skrun-dev/ | 210 | — | ~310 | Automated safety check: Pass | MIT | 18 days ago |
| 567 | Run outcome-focused Firecrawl workflows that produce deliverables such as research reports, literature reviews over published papers, SEO audits, QA reports, lead lists, knowledge bases, website… | firecrawl/ | 117 | — | ~1.3k | Automated safety check: Pass | ISC | 3 days ago |
| 568 | Cloudflare Browser Rendering with Puppeteer/Playwright. An agent skill from secondsky/claude-skills. | secondsky/ | 227 | — | ~4k | Automated safety check: Pass | MIT | 13 days ago |
| 569 | Monitor paste sites like Pastebin and GitHub Gists for leaked credentials, API keys, and sensitive data dumps using automated scraping and keyword matching to detect breaches early. | mukul975/ | 34k | — | ~3.7k | Automated safety check: Warn | Apache-2.0 | 1 mo ago |
| 570 | 570.Jina Extract content from URLs and search with Jina. An agent skill from refly-ai/refly-skills. | refly-ai/ | 204 | — | ~461 | Automated safety check: Pass | No licence | 2 mo ago |
| 571 | 571.Crawlee Expert guide for building web scrapers and crawlers using Crawlee (JavaScript/TypeScript and Python). | LeoYeAI/ | 2.2k | — | ~4.7k | Automated safety check: Pass | MIT | 2 mo ago |
| 572 | 572.Firecrawl Scrape and crawl websites with Firecrawl: scrape a page, start a crawl, check crawl status, map a site, search the web. | Anil-matcha/ | 1.3k | — | ~557 | Automated safety check: Pass | MIT | 6 days ago |
| 573 | Get structured Yandex search results without an official API key using the Apify Yandex Search Scraper Actor (johnvc/Scrape-Yandex). | apify/ | 266 | — | ~2.1k | Automated safety check: Pass | MIT | 19 days ago |
| 574 | Configure CI/CD pipelines for Apify Actor builds and deployments. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | yesterday |
| 575 | Diagnose and fix common Apify Actor and API errors. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~1.3k | Automated safety check: Pass | MIT | yesterday |
| 576 | Build a complete web scraping Actor with Crawlee and deploy to Apify. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | yesterday |
