Best web scraping skills, page 5

Wire an AI agent to live e-commerce product data using Apify's E-commerce Scraping Tool over MCP, either as runtime tool calls or as a scheduled refresh into a vector store.

apify/awesome-skills

Guides a policy notification agent through crawling government policy sources, saving them locally, matching them to enterprise profiles and generating notifications.

Serein-81/financial_rag

Triggered when the user asks for page-level interaction with a specific webpage: login, form filling, button clicks, pagination scraping, screenshots, downloading page images, handling CAPTCHAs or…

OpenLoaf/OpenLoaf

A skill for analyzing website anti-bot defense mechanisms and developing legitimate evasion strategies.

revfactory/harness-100

Find the TikTok photo-mode carousels (slideshows) that actually go viral in a niche and the accounts behind them, rank them by organic quality (save-rate, like-rate, boost detection) instead of raw…

nestyme/awesome-prompts

Run a complete technical SEO + AI-search audit of a website with crawlie.

spronta/crawlie

Extract structured data from websites into CSV or JSON. An agent skill from hanzili/hanzi-browse.

hanzili/hanzi-browse

Twitter 推文爬取器 - 指定用户名爬取推文，保存为 Markdown 格式，支持自定义数量和字段. An agent skill from huangserva/servasyy_skills.

huangserva/servasyy_skills

Searches Douyin (douyin.com) for videos by keyword and returns structured video data including author info, stats, cover, description, hashtags, and download URL.

browser-act/skills

Design and validate safe source connector manifests for public graduate-admission, policy, advisor, lab, and community sources.

Bubble252/offer-harvester

Remote control tmux sessions for interactive CLIs (python, gdb, etc.) by sending keystrokes and scraping pane output.

archibate/dotfiles-opencode

Fetch, search, and summarize financial news articles via the local scraper service (~/dev/scraper) at http://127.0.0.1:8089.

9600dev/mmr

A skill your agent uses when the user says "enrich people who engaged with this post", "qualify post engagers with FullEnrich", "scrape and enrich LinkedIn post {URL}", "engagers from this post into…

Othmane-Khadri/YALC-the-GTM-operating-system

Extract structured company lists from directories with Firecrawl.

firecrawl/skills

基于 CDP 原生 WebSocket 抓取牛客网面经文章。当用户说"抓牛客"、"爬牛客面经"、"nowcoder 抓取"、"抓取面经列表"时触发。通过 Chrome 调试端口直接连接已登录的浏览器会话，支持首页、话题、搜索分页和详情全文抓取，输出 Markdown。

ranxi2001/zero2Agent

当你需要开发/排查 HTTP 抓取、SSRF、Playwright 受控浏览器、本地字体增强截图，或判断 webfetch 与 browser 工作流如何选型时使用。

xrkseek/XRK-AGT

Track which of your LinkedIn comments earned author replies.

sergebulaev/linkedin-skills

Complete guide to Prometheus setup, metric collection, scrape configuration, and recording rules.

davila7/claude-code-templates

Reverse-engineer what a company is building by scraping their job postings, careers page, LinkedIn Jobs, and engineering blog using TinyFish web agents.

tinyfish-io/tinyfish-cookbook

Find ICP-fit leads from KOL audiences on LinkedIn. An agent skill from gooseworks-ai/goose-skills.

gooseworks-ai/goose-skills

A skill your agent uses when a user provides DeepSeek web AI-search keywords, repeat count, target entity, and entity type, then needs repeated fresh-window crawls aggregated into JSON plus a Kami…

yaojingang/yao-geo-skills

用 AutoCLI 二进制驱动用户已登录的 Chrome 抓取 Twitter/X、知乎、Bilibili、Reddit 等 55+ 站点

ChanningLua/prax-agent

Decision layer for researching social posts and trends that ranks discovery results and enforces a privacy screen before any identifying data leaves the local session.

kerpopule/hermes-jev-skills

Compress bulky coding-agent context (tool dumps, logs, diffs, files, scrapes) before it burns tokens.

Supercompress/Supercompress

Scrapes the Hacker News front page and returns the top 30 stories as JSON with rank, title, link, points and comment count.

garrytan/gstack

Extracts data from a web page through the Aside browser, using your real signed-in sessions, and returns one JSON document without changing anything.

garrytan/gstack

Run a quick extraction test against a URL or HTML file. An agent skill from RealEstateWebTools/property_web_scraper.

RealEstateWebTools/property_web_scraper

Use kuri-server to automate Chrome via HTTP API — navigate pages, get a11y snapshots, interact with elements, capture network traffic (HAR), extract cookies, and bypass bot protection.

justrach/kuri

Run, diagnose, and validate local recruitment crawler operations.

849879772/recruitops-agent

Conduct a local Publisher evaluation loop in five steps: scrape/run, eval, diagnose, improve, checkpoint.

malloydata/publisher

Extracts full detail data from a single Goofish (闲鱼/xianyu, goofish.com) second-hand item page.

browser-act/skills

Scrapes second-hand item search results from Goofish (闲鱼/xianyu, goofish.com) — China's largest second-hand marketplace.

browser-act/skills

This skill helps users automatically scrape business data from Google Maps using the BrowserAct Google Maps API.

browser-act/skills

Extracts business contact details from Google Maps search results and place detail pages, then visits each business website to collect emails, phone numbers, and social media profiles (Facebook…

browser-act/skills

Search Taobao and Tmall product listings by keyword, returning paginated product cards with title, price, shop, image, sales, and tags.

browser-act/skills

Browse a Taobao or Tmall shop's product catalog by shopId, returning paginated product listings with itemId and title.

browser-act/skills

This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API.

browser-act/skills

This skill helps users extract full article contents from WeChat using the BrowserAct API.

browser-act/skills

This skill helps users automatically extract detailed video metrics and channel information from YouTube based on keyword searches using the BrowserAct API.

browser-act/skills

This skill helps users automatically extract YouTube video transcripts and metadata in batch via the BrowserAct API.

browser-act/skills

This skill helps users extract structured video list data and comment data from YouTube using the BrowserAct API.

browser-act/skills

This skill helps users automatically extract YouTube video transcripts and metadata via the BrowserAct API.

browser-act/skills

This skill helps users automatically extract channel-level and video detail data from a specific YouTube channel via BrowserAct API.

browser-act/skills

Fix mypy --strict type errors in crawler files. An agent skill from opensanctions/opensanctions.

opensanctions/opensanctions

A skill your agent uses when working with UnifAPI public-data APIs or the UnifAPI MCP server: connecting OAuth MCP clients, discovering operations, calling social/search/scrape/news APIs…

unifapi-agent/agents

A skill your agent uses when extracting or mapping public web content into a local cited corpus: scrape or crawl a URL/docs site, pull tables/pricing/product fields, diagnose blocked or thin pages…

bgauryy/octocode

A skill your agent uses when the user says "enrich this LinkedIn event", "enrich attendees of this event", "enrich this attendees CSV", "scrape and enrich LinkedIn event {URL}", "FullEnrich event…

Othmane-Khadri/YALC-the-GTM-operating-system

Monitor competitor pricing, features, changelogs, dashboards, and product changes with Firecrawl.

firecrawl/skills