Web scraping

Exports the article list and original article text from a Tencent ima knowledge base through a logged-in Chrome session, using browser automation.

zj-unicom-ai/UniEmployee

Collect fresh job-posting URLs into ~/.dear-hiring-manager/urls.txt by running an Apify job scraper — the discovery source for /batch.

extrasmall0/dear-hiring-manager

Intelligent web scraper with content extraction, multiple output formats, and error handling

21pounder/terminalAgent

Turn a Zillow listing into a cinematic room-by-room walkthrough video (Apify scrape → Higgsfield image-to-video → ffmpeg stitch) to sell to real estate agents

charlesdove977/re-walkthrough-pro

Use this in the AI blogger crawler project when Douyin daily creator updates should use the Codex Chrome plugin instead of the local web-access CDP proxy to collect creator-page cards, selected…

dragon-hh/ai-boshu-crawler

Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automatically.

oxylabs/agent-skills

Fetch and read any web page, search the web, crawl a site, or pull structured data out of pages.

ScrapingBee/scrapingbee-cli

Read a known webpage or execute a discovered workflow or data-provider capability.

firecrawl/skills

A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

xcrawl-api/xcrawl-skills

Carve guardrail-adjacent items out of scope with safe alternatives before risk-adjacent work starts, then run the safe remainder at full strength in a fresh subagent that only ever sees the carved…

LilMGenius/paperthin

Diagnose and fix a broken scraper mapping. An agent skill from RealEstateWebTools/property_web_scraper.

RealEstateWebTools/property_web_scraper

Guides designing and building an official Apify integration for a company's product: workflow-automation apps, AI agent plugins, AI framework packages or direct API clients.

apify/agent-skills

Generates Python LeetCode practice environments and manages a 307-problem catalog with the lcpy CLI.

wislertt/leetcode-py

Set up a recurring buying-signal detection pipeline that finds companies showing buying intent across three signal types — job postings (hiring for the persona), fundraising events (recent raises)…

apify/awesome-skills

Always-on context compression for Grok Build. An agent skill from Supercompress/Supercompress.

Supercompress/Supercompress

Search ChatGPT and extract the full response + hydration JSON that powers the UI.

SeifBenayed/cloclo

Migrate ad-hoc name cleaning in a crawler to h.reviewnames (Step 1 of the name framework migration).

opensanctions/opensanctions

Plans how to pull data from websites into an exact JSON schema, with separate approaches for single facts, one-entity research, item lists and whole sites.

firecrawl/web-agent

Umbrella skill for a library of website-specific browsing skills. Use when the user's request targets one of these specific websites: <!…

browsing-skills/browsing-skills

MUST USE when investigating performance issues on a ClickHouse-managed Postgres instance.

ClickHouse/agent-skills

Kimi Browser Extension（Kimi 浏览器扩展，原 Kimi WebBridge）lets AI control the user's real browser — navigate, click, type, read, screenshot, and interact with any website using the user's actual login…

mxyhi/ok-skills

Scrape, crawl, and extract data from websites. An agent skill from shobcoder/shob.

shobcoder/shob

Autonomous cold email campaign launcher. An agent skill from growthenginenowoslawski/coldoutboundskills.

growthenginenowoslawski/coldoutboundskills

网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集. An agent skill from charlie-chann/ai-agent-langgraph-main.

charlie-chann/ai-agent-langgraph-main

A skill your agent uses for XCrawl search tasks, including keyword search request design, location and language controls, result analysis, and follow-up crawl or scrape planning.

xcrawl-api/xcrawl-skills

Runs web-page JavaScript without a browser, in a V8 sandbox with a browser-environment shim, for scripts that only probe the environment and compute a result.

taxueseek/argo

Score and enrich a CSV of B2B leads using Apify Actors. An agent skill from apify/awesome-skills.

apify/awesome-skills

Routes every networked task to the lightest channel that reaches it: a direct search, a page fetch, or a persistent browser for logins and dynamic pages.

ZhanlinCui/Agent-Skills-Hunter

Build high-quality literature reviews from a research topic using a 10-phase workflow.

Drchronx/ai-agent-research-starter-kit

This skill helps users automatically scrape business data from Google Maps using the BrowserAct Google Maps API.

browser-act/skills

Rewrite messy or AI-generated crawler code into clean, production-ready style that follows the zavod best practices.

opensanctions/opensanctions

Remote control tmux sessions for interactive CLIs (python, gdb, etc.) by sending keystrokes and scraping pane output.

mitsuhiko/agent-stuff

Deprecated. An agent skill from crafter-station/skills.

crafter-station/skills

A skill your agent uses when a live page needs Chrome DevTools/CDP evidence: network failures, console errors, performance, DOM/CSS actionability, screenshots/PDF, cookies/storage…

bgauryy/octocode

Crawls, maps, and scrapes an entire site through the Firecrawl MCP server for broken-link checks and content inventories.

AgriciDaniel/claude-seo

Autonomously navigate websites and extract structured data across pages.

firecrawl/skills

Run this BEFORE any package install (pip / npm / apt / brew / cargo / gem / go install) you would otherwise execute via the exec tool — including when the user asks for a deliverable that needs…

fastclaw-ai/fastclaw

Guides a policy notification agent through crawling government policy sources, saving them locally, matching them to enterprise profiles and generating notifications.

Serein-81/financial_rag

Triggered when the user asks for page-level interaction with a specific webpage: login, form filling, button clicks, pagination scraping, screenshots, downloading page images, handling CAPTCHAs or…

OpenLoaf/OpenLoaf

A skill for analyzing website anti-bot defense mechanisms and developing legitimate evasion strategies.

revfactory/harness-100

Gate a build on browser fingerprint regressions with liarjs - save a baseline scan as JSON, diff later runs against it, and fail the job when the consistency score falls below a floor.

liarjsdev/liarjs-skills

Find the TikTok photo-mode carousels (slideshows) that actually go viral in a niche and the accounts behind them, rank them by organic quality (save-rate, like-rate, boost detection) instead of raw…

nestyme/awesome-prompts

Scrape blog posts via RSS feeds (free, no API key) with Apify fallback for JS-heavy sites.

gooseworks-ai/goose-skills

Run a complete technical SEO + AI-search audit of a website with crawlie.

spronta/crawlie

Scrape and extract public data from 27+ social media platforms using the ScrapeCreators REST API.

ScrapeCreators/social-media-research-skills

Extract structured data from websites into CSV or JSON. An agent skill from hanzili/hanzi-browse.

hanzili/hanzi-browse

Twitter 推文爬取器 - 指定用户名爬取推文，保存为 Markdown 格式，支持自定义数量和字段. An agent skill from huangserva/servasyy_skills.

huangserva/servasyy_skills

A skill your agent uses when fetching, searching, or analyzing transcripts from Lenny's Podcast, Dwarkesh Podcast, Cheeky Pint, 20VC, or A16z Podcast.

Varnan-Tech/opendirectory