Best web scraping skills, page 4

Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.).

duyet/pricetrack

Builds the printable pamphlet panels that go inside a GOG backup disc case — scrapes the store page, generates the QR badge, writes the per-title JSON and runs buildset.py to emit 483x629 SVG and…

east35/GOG-Disc-Packager

Refactor the title, description and coverage frequency of a legislature/parliament PEP dataset .yml into the house style.

opensanctions/opensanctions

Exports the article list and original article text from a Tencent ima knowledge base through a logged-in Chrome session, using browser automation.

zj-unicom-ai/UniEmployee

Intelligent web scraper with content extraction, multiple output formats, and error handling

21pounder/terminalAgent

Collect fresh job-posting URLs into ~/.dear-hiring-manager/urls.txt by running an Apify job scraper — the discovery source for /batch.

extrasmall0/dear-hiring-manager

Turn a Zillow listing into a cinematic room-by-room walkthrough video (Apify scrape → Higgsfield image-to-video → ffmpeg stitch) to sell to real estate agents

charlesdove977/re-walkthrough-pro

Use this in the AI blogger crawler project when Douyin daily creator updates should use the Codex Chrome plugin instead of the local web-access CDP proxy to collect creator-page cards, selected…

dragon-hh/ai-boshu-crawler

Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automatically.

oxylabs/agent-skills

Fetch and read any web page, search the web, crawl a site, or pull structured data out of pages.

ScrapingBee/scrapingbee-cli

Find leads by scraping engagers from a competitor's top LinkedIn posts.

gooseworks-ai/goose-skills

A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

xcrawl-api/xcrawl-skills

Read a known webpage or execute a discovered workflow or data-provider capability.

firecrawl/skills

Carve guardrail-adjacent items out of scope with safe alternatives before risk-adjacent work starts, then run the safe remainder at full strength in a fresh subagent that only ever sees the carved…

LilMGenius/paperthin

Diagnose and fix a broken scraper mapping. An agent skill from RealEstateWebTools/property_web_scraper.

RealEstateWebTools/property_web_scraper

Generates Python LeetCode practice environments and manages a 307-problem catalog with the lcpy CLI.

wislertt/leetcode-py

Guides designing and building an official Apify integration for a company's product: workflow-automation apps, AI agent plugins, AI framework packages or direct API clients.

apify/agent-skills

Set up a recurring buying-signal detection pipeline that finds companies showing buying intent across three signal types — job postings (hiring for the persona), fundraising events (recent raises)…

apify/awesome-skills

Always-on context compression for Grok Build. An agent skill from Supercompress/Supercompress.

Supercompress/Supercompress

Extracts Airbnb search results - listing id, name, coordinates, rating, price, photos and badges - from the page's own embedded search data, with pagination.

browser-act/skills

Search ChatGPT and extract the full response + hydration JSON that powers the UI.

SeifBenayed/cloclo

Practical guidance for multi-source web research with Exa, the Firecrawl CLI and Reddit MCP tools: when to search, when to fetch and which tool to prefer.

malob/nix-config

Migrate ad-hoc name cleaning in a crawler to h.reviewnames (Step 1 of the name framework migration).

opensanctions/opensanctions

Plans how to pull data from websites into an exact JSON schema, with separate approaches for single facts, one-entity research, item lists and whole sites.

firecrawl/web-agent

Umbrella skill for a library of website-specific browsing skills. Use when the user's request targets one of these specific websites: <!…

browsing-skills/browsing-skills

MUST USE when investigating performance issues on a ClickHouse-managed Postgres instance.

ClickHouse/agent-skills

Kimi Browser Extension（Kimi 浏览器扩展，原 Kimi WebBridge）lets AI control the user's real browser — navigate, click, type, read, screenshot, and interact with any website using the user's actual login…

mxyhi/ok-skills

Scrape, crawl, and extract data from websites. An agent skill from shobcoder/shob.

shobcoder/shob

Drive Chromium from standard Playwright APIs with a real-device fingerprint applied in the kernel, one persistent isolated profile per identity, and a per-profile proxy whose exit IP sets timezone…

antibrow/anti-detect-browser-skills

Run this BEFORE any package install (pip / npm / apt / brew / cargo / gem / go install) you would otherwise execute via the exec tool — including when the user asks for a deliverable that needs…

fastclaw-ai/fastclaw

Turns your latest successful /scrape run into a permanent browser skill with a script, a test and a fixture, so repeat scrapes run in about 200 ms.

garrytan/gstack

Autonomous cold email campaign launcher. An agent skill from growthenginenowoslawski/coldoutboundskills.

growthenginenowoslawski/coldoutboundskills

网页数据抓取专家。能提取网页正文、表格、列表、特定元素。适用于：竞品监控、价格追踪、结构化数据采集. An agent skill from charlie-chann/ai-agent-langgraph-main.

charlie-chann/ai-agent-langgraph-main

A skill your agent uses for XCrawl search tasks, including keyword search request design, location and language controls, result analysis, and follow-up crawl or scrape planning.

xcrawl-api/xcrawl-skills

Runs web-page JavaScript without a browser, in a V8 sandbox with a browser-environment shim, for scripts that only probe the environment and compute a result.

taxueseek/argo

Score and enrich a CSV of B2B leads using Apify Actors. An agent skill from apify/awesome-skills.

apify/awesome-skills

Routes every networked task to the lightest channel that reaches it: a direct search, a page fetch, or a persistent browser for logins and dynamic pages.

ZhanlinCui/Agent-Skills-Hunter

Build high-quality literature reviews from a research topic using a 10-phase workflow.

Drchronx/ai-agent-research-starter-kit

Audit whether AI agents and AI crawlers can actually use a site — robots.txt rules per AI crawler token (OpenAI, Anthropic and Perplexity bots, Google-Extended, Applebot-Extended)…

indranilbanerjee/digital-marketing-pro

Finds a company's official website and social profiles from its name, or collects social links from a website URL, using BrowserAct templates run by a Python script.

browser-act/skills

Rewrite messy or AI-generated crawler code into clean, production-ready style that follows the zavod best practices.

opensanctions/opensanctions

Remote control tmux sessions for interactive CLIs (python, gdb, etc.) by sending keystrokes and scraping pane output.

mitsuhiko/agent-stuff

Deprecated. An agent skill from crafter-station/skills.

crafter-station/skills

A skill your agent uses when a live page needs Chrome DevTools/CDP evidence: network failures, console errors, performance, DOM/CSS actionability, screenshots/PDF, cookies/storage…

bgauryy/octocode

Run the same scrape or task across many accounts at once - each in its own browser profile with its own fingerprint, cookies and exit IP - and read data from sites that need a session or that answer…

antibrow/anti-detect-browser-skills

A skill your agent uses when improving internal link structure, anchor text, orphan pages, crawl depth, site architecture, or link equity flow.

ViryaZheng/recomby-geo

Crawls, maps, and scrapes an entire site through the Firecrawl MCP server for broken-link checks and content inventories.

AgriciDaniel/claude-seo

Autonomously navigate websites and extract structured data across pages.

firecrawl/skills