Best web scraping skills, page 2

Multi-engine web search (SearXNG) + browsing/scraping (Camofox, CloakBrowser).

Johell1NS/browser-search

Gate a build on browser fingerprint regressions with liarjs - save a baseline scan as JSON, diff later runs against it, and fail the job when the consistency score falls below a floor.

liarjsdev/liarjs-skills

When the user wants to research, profile, or analyze competitors from their URLs.

Nexus-JPF/note-companion

Access 2,000+ AI models and API tools through one MCP interface for inference, media generation, search, scraping, embeddings, social data, and structured retrieval.

iflytek/skillhub

Direct browser control via CDP. An agent skill from davidondrej/skills.

davidondrej/skills

Execute Python code in a safe sandboxed environment via [inference.sh](https://inference.sh).

cortega26/chile-hub

Analyzes ranking charts from Chinese web novel platforms such as Qidian, Fanqie and Jinjiang to spot market trends and promising genres, with scraper scripts per site.

uu201/character-arc

Official skill for twitterapi.io — query Twitter/X data (tweets, profiles, followers, advanced search, trends, spaces, communities, lists) and perform authenticated actions (post, reply, like…

kaitoInfra/twitterapi-io

使用 scrapling 进行网页抓取和数据提取。根据目标网站特征自动选择最佳 Fetcher， 生成并执行 Python 脚本完成任务。Use when: (1) 抓取/爬取网页内容或数据（scrape, crawl, fetch page, extract data） (2) 需要绕过 Cloudflare/WAF 等反爬保护 (3) 登录后抓取受保护页面 (4) 解析已有 HTML…

Cedriccmh/claude-code-skill-scrapling

Collects structured product data from Amazon search results for a keyword and optional brand, using a BrowserAct script, for market and competitor research.

browser-act/skills

A skill your agent uses when fetching, searching, or analyzing transcripts from Lenny's Podcast, Dwarkesh Podcast, Cheeky Pint, 20VC, or A16z Podcast.

Varnan-Tech/opendirectory

Query 57 Indonesian government APIs and data sources — BPJPH halal certification, BPOM food safety, OJK financial legality, BPS statistics, BMKG weather/earthquakes, Bank Indonesia exchange rates…

suryast/indonesia-gov-apis

Query Spot/preemptible VM prices, savings and interruption risk across AWS, GCP and Azure with the spotinfo CLI.

alexei-led/spotinfo

Scrape video stats from the Douyin creator center (creator.douyin.com) using AppleScript to automate the user's logged-in Chrome.

TradingAi666/TzFilm-Douyin-Tool

Scaffold a new PEP (Politically Exposed Persons) crawler — members of a parliament, legislature, senate, chamber of deputies, cabinet, judiciary, or an asset-declaration register — from a source URL…

opensanctions/opensanctions

Downloads and manages WeChat official account articles from URLs, an account's history or subscriptions, adding engagement metrics and top comments when a valid session exists.

Moore-developers/moore-wechat-article-downloader

Surveys open Korean government startup and R&D support programs and sorts them by fit with your project, checking eligibility against the original notices.

djfksjd/ir-search

Scrape AI papers published by 28 big tech companies and AI labs in a given date window, with institutional attribution (lead vs.

tigerless-labs/paper-radar

Analyzes ranking-list data from Chinese web novel platforms to spot repeating genres, title patterns and opening hooks, then writes a market report for authors.

zenstory-ai/oh-story-claudecode

Connects to Oxylabs remote agent browsers over the Chrome DevTools Protocol (CDP) with Playwright or Puppeteer.

oxylabs/agent-skills

Install, authenticate, configure, operate, and troubleshoot the external MediaCrawler client shared by Douyin, Kuaishou, Bilibili, Weibo, Tieba, and Zhihu collectors.

tsingyuai/growth-lab

Browse websites, read web pages, interact with web apps, call website APIs, and automate web tasks.

4ier/neo

Drive a signed-in Chrome / Brave / Safari session via the interceptor CLI: open/read pages, click, type, inspect DOM/text/network, automate rich browser editors and scene graphs, capture…

Hacker-Valley-Media/Interceptor

Generate beautiful, on-brand HTML — presentation decks or full responsive websites — in any brand's design language, combining brand DNA extracted via Firecrawl with codified, research-backed design…

ItsssssJack/power-design

Conduct deep OSINT research on individuals. An agent skill from smixs/osint-skill.

smixs/osint-skill

Enter a friendly OpenSEO coach mode that explains workflows, recommends next steps, and helps users use agents, web search, scraping, and MCP data effectively.

petera2c/simple-table

Pulls structured Amazon product reviews for an ASIN through BrowserAct's Amazon Reviews API, with no Amazon login, using a bundled Python script.

browser-act/skills

Extracts data from web pages using browser automation and CSS/JavaScript selectors.

platonai/Browser4

Your For You page for content creators. An agent skill from bradautomates/content-ideas.

bradautomates/content-ideas

Anti-detection browser automation for AI agents. An agent skill from redf0x1/camofox-browser.

redf0x1/camofox-browser

Compares two or more products or companies on pricing, features and positioning by scraping their sites, and returns a normalized JSON matrix.

firecrawl/web-agent

Searches and fetches pages through a real logged-in Chromium session when ordinary API or HTML retrieval cannot get past login walls, scripts or anti-bot checks.

taxueseek/argo

Activate when the user needs to interact with any website — browser automation, web scraping, screenshots, form filling, UI testing, monitoring, or building AI agents.

actionbook/actionbook

browser-based page capture and text extraction for public-opinion research.

123321kk/opinion-agent-ultimate

Generate, revise, translate, and manage App Store / Google Play marketing screenshots.

hypersocialinc/shots

Generate working code that routes HTTP requests through Bright Data proxy networks (Datacenter, ISP, Residential, Mobile) and help users decide which network and IP pool type to use (shared pool…

brightdata/skills

Browser automation, debugging, and performance analysis using Puppeteer CLI scripts.

einverne/dotfiles

DEFAULT search skill for OpenClaw. An agent skill from skernelx/MySearch-Proxy.

skernelx/MySearch-Proxy

Manage cloud development sandboxes with cmux. An agent skill from manaflow-ai/manaflow.

manaflow-ai/manaflow

Oxylabs proxy networks: Residential, Mobile, shared Datacenter/ISP, and Dedicated Datacenter/ISP proxies with geo-targeting, IP rotation, session persistence, and port-based sticky IPs.

oxylabs/agent-skills

Use this skill as the default XCrawl entry point for direct XCrawl requests, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

xcrawl-api/xcrawl-skills

用 DrissionPage 爬取 BOSS 直聘职位，解析简历，用规则打分 + LLM 语义分析做岗位匹配，生成 HTML 可视化报告，自动投递匹配岗位，并启动内嵌的 Markdown 简历编辑器（ShowCV）。当用户想搜索 BOSS 直聘职位、上传简历做岗位匹配、生成岗位匹配报告、自动投递匹配岗位、针对特定 JD 优化简历，或打开简历编辑器写/改简历（"打开简历编辑器"、"启动…

zhansan379/boss-crawler-skill

Fetch a URL directly with scrapling's bot-detection bypass. An agent skill from cyberchitta/scrapling-fetch-mcp.

cyberchitta/scrapling-fetch-mcp

Native Rust browser automation CLI for AI agents. An agent skill from gsd-build/gsd-browser.

gsd-build/gsd-browser

智能读取任意URL内容，支持微信公众号、小红书、今日头条、抖音、淘宝、天猫、京东、百度等中国主流平台，自动识别平台类型并提取核心内容。自动保存内容为Markdown，下载图片到本地。

yhslgg-arch/url-reader

Audit websites for Google AdSense application readiness and ad-serving compliance.

yantoumu/adsense-site-auditor-skill

Fetches a web page through a 9Router server's web fetch endpoint and returns it as markdown, plain text or HTML, using one of several extraction providers.

decolua/9router

Iteratively improves cookie-popup button regex patterns in button-patterns.js against labelled-button-texts.csv.

duckduckgo/tracker-radar-collector