Web scraping

Gets Firecrawl working in a project: signs you in through the browser, saves FIRECRAWL_API_KEY to .env and picks the first SDK or REST path.

firecrawl/firecrawl

Routes every web task, from searching to logged-in browsing, through a tiered choice of search, fetch, curl or a real Chrome or Edge session driven over CDP.

eze-is/web-access

Automates a real browser through short TypeScript scripts that keep page state between runs, for navigating, filling forms, taking screenshots and extracting data.

MemTensor/MemOS

Routes web research and platform lookups across 16 sites, including Twitter, Reddit, YouTube, Bilibili, Xiaohongshu and GitHub, through one command-line tool.

Panniantong/Agent-Reach

Adds Firecrawl's /scrape endpoint to application code to pull markdown, HTML, links, screenshots or structured data from a single known URL.

firecrawl/firecrawl

Walks through writing an OpenCLI adapter for a new site or a new command on an existing one, from first recon and field decoding to coding and verification.

jackwener/OpenCLI

Adds web search, scraping, structured extraction and browser interaction to application code using Firecrawl's scrape, search and interact endpoints.

firecrawl/firecrawl

Picks the right Skyvern CLI command for a web task, from quick yes/no checks to reusable multi-page workflows, instead of falling back to plain page fetching.

Skyvern-AI/skyvern

Guides adding Firecrawl's /interact endpoint to product code for pages that need clicks, forms, pagination or logged-in flows beyond plain scraping.

firecrawl/firecrawl

Remote-control tmux sessions for interactive CLIs by sending keystrokes and scraping pane output.

trpc-group/trpc-agent-go

Drives a real Chrome window through the opencli CLI to inspect pages, fill forms, click through logged-in flows and extract data from structured command responses.

jackwener/OpenCLI

Drives headless Chrome through Cloudflare Browser Rendering over a CDP WebSocket to take screenshots, navigate and scrape pages, and record multi-page videos.

cloudflare/moltworker

Drives a real browser through the omowright library, either the user's own signed-in browser or a separate browser the code launches, for forms, QA, screenshots and scraping.

code-yeongyu/oh-my-openagent

Guidance for adding Firecrawl's /search endpoint to product code and agent workflows when a feature starts from a query rather than a URL.

firecrawl/firecrawl

Core usage guide for the agent-browser CLI: the snapshot-and-ref workflow for navigating, clicking, filling forms, extracting data and running parallel sessions.

vercel-labs/agent-browser

Browser automation with persistent named pages via the dev-browser CLI. Use when users ask to navigate websites, fill forms, take screenshots…

SawyerHood/dev-browser

Controls a real Chrome browser over CDP for clicking, typing, navigation, logged-in sessions and JavaScript-heavy or bot-protected pages.

browser-use/browser-harness

Detects the type of a knowledge source and uses the Skill Seekers MCP tools to turn docs, repos, PDFs or videos into packaged AI skills.

yusufkaraaslan/Skill_Seekers

Drives a web browser from the shell with the agent-browser CLI: open pages, read an element snapshot, click and fill by reference, grab text and screenshots.

nanocoai/nanoclaw

How to scan a job source through an Apify actor as a keyed provider.

career-ops-hq/career-ops

Fetches structured Amazon product details such as title, price, ratings and availability for a given ASIN through BrowserAct's lookup API template.

browser-act/skills

Drives a real browser from the shell with the agent-browser CLI: open pages, snapshot elements by ref, click, fill and extract, for testing web flows.

slopus/happy

Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but…

1broseidon/ketch

Extract structured data from websites and produce an executable Playwright script plus extracted data.

actionbook/actionbook

Kimi Browser Extension（Kimi 浏览器扩展，原 Kimi WebBridge）lets AI control the user's real browser — navigate, click, type, read, screenshot, and interact with any website using the user's actual login…

MoonshotAI/kimi-code

Controls a browser through BrowserWing's local HTTP API: navigation, clicks, typing, data extraction, accessibility snapshots, screenshots and batch operations.

MemTensor/MemOS

Drives your real, logged-in Chrome browser from the command line to read pages, fill forms, fetch authenticated URLs and run ready-made site commands.

epiral/bb-browser

Turns a plain request such as finding dentists in a city into a local Google Maps crawl run with Docker, then monitors it and helps you work with the results.

gosom/google-maps-scraper

Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

smallnest/goclaw

Scrape BOSS直聘 (job listing site) via Chrome CDP. An agent skill from eatmoreduck/boss-zhipin-scraper.

eatmoreduck/boss-zhipin-scraper

Automates websites with Skyvern's AI browser agent to fill forms, extract data, download files, log in and run multi-step workflows through SDKs, REST, MCP or a CLI.

Skyvern-AI/skyvern

Use the ax CLI instead of curl + throwaway parsing scripts whenever you fetch a URL, explore an unknown web page, or extract structured data from HTML.

yusukebe/ax

Extracts structured Amazon product data for a keyword and marketplace through the BrowserAct API, including titles, prices, ratings, reviews, sales volume and promotions.

browser-act/skills

Scrape any website into clean markdown or structured JSON. An agent skill from Anakin-Inc/anakin.

Anakin-Inc/anakin

PROACTIVELY use whenever the user needs data outside your training set or requires a live network call — web search, URL scraping, news, social media (any platform), market prices…

chainbase-labs/Agentkey

Guides building Tavily integrations for web search, URL extraction, site crawling and AI-assisted research in Python or JavaScript agent and RAG projects.

andrewyng/context-hub

Fetches Reddit posts, threads and search results as JSON through a browser session, using a DuckDuckGo redirect to get past Reddit's automated-access block.

ykdojo/claude-code-tips

Finds new job postings that match your profile through installed portal-search CLIs, dedupes against past runs and your application tracker, and rates each one's fit.

MadsLorentzen/ai-job-search

A skill your agent uses when helping a Chinese job seeker, especially students, interns, or early-career users, prepare job applications with an agent without fabricating experience, auto-submitting…

GresonKwan/JobOK

Live SEO data via DataForSEO MCP server. An agent skill from AgriciDaniel/codex-seo.

AgriciDaniel/codex-seo

When the user wants to research, profile, or analyze competitors from their URLs.

Nexus-JPF/note-companion

Browser automation platform with 78 built-in scripts and full CLI.

browserwing/browserwing

Scrape Google Maps business listings (name, address, phone, website, rating, reviews, lat/lng, hours, emails) via the local gosom google-maps-scraper REST API.

Mahanaicoach/google-maps-scraper-kit

Runs structured data commands against sites such as Twitter, Reddit, GitHub, YouTube and Zhihu through OpenClaw's browser, reusing your existing login state.

epiral/bb-browser

Implement web page content extraction capabilities using the z-ai-web-dev-sdk.

jjyaoao/HelloAgents

Searches WeChat public account articles by keyword through Sogou WeChat Search and returns titles, summaries, dates, source accounts and links.

zjp1997720/wechat-article-search

A skill your agent uses when opening, navigating, inspecting, testing, clicking, typing, filling, screenshotting, or verifying web pages and local HTTP targets (localhost, 127.0.0.1, ::1) inside…

zai-org/ZCode

Multi-engine web search (SearXNG) + browsing/scraping (Camofox, CloakBrowser).

Johell1NS/browser-search