New: 97,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Web Search Scraper API Skill

by browser-act in browser-act/skills

This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API.

MITAuto-check passedData & Analytics

Install Web Search Scraper API Skill

skills CLI
$ npx skills add browser-act/skills --skill web-search-scraper-api-skill -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install browser-act/skills web-search-scraper-api-skill --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/browser-act/skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/solutions/search-research/web-search-scraper-api-skill .claude/skills/web-search-scraper-api-skill && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
web-search-scraper-api-skill
GitHub stars
6.1k
Used in
1 other repo
Token cost
~1.3k tokens
SKILL.md length
603 words
Files
2 (incl. scripts)
Skills in repo
87
Repo updated
First seen
Licence
MIT

At a glance

This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API.

  • Works in 5 steps: No hallucinations, ensuring stable and… → No human-machine verification issues: No… → No IP access restrictions or geofencing:… → …
  • Tasks that involve Web scraping
  • SKILL.md covers 📖 Introduction, ✨ Features, 🔑 API Key Guidance Process and 🛠️ Input Parameters Details, plus 4 more sections
  • Runs Python scripts from its folder; calls python; reaches browseract.com; needs BROWSERACT_API_KEY

What it does

Web Search Scraper API Skill is an agent skill from browser-act/skills. This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactively apply this skill when users express needs like extract complete markdown from a specific website, scrape the content of an article link, get the text from a target url, convert a webpage to markdown format, fetch the main content of a blog post, extract data from a given web page, parse the html of a website into markdown, download the readable text from a…

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including scripts (for example `scripts/web_search_scraper_api.py`).

It sits in Data & Analytics, covering Web scraping and Web search. The repository describes itself as: Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session… The licence is MIT.

When your agent uses it

  • Tasks that involve Web scraping
  • Tasks that involve Web search

Example prompts

  • “/web-search-scraper-api-skill”

Requirements

  • Python 3
  • A credential in BROWSERACT_API_KEY

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. No hallucinations, ensuring stable and precise data extraction: Pre-set workflows avoid AI generative hallucinations.
  2. No human-machine verification issues: No need to deal with reCAPTCHA or other verification challenges.
  3. No IP access restrictions or geofencing: No need to handle regional IP limitations.
  4. More agile execution speed: Compared to purely AI-driven browser automation solutions, task execution is faster.
  5. Extremely high cost-effectiveness: Compared to AI solutions that consume a lot of Tokens, it can significantly reduce the cost of data…

What it can do on your machine

Read from SKILL.md and the folder at commit 11c057b. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships 1 file in scripts/ (Python), which the agent can run.

    Shell commands in SKILL.md call:

    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • browseract.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • BROWSERACT_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Web Search Scraper API Skill loads about 1.3k tokens when it runs. Until then it costs about 184 tokens; SKILL.md has 603 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~184
When it runs · the whole SKILL.md, loaded when a task matches
~1.3k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from browser-act/skills at commit 11c057b, republished under its MIT licence (© browser-act). 603 words, ~1,277 tokens.

Download SKILL.mdSave it as .claude/skills/web-search-scraper-api-skill/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
web-search-scraper-api-skill
description
This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should proactively apply this skill when users express needs like extract complete markdown from a specific website, scrape the content of an article link, get the text from a target url, convert a webpage to markdown format, fetch the main content of a blog post, extract data from a given web page, parse the html of a website into markdown, download the readable text from a news article, obtain the content of a tutorial page, extract all the markdown text from any http or https url, scrape documentation from a web link, or grab the text of a single webpage.

Web Search Scraper API Skill

📖 Introduction

This skill provides users with a one-stop web page extraction service through the BrowserAct Web Search Scraper API template. It can directly extract structured markdown content from any given URL. By simply inputting the target URL, you can get clean and usable markdown data.

✨ Features

  1. No hallucinations, ensuring stable and precise data extraction: Pre-set workflows avoid AI generative hallucinations.
  2. No human-machine verification issues: No need to deal with reCAPTCHA or other verification challenges.
  3. No IP access restrictions or geofencing: No need to handle regional IP limitations.
  4. More agile execution speed: Compared to purely AI-driven browser automation solutions, task execution is faster.
  5. Extremely high cost-effectiveness: Compared to AI solutions that consume a lot of Tokens, it can significantly reduce the cost of data acquisition.

🔑 API Key Guidance Process

Before running, you must check the BROWSERACT_API_KEY environment variable. If it is not set, do not take other actions first; you should ask and wait for the user to provide it cooperatively. The Agent must inform the user at this time:

"Since you have not configured the BrowserAct API Key, please go to the BrowserAct Console first to get your Key."

🛠️ Input Parameters Details

Agent should flexibly configure the following parameters based on user needs when calling the script:

  1. target_url
    • Type: string
    • Description: The website URL to extract content from. Supports any HTTP/HTTPS URL.
    • Example: https://www.browseract.com

Agent should execute the following independent script to achieve "one command gets the result":

bash
# Example invocation
python -u ./scripts/web_search_scraper_api.py "target_url"
⏳ Execution Status Monitoring

Since the task involves automated browser operations, it may take a long time (several minutes). The script will continuously output status logs with timestamps (e.g., [14:30:05] Task Status: running) while running. Notice for Agent:

  • While waiting for the script to return results, please keep paying attention to the terminal output.
  • As long as the terminal is still outputting new status logs, it means the task is running normally. Do not misjudge it as a deadlock or unresponsiveness.
  • If the status remains unchanged for a long time or the script stops outputting and no result is returned, the retry mechanism can be triggered.
Show full SKILL.md (246 more words)Show less

📊 Data Output Description

Upon successful execution, the script will directly parse and print the result from the API response. The result contains:

  • content: The complete markdown content of the webpage.

⚠️ Error Handling & Retry Mechanism

During the execution of the script, if an error occurs (such as network fluctuation or task failure), the Agent should follow this logic:

  1. Check the output content:

    • If the output contains "Invalid authorization", it means the API Key is invalid or expired. At this time, do not retry, and you should guide the user to recheck and provide the correct API Key.
    • If the output does not contain "Invalid authorization" but the task execution fails (for example, the output starts with Error: or the returned result is empty), the Agent should automatically try to re-execute the script once.

  2. Retry limit:

    • Automatic retry is limited to once. If the second attempt still fails, stop retrying and report the specific error message to the user.

🌟 Typical Use Cases

  1. Article Extraction: Scrape the main content of a news article link into markdown.
  2. Blog Post Parsing: Download the readable text from a target blog post URL.
  3. Webpage to Markdown: Convert any given website URL into clean markdown format.
  4. Documentation Scraping: Fetch the contents of a tutorial or documentation page for offline reading.
  5. Content Monitoring: Automatically extract the text from a specific webpage for updates.
  6. Data Processing: Parse the HTML of an arbitrary HTTP/HTTPS URL to structure its content.

© browser-act, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (scripts) in solutions/search-research/web-search-scraper-api-skill of browser-act/skills.

  • SKILL.md
  • scripts/web_search_scraper_api.py

Open the folder on GitHubat commit 11c057b

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in browser-act/skills, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Web Search Scraper API Skill next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Web Search Scraper API Skill compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Web Search Scraper API Skill this skillbrowser-act/skills6.1k1 repos~1.3kAutomated safety check: PassMIT
Keirouter Web Fetchmydisha/keirouter147—~741Automated safety check: PassMIT
Deepapidavidondrej/skills4.1k—~2.5kAutomated safety check: PassMIT
Bright Data Best Practicesbrightdata/skills2641 repos~3.6kAutomated safety check: PassMIT
Searchbrightdata/skills264—~1.5kAutomated safety check: PassMIT
Coffee ChatLeoYeAI/openclaw-master-skills2.2k—~6.6kAutomated safety check: PassMIT

Similar skills

  • Keirouter Web Fetch

    mydisha/keirouter

    Fetch URL → markdown / text / HTML via KeiRouter /v1/web/fetch using Firecrawl / Jina Reader / Tavily Extract / Exa Contents.

    147 GitHub stars~741 tokensUpdated 27 days ago
    Data & AnalyticsAuto-check passed

  • Deepapi

    davidondrej/skills

    Use DeepAPI for all web search, deep research, and web scraping (websites, LinkedIn, GitHub, X/Twitter, YouTube, Instagram) instead of built-in search, research, fetch, or browser tools.

    4.1k GitHub stars~2.5k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Bright Data Best Practices

    brightdata/skills

    Build production-ready Bright Data integrations with best practices baked in.

    264 GitHub starsUsed in 1 repo~3.6k tokens
    Data & AnalyticsAuto-check passed

  • Search

    brightdata/skills

    Search the web via the Bright Data CLI — bdata search for Google/Bing/Yandex SERP, bdata discover for intent-ranked semantic results.

    264 GitHub stars~1.5k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Coffee Chat

    LeoYeAI/openclaw-master-skills

    Generate a personalized coffee chat playbook for networking conversations.

    2.2k GitHub stars~6.6k tokensUpdated 2 mo ago
    Data & AnalyticsAuto-check passed

  • Agent Readiness Audit

    indranilbanerjee/digital-marketing-pro

    Audit whether AI agents and AI crawlers can actually use a site — robots.txt rules per AI crawler token (OpenAI, Anthropic and Perplexity bots, Google-Extended, Applebot-Extended)…

    854 GitHub starsUsed in 1 repo~3.9k tokens
    Data & AnalyticsAuto-check passed

More from browser-act/skills

All 87 skills in this repo

  • Amazon ASIN Lookup

    browser-act/skills

    Fetches structured Amazon product details such as title, price, ratings and availability for a given ASIN through BrowserAct's lookup API template.

    6.1k GitHub starsUsed in 2 repos~1.5k tokens
    Auto-check passed

  • Amazon Best Sellers Finder

    browser-act/skills

    Extracts structured Amazon product data for a keyword and marketplace through the BrowserAct API, including titles, prices, ratings, reviews, sales volume and promotions.

    6.1k GitHub starsUsed in 2 repos~1.5k tokens
    Auto-check passed

  • Amazon Buy Box Monitor

    browser-act/skills

    Pulls Amazon product details, competing seller prices and seller ratings for a given ASIN through the BrowserAct API, without browser automation.

    6.1k GitHub starsUsed in 2 repos~1.6k tokens
    Auto-check passed

  • Amazon Listing Competitor Analysis

    browser-act/skills

    Analyzes a competitor's Amazon listing by ASIN with BrowserAct data extraction, then reports what it does well, where the market has gaps and opportunity points for your own listing.

    6.1k GitHub starsUsed in 2 repos~3.2k tokens
    Auto-check passed

  • Amazon Product Search Extractor

    browser-act/skills

    Pulls structured Amazon search results (titles, ASINs, prices, ratings, specifications) for a keyword and brand through BrowserAct's Amazon Product API template.

    6.1k GitHub starsUsed in 2 repos~1.5k tokens
    Auto-check passed

  • Amazon Product Search Extractor

    browser-act/skills

    Collects structured product data from Amazon search results for a keyword and optional brand, using a BrowserAct script, for market and competitor research.

    6.1k GitHub starsUsed in 2 repos~1.6k tokens
    Auto-check passed

Categories

Questions about Web Search Scraper API Skill

What does Web Search Scraper API Skill do?

This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. Web Search Scraper API Skill is an agent skill from browser-act/skills. This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API.

When should I use Web Search Scraper API Skill?

Web Search Scraper API Skill fits situations like: tasks that involve Web scraping; tasks that involve Web search.

How do I install Web Search Scraper API Skill in Claude Code?

Run `npx skills add browser-act/skills --skill web-search-scraper-api-skill -a claude-code`. Or copy the skill folder (solutions/search-research/web-search-scraper-api-skill in browser-act/skills) into .claude/skills/web-search-scraper-api-skill in your project. Claude Code loads it when a task matches its description.

How do I install Web Search Scraper API Skill in Codex?

Run `npx skills add browser-act/skills --skill web-search-scraper-api-skill -a codex`. Or copy the skill folder (solutions/search-research/web-search-scraper-api-skill in browser-act/skills) into .agents/skills/web-search-scraper-api-skill in your project. Codex loads it when a task matches its description.

Can I use Web Search Scraper API Skill in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add browser-act/skills --skill web-search-scraper-api-skill -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/web-search-scraper-api-skill, .gemini/skills/web-search-scraper-api-skill, .github/skills/web-search-scraper-api-skill and .opencode/skills/web-search-scraper-api-skill in your project.

What does Web Search Scraper API Skill need to run?

Going by SKILL.md and its folder, Web Search Scraper API Skill needs Python for the scripts in its folder, the command-line tools its instructions call (python) and credentials named BROWSERACT_API_KEY. Our summary lists: Python 3; A credential in BROWSERACT_API_KEY.

Does Web Search Scraper API Skill access the network?

SKILL.md names 1 domain. In commands or code: browseract.com; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.

Is Web Search Scraper API Skill safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Web Search Scraper API Skill use?

Web Search Scraper API Skill is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Web Search Scraper API Skill use?

About 1.3k tokens (SKILL.md is roughly 5.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Web Search Scraper API Skill?

Skills that share tags, products or a category with Web Search Scraper API Skill: Keirouter Web Fetch (mydisha/keirouter, 147 stars), Deepapi (davidondrej/skills, 4.1k stars), Bright Data Best Practices (brightdata/skills, 264 stars) and Search (brightdata/skills, 264 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Web Search Scraper API Skill?

browser-act (a GitHub organization) maintains it in browser-act/skills, which has 6,108 GitHub stars. The repository holds 87 skills in this directory. The repository was last updated on August 24, 2026.

Source: browser-act/skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.