Agent skill

Firecrawl Scraper

Web scraping of JavaScript-rendered scientific websites using Firecrawl API

Apache-2.0Auto-check passedData & Analytics

Install Firecrawl Scraper

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/firecrawl-scraper .claude/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .claude/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/firecrawl-scraper .agents/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .agents/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/firecrawl-scraper .cursor/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .cursor/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/lamm-mit/scienceclaw.git --path skills/firecrawl-scraper

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/firecrawl-scraper .gemini/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .gemini/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/firecrawl-scraper .github/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .github/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install lamm-mit/scienceclaw firecrawl-scraper --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/lamm-mit/scienceclaw.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/firecrawl-scraper .opencode/skills/firecrawl-scraper && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "firecrawl-scraper" agent skill from https://github.com/lamm-mit/scienceclaw/tree/main/skills/firecrawl-scraper into .opencode/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: firecrawl-scraper
GitHub stars: 244
Token cost: ~425 tokens
SKILL.md length: 80 words
Files: 3 (incl. scripts)
Skills in repo: 85
Repo updated: Aug 21, 2026
First seen: Oct 7, 2026
Licence: Apache-2.0

At a glance

Web scraping of JavaScript-rendered scientific websites using Firecrawl API

Tasks that involve Web scraping
SKILL.md covers Overview, Usage, Output Format and Setup
Runs Python scripts from its folder; calls python3; reaches uniprot.org and rcsb.org; needs FIRECRAWL_API_KEY

What it does

Firecrawl Scraper is an agent skill from lamm-mit/scienceclaw. Web scraping of JavaScript-rendered scientific websites using Firecrawl API

Its SKILL.md is about 430 tokens, which your agent loads only when the skill is triggered. The skill folder holds 4 other files, including scripts (for example `scripts/firecrawl_scrape.py`).

It sits in Data & Analytics, covering Web scraping. It works with Firecrawl and JavaScript. The licence is Apache-2.0.

When your agent uses it

Tasks that involve Web scraping

Example prompts

“/firecrawl-scraper”

Requirements

Python 3
A credential in FIRECRAWL_API_KEY

What it can do on your machine

Read from SKILL.md and the folder at commit ab9aba1. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Ships 2 files in scripts/ (Python), which the agent can run.
Shell commands in SKILL.md call:
- python3
From the folder's file list and the shell code blocks in SKILL.md.
Network
Hosts in commands or code, which the agent is likely to contact:
- uniprot.org
- rcsb.org
- biorxiv.org
Also links to:
- firecrawl.dev
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names these keys or tokens, usually read from environment variables:
- FIRECRAWL_API_KEY
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Firecrawl Scraper loads about 425 tokens when it runs. Until then it costs about 23 tokens; SKILL.md has 80 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~23
When it runs · the whole SKILL.md, loaded when a task matches: ~425

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.

SKILL.md

The full file from lamm-mit/scienceclaw at commit ab9aba1, republished under its Apache-2.0 licence (© lamm-mit). 80 words, ~425 tokens.

Download SKILL.mdSave it as .claude/skills/firecrawl-scraper/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.

name: firecrawl-scraper
description: Web scraping of JavaScript-rendered scientific websites using Firecrawl API

Overview

Web scraping using the Firecrawl API for JavaScript-rendered scientific websites, database pages, and literature sources. Returns clean Markdown content optimized for LLM processing. Handles dynamic content, authentication flows, and complex single-page applications that static scrapers cannot access.

Particularly useful for scraping scientific databases with JavaScript-heavy frontends, preprint servers, supplementary data pages, and research institution websites.

Usage

bash

# Scrape a scientific database page as markdown
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py --url "https://www.uniprot.org/uniprotkb/P53_HUMAN"

# Scrape and return raw HTML
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py --url "https://www.rcsb.org/structure/1TUP" --format html

# Use explicit API key
python3 skills/firecrawl-scraper/scripts/firecrawl_scrape.py \
  --url "https://www.biorxiv.org/content/10.1101/2024.01.01.000001" \
  --api-key fc-yourkey123 \
  --format markdown

Output Format

json

{
  "url": "https://www.uniprot.org/uniprotkb/P53_HUMAN",
  "content": "# Cellular tumor antigen p53\n\n**Organism:** Homo sapiens...",
  "format": "markdown",
  "title": "P53_HUMAN - Cellular tumor antigen p53",
  "links": [
    "https://www.uniprot.org/uniprotkb/P04637",
    "https://www.rcsb.org/structure/2OCJ"
  ]
}

Setup

Set your Firecrawl API key as an environment variable:

bash

export FIRECRAWL_API_KEY=fc-yourkey123

Or pass it directly via --api-key. Get a key at https://firecrawl.dev.

Files

SKILL.md and 2 other files (scripts) in skills/firecrawl-scraper of lamm-mit/scienceclaw.

SKILL.md
scripts/__pycache__/firecrawl_scrape.cpython-313.pyc
scripts/firecrawl_scrape.py

Open the folder on GitHubat commit ab9aba1

Compare with similar skills

Firecrawl Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Firecrawl Scraper compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Firecrawl Scraper this skilllamm-mit/scienceclaw	244	—	~425	Automated safety check: Pass	Apache-2.0	1 mo ago
Firecrawl Scraperynulihao/AgentSkillOS	617	1 repos	~4.1k	Automated safety check: Notes	MIT	7 mo ago
Firecrawl Scrapersecondsky/claude-skills	227	1 repos	~1.9k	Automated safety check: Notes	MIT	9 days ago
Firecrawlaiskillstore/marketplace	430	1 repos	~2.6k	Automated safety check: Pass	None	today
Web Scrapingplatonai/Browser4	1.2k	—	~1.1k	Automated safety check: Pass	Apache-2.0	today
Selenium Opinion Crawler123321kk/opinion-agent-ultimate	107	—	~631	Automated safety check: Pass	None	6 mo ago

Similar skills

Firecrawl Scraper
ynulihao/AgentSkillOS
Complete knowledge domain for Firecrawl v2 API - web scraping and crawling that converts websites into LLM-ready markdown or structured data.
617 GitHub starsUsed in 1 repo~4.1k tokens
Data & AnalyticsAuto-check: notes
Firecrawl Scraper
secondsky/claude-skills
Firecrawl v2.5 API for web scraping/crawling to LLM-ready markdown.
227 GitHub starsUsed in 1 repo~1.9k tokens
Data & AnalyticsAuto-check: notes
Firecrawl
aiskillstore/marketplace
Firecrawl handles all web operations with superior accuracy, speed, and LLM-optimized output.
430 GitHub starsUsed in 1 repo~2.6k tokens
Data & AnalyticsAuto-check passed
Web Scraping
platonai/Browser4
Extracts data from web pages using browser automation and CSS/JavaScript selectors.
1.2k GitHub stars~1.1k tokensUpdated today
Data & AnalyticsAuto-check passed
Selenium Opinion Crawler
123321kk/opinion-agent-ultimate
browser-based page capture and text extraction for public-opinion research.
107 GitHub stars~631 tokensUpdated 6 mo ago
Data & AnalyticsAuto-check passed
Chrome Devtools
einverne/dotfiles
Browser automation, debugging, and performance analysis using Puppeteer CLI scripts.
121 GitHub starsUsed in 1 repo~1.6k tokens
Data & AnalyticsAuto-check: notes

Questions about Firecrawl Scraper

What does Firecrawl Scraper do?

Web scraping of JavaScript-rendered scientific websites using Firecrawl API. Firecrawl Scraper is an agent skill from lamm-mit/scienceclaw.

When should I use Firecrawl Scraper?

Firecrawl Scraper fits situations like: tasks that involve Web scraping.

How do I install Firecrawl Scraper in Claude Code?

Run `npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a claude-code`. Or copy the skill folder (skills/firecrawl-scraper in lamm-mit/scienceclaw) into .claude/skills/firecrawl-scraper in your project. Claude Code loads it when a task matches its description.

How do I install Firecrawl Scraper in Codex?

Run `npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a codex`. Or copy the skill folder (skills/firecrawl-scraper in lamm-mit/scienceclaw) into .agents/skills/firecrawl-scraper in your project. Codex loads it when a task matches its description.

Can I use Firecrawl Scraper in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add lamm-mit/scienceclaw --skill firecrawl-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/firecrawl-scraper, .gemini/skills/firecrawl-scraper, .github/skills/firecrawl-scraper and .opencode/skills/firecrawl-scraper in your project.

What does Firecrawl Scraper need to run?

Going by SKILL.md and its folder, Firecrawl Scraper needs Python for the scripts in its folder, the command-line tools its instructions call (python3) and credentials named FIRECRAWL_API_KEY. Our summary lists: Python 3; A credential in FIRECRAWL_API_KEY.

Does Firecrawl Scraper access the network?

SKILL.md names 4 domains. In commands or code: uniprot.org, rcsb.org and biorxiv.org; the agent is likely to contact these when it follows the instructions. As links in the text: firecrawl.dev. This is read from the text; nothing was executed.

Is Firecrawl Scraper safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.

What licence does Firecrawl Scraper use?

Firecrawl Scraper is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Firecrawl Scraper use?

About 425 tokens (SKILL.md is roughly 1.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Firecrawl Scraper?

Skills that share tags, products or a category with Firecrawl Scraper: Firecrawl Scraper (ynulihao/AgentSkillOS, 617 stars), Firecrawl Scraper (secondsky/claude-skills, 227 stars), Firecrawl (aiskillstore/marketplace, 430 stars) and Web Scraping (platonai/Browser4, 1.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Firecrawl Scraper?

lamm-mit (a GitHub user) maintains it in lamm-mit/scienceclaw, which has 244 GitHub stars. The repository holds 85 skills in this directory. The repository was last updated on August 21, 2026.

Source: lamm-mit/scienceclaw on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Firecrawl Scraper

Install Firecrawl Scraper

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Context cost

Safety

SKILL.md

Overview

Usage

Output Format

Setup

Files

Compare with similar skills

Similar skills