Firecrawl Scraper
ynulihao/AgentSkillOS
Complete knowledge domain for Firecrawl v2 API - web scraping and crawling that converts websites into LLM-ready markdown or structured data.
Firecrawl v2.5 API for web scraping/crawling to LLM-ready markdown.
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install secondsky/claude-skills firecrawl-scraper --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .claude/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .claude/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraperType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install secondsky/claude-skills firecrawl-scraper --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .agents/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .agents/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install secondsky/claude-skills firecrawl-scraper --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .cursor/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .cursor/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/secondsky/claude-skills.git --path plugins/firecrawl-scraper/skills/firecrawl-scraper--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install secondsky/claude-skills firecrawl-scraper --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .gemini/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .gemini/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install secondsky/claude-skills firecrawl-scraperInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .github/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .github/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add secondsky/claude-skills --skill firecrawl-scraper -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install secondsky/claude-skills firecrawl-scraper --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/secondsky/claude-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/plugins/firecrawl-scraper/skills/firecrawl-scraper .opencode/skills/firecrawl-scraper && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "firecrawl-scraper" agent skill from https://github.com/secondsky/claude-skills/tree/main/plugins/firecrawl-scraper/skills/firecrawl-scraper into .opencode/skills/firecrawl-scraper/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "firecrawl-scraper", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
firecrawl-scraperFirecrawl v2.5 API for web scraping/crawling to LLM-ready markdown.
Firecrawl Scraper is an agent skill from secondsky/claude-skills. Firecrawl v2.5 API for web scraping/crawling to LLM-ready markdown. Use for site extraction, dynamic content, or encountering JavaScript rendering, bot detection, content loading errors.
Its SKILL.md is about 1.9k tokens, which your agent loads only when the skill is triggered. The skill folder holds 8 other files, including reference files (for example `references/common-patterns.md`, `references/endpoints.md` and `templates/firecrawl-crawl-example.py`).
It sits in Data & Analytics, covering Web scraping. It works with Firecrawl and JavaScript. The repository describes itself as: Production-ready skills for Claude Code CLI - Cloudflare, React, Tailwind v4, and AI integrations. The licence is MIT.
4 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit 8837836. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Ships script files (Python and TypeScript), which the agent can run.
Shell commands in SKILL.md call:
pipbunFrom the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
api.firecrawl.devAlso links to:
docs.firecrawl.devfirecrawl.devgithub.comFrom URLs in SKILL.md, links to its own repository left out.
Names these keys or tokens, usually read from environment variables:
FIRECRAWL_API_KEYFrom names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Firecrawl Scraper loads about 1.9k tokens when it runs, and up to ~9k if it reads all its reference files. Until then it costs about 51 tokens; SKILL.md has 586 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check noted patterns worth knowing about, such as sudo or a known installer.
# .env file# .env.local (for local development)Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from secondsky/claude-skills at commit 8837836, republished under its MIT licence (© secondsky). 586 words, ~1,865 tokens.
.claude/skills/firecrawl-scraper/SKILL.md (or your agent's skills folder). This skill also uses 6 other files; get the full folder from GitHub.Status: Production Ready ✅ Last Updated: 2026-08-03 Official Docs: https://docs.firecrawl.dev API Version: v2.5
Firecrawl is a Web Data API for AI that turns entire websites into LLM-ready markdown or structured data. It handles:
/v2/scrape - Single Page ScrapingScrapes a single webpage and returns clean, structured content.
Use Cases:
Key Options:
formats: ["markdown", "html", "screenshot"]onlyMainContent: true/false (removes nav, footer, ads)waitFor: milliseconds to wait before scrapingactions: browser automation actions (click, scroll, etc.)/v2/crawl - Full Site CrawlingCrawls all accessible pages from a starting URL.
Use Cases:
Key Options:
limit: max pages to crawlmaxDepth: how many links deep to followallowedDomains: restrict to specific domainsexcludePaths: skip certain URL patterns/v2/map - URL DiscoveryMaps all URLs on a website without scraping content.
Use Cases:
/v2/extract - Structured Data ExtractionUses AI to extract specific data fields from pages.
Use Cases:
Key Options:
schema: Zod or JSON schema defining desired structuresystemPrompt: guide AI extraction behaviorFirecrawl requires an API key for all requests.
fc-)NEVER hardcode API keys in code!
# .env file
FIRECRAWL_API_KEY=fc-your-api-key-here# .env.local (for local development)
FIRECRAWL_API_KEY=fc-your-api-key-herepip install firecrawl-py # v4.5.0+from firecrawl import FirecrawlApp
import os
app = FirecrawlApp(api_key=os.environ.get("FIRECRAWL_API_KEY"))
result = app.scrape_url("https://example.com", params={"formats": ["markdown"], "onlyMainContent": True})
print(result.get("markdown"))bun add @mendable/firecrawl-js # v4.32.0+import FirecrawlApp from '@mendable/firecrawl-js';
const app = new FirecrawlApp({ apiKey: process.env.FIRECRAWL_API_KEY });
const result = await app.scrapeUrl('https://example.com', { formats: ['markdown'], onlyMainContent: true });
console.log(result.markdown);See: templates/ for crawl, extract, and advanced examples
| Use Case | Endpoint | Key Options |
|---|---|---|
| Documentation scraping | crawl_url() | limit: 500, allowedDomains |
| Product data extraction | extract() | Zod schema + systemPrompt |
| News article scraping | scrape_url() | onlyMainContent: true, removeBase64Images |
| URL discovery | map() | Find all pages before crawling |
See: references/common-patterns.md for complete examples.
# Python
try:
result = app.scrape_url("https://example.com")
except FirecrawlException as e:
print(f"Firecrawl error: {e}")// TypeScript
try {
const result = await app.scrapeUrl('https://example.com');
} catch (error) {
console.error('Error:', error.message);
}| Best Practice | Why |
|---|---|
Use onlyMainContent: true | Reduces credits, cleaner output |
Set reasonable limit | Avoid excessive costs |
Use map endpoint first | Plan crawling strategy |
| Cache results | Avoid re-scraping |
| Batch extract calls | More efficient for multiple URLs |
Credits: Free tier = 500/month, paid tiers higher.
⚠️ SDK cannot run in Workers (Node.js dependencies). Use direct REST API:
const response = await fetch('https://api.firecrawl.dev/v2/scrape', {
method: 'POST',
headers: {
'Authorization': `Bearer ${env.FIRECRAWL_API_KEY}`,
'Content-Type': 'application/json',
},
body: JSON.stringify({ url, formats: ['markdown'], onlyMainContent: true })
});See: references/common-patterns.md for complete Workers example with caching.
| ✅ Use Firecrawl | ❌ Don't Use |
|---|---|
| Modern JS-rendered sites | Simple static HTML (use cheerio) |
| Clean markdown for LLMs | Existing Puppeteer setup works |
| RAG/chatbot content | Direct API available |
| Structured data extraction | Budget constraints |
| Bot protection bypass |
| Issue | Cause | Fix |
|---|---|---|
| "Invalid API Key" | Key not set | Check $FIRECRAWL_API_KEY starts with fc- |
| "Rate limit exceeded" | Monthly credits used | Check dashboard, upgrade plan |
| "Timeout error" | Page slow to load | Add waitFor: 10000 |
| "Content is empty" | JS loads late | Add actions: [{type: "wait", milliseconds: 3000}] |
| Feature | Usage |
|---|---|
| Browser actions | actions: [{type: "click", selector: "button"}] |
| Custom headers | headers: {"User-Agent": "Custom Bot"} |
| Webhooks | webhook: "https://your-domain.com/webhook" |
| Screenshots | formats: ["screenshot"] |
See: references/endpoints.md for complete API reference.
| Reference | Load When... |
|---|---|
endpoints.md | Need complete API endpoint documentation |
common-patterns.md | Cloudflare Workers, caching, batch processing, error handling |
| Package | Version |
|---|---|
| firecrawl-py | 4.5.0+ |
| @mendable/firecrawl-js | 4.32.0+ |
| API | v2 |
Note: Node.js SDK requires Node.js >=22.0.0, cannot run in Workers.
Official Docs: https://docs.firecrawl.dev | GitHub: https://github.com/mendableai/firecrawl
Token Savings: ~60% | Production Ready: ✅
© secondsky, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 6 other files (references) in plugins/firecrawl-scraper/skills/firecrawl-scraper of secondsky/claude-skills.
Open the folder on GitHubat commit 8837836
We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in secondsky/claude-skills, which our catalogue first saw on October 7, 2026.
Firecrawl Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Firecrawl Scraper this skillsecondsky/claude-skills | 227 | 1 repos | ~1.9k | Automated safety check: Notes | MIT | |
| Firecrawl Scraperynulihao/AgentSkillOS | 617 | 1 repos | ~4.1k | Automated safety check: Notes | MIT | |
| Firecrawlaiskillstore/marketplace | 430 | 1 repos | ~2.6k | Automated safety check: Pass | None | |
| Firecrawl Scraperlamm-mit/scienceclaw | 244 | — | ~425 | Automated safety check: Pass | Apache-2.0 | |
| Web Scrapingplatonai/Browser4 | 1.2k | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | |
| Selenium Opinion Crawler123321kk/opinion-agent-ultimate | 107 | — | ~631 | Automated safety check: Pass | None |
ynulihao/AgentSkillOS
Complete knowledge domain for Firecrawl v2 API - web scraping and crawling that converts websites into LLM-ready markdown or structured data.
aiskillstore/marketplace
Firecrawl handles all web operations with superior accuracy, speed, and LLM-optimized output.
lamm-mit/scienceclaw
Web scraping of JavaScript-rendered scientific websites using Firecrawl API
platonai/Browser4
Extracts data from web pages using browser automation and CSS/JavaScript selectors.
123321kk/opinion-agent-ultimate
browser-based page capture and text extraction for public-opinion research.
einverne/dotfiles
Browser automation, debugging, and performance analysis using Puppeteer CLI scripts.
secondsky/claude-skills
TanStack AI (alpha) provider-agnostic type-safe chat with streaming for OpenAI, Anthropic, Gemini, Ollama.
secondsky/claude-skills
AutoAnimate (@formkit/auto-animate) zero-config animations for React.
secondsky/claude-skills
MUI Base UI unstyled React components with Floating UI. An agent skill from secondsky/claude-skills.
secondsky/claude-skills
This skill should be used when the user asks to "upload images to Cloudflare", "implement direct creator upload", "configure image transformations", "optimize WebP/AVIF", "create image variants"…
secondsky/claude-skills
Deploy Next.js to Cloudflare Workers via the OpenNext adapter (@opennextjs/cloudflare).
secondsky/claude-skills
Cloudflare Sandboxes SDK for secure code execution in Linux containers at edge.
Works with
Categories
Firecrawl v2.5 API for web scraping/crawling to LLM-ready markdown. Firecrawl Scraper is an agent skill from secondsky/claude-skills.5 API for web scraping/crawling to LLM-ready markdown.
Firecrawl Scraper fits situations like: site extraction; dynamic content; encountering JavaScript rendering; content loading errors.
Run `npx skills add secondsky/claude-skills --skill firecrawl-scraper -a claude-code`. Or copy the skill folder (plugins/firecrawl-scraper/skills/firecrawl-scraper in secondsky/claude-skills) into .claude/skills/firecrawl-scraper in your project. Claude Code loads it when a task matches its description.
Run `npx skills add secondsky/claude-skills --skill firecrawl-scraper -a codex`. Or copy the skill folder (plugins/firecrawl-scraper/skills/firecrawl-scraper in secondsky/claude-skills) into .agents/skills/firecrawl-scraper in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add secondsky/claude-skills --skill firecrawl-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/firecrawl-scraper, .gemini/skills/firecrawl-scraper, .github/skills/firecrawl-scraper and .opencode/skills/firecrawl-scraper in your project.
Going by SKILL.md and its folder, Firecrawl Scraper needs Python and TypeScript for the scripts in its folder, the command-line tools its instructions call (pip and bun) and credentials named FIRECRAWL_API_KEY. Our summary lists: Python 3; Node.js; A credential in FIRECRAWL_API_KEY.
SKILL.md names 4 domains. In commands or code: api.firecrawl.dev; the agent is likely to contact it when it follows the instructions. As links in the text: docs.firecrawl.dev, firecrawl.dev and github.com. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.
Firecrawl Scraper is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.9k tokens (SKILL.md is roughly 7.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 7.1k tokens, read only when the agent opens those files.
Skills that share tags, products or a category with Firecrawl Scraper: Firecrawl Scraper (ynulihao/AgentSkillOS, 617 stars), Firecrawl (aiskillstore/marketplace, 430 stars), Firecrawl Scraper (lamm-mit/scienceclaw, 244 stars) and Web Scraping (platonai/Browser4, 1.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
secondsky (a GitHub user) maintains it in secondsky/claude-skills, which has 227 GitHub stars. The repository holds 169 skills in this directory. The repository was last updated on September 28, 2026.
Source: secondsky/claude-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.