New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Firecrawl Architecture Variants

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing.

MITAuto-check passedData & Analytics

Install Firecrawl Architecture Variants

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill firecrawl-architecture-variants -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace firecrawl-architecture-variants --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/firecrawl-architecture-variants .claude/skills/firecrawl-architecture-variants && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
firecrawl-architecture-variants
GitHub stars
2.8k
Token cost
~1.2k tokens
SKILL.md length
506 words
Files
2 (incl. references)
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing.

  • Works in 7 steps: Inventory the source domains, ownership… → Choose scrape for bounded single pages,… → Choose polling, WebSocket streaming, or… → …
  • Reviewing a Firecrawl system
  • SKILL.md covers Overview, Prerequisites, Current Contract and Authentication, plus 7 more sections
  • Needs FIRECRAWL_API_KEY

What it does

Firecrawl Architecture Variants is an agent skill from jeremylongshore/tons-of-skills-marketplace. Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing. Use when designing or reviewing a Firecrawl system. Trigger with "Firecrawl architecture", "design a crawl pipeline", or "cloud versus self-hosted Firecrawl".

Its SKILL.md is about 1.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/official-docs.md`). Compatibility notes: Designed for Claude Code; Firecrawl Cloud work requires network access

It sits in Data & Analytics, covering Web scraping. It works with Firecrawl. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Reviewing a Firecrawl system
  • With Firecrawl architecture
  • Design a crawl pipeline
  • Cloud versus self-hosted Firecrawl

Example prompts

  • “Firecrawl architecture”
  • “design a crawl pipeline”
  • “cloud versus self-hosted Firecrawl”
  • “/firecrawl-architecture-variants”

Requirements

  • A credential in FIRECRAWL_API_KEY
  • Compatibility (from SKILL.md): Designed for Claude Code; Firecrawl Cloud work requires network access
  • Pre-approved tools (allowed-tools): Read, Glob, Grep, Write, Edit

Workflow steps

7 steps, taken from the first numbered list in SKILL.md.

  1. Inventory the source domains, ownership or authorization basis, expected page volume, freshness target, output formats, data…
  2. Choose scrape for bounded single pages, map plus selective scrape for curated URL sets, batch scrape for known URL collections, and crawl…
  3. Choose polling, WebSocket streaming, or signed webhooks for asynchronous delivery based on network topology and recovery needs.
  4. Decide Cloud versus self-hosting using required capabilities, data flows, operator staffing, availability target, and upgrade ownership…
  5. Place a policy gateway before Firecrawl for domain authorization, request shaping, budgets, key selection, and audit receipts. Keep…
  6. Define queue limits, explicit crawl limits, retention/cache choices, idempotency keys, pagination ownership, and degraded modes.
  7. Validate the chosen variant with one approved canary and document failure, retry, cancellation, and rollback paths.

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Glob
    • Grep
    • Write
    • Edit

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • FIRECRAWL_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code; Firecrawl Cloud work requires network access

    From compatibility in the SKILL.md frontmatter.

Context cost

Firecrawl Architecture Variants loads about 1.2k tokens when it runs, and up to ~1.6k if it reads all its reference files. Until then it costs about 82 tokens; SKILL.md has 506 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~82
When it runs · the whole SKILL.md, loaded when a task matches
~1.2k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 506 words, ~1,165 tokens.

Download SKILL.mdSave it as .claude/skills/firecrawl-architecture-variants/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
firecrawl-architecture-variants
description
Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing. Use when designing or reviewing a Firecrawl system. Trigger with "Firecrawl architecture", "design a crawl pipeline", or "cloud versus self-hosted Firecrawl".
allowed-tools
Read, Glob, Grep, Write, Edit
compatibility
Designed for Claude Code; Firecrawl Cloud work requires network access
argument-hint
<repository-path> <workload-and-slo>
version
1.12.0
license
MIT
author
Jeremy Longshore <jeremy@intentsolutions.io>
tags
saas, firecrawl, architecture, design
model
inherit
effort
high

Firecrawl Architecture Selection

Overview

Turn workload, freshness, compliance, throughput, and recovery requirements into an explicit architecture decision. Prefer the smallest Firecrawl surface that meets the outcome.

Prerequisites

  • The target repository or integration path and the requested operator outcome.
  • The source authorization, data classification, and environment policy.
  • Current Firecrawl documentation, credentials only when needed, and an owner for approvals.

Current Contract

Scrape is a synchronous single-resource primitive; crawl and batch scrape support asynchronous jobs, pagination, webhooks, and status retrieval; map discovers URLs without retrieving page content; search discovers external sources; parse handles local file bytes. The default self-hosted Compose stack does not provide every Cloud capability and is not a production security design.

Authentication

For authenticated Cloud operations, inject FIRECRAWL_API_KEY from an approved secret manager. REST requests use Authorization: Bearer with the key. Never print, commit, transmit, or place a key in a URL. Keyless access is suitable only where the current documentation explicitly allows it and the workload accepts its limits; production workflows should make identity and team ownership explicit.

Instructions

  1. Inventory the source domains, ownership or authorization basis, expected page volume, freshness target, output formats, data classification, and recovery objective.
  2. Choose scrape for bounded single pages, map plus selective scrape for curated URL sets, batch scrape for known URL collections, and crawl for recursive site discovery.
  3. Choose polling, WebSocket streaming, or signed webhooks for asynchronous delivery based on network topology and recovery needs.
  4. Decide Cloud versus self-hosting using required capabilities, data flows, operator staffing, availability target, and upgrade ownership. Record unsupported self-hosted features explicitly.
  5. Place a policy gateway before Firecrawl for domain authorization, request shaping, budgets, key selection, and audit receipts. Keep content storage and indexing downstream.
  6. Define queue limits, explicit crawl limits, retention/cache choices, idempotency keys, pagination ownership, and degraded modes.
  7. Validate the chosen variant with one approved canary and document failure, retry, cancellation, and rollback paths.
Show full SKILL.md (190 more words)Show less

Tool Discipline

Use Read, Glob, and Grep to inspect code, configuration, tests, and evidence. Use Write/Edit only for approved implementation or documentation changes. Do not call Firecrawl, rotate keys, change account settings, scrape a target, or deploy merely because this skill was invoked.

Approval Boundaries

Require approval before selecting self-hosting, introducing a new external provider, permitting authenticated-page capture, enabling Cloud-only capabilities, or broadening domains and retention.

Output

Return an architecture decision record containing workload facts, chosen endpoints, sequence, trust boundaries, data flows, capacity assumptions, recovery path, alternatives rejected, validation evidence, and open approvals.

Error Handling

  • Requirements conflict: surface the conflict and propose bounded variants instead of hiding it in implementation.
  • Self-host feature is unsupported: choose Cloud or identify and validate the required external service.
  • Recovery path is undefined: block launch until cancellation, replay, and deduplication behavior is owned.

Examples

  • "Design a nightly documentation ingest" selects a bounded crawl or map-plus-batch variant with async recovery.
  • "Keep all traffic inside our infrastructure" evaluates self-hosted capability gaps and operating cost before choosing it.

Resources

Read official Firecrawl evidence before relying on an endpoint, SDK method, plan limit, price, retention option, or self-hosted release.

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (references) in skills/.curated/firecrawl-architecture-variants of jeremylongshore/tons-of-skills-marketplace.

  • SKILL.md
  • references/official-docs.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Firecrawl Architecture Variants next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Firecrawl Architecture Variants compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Firecrawl Architecture Variants this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.2kAutomated safety check: PassMIT
Firecrawl Scrapefirecrawl/skills117—~1.8kAutomated safety check: PassISC
Firecrawl Agentfirecrawl/skills117—~1.2kAutomated safety check: PassISC
Firecrawl Company Directoriesfirecrawl/skills117—~557Automated safety check: PassISC
Firecrawl Competitive Intelfirecrawl/skills117—~604Automated safety check: PassISC
Firecrawlzapier/connectors177—~4.2kAutomated safety check: PassElastic-2.0

Similar skills

  • Firecrawl Scrape

    firecrawl/skills

    Read a known webpage or execute a discovered workflow or data-provider capability.

    117 GitHub stars~1.8k tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed

  • Firecrawl Agent

    firecrawl/skills

    Autonomously navigate websites and extract structured data across pages.

    117 GitHub stars~1.2k tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed

  • Firecrawl Company Directories

    firecrawl/skills

    Extract structured company lists from directories with Firecrawl.

    117 GitHub stars~557 tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed

  • Firecrawl Competitive Intel

    firecrawl/skills

    Monitor competitor pricing, features, changelogs, dashboards, and product changes with Firecrawl.

    117 GitHub stars~604 tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed

  • Firecrawl

    zapier/connectors

    Official

    Agent-callable Firecrawl tools — scrape a URL to clean Markdown, crawl a site, search the web, map site URLs, and extract structured data.

    177 GitHub stars~4.2k tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed

  • SEO Firecrawl

    seranking/seo-skills

    Ad-hoc web scraping, site mapping, and full-site crawling via Firecrawl MCP.

    161 GitHub stars~2.3k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo

  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes

  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed

  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed

  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed

  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Firecrawl Architecture Variants

What does Firecrawl Architecture Variants do?

Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing. Firecrawl Architecture Variants is an agent skill from jeremylongshore/tons-of-skills-marketplace. Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing.

When should I use Firecrawl Architecture Variants?

Firecrawl Architecture Variants fits situations like: reviewing a Firecrawl system; with Firecrawl architecture; design a crawl pipeline; cloud versus self-hosted Firecrawl.

How do I install Firecrawl Architecture Variants in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill firecrawl-architecture-variants -a claude-code`. Or copy the skill folder (skills/.curated/firecrawl-architecture-variants in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/firecrawl-architecture-variants in your project. Claude Code loads it when a task matches its description.

How do I install Firecrawl Architecture Variants in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill firecrawl-architecture-variants -a codex`. Or copy the skill folder (skills/.curated/firecrawl-architecture-variants in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/firecrawl-architecture-variants in your project. Codex loads it when a task matches its description.

Can I use Firecrawl Architecture Variants in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill firecrawl-architecture-variants -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/firecrawl-architecture-variants, .gemini/skills/firecrawl-architecture-variants, .github/skills/firecrawl-architecture-variants and .opencode/skills/firecrawl-architecture-variants in your project.

What does Firecrawl Architecture Variants need to run?

Going by SKILL.md and its folder, Firecrawl Architecture Variants needs credentials named FIRECRAWL_API_KEY. Our summary lists: A credential in FIRECRAWL_API_KEY. Its frontmatter pre-approves these tools: Read, Glob, Grep, Write, Edit. Compatibility (from SKILL.md): Designed for Claude Code; Firecrawl Cloud work requires network access.

Does Firecrawl Architecture Variants access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Firecrawl Architecture Variants safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Firecrawl Architecture Variants use?

Firecrawl Architecture Variants is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Firecrawl Architecture Variants use?

About 1.2k tokens (SKILL.md is roughly 4.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 467 tokens, read only when the agent opens those files.

What are the alternatives to Firecrawl Architecture Variants?

Skills that share tags, products or a category with Firecrawl Architecture Variants: Firecrawl Scrape (firecrawl/skills, 117 stars), Firecrawl Agent (firecrawl/skills, 117 stars), Firecrawl Company Directories (firecrawl/skills, 117 stars) and Firecrawl Competitive Intel (firecrawl/skills, 117 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Firecrawl Architecture Variants?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.