Agent skill

Firecrawl Knowledge Base

by firecrawl in firecrawl/skills

Build a knowledge base from web content with Firecrawl. An agent skill from firecrawl/skills.

ISCAuto-check passedKnowledge Management

Install Firecrawl Knowledge Base

skills CLI
$ npx skills add firecrawl/skills --skill firecrawl-knowledge-base -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install firecrawl/skills firecrawl-knowledge-base --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/firecrawl/skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/workflows/firecrawl-knowledge-base .claude/skills/firecrawl-knowledge-base && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
firecrawl-knowledge-base
GitHub stars
115
Token cost
~612 tokens
SKILL.md length
180 words
Files
1
Skills in repo
29
Repo updated
First seen
Licence
ISC

At a glance

Build a knowledge base from web content with Firecrawl. An agent skill from firecrawl/skills.

  • Local reference docs
  • SKILL.md covers Onboarding Interview, Firecrawl Collection Plan, Parallel Work and Output Modes, plus 2 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • RAG-ready chunks

What it does

Firecrawl Knowledge Base is an agent skill from firecrawl/skills. Build a knowledge base from web content with Firecrawl. Use for local reference docs, RAG-ready chunks, fine-tuning datasets, documentation mirrors, topic corpora, or LLM-ready markdown organized from web sources.

Its SKILL.md is about 610 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Knowledge Management, covering Web scraping and Knowledge bases. It works with Firecrawl. The licence is ISC.

When your agent uses it

  • Local reference docs
  • RAG-ready chunks
  • Fine-tuning datasets
  • Documentation mirrors

Example prompts

  • “/firecrawl-knowledge-base”

Requirements

  • A credential in FIRECRAWL_API_KEY

What it can do on your machine

Read from SKILL.md and the folder at commit d0ffd7c. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are markdown).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Firecrawl Knowledge Base loads about 612 tokens when it runs. Until then it costs about 60 tokens; SKILL.md has 180 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~60
When it runs · the whole SKILL.md, loaded when a task matches
~612

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from firecrawl/skills at commit d0ffd7c, republished under its ISC licence (© firecrawl). 180 words, ~612 tokens.

Download SKILL.mdSave it as .claude/skills/firecrawl-knowledge-base/SKILL.md (or your agent's skills folder).
name
firecrawl-knowledge-base
description
Build a knowledge base from web content with Firecrawl. Use for local reference docs, RAG-ready chunks, fine-tuning datasets, documentation mirrors, topic corpora, or LLM-ready markdown organized from web sources.
license
ISC
metadata.author
firecrawl
metadata.version
0.1.0
metadata.homepage
https://www.firecrawl.dev
metadata.source
https://github.com/firecrawl/firecrawl-workflows

Firecrawl Knowledge Base

Use this to turn URLs or topics into organized LLM-ready content.

Onboarding Interview

Infer the source, goal, depth, and output location from context. If the source and goal are clear, proceed immediately.

Ask at most 1-3 concise questions only if blocked, such as the source URL/topic, whether the output is reference/RAG/training/docs, or training format if training is requested.

Firecrawl Collection Plan

Use Firecrawl map for documentation sites, search for topic-based corpora, scrape pages into markdown, and preserve code examples and tables.

For files, follow the Firecrawl download-style convention:

text
.firecrawl/
  <hostname>/
    <path>/
      index.md

Parallel Work

If appropriate, use sub-agents or equivalent parallel task runners:

  • one docs section per researcher
  • official docs, tutorials, community discussions, and references by source type
  • source scraping vs chunk generation vs manifest generation

Output Modes

  • Reference: markdown files, index.md, and sources.json.
  • RAG: markdown files plus chunk files and manifest.json.
  • Training: scraped source files plus training-data.jsonl and training-metadata.json.
  • Docs mirror: complete markdown mirror with a table of contents.

Final Deliverable

markdown
# Knowledge Base: [Source]

## Summary
[What was collected and why]

## Output Structure
[Files/directories created]

## Coverage
[Sections, source types, counts]

## Usage Notes
[How to use in RAG, docs, training, or agent context]

## Sources
[URLs collected]

## Rerun Inputs
workflow: firecrawl-knowledge-base
source: [url/topic]
goal: [reference/rag/train/docs]
depth: [quick/thorough/exhaustive]
output_dir: [.firecrawl/]

Quality Bar

  • Preserve code examples and formatting.
  • Remove boilerplate navigation where possible.
  • Include source URLs in frontmatter or metadata.

© firecrawl, ISC. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/workflows/firecrawl-knowledge-base of firecrawl/skills.

Open the folder on GitHubat commit d0ffd7c

Compare with similar skills

Firecrawl Knowledge Base next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Firecrawl Knowledge Base compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Firecrawl Knowledge Base this skillfirecrawl/skills115—~612Automated safety check: PassISC
Init KbLeoYeAI/openclaw-master-skills2.2k—~7kAutomated safety check: PassMIT
Cf Crawldavila7/claude-code-templates32k—~2.6kAutomated safety check: NotesMIT
Kb Refreshtechwolf-ai/ai-first-toolkit132—~1.3kAutomated safety check: PassMIT
Keirouter Web Fetchmydisha/keirouter147—~741Automated safety check: PassMIT
Tencent ima Knowledge Base Readerzj-unicom-ai/UniEmployee348—~1kAutomated safety check: PassMIT

Similar skills

  • Init Kb

    LeoYeAI/openclaw-master-skills

    Initialize or update a knowledge base for a project, business, or client.

    2.2k GitHub stars~7k tokensUpdated 2 mo ago
    Data & AnalyticsAuto-check passed
  • Cf Crawl

    davila7/claude-code-templates

    Crawl entire websites using Cloudflare Browser Rendering /crawl API.

    32k GitHub stars~2.6k tokensUpdated today
    Knowledge ManagementAuto-check: notes
  • Kb Refresh

    techwolf-ai/ai-first-toolkit

    Add new sources to your knowledge base or re-scrape existing ones to pick up changes.

    132 GitHub stars~1.3k tokensUpdated 8 days ago
    Knowledge ManagementAuto-check passed
  • Keirouter Web Fetch

    mydisha/keirouter

    Fetch URL → markdown / text / HTML via KeiRouter /v1/web/fetch using Firecrawl / Jina Reader / Tavily Extract / Exa Contents.

    147 GitHub stars~741 tokensUpdated 26 days ago
    Data & AnalyticsAuto-check passed
  • Tencent ima Knowledge Base Reader

    zj-unicom-ai/UniEmployee

    Exports the article list and original article text from a Tencent ima knowledge base through a logged-in Chrome session, using browser automation.

    348 GitHub stars~1k tokensUpdated 5 days ago
    Knowledge ManagementAuto-check passed
  • SEO Firecrawl

    seranking/seo-skills

    Ad-hoc web scraping, site mapping, and full-site crawling via Firecrawl MCP.

    160 GitHub stars~2.3k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed

More from firecrawl/skills

All 29 skills in this repo
  • Firecrawl Scrape

    firecrawl/skills

    Read a known webpage or execute a discovered workflow or data-provider capability.

    115 GitHub stars~1.8k tokensUpdated today
    Auto-check passed
  • Firecrawl Agent

    firecrawl/skills

    Autonomously navigate websites and extract structured data across pages.

    115 GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Extract structured company lists from directories with Firecrawl.

    115 GitHub stars~557 tokensUpdated today
    Auto-check passed
  • Monitor competitor pricing, features, changelogs, dashboards, and product changes with Firecrawl.

    115 GitHub stars~604 tokensUpdated today
    Auto-check passed
  • Firecrawl Crawl

    firecrawl/skills

    Bulk-extract many pages from one site or section. An agent skill from firecrawl/skills.

    115 GitHub stars~467 tokensUpdated today
    Auto-check passed
  • Pull metrics from analytics dashboards and internal web tools with Firecrawl browser.

    115 GitHub stars~590 tokensUpdated today
    Auto-check passed

Works with

Questions about Firecrawl Knowledge Base

What does Firecrawl Knowledge Base do?

Build a knowledge base from web content with Firecrawl. An agent skill from firecrawl/skills. Firecrawl Knowledge Base is an agent skill from firecrawl/skills. Build a knowledge base from web content with Firecrawl.

When should I use Firecrawl Knowledge Base?

Firecrawl Knowledge Base fits situations like: local reference docs; RAG-ready chunks; fine-tuning datasets; documentation mirrors.

How do I install Firecrawl Knowledge Base in Claude Code?

Run `npx skills add firecrawl/skills --skill firecrawl-knowledge-base -a claude-code`. Or copy the skill folder (skills/workflows/firecrawl-knowledge-base in firecrawl/skills) into .claude/skills/firecrawl-knowledge-base in your project. Claude Code loads it when a task matches its description.

How do I install Firecrawl Knowledge Base in Codex?

Run `npx skills add firecrawl/skills --skill firecrawl-knowledge-base -a codex`. Or copy the skill folder (skills/workflows/firecrawl-knowledge-base in firecrawl/skills) into .agents/skills/firecrawl-knowledge-base in your project. Codex loads it when a task matches its description.

Can I use Firecrawl Knowledge Base in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add firecrawl/skills --skill firecrawl-knowledge-base -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/firecrawl-knowledge-base, .gemini/skills/firecrawl-knowledge-base, .github/skills/firecrawl-knowledge-base and .opencode/skills/firecrawl-knowledge-base in your project.

What does Firecrawl Knowledge Base need to run?

SKILL.md names no scripts, command-line tools or credentials: Firecrawl Knowledge Base is instructions for the agent only. Our summary lists: A credential in FIRECRAWL_API_KEY.

Does Firecrawl Knowledge Base access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Firecrawl Knowledge Base safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Firecrawl Knowledge Base use?

Firecrawl Knowledge Base is published under the ISC licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Firecrawl Knowledge Base use?

About 612 tokens (SKILL.md is roughly 2.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Firecrawl Knowledge Base?

Skills that share tags, products or a category with Firecrawl Knowledge Base: Init Kb (LeoYeAI/openclaw-master-skills, 2.2k stars), Cf Crawl (davila7/claude-code-templates, 32k stars), Kb Refresh (techwolf-ai/ai-first-toolkit, 132 stars) and Keirouter Web Fetch (mydisha/keirouter, 147 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Firecrawl Knowledge Base?

firecrawl (a GitHub organization) maintains it in firecrawl/skills, which has 115 GitHub stars. The repository holds 29 skills in this directory. The repository was last updated on October 6, 2026.

Source: firecrawl/skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.