SEO Firecrawl
seranking/seo-skills
Ad-hoc web scraping, site mapping, and full-site crawling via Firecrawl MCP.
A skill your agent uses when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST.
Install Serving The API
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-api --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .claude/skills/serving-the-api && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .claude/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-apiType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-api --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .agents/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .agents/skills/serving-the-api && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .agents/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-api --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .cursor/skills/serving-the-api && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .cursor/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/hashgraph-online/awesome-codex-plugins.git --path plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-api --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .gemini/skills/serving-the-api && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .gemini/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-apiInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .github/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .github/skills/serving-the-api && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .github/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins serving-the-api --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api .opencode/skills/serving-the-api && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "serving-the-api" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api into .opencode/skills/serving-the-api/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "serving-the-api", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
serving-the-api- GitHub stars
- 1.2k
- Token cost
- ~1.3k tokens
- SKILL.md length
- 468 words
- Files
- 1
- Skills in repo
- 736
- Repo updated
- First seen
- Licence
- Apache-2.0
At a glance
A skill your agent uses when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST.
- The user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls
- SKILL.md covers Quick recipe, Flags, Endpoints and Examples, plus 2 more sections
- Calls curl, jq and cargo
- The MCP server — for example wiring crawlberg into other apps over REST
What it does
Serving The API is an agent skill from hashgraph-online/awesome-codex-plugins. Use when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST. Covers crawlberg serve, the Firecrawl-v1-compatible endpoints, --host/--port, and when to prefer it.
Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Data & Analytics, covering Web scraping. It works with Model Context Protocol and Firecrawl. The repository describes itself as: A curated list of awesome OpenAI Codex / ChatGPT plugins, skills, and resources. The 1 Codex Marketplace. See live plugins at: https://hol.org/plugins/best-codex-plugins. The licence is Apache-2.0.
When your agent uses it
- The user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls
- The MCP server — for example wiring crawlberg into other apps over REST
Example prompts
- “/serving-the-api”
What it can do on your machine
Read from SKILL.md and the folder at commit 16b4156. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
curljqcargo
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md. Its commands use curl, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Serving The API loads about 1.3k tokens when it runs. Until then it costs about 75 tokens; SKILL.md has 468 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from hashgraph-online/awesome-codex-plugins at commit 16b4156, republished under its Apache-2.0 licence (© hashgraph-online). 468 words, ~1,302 tokens.
Download SKILL.mdSave it as
.claude/skills/serving-the-api/SKILL.md (or your agent's skills folder).- name
- serving-the-api
- description
- Use when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST. Covers `crawlberg serve`, the Firecrawl-v1-compatible endpoints, `--host`/`--port`, and when to prefer it.
<!--
AI-RULEZ :: GENERATED FILE — DO NOT EDIT
Content-Hash: blake3:a011fca3e4de3a4e6442e1779c4425d884cafb3369765d37e52d2f01dd8671bb
Source-Hash: blake3:b5689383a3914da8e3cc6ad3614356ae7f98c90cf99cb1b4b47be38456ff7a7c
Schema-Version: v1
-->Serving the API
crawlberg serve starts a long-running REST API server exposing the crawl
engine over HTTP. The endpoints are Firecrawl v1-compatible, so existing
Firecrawl clients and SDKs can point at a local crawlberg instance.
This subcommand requires the binary to be built with the optional api
feature (non-default). The Homebrew tap is built with all features, so serve
is available there; a from-source build needs
cargo install crawlberg-cli --features api
(or --features all) to include it.
Quick recipe
crawlberg serve --host 127.0.0.1 --port 3000It logs Starting REST API server on <host>:<port> to stderr and blocks until
terminated. Hit GET /health to confirm it is up.
Flags
| Flag | Default | Purpose |
|---|---|---|
--host | 0.0.0.0 | Address to bind to. |
--port | 3000 | Port to listen on. |
serve does not take the per-request crawl flags — it boots with the default
CrawlConfig and accepts per-request options in each HTTP request body.
Endpoints
Firecrawl v1 surface:
| Method + path | Purpose |
|---|---|
POST /v1/scrape | Scrape a single URL (synchronous). |
POST /v1/crawl | Start an asynchronous crawl job → returns a job id. |
GET /v1/crawl/{id} | Poll crawl job status and collect results. |
DELETE /v1/crawl/{id} | Cancel a running crawl job. |
POST /v1/map | Discover URLs on a site (synchronous). |
POST /v1/batch/scrape | Start an asynchronous batch-scrape job → job id. |
GET /v1/batch/scrape/{id} | Poll batch-scrape job status and results. |
POST /v1/download | Download a document from a URL. |
Operational:
| Method + path | Purpose |
|---|---|
GET /health | Health check ({ status, version }). |
GET /version | Version information. |
GET /openapi.json | OpenAPI schema for the whole surface. |
Request bodies use camelCase fields. Scrape/crawl/map mirror the CLI:
url, formats, onlyMainContent, includeTags/excludeTags, timeout
for scrape; url, maxDepth, maxPages, includePaths/excludePaths for
crawl; url, limit, search for map. Responses wrap data as
{ success, data | error }; async jobs return { success, id } and are polled
for { status, total, completed, data, error }.
Show full SKILL.md (184 more words)Show less
Examples
Scrape via HTTP
curl -s http://127.0.0.1:3000/v1/scrape \
-H 'content-type: application/json' \
-d '{"url":"https://example.com","formats":["markdown"]}' | jq '.data'Start a crawl job and poll it
id=$(curl -s http://127.0.0.1:3000/v1/crawl \
-H 'content-type: application/json' \
-d '{"url":"https://example.com","maxDepth":2,"maxPages":100}' | jq -r '.id')
curl -s "http://127.0.0.1:3000/v1/crawl/$id" | jq '{status,completed,total}'Map URLs
curl -s http://127.0.0.1:3000/v1/map \
-H 'content-type: application/json' \
-d '{"url":"https://example.com","limit":500,"search":"docs"}' | jq '.data'Operational notes
- The server accepts CORS from any origin and ships no built-in
authentication — do not expose it on a public interface. Bind to
127.0.0.1for local use, or put it behind a reverse proxy / gateway that enforces auth and rate limiting before exposing it more widely. - Request bodies are capped at 10 MB and each request times out after 5 minutes.
- Crawl and batch-scrape are asynchronous: the POST returns a job
idimmediately and you poll the{id}endpoint untilstatusiscompleted,failed, orcancelled.
When to run serve vs. CLI vs. MCP
- CLI (
scrape/crawl/map/interact) — one-shot jobs, shell pipelines, scripting. No long-running process. - MCP (
crawlberg mcp) — driving the crawler from an AI agent harness (Claude Code, Codex, Cursor, Gemini, opencode). Auto-registered by this plugin; prefer it inside an agent. - serve (
crawlberg serve) — a persistent HTTP service for other applications or non-agent clients that speak REST, or when you want Firecrawl-v1 compatibility. Choose it when many callers need the crawler over the network rather than one agent or one shell.
© hashgraph-online, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
Just SKILL.md in plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api of hashgraph-online/awesome-codex-plugins.
Open the folder on GitHubat commit 16b4156
Compare with similar skills
Serving The API next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Serving The API this skillhashgraph-online/awesome-codex-plugins | 1.2k | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | |
| SEO Firecrawlseranking/seo-skills | 160 | — | ~2.3k | Automated safety check: Pass | MIT | |
| Firecrawl Scrapeparcadei/Continuous-Claude-v3 | 3.9k | 2 repos | ~254 | Automated safety check: Notes | MIT | |
| Firecrawl MCPLeoYeAI/openclaw-master-skills | 2.2k | — | ~7.4k | Automated safety check: Pass | MIT | |
| Web SearchaAAaqwq/AGI-Super-Team | 105 | 1 repos | ~703 | Automated safety check: Notes | MIT | |
| Firecrawl Site Crawl ExtensionAgriciDaniel/claude-seo | 18k | 1 repos | ~2k | Automated safety check: Pass | MIT |
Similar skills
Firecrawl Scrape
parcadei/Continuous-Claude-v3
Scrape web pages and extract content via Firecrawl MCP. An agent skill from parcadei/Continuous-Claude-v3.
Firecrawl MCP
LeoYeAI/openclaw-master-skills
Auto-generated skill for firecrawl-mcp tools via OneKey Gateway.
Web Search
aAAaqwq/AGI-Super-Team
网络搜索与网页内容获取。当用户需要搜索互联网信息、获取网页内容、查找实时数据、进行 websearch 时使用此技能。支持多种搜索工具：WebFetch、Firecrawl skill、Tavily skill。
Firecrawl Site Crawl Extension
AgriciDaniel/claude-seo
Crawls, maps, and scrapes an entire site through the Firecrawl MCP server for broken-link checks and content inventories.
SEO Sitemap
seranking/seo-skills
Pull a domain's XML sitemap (and sitemap-of-sitemaps), then compare against the most recent SE Ranking website audit.
More from hashgraph-online/awesome-codex-plugins
All 736 skills in this repoAnime Reaction Gif
hashgraph-online/awesome-codex-plugins
Create original anime-style reaction stickers as looping GIFs and MP4 previews, using generated character pose sheets and timed key poses.
Calibredb
hashgraph-online/awesome-codex-plugins
Manage and query Calibre libraries with the calibredb CLI (local paths or Calibre Content server URLs).
Rust API Test Harness
hashgraph-online/awesome-codex-plugins
A skill your agent uses when adding, changing, testing, or debugging Rust HTTP APIs and services, especially when Codex needs black-box integration tests, random-port app startup, real database test…
Art
hashgraph-online/awesome-codex-plugins
Make a studio's game look like something at build time — a cover from a real frame of the game (free), painted covers, backdrops, textures and character plates from image models through the…
Calle
hashgraph-online/awesome-codex-plugins
Use CALL-E from Codex through the calle CLI. An agent skill from hashgraph-online/awesome-codex-plugins.
Game Balance Economy
hashgraph-online/awesome-codex-plugins
Balance game difficulty, resources, rewards, probability, progression, economies, and dominant strategies.
Related
Works with
Categories
Questions about Serving The API
What does Serving The API do?
A skill your agent uses when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST. Serving The API is an agent skill from hashgraph-online/awesome-codex-plugins. Use when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring crawlberg into other apps over REST.
When should I use Serving The API?
Serving The API fits situations like: the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls; the MCP server — for example wiring crawlberg into other apps over REST.
How do I install Serving The API in Claude Code?
Run `npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a claude-code`. Or copy the skill folder (plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api in hashgraph-online/awesome-codex-plugins) into .claude/skills/serving-the-api in your project. Claude Code loads it when a task matches its description.
How do I install Serving The API in Codex?
Run `npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a codex`. Or copy the skill folder (plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/serving-the-api in hashgraph-online/awesome-codex-plugins) into .agents/skills/serving-the-api in your project. Codex loads it when a task matches its description.
Can I use Serving The API in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add hashgraph-online/awesome-codex-plugins --skill serving-the-api -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/serving-the-api, .gemini/skills/serving-the-api, .github/skills/serving-the-api and .opencode/skills/serving-the-api in your project.
What does Serving The API need to run?
Going by SKILL.md and its folder, Serving The API needs the command-line tools its instructions call (curl, jq and cargo).
Does Serving The API access the network?
SKILL.md contains no URLs. Its commands use curl, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Is Serving The API safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Serving The API use?
Serving The API is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Serving The API use?
About 1.3k tokens (SKILL.md is roughly 5.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Serving The API?
Skills that share tags, products or a category with Serving The API: SEO Firecrawl (seranking/seo-skills, 160 stars), Firecrawl Scrape (parcadei/Continuous-Claude-v3, 3.9k stars), Firecrawl MCP (LeoYeAI/openclaw-master-skills, 2.2k stars) and Web Search (aAAaqwq/AGI-Super-Team, 105 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Serving The API?
hashgraph-online (a GitHub organization) maintains it in hashgraph-online/awesome-codex-plugins, which has 1,232 GitHub stars. The repository holds 736 skills in this directory. The repository was last updated on October 6, 2026.
Source: hashgraph-online/awesome-codex-plugins on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.