Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawl --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .claude/skills/kreuzcrawl && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .claude/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawlType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawl --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .agents/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .agents/skills/kreuzcrawl && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .agents/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawl --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .cursor/skills/kreuzcrawl && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .cursor/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/hashgraph-online/awesome-codex-plugins.git --path plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawl --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .gemini/skills/kreuzcrawl && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .gemini/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawlInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .github/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .github/skills/kreuzcrawl && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .github/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install hashgraph-online/awesome-codex-plugins kreuzcrawl --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/hashgraph-online/awesome-codex-plugins.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl .opencode/skills/kreuzcrawl && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "kreuzcrawl" agent skill from https://github.com/hashgraph-online/awesome-codex-plugins/tree/main/plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl into .opencode/skills/kreuzcrawl/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "kreuzcrawl", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
kreuzcrawlCrawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server.
Kreuzcrawl is an agent skill from hashgraph-online/awesome-codex-plugins. Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.
Its SKILL.md is about 2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Data & Analytics, covering Web scraping and MCP servers. It works with Model Context Protocol. The repository describes itself as: A curated list of awesome OpenAI Codex / ChatGPT plugins, skills, and resources. The 1 Codex Marketplace. See live plugins at: https://hol.org/plugins/best-codex-plugins. The licence is MIT.
3 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 9e7b281. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
brewnpxuvxcargoFrom the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
github.comFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Kreuzcrawl loads about 2k tokens when it runs. Until then it costs about 102 tokens; SKILL.md has 772 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from hashgraph-online/awesome-codex-plugins at commit 9e7b281, republished under its MIT licence (© hashgraph-online). 772 words, ~2,013 tokens.
.claude/skills/kreuzcrawl/SKILL.md (or your agent's skills folder).Kreuzcrawl is a Rust-native web crawler and scraper. It fetches static HTML
with reqwest, falls back to headless Chrome when a page needs JS or trips a
WAF, and converts every result to clean Markdown via the built-in
HTML→Markdown engine.
Use this skill when the user wants to:
The plugin shells out to a kreuzcrawl binary on PATH. Install one of:
brew install kreuzberg-dev/tap/kreuzcrawl
# or run without a persistent install (the CLI proxy package self-installs the binary):
npx @kreuzberg/kreuzcrawl-cli --help
uvx --from kreuzcrawl-cli kreuzcrawl --help
# or build from source:
cargo install --git https://github.com/kreuzberg-dev/kreuzcrawl kreuzcrawl-cli --features allThe serve and mcp subcommands are gated behind non-default cargo features
(api and mcp). The Homebrew tap is built with all features, so both
subcommands work out of the box. A from-source build must pass
--features mcp (and --features api for serve), or --features all, to
include them.
Verify:
kreuzcrawl --versionHeadless fallback needs Chrome/Chromium reachable locally (chromiumoxide
launches it on demand). Skip the install if you only plan to use
--browser-mode never.
kreuzcrawl scrape <url> # single page → JSON or Markdown
kreuzcrawl crawl <url...> # follow links, BFS, depth-bounded
kreuzcrawl map <url> # enumerate URLs via sitemaps + link extraction
kreuzcrawl interact <url> # browser actions: click, type, scroll
kreuzcrawl mcp # MCP server (stdio) — auto-registered (`mcp` feature)
kreuzcrawl serve # REST API server (`api` feature)Batch behaviour is built into crawl: pass multiple seed URLs and the engine
fans out via batch_crawl internally.
| Flag | Default | Notes |
|---|---|---|
--format | json | json or markdown. |
--timeout | 30000 | Request timeout in milliseconds. |
--browser-mode | auto | auto, always, or never. |
--browser-endpoint | — | Optional CDP ws:// or wss:// URL. |
--respect-robots-txt | off | Pass to obey robots.txt. |
--config <json> | — | Inline JSON or @file.json to override defaults. |
The --config flag accepts the full CrawlConfig schema. Anything you set
explicitly on the CLI overrides the corresponding JSON field.
kreuzcrawl scrape https://example.com --format markdownJSON output (default) carries the rendered Markdown, page metadata
(PageMetadata), links by category, images, feeds, JSON-LD blocks, and
HTTP response metadata. Use Markdown output when piping into a file the user
will read.
See the scraping-html-to-markdown skill for the full flag surface.
kreuzcrawl crawl https://example.com \
--depth 3 --max-pages 200 --concurrent 8 --rate-limit 250 \
--stay-on-domain --respect-robots-txt --format markdownCrawling is BFS by default, bounded by --depth, --max-pages, and
--concurrent. Per-domain politeness is enforced by --rate-limit
(milliseconds between requests to the same origin).
See the crawling-a-site skill for the recommended defaults and the full
flag surface.
kreuzcrawl map https://example.com --limit 500 --search docs --format markdownmap reads sitemap.xml (and nested sitemaps), then falls back to link
extraction from the seed page. It does not render pages — use it to plan a
crawl or to feed URLs into another tool.
kreuzcrawl interact https://example.com \
--actions '[{"type":"click","selector":"#load-more"},
{"type":"wait","milliseconds":500},
{"type":"scrape"}]'Action types are click, type, press, scroll, wait, screenshot,
executeJs, and scrape (to wait for an element, use wait with a
selector field). The result wraps the final HTML under
interaction.final_html. See the automating-the-browser skill for the full
action schema and limits.
When this plugin is installed in a Claude Code / Codex / Cursor / Gemini / opencode harness, the MCP server is auto-registered:
kreuzcrawl mcpmcp is a stdio-transport server and takes no arguments. It requires a binary
built with the mcp feature (see Installation).
Prefer MCP tools over shelling out when both are available:
--format juggling — the harness pulls whatever shape it needs.Fall back to the CLI when you need to script a pipeline, capture stderr, or chain with shell tools.
In --browser-mode auto (default), the engine:
reqwest.Force the browser path with --browser-mode always when you already know
the page needs JS. Use --browser-mode never for hot loops where the cost
of a stray Chrome launch is unacceptable.
Point --browser-endpoint ws://host:9222/devtools/browser/<id> at an
already-running Chrome to skip the local launch.
See the headless-fallback skill for symptoms, costs, and external-CDP
patterns.
| Mode | Use when |
|---|---|
json | Downstream consumer needs metadata, links, images, etc. |
markdown | Human reader or LLM-context payload. |
Markdown output skips metadata. If you need both, run with --format json
and read result.markdown.content.
--respect-robots-txt is off by default; pass it for any crawl on a host
you do not own.--rate-limit 200 already produces a polite cadence; raise it
for shared hosts.--user-agent. Do not impersonate a
browser unless the operator has approved it.skills/crawling-a-site/SKILL.md — multi-page crawl with depth, page
caps, concurrency, rate limits, and domain scoping.skills/scraping-html-to-markdown/SKILL.md — single-page rendering, the
Markdown output shape, and common pitfalls.skills/mapping-urls/SKILL.md — map: sitemap + link URL discovery,
filtering, and seeding a crawl.skills/automating-the-browser/SKILL.md — interact: the full scripted
action schema, limits, and result shape.skills/serving-the-api/SKILL.md — serve: the Firecrawl-v1-compatible
REST API server and its endpoints.skills/headless-fallback/SKILL.md — when and how to force the browser
backend.© hashgraph-online, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl of hashgraph-online/awesome-codex-plugins.
Open the folder on GitHubat commit 9e7b281
Kreuzcrawl next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Kreuzcrawl this skillhashgraph-online/awesome-codex-plugins | 1.3k | — | ~2k | Automated safety check: Pass | MIT | |
| Querying Indonesian Gov Datasuryast/indonesia-gov-apis | 172 | — | ~997 | Automated safety check: Pass | MIT | |
| Scraplingforyourhealth111-pixel/Vibe-Skills | 3.6k | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | |
| Firecrawl MCPLeoYeAI/openclaw-master-skills | 2.2k | — | ~7.4k | Automated safety check: Pass | MIT | |
| Skill Seekers Builderyusufkaraaslan/Skill_Seekers | 15k | — | ~760 | Automated safety check: Pass | MIT | |
| Sandbaseiflytek/skillhub | 5.2k | 2 repos | ~2.1k | Automated safety check: Pass | Apache-2.0 |
suryast/indonesia-gov-apis
Query 57 Indonesian government APIs and data sources — BPJPH halal certification, BPOM food safety, OJK financial legality, BPS statistics, BMKG weather/earthquakes, Bank Indonesia exchange rates…
foryourhealth111-pixel/Vibe-Skills
CLI-first web scraping & content extraction with optional MCP server.
LeoYeAI/openclaw-master-skills
Auto-generated skill for firecrawl-mcp tools via OneKey Gateway.
yusufkaraaslan/Skill_Seekers
Detects the type of a knowledge source and uses the Skill Seekers MCP tools to turn docs, repos, PDFs or videos into packaged AI skills.
iflytek/skillhub
Access 2,000+ AI models and API tools through one MCP interface for inference, media generation, search, scraping, embeddings, social data, and structured retrieval.
Xquik-dev/x-twitter-scraper
Use Xquik to fetch X (Twitter) data or act through a connected account: search, profiles, followers, replies, threads, timelines, media downloads, bulk exports, trends, monitors, signed webhooks…
hashgraph-online/awesome-codex-plugins
Create original anime-style reaction stickers as looping GIFs and MP4 previews, using generated character pose sheets and timed key poses.
hashgraph-online/awesome-codex-plugins
Manage and query Calibre libraries with the calibredb CLI (local paths or Calibre Content server URLs).
hashgraph-online/awesome-codex-plugins
A skill your agent uses when adding, changing, testing, or debugging Rust HTTP APIs and services, especially when Codex needs black-box integration tests, random-port app startup, real database test…
hashgraph-online/awesome-codex-plugins
Make a studio's game look like something at build time — a cover from a real frame of the game (free), painted covers, backdrops, textures and character plates from image models through the…
hashgraph-online/awesome-codex-plugins
Use CALL-E from Codex through the calle CLI. An agent skill from hashgraph-online/awesome-codex-plugins.
hashgraph-online/awesome-codex-plugins
Balance game difficulty, resources, rewards, probability, progression, economies, and dominant strategies.
Works with
Categories
Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server. Kreuzcrawl is an agent skill from hashgraph-online/awesome-codex-plugins. Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server.
Kreuzcrawl fits situations like: the user wants to fetch a page; follow links across a domain; drive a real browser.
Run `npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a claude-code`. Or copy the skill folder (plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl in hashgraph-online/awesome-codex-plugins) into .claude/skills/kreuzcrawl in your project. Claude Code loads it when a task matches its description.
Run `npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a codex`. Or copy the skill folder (plugins/kreuzberg-dev/plugins/plugins/kreuzcrawl/skills/kreuzcrawl in hashgraph-online/awesome-codex-plugins) into .agents/skills/kreuzcrawl in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add hashgraph-online/awesome-codex-plugins --skill kreuzcrawl -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/kreuzcrawl, .gemini/skills/kreuzcrawl, .github/skills/kreuzcrawl and .opencode/skills/kreuzcrawl in your project.
Going by SKILL.md and its folder, Kreuzcrawl needs the command-line tools its instructions call (brew, npx, uvx and cargo). Our summary lists: Node.js.
SKILL.md names 1 domain. In commands or code: github.com; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Kreuzcrawl is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.
About 2k tokens (SKILL.md is roughly 8.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Kreuzcrawl: Querying Indonesian Gov Data (suryast/indonesia-gov-apis, 172 stars), Scrapling (foryourhealth111-pixel/Vibe-Skills, 3.6k stars), Firecrawl MCP (LeoYeAI/openclaw-master-skills, 2.2k stars) and Skill Seekers Builder (yusufkaraaslan/Skill_Seekers, 15k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
hashgraph-online (a GitHub organization) maintains it in hashgraph-online/awesome-codex-plugins, which has 1,255 GitHub stars. The repository holds 714 skills in this directory. The repository was last updated on October 9, 2026.
Source: hashgraph-online/awesome-codex-plugins on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.
