Agent skill

Xcrawl Map

by xcrawl-api in xcrawl-api/xcrawl-skills

A skill your agent uses for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.

No licenceAuto-check passedData & Analytics

Install Xcrawl Map

skills CLI
$ npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-map -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install xcrawl-api/xcrawl-skills xcrawl-map --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/xcrawl-api/xcrawl-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/xcrawl-map .claude/skills/xcrawl-map && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
xcrawl-map
GitHub stars
449
Token cost
~1.1k tokens
SKILL.md length
361 words
Files
1
Skills in repo
5
Repo updated
First seen
Licence
None found

At a glance

A skill your agent uses for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.

  • XCrawl map tasks
  • SKILL.md covers Overview, Required Local Config, Credits and Account Setup and Tool Permission Policy, plus 7 more sections
  • Calls node and curl; reaches run.xcrawl.com and dash.xcrawl.com; needs XCRAWL_API_KEY and API_KEY
  • Including site URL discovery

What it does

Xcrawl Map is an agent skill from xcrawl-api/xcrawl-skills. Use this skill for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.

Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics. The repository describes itself as: Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

When your agent uses it

  • XCrawl map tasks
  • Including site URL discovery
  • Regex filtering
  • Scope estimation

Example prompts

  • “/xcrawl-map”

Requirements

  • A credential in XCRAWL_API_KEY
  • A credential in API_KEY
  • Pre-approved tools (allowed-tools): Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep

What it can do on your machine

Read from SKILL.md and the folder at commit 768158d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Bash(curl:*)
    • Bash(node:*)
    • Read
    • Write
    • Edit
    • Grep

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • node
    • curl

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • run.xcrawl.com
    • dash.xcrawl.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • XCRAWL_API_KEY
    • API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Xcrawl Map loads about 1.1k tokens when it runs. Until then it costs about 40 tokens; SKILL.md has 361 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~40
When it runs · the whole SKILL.md, loaded when a task matches
~1.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 361 words (~1,101 tokens).

“This skill uses XCrawl Map API to discover URLs for a site. Default behavior is raw passthrough: return upstream API response bodies as-is.”

— opening of SKILL.md by xcrawl-api
name
xcrawl-map
allowed-tools
Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep
metadata.version
1.0.2

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/xcrawl-map of xcrawl-api/xcrawl-skills.

Open the folder on GitHubat commit 768158d

Compare with similar skills

Xcrawl Map next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Xcrawl Map compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Xcrawl Map this skillxcrawl-api/xcrawl-skills449—~1.1kAutomated safety check: PassNone
Exploratory Data Analysisspacering-net/codeg3.8k15 repos~3.6kAutomated safety check: PassMIT
MatplotlibzLanqing/codex-claude-academic-skills4.6k17 repos~2.9kAutomated safety check: PassMIT
Scikit LearnzLanqing/codex-claude-academic-skills4.6k17 repos~3.9kAutomated safety check: PassBSD-3-Clause
Chart Visualizationbytedance/deer-flow83k2 repos~840Automated safety check: PassMIT
TimesFM Forecastinggoogle-research/timesfm34k—~4.7kAutomated safety check: PassApache-2.0

Similar skills

  • Exploratory Data Analysis

    spacering-net/codeg

    Perform comprehensive exploratory data analysis on scientific data files across 200+ file formats.

    3.8k GitHub starsUsed in 15 repos~3.6k tokens
    Data & AnalyticsAuto-check passed
  • Matplotlib

    zLanqing/codex-claude-academic-skills

    Low-level plotting library for full customization. An agent skill from zLanqing/codex-claude-academic-skills.

    4.6k GitHub starsUsed in 17 repos~2.9k tokens
    Data & AnalyticsAuto-check passed
  • Scikit Learn

    zLanqing/codex-claude-academic-skills

    Machine learning in Python with scikit-learn. An agent skill from zLanqing/codex-claude-academic-skills.

    4.6k GitHub starsUsed in 17 repos~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Chart Visualization

    bytedance/deer-flow

    Picks a suitable chart type from 26 options for your data, maps the data to that chart's parameters and generates a chart image through a JavaScript script.

    83k GitHub starsUsed in 2 repos~840 tokens
    Data & AnalyticsAuto-check passed
  • TimesFM Forecasting

    google-research/timesfm

    Forecasts any univariate time series zero-shot with Google's TimesFM model, returning point forecasts and calibrated prediction intervals without training.

    34k GitHub stars~4.7k tokensUpdated 8 days ago
    Data & AnalyticsAuto-check passed
  • Jupyter Notebook

    microsoft/ai-agents-for-beginners

    Official

    A skill your agent uses when the user asks to create, scaffold, or edit Jupyter notebooks (.ipynb) for experiments, explorations, or tutorials; prefer the bundled templates and run the helper script…

    77k GitHub starsUsed in 8 repos~1k tokens
    Data & AnalyticsAuto-check passed

More from xcrawl-api/xcrawl-skills

  • Xcrawl

    xcrawl-api/xcrawl-skills

    Use this skill as the default XCrawl entry point for direct XCrawl requests, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

    449 GitHub stars~2.4k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Crawl

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl crawl tasks, including bulk site crawling, crawler rule design, async status polling, and delivery of crawl output for downstream scrape and search workflows.

    449 GitHub stars~2.1k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Scrape

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

    449 GitHub stars~2.2k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Search

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl search tasks, including keyword search request design, location and language controls, result analysis, and follow-up crawl or scrape planning.

    449 GitHub stars~1.1k tokensUpdated 6 mo ago
    Auto-check passed

Questions about Xcrawl Map

What does Xcrawl Map do?

A skill your agent uses for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling. Xcrawl Map is an agent skill from xcrawl-api/xcrawl-skills. Use this skill for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.

When should I use Xcrawl Map?

Xcrawl Map fits situations like: XCrawl map tasks; including site URL discovery; regex filtering; scope estimation.

How do I install Xcrawl Map in Claude Code?

Run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-map -a claude-code`. Or copy the skill folder (skills/xcrawl-map in xcrawl-api/xcrawl-skills) into .claude/skills/xcrawl-map in your project. Claude Code loads it when a task matches its description.

How do I install Xcrawl Map in Codex?

Run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-map -a codex`. Or copy the skill folder (skills/xcrawl-map in xcrawl-api/xcrawl-skills) into .agents/skills/xcrawl-map in your project. Codex loads it when a task matches its description.

Can I use Xcrawl Map in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-map -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/xcrawl-map, .gemini/skills/xcrawl-map, .github/skills/xcrawl-map and .opencode/skills/xcrawl-map in your project.

What does Xcrawl Map need to run?

Going by SKILL.md and its folder, Xcrawl Map needs the command-line tools its instructions call (node and curl) and credentials named XCRAWL_API_KEY and API_KEY. Our summary lists: A credential in XCRAWL_API_KEY; A credential in API_KEY. Its frontmatter pre-approves these tools: Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep.

Does Xcrawl Map access the network?

SKILL.md names 2 domains. In commands or code: run.xcrawl.com and dash.xcrawl.com; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.

Is Xcrawl Map safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Xcrawl Map use?

No licence was found for Xcrawl Map or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Xcrawl Map use?

About 1.1k tokens (SKILL.md is roughly 4.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Xcrawl Map?

Skills that share tags, products or a category with Xcrawl Map: Exploratory Data Analysis (spacering-net/codeg, 3.8k stars), Matplotlib (zLanqing/codex-claude-academic-skills, 4.6k stars), Scikit Learn (zLanqing/codex-claude-academic-skills, 4.6k stars) and Chart Visualization (bytedance/deer-flow, 83k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Xcrawl Map?

xcrawl-api (a GitHub organization) maintains it in xcrawl-api/xcrawl-skills, which has 449 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on March 20, 2026.

Source: xcrawl-api/xcrawl-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.