Agent skill

Xcrawl Scrape

by xcrawl-api in xcrawl-api/xcrawl-skills

A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

No licenceAuto-check passedData & Analytics

Install Xcrawl Scrape

skills CLI
$ npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-scrape -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install xcrawl-api/xcrawl-skills xcrawl-scrape --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/xcrawl-api/xcrawl-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/xcrawl-scrape .claude/skills/xcrawl-scrape && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
xcrawl-scrape
GitHub stars
449
Token cost
~2.2k tokens
SKILL.md length
692 words
Files
1
Skills in repo
5
Repo updated
First seen
Licence
None found

At a glance

A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

  • XCrawl scrape tasks
  • SKILL.md covers Overview, Required Local Config, Credits and Account Setup and Tool Permission Policy, plus 7 more sections
  • Calls node and curl; reaches run.xcrawl.com and dash.xcrawl.com; needs XCRAWL_API_KEY and API_KEY
  • Including single-URL fetch

What it does

Xcrawl Scrape is an agent skill from xcrawl-api/xcrawl-skills. Use this skill for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

Its SKILL.md is about 2.2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Web scraping. The repository describes itself as: Reusable Xcrawl skill definitions for multi-agent runtimes, focused on API-first web data workflows.

When your agent uses it

  • XCrawl scrape tasks
  • Including single-URL fetch
  • Format selection
  • Async execution

Example prompts

  • “/xcrawl-scrape”

Requirements

  • A credential in XCRAWL_API_KEY
  • A credential in API_KEY
  • Pre-approved tools (allowed-tools): Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep

What it can do on your machine

Read from SKILL.md and the folder at commit 768158d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Bash(curl:*)
    • Bash(node:*)
    • Read
    • Write
    • Edit
    • Grep

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • node
    • curl

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • run.xcrawl.com
    • dash.xcrawl.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • XCRAWL_API_KEY
    • API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Xcrawl Scrape loads about 2.2k tokens when it runs. Until then it costs about 43 tokens; SKILL.md has 692 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~43
When it runs · the whole SKILL.md, loaded when a task matches
~2.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 692 words (~2,158 tokens).

“This skill handles single-page extraction with XCrawl Scrape APIs. Default behavior is raw passthrough: return upstream API response bodies as-is.”

— opening of SKILL.md by xcrawl-api
name
xcrawl-scrape
allowed-tools
Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep
metadata.version
1.0.2

Read the full SKILL.md on GitHub

Files

Just SKILL.md in skills/xcrawl-scrape of xcrawl-api/xcrawl-skills.

Open the folder on GitHubat commit 768158d

Compare with similar skills

Xcrawl Scrape next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Xcrawl Scrape compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Xcrawl Scrape this skillxcrawl-api/xcrawl-skills449—~2.2kAutomated safety check: PassNone
Tmuxtrpc-group/trpc-agent-go1.8k23 repos~868Automated safety check: PassApache-2.0
Ketch1broseidon/ketch6961 repos~3.9kAutomated safety check: PassMIT
Crawl4AI Web Scrapingsmallnest/goclaw5981 repos~2.5kAutomated safety check: PassMIT
Boss Zhipin Scrapereatmoreduck/boss-zhipin-scraper1.5k—~2.6kAutomated safety check: PassMIT
Axyusukebe/ax7191 repos~918Automated safety check: PassMIT

Similar skills

  • Tmux

    trpc-group/trpc-agent-go

    Remote-control tmux sessions for interactive CLIs by sending keystrokes and scraping pane output.

    1.8k GitHub starsUsed in 23 repos~868 tokens
    Data & AnalyticsAuto-check passed
  • Ketch

    1broseidon/ketch

    Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but…

    696 GitHub starsUsed in 1 repo~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Crawl4AI Web Scraping

    smallnest/goclaw

    Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

    598 GitHub starsUsed in 1 repo~2.5k tokens
    Data & AnalyticsAuto-check passed
  • Boss Zhipin Scraper

    eatmoreduck/boss-zhipin-scraper

    Scrape BOSS直聘 (job listing site) via Chrome CDP. An agent skill from eatmoreduck/boss-zhipin-scraper.

    1.5k GitHub stars~2.6k tokensUpdated 8 days ago
    Data & AnalyticsAuto-check passed
  • Ax

    yusukebe/ax

    Use the ax CLI instead of curl + throwaway parsing scripts whenever you fetch a URL, explore an unknown web page, or extract structured data from HTML.

    719 GitHub starsUsed in 1 repo~918 tokens
    Data & AnalyticsAuto-check passed
  • Anakinscraper

    Anakin-Inc/anakin

    Scrape any website into clean markdown or structured JSON. An agent skill from Anakin-Inc/anakin.

    4.5k GitHub stars~859 tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed

More from xcrawl-api/xcrawl-skills

  • Xcrawl

    xcrawl-api/xcrawl-skills

    Use this skill as the default XCrawl entry point for direct XCrawl requests, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

    449 GitHub stars~2.4k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Crawl

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl crawl tasks, including bulk site crawling, crawler rule design, async status polling, and delivery of crawl output for downstream scrape and search workflows.

    449 GitHub stars~2.1k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Map

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.

    449 GitHub stars~1.1k tokensUpdated 6 mo ago
    Auto-check passed
  • Xcrawl Search

    xcrawl-api/xcrawl-skills

    A skill your agent uses for XCrawl search tasks, including keyword search request design, location and language controls, result analysis, and follow-up crawl or scrape planning.

    449 GitHub stars~1.1k tokensUpdated 6 mo ago
    Auto-check passed

Questions about Xcrawl Scrape

What does Xcrawl Scrape do?

A skill your agent uses for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema. Xcrawl Scrape is an agent skill from xcrawl-api/xcrawl-skills. Use this skill for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or jsonschema.

When should I use Xcrawl Scrape?

Xcrawl Scrape fits situations like: XCrawl scrape tasks; including single-URL fetch; format selection; async execution.

How do I install Xcrawl Scrape in Claude Code?

Run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-scrape -a claude-code`. Or copy the skill folder (skills/xcrawl-scrape in xcrawl-api/xcrawl-skills) into .claude/skills/xcrawl-scrape in your project. Claude Code loads it when a task matches its description.

How do I install Xcrawl Scrape in Codex?

Run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-scrape -a codex`. Or copy the skill folder (skills/xcrawl-scrape in xcrawl-api/xcrawl-skills) into .agents/skills/xcrawl-scrape in your project. Codex loads it when a task matches its description.

Can I use Xcrawl Scrape in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add xcrawl-api/xcrawl-skills --skill xcrawl-scrape -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/xcrawl-scrape, .gemini/skills/xcrawl-scrape, .github/skills/xcrawl-scrape and .opencode/skills/xcrawl-scrape in your project.

What does Xcrawl Scrape need to run?

Going by SKILL.md and its folder, Xcrawl Scrape needs the command-line tools its instructions call (node and curl) and credentials named XCRAWL_API_KEY and API_KEY. Our summary lists: A credential in XCRAWL_API_KEY; A credential in API_KEY. Its frontmatter pre-approves these tools: Bash(curl:*), Bash(node:*), Read, Write, Edit, Grep.

Does Xcrawl Scrape access the network?

SKILL.md names 2 domains. In commands or code: run.xcrawl.com and dash.xcrawl.com; the agent is likely to contact these when it follows the instructions. This is read from the text; nothing was executed.

Is Xcrawl Scrape safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Xcrawl Scrape use?

No licence was found for Xcrawl Scrape or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Xcrawl Scrape use?

About 2.2k tokens (SKILL.md is roughly 8.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Xcrawl Scrape?

Skills that share tags, products or a category with Xcrawl Scrape: Tmux (trpc-group/trpc-agent-go, 1.8k stars), Ketch (1broseidon/ketch, 696 stars), Crawl4AI Web Scraping (smallnest/goclaw, 598 stars) and Boss Zhipin Scraper (eatmoreduck/boss-zhipin-scraper, 1.5k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Xcrawl Scrape?

xcrawl-api (a GitHub organization) maintains it in xcrawl-api/xcrawl-skills, which has 449 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on March 20, 2026.

Source: xcrawl-api/xcrawl-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.