Diagnose and fix a broken scraper mapping. An agent skill from RealEstateWebTools/property_web_scraper.

MITAuto-check passedData & Analytics

Install Fix Scraper

skills CLI
$ npx skills add RealEstateWebTools/property_web_scraper --skill fix-scraper -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install RealEstateWebTools/property_web_scraper fix-scraper --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/RealEstateWebTools/property_web_scraper.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/fix-scraper .claude/skills/fix-scraper && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
fix-scraper
GitHub stars
132
Token cost
~1k tokens
SKILL.md length
437 words
Files
1
Skills in repo
5
Repo updated
First seen
Licence
MIT

At a glance

Diagnose and fix a broken scraper mapping. An agent skill from RealEstateWebTools/property_web_scraper.

  • Works in 4 steps: Identify the problem → Diagnose root cause → Fix → …
  • Extraction tests fail
  • SKILL.md covers Inputs, Step-by-step workflow and Key references
  • Calls npx

What it does

Fix Scraper is an agent skill from RealEstateWebTools/property_web_scraper. Diagnose and fix a broken scraper mapping. Use when extraction tests fail, a scraper returns wrong data, or a website has changed its HTML structure.

Its SKILL.md is about 1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Web scraping. It works with Astro. The repository describes itself as: Web based UI to make processing scraped data from real estate websites super simple. The licence is MIT.

When your agent uses it

  • Extraction tests fail
  • A scraper returns wrong data
  • A website has changed its HTML structure

Example prompts

  • “/fix-scraper”

Requirements

  • Node.js

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Identify the problem
  2. Diagnose root cause
  3. Fix
  4. Verify

What it can do on your machine

Read from SKILL.md and the folder at commit 02088f3. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • npx

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use npx, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Fix Scraper loads about 1k tokens when it runs. Until then it costs about 40 tokens; SKILL.md has 437 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~40
When it runs · the whole SKILL.md, loaded when a task matches
~1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from RealEstateWebTools/property_web_scraper at commit 02088f3, republished under its MIT licence (© RealEstateWebTools). 437 words, ~1,011 tokens.

Download SKILL.mdSave it as .claude/skills/fix-scraper/SKILL.md (or your agent's skills folder).
name
fix-scraper
description
Diagnose and fix a broken scraper mapping. Use when extraction tests fail, a scraper returns wrong data, or a website has changed its HTML structure.
argument-hint
scraper-name

Fix a Broken Scraper Mapping

You are helping the user diagnose and fix a broken scraper mapping. This follows the workflow in astro-app/docs/scraper-maintenance-guide.md.

Inputs

$ARGUMENTS should be a scraper name (e.g. rightmove, idealista). If not provided, ask the user which scraper is broken, or run the full test suite to find failures.

Step-by-step workflow

Phase 1: Identify the problem
  1. Run the scraper's validation tests to see which fields are failing:

    bash
    cd astro-app && npx vitest run test/lib/scraper-validation.test.ts -t "<scraper_name>"
  2. If no scraper name was given, run the full validation suite and identify which scrapers have failures:

    bash
    cd astro-app && npx vitest run test/lib/scraper-validation.test.ts
  3. Read the test output and identify the specific fields that are failing. Note the expected vs actual values.

Phase 2: Diagnose root cause
  1. Read the scraper mapping at config/scraper_mappings/<name>.json. For each failing field, identify the extraction strategy (cssLocator, scriptRegEx, urlPathPart, scriptJsonPath, jsonLdPath).

  2. Read the HTML fixture at astro-app/test/fixtures/<name>.html. Search for the DOM elements the mapping targets.

  3. Check the manifest at astro-app/test/fixtures/manifest.ts to understand expected values.

  4. Identify the root cause using this checklist:

    SymptomLikely cause
    Field returns 0 or empty stringCSS selector doesn't match any element
    Field returns concatenated garbageSelector matches multiple elements, missing cssCountId
    Field is wrong type (string vs int)Field defined in two sections, last one wins
    splitTextCharacter produces wrong resultCheerio normalizes <br> to \n, not \r
    scriptRegEx returns emptyPattern doesn't match any script tag content
    stripString doesn't strip enoughOnly removes one exact substring occurrence
    JSON-LD / scriptJsonPath returns emptyStructure changed or variable name changed
Show full SKILL.md (190 more words)Show less
Phase 3: Fix
  1. Edit the mapping JSON at config/scraper_mappings/<name>.json. Only change the specific fields that are broken. Common fixes:

    • Update CSS selectors to match current DOM structure
    • Add cssCountId when selector matches multiple elements
    • Fix splitTextCharacter (use \n not \r)
    • Update scriptRegEx pattern
    • Add fallback strategies via fallbacks array
    • Move field to correct section if type is wrong
  2. Update expected values in astro-app/test/fixtures/manifest.ts if the site content has legitimately changed.

  3. If the fixture HTML is outdated, offer to recapture it:

    bash
    cd astro-app
    npm run capture-fixture -- --file <new_html_file> --url <source_url> --name <scraper_name> --force
Phase 4: Verify
  1. Run the specific scraper's tests:

    bash
    cd astro-app && npx vitest run test/lib/scraper-validation.test.ts -t "<scraper_name>"
  2. Run the full test suite to check for regressions:

    bash
    cd astro-app && npx vitest run
  3. Present a summary of changes made and offer to commit.

Key references

  • Mapping format: DESIGN.md (Scraper Mapping Schema section)
  • Extraction pipeline order: defaultValues -> images -> features -> intFields -> floatFields -> textFields -> booleanFields
  • Maintenance guide: astro-app/docs/scraper-maintenance-guide.md
  • All strategies: cssLocator, scriptRegEx, urlPathPart, scriptJsonPath, scriptJsonVar, jsonLdPath, jsonLdType, flightDataPath
  • Post-processing: cssAttr, xmlAttr, cssCountId, splitTextCharacter, splitTextArrayId, stripString, stripPunct, stripFirstChar
  • Fallback chains: fallbacks array on any field mapping

© RealEstateWebTools, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .claude/skills/fix-scraper of RealEstateWebTools/property_web_scraper.

Open the folder on GitHubat commit 02088f3

Compare with similar skills

Fix Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Fix Scraper compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Fix Scraper this skillRealEstateWebTools/property_web_scraper132—~1kAutomated safety check: PassMIT
Tmuxtrpc-group/trpc-agent-go1.8k24 repos~868Automated safety check: PassApache-2.0
Ketch1broseidon/ketch6971 repos~3.9kAutomated safety check: PassMIT
Crawl4AI Web Scrapingsmallnest/goclaw5981 repos~2.5kAutomated safety check: PassMIT
Boss Zhipin Scrapereatmoreduck/boss-zhipin-scraper1.5k—~2.6kAutomated safety check: PassMIT
Axyusukebe/ax7191 repos~918Automated safety check: PassMIT

Similar skills

  • Tmux

    trpc-group/trpc-agent-go

    Remote-control tmux sessions for interactive CLIs by sending keystrokes and scraping pane output.

    1.8k GitHub starsUsed in 24 repos~868 tokens
    Data & AnalyticsAuto-check passed
  • Ketch

    1broseidon/ketch

    Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but…

    697 GitHub starsUsed in 1 repo~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Crawl4AI Web Scraping

    smallnest/goclaw

    Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

    598 GitHub starsUsed in 1 repo~2.5k tokens
    Data & AnalyticsAuto-check passed
  • Boss Zhipin Scraper

    eatmoreduck/boss-zhipin-scraper

    Scrape BOSS直聘 (job listing site) via Chrome CDP. An agent skill from eatmoreduck/boss-zhipin-scraper.

    1.5k GitHub stars~2.6k tokensUpdated 9 days ago
    Data & AnalyticsAuto-check passed
  • Ax

    yusukebe/ax

    Use the ax CLI instead of curl + throwaway parsing scripts whenever you fetch a URL, explore an unknown web page, or extract structured data from HTML.

    719 GitHub starsUsed in 1 repo~918 tokens
    Data & AnalyticsAuto-check passed
  • Anakinscraper

    Anakin-Inc/anakin

    Scrape any website into clean markdown or structured JSON. An agent skill from Anakin-Inc/anakin.

    4.5k GitHub stars~859 tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed

More from RealEstateWebTools/property_web_scraper

  • Add Scraper

    RealEstateWebTools/property_web_scraper

    Add support for scraping property listings from a new website.

    132 GitHub stars~1.4k tokensUpdated 2 mo ago
    Auto-check passed
  • Diagnose Extraction

    RealEstateWebTools/property_web_scraper

    Deep-dive diagnostics on a low-quality or failed extraction.

    132 GitHub stars~1.2k tokensUpdated 2 mo ago
    Auto-check passed
  • Extract

    RealEstateWebTools/property_web_scraper

    Run a quick extraction test against a URL or HTML file. An agent skill from RealEstateWebTools/property_web_scraper.

    132 GitHub stars~787 tokensUpdated 2 mo ago
    Auto-check passed
  • Scraper Status

    RealEstateWebTools/property_web_scraper

    Quick overview of all scrapers — quality grades, extraction rates, and coverage gaps.

    132 GitHub stars~364 tokensUpdated 2 mo ago
    Auto-check passed

Works with

Questions about Fix Scraper

What does Fix Scraper do?

Diagnose and fix a broken scraper mapping. An agent skill from RealEstateWebTools/property_web_scraper. Fix Scraper is an agent skill from RealEstateWebTools/property_web_scraper. Diagnose and fix a broken scraper mapping.

When should I use Fix Scraper?

Fix Scraper fits situations like: extraction tests fail; A scraper returns wrong data; A website has changed its HTML structure.

How do I install Fix Scraper in Claude Code?

Run `npx skills add RealEstateWebTools/property_web_scraper --skill fix-scraper -a claude-code`. Or copy the skill folder (.claude/skills/fix-scraper in RealEstateWebTools/property_web_scraper) into .claude/skills/fix-scraper in your project. Claude Code loads it when a task matches its description.

How do I install Fix Scraper in Codex?

Run `npx skills add RealEstateWebTools/property_web_scraper --skill fix-scraper -a codex`. Or copy the skill folder (.claude/skills/fix-scraper in RealEstateWebTools/property_web_scraper) into .agents/skills/fix-scraper in your project. Codex loads it when a task matches its description.

Can I use Fix Scraper in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add RealEstateWebTools/property_web_scraper --skill fix-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/fix-scraper, .gemini/skills/fix-scraper, .github/skills/fix-scraper and .opencode/skills/fix-scraper in your project.

What does Fix Scraper need to run?

Going by SKILL.md and its folder, Fix Scraper needs the command-line tools its instructions call (npx). Our summary lists: Node.js.

Does Fix Scraper access the network?

SKILL.md contains no URLs. Its commands use npx, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Fix Scraper safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Fix Scraper use?

Fix Scraper is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Fix Scraper use?

About 1k tokens (SKILL.md is roughly 4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Fix Scraper?

Skills that share tags, products or a category with Fix Scraper: Tmux (trpc-group/trpc-agent-go, 1.8k stars), Ketch (1broseidon/ketch, 697 stars), Crawl4AI Web Scraping (smallnest/goclaw, 598 stars) and Boss Zhipin Scraper (eatmoreduck/boss-zhipin-scraper, 1.5k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Fix Scraper?

RealEstateWebTools (a GitHub organization) maintains it in RealEstateWebTools/property_web_scraper, which has 132 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on July 21, 2026.

Source: RealEstateWebTools/property_web_scraper on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.