Agent skill

Scraper

by duyet in duyet/pricetrack

Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.).

MITAuto-check passedData & Analytics

Install Scraper

skills CLI
$ npx skills add duyet/pricetrack --skill scraper -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install duyet/pricetrack scraper --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/duyet/pricetrack.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/scraper .claude/skills/scraper && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
scraper
GitHub stars
139
Token cost
~451 tokens
SKILL.md length
187 words
Files
1
Skills in repo
2
Repo updated
First seen
Licence
MIT

At a glance

Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.).

  • Works in 2 steps: Config (functions/config/.js) —… → Module (functions/modules/pullData.js) —…
  • Working with scraper configs
  • SKILL.md covers Architecture, Adding a New Scraper, Debugging and Key Files
  • Calls firebase

What it does

Scraper is an agent skill from duyet/pricetrack. Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.). Use when working with scraper configs or pullData modules.

Its SKILL.md is about 450 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics, covering Web scraping. It works with Firebase and Cloud Firestore. The repository describes itself as: Price tracker monitors of products and alerts you when prices drop. Supported tiki.vn, shopee, lotte.vn, ... Built with firebase https://pricetrack.web.app. The licence is MIT.

When your agent uses it

  • Working with scraper configs
  • PullData modules

Example prompts

  • “/scraper”

Workflow steps

2 steps, taken from the first numbered list in SKILL.md.

  1. Config (functions/config/.js) — Site-specific selectors and URL patterns. Exports an object with
  2. Module (functions/modules/pullData.js) — Generic pull logic that reads configs and fetches/scrapes product pages using

What it can do on your machine

Read from SKILL.md and the folder at commit accb727. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • firebase

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use firebase, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Scraper loads about 451 tokens when it runs. Until then it costs about 39 tokens; SKILL.md has 187 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~39
When it runs · the whole SKILL.md, loaded when a task matches
~451

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from duyet/pricetrack at commit accb727, republished under its MIT licence (© duyet). 187 words, ~451 tokens.

Download SKILL.mdSave it as .claude/skills/scraper/SKILL.md (or your agent's skills folder).
name
scraper
description
Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.). Use when working with scraper configs or pullData modules.

Scraper Skill

Work with PriceTrack's price scrapers — add new sites, debug existing ones, or modify scraping logic.

Architecture

Scrapers are split into two parts:

  1. Config (functions/config/<site>.js) — Site-specific selectors and URL patterns. Exports an object with:

    • urlPattern — regex to match product URLs
    • selectors — CSS selectors for price, title, image, etc.
    • transform — optional data transformation functions
  2. Module (functions/modules/pullData.js) — Generic pull logic that reads configs and fetches/scrapes product pages using:

    • Puppeteer-core + @sparticuz/chromium for JS-rendered pages (serverless Chromium)
    • jsdom for static HTML parsing
    • axios for simple HTTP fetches

Adding a New Scraper

  1. Create functions/config/<site>.js with the site's URL pattern and selectors
  2. Register it in the config index (check how existing sites are imported)
  3. Test with: firebase functions:shell → pullData({url: '<product-url>'})
  4. Verify the scraped data structure matches what modules/pullData.js expects

Debugging

  • Check Firebase Functions logs: firebase functions:log
  • Puppeteer scrapers run headless on serverless Chromium — no GPU, limited memory
  • Some sites require specific headers or cookie consent handling
  • @sparticuz/chromium has size limits; check if the binary is up to date

Key Files

  • functions/config/ — per-site scraper configurations
  • functions/modules/pullData.js — main scraping orchestration
  • functions/modules/updateInfo.js — product info updates
  • functions/utils/fetch.js — HTTP fetch utilities

© duyet, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .claude/skills/scraper of duyet/pricetrack.

Open the folder on GitHubat commit accb727

Compare with similar skills

Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Scraper compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Scraper this skillduyet/pricetrack139—~451Automated safety check: PassMIT
Tmuxtrpc-group/trpc-agent-go1.8k23 repos~868Automated safety check: PassApache-2.0
Ketch1broseidon/ketch6961 repos~3.9kAutomated safety check: PassMIT
Crawl4AI Web Scrapingsmallnest/goclaw5981 repos~2.5kAutomated safety check: PassMIT
Boss Zhipin Scrapereatmoreduck/boss-zhipin-scraper1.5k—~2.6kAutomated safety check: PassMIT
Axyusukebe/ax7191 repos~918Automated safety check: PassMIT

Similar skills

  • Tmux

    trpc-group/trpc-agent-go

    Remote-control tmux sessions for interactive CLIs by sending keystrokes and scraping pane output.

    1.8k GitHub starsUsed in 23 repos~868 tokens
    Data & AnalyticsAuto-check passed
  • Ketch

    1broseidon/ketch

    Research skill for ketch — a fast stateless CLI for web search, OSS code search, curated library docs, page scraping, and site crawling; an optional MCP server exists for operators who want it, but…

    696 GitHub starsUsed in 1 repo~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Crawl4AI Web Scraping

    smallnest/goclaw

    Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

    598 GitHub starsUsed in 1 repo~2.5k tokens
    Data & AnalyticsAuto-check passed
  • Boss Zhipin Scraper

    eatmoreduck/boss-zhipin-scraper

    Scrape BOSS直聘 (job listing site) via Chrome CDP. An agent skill from eatmoreduck/boss-zhipin-scraper.

    1.5k GitHub stars~2.6k tokensUpdated 8 days ago
    Data & AnalyticsAuto-check passed
  • Ax

    yusukebe/ax

    Use the ax CLI instead of curl + throwaway parsing scripts whenever you fetch a URL, explore an unknown web page, or extract structured data from HTML.

    719 GitHub starsUsed in 1 repo~918 tokens
    Data & AnalyticsAuto-check passed
  • Anakinscraper

    Anakin-Inc/anakin

    Scrape any website into clean markdown or structured JSON. An agent skill from Anakin-Inc/anakin.

    4.5k GitHub stars~859 tokensUpdated 1 mo ago
    Data & AnalyticsAuto-check passed

More from duyet/pricetrack

  • Deploy

    duyet/pricetrack

    Deploy functions, hosting, or full release to Firebase. An agent skill from duyet/pricetrack.

    139 GitHub stars~338 tokensUpdated 2 days ago
    Auto-check passed

Questions about Scraper

What does Scraper do?

Add, debug, or modify price scrapers for e-commerce sites (Shopee, Lazada, Tiki, etc.). Scraper is an agent skill from duyet/pricetrack.).

When should I use Scraper?

Scraper fits situations like: working with scraper configs; pullData modules.

How do I install Scraper in Claude Code?

Run `npx skills add duyet/pricetrack --skill scraper -a claude-code`. Or copy the skill folder (.claude/skills/scraper in duyet/pricetrack) into .claude/skills/scraper in your project. Claude Code loads it when a task matches its description.

How do I install Scraper in Codex?

Run `npx skills add duyet/pricetrack --skill scraper -a codex`. Or copy the skill folder (.claude/skills/scraper in duyet/pricetrack) into .agents/skills/scraper in your project. Codex loads it when a task matches its description.

Can I use Scraper in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add duyet/pricetrack --skill scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/scraper, .gemini/skills/scraper, .github/skills/scraper and .opencode/skills/scraper in your project.

What does Scraper need to run?

Going by SKILL.md and its folder, Scraper needs the command-line tools its instructions call (firebase).

Does Scraper access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Scraper safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Scraper use?

Scraper is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Scraper use?

About 451 tokens (SKILL.md is roughly 1.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Scraper?

Skills that share tags, products or a category with Scraper: Tmux (trpc-group/trpc-agent-go, 1.8k stars), Ketch (1broseidon/ketch, 696 stars), Crawl4AI Web Scraping (smallnest/goclaw, 598 stars) and Boss Zhipin Scraper (eatmoreduck/boss-zhipin-scraper, 1.5k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Scraper?

duyet (a GitHub user) maintains it in duyet/pricetrack, which has 139 GitHub stars. The repository holds 2 skills in this directory. The repository was last updated on October 5, 2026.

Source: duyet/pricetrack on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.