Agent skill

Apify Ultimate Scraper

by sickn33 in sickn33/agentic-awesome-skills

AI-driven data extraction from 55+ Actors across all major platforms.

MITAuto-check: notesData & Analytics

Install Apify Ultimate Scraper

skills CLI
$ npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install sickn33/agentic-awesome-skills apify-ultimate-scraper --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/sickn33/agentic-awesome-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/apify-ultimate-scraper .claude/skills/apify-ultimate-scraper && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
apify-ultimate-scraper
GitHub stars
47k
Used in
2 other repos
Token cost
~2.7k tokens
SKILL.md length
847 words
Files
2
Skills in repo
1,493
Repo updated
First seen
Licence
MIT

At a glance

AI-driven data extraction from 55+ Actors across all major platforms.

  • Works in 5 steps: Understand User Goal and Select Actor → Fetch Actor Schema → Ask User Preferences → …
  • Tasks that involve Web scraping
  • SKILL.md covers When to Use, Prerequisites, Workflow and Error Handling, plus 1 more section
  • Runs JavaScript scripts from its folder; calls node, jq and npm; needs APIFY_TOKEN

What it does

Apify Ultimate Scraper is an agent skill from sickn33/agentic-awesome-skills. AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.

Its SKILL.md is about 2.7k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files (for example `reference/scripts/run_actor.js`).

It sits in Data & Analytics, covering Web scraping. It works with Apify and Instagram. The repository describes itself as: AAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 2,400+ agentic skills. Includes… The licence is MIT.

When your agent uses it

  • Tasks that involve Web scraping

Example prompts

  • “/apify-ultimate-scraper”

Requirements

  • Node.js
  • A credential in APIFY_TOKEN

Workflow steps

5 steps, taken from the step headings in SKILL.md.

  1. Understand User Goal and Select Actor
  2. Fetch Actor Schema
  3. Ask User Preferences
  4. Run the Script
  5. Summarize Results and Offer Follow-ups

What it can do on your machine

Read from SKILL.md and the folder at commit 680176d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships script files (JavaScript), which the agent can run.

    Shell commands in SKILL.md call:

    • node
    • jq
    • npm

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • apify.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • APIFY_TOKEN

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Apify Ultimate Scraper loads about 2.7k tokens when it runs. Until then it costs about 39 tokens; SKILL.md has 847 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~39
When it runs · the whole SKILL.md, loaded when a task matches
~2.7k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NoteMentions a .env fileSKILL.md:21
    - `.env` file with `APIFY_TOKEN`
  • NoteMentions a .env fileSKILL.md:174
    export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools
  • NoteMentions a .env fileSKILL.md:184
    export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools
  • NoteMentions a .env fileSKILL.md:207
    node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  • NoteMentions a .env fileSKILL.md:214
    node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  • NoteMentions a .env fileSKILL.md:223
    node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  • NoteMentions a .env fileSKILL.md:247
    Y_TOKEN not found` - Ask user to create `.env` with `APIFY_TOKEN=your_token`

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from sickn33/agentic-awesome-skills at commit 680176d, republished under its MIT licence (© sickn33). 847 words, ~2,738 tokens.

Download SKILL.mdSave it as .claude/skills/apify-ultimate-scraper/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
apify-ultimate-scraper
description
AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.
risk
critical
source
community
date_added
2026-09-04

Universal Web Scraper

AI-driven data extraction from 55+ Actors across all major platforms. This skill automatically selects the best Actor for your task.

When to Use

  • The user needs web data extraction but has not yet chosen a specific Apify Actor.
  • You need a general-purpose Apify entry point that maps a broad scraping goal to the most suitable Actor.
  • The task spans multiple platforms and benefits from one unified workflow for actor selection, execution, and summarization.

Prerequisites

(No need to check it upfront)

  • .env file with APIFY_TOKEN
  • Node.js 20.6+ (for native --env-file support)
  • mcpc CLI tool: npm install -g @apify/mcpc

Workflow

Copy this checklist and track progress:

Task Progress:
- [ ] Step 1: Understand user goal and select Actor
- [ ] Step 2: Fetch Actor schema via mcpc
- [ ] Step 3: Ask user preferences (format, filename)
- [ ] Step 4: Run the scraper script
- [ ] Step 5: Summarize results and offer follow-ups
Step 1: Understand User Goal and Select Actor

First, understand what the user wants to achieve. Then select the best Actor from the options below.

Instagram Actors (12)
Actor IDBest For
apify/instagram-profile-scraperProfile data, follower counts, bio info
apify/instagram-post-scraperIndividual post details, engagement metrics
apify/instagram-comment-scraperComment extraction, sentiment analysis
apify/instagram-hashtag-scraperHashtag content, trending topics
apify/instagram-hashtag-statsHashtag performance metrics
apify/instagram-reel-scraperReels content and metrics
apify/instagram-search-scraperSearch users, places, hashtags
apify/instagram-tagged-scraperPosts tagged with specific accounts
apify/instagram-followers-count-scraperFollower count tracking
apify/instagram-scraperComprehensive Instagram data
apify/instagram-api-scraperAPI-based Instagram access
apify/export-instagram-comments-postsBulk comment/post export
Facebook Actors (14)
Actor IDBest For
apify/facebook-pages-scraperPage data, metrics, contact info
apify/facebook-page-contact-informationEmails, phones, addresses from pages
apify/facebook-posts-scraperPost content and engagement
apify/facebook-comments-scraperComment extraction
apify/facebook-likes-scraperReaction analysis
apify/facebook-reviews-scraperPage reviews
apify/facebook-groups-scraperGroup content and members
apify/facebook-events-scraperEvent data
apify/facebook-ads-scraperAd creative and targeting
apify/facebook-search-scraperSearch results
apify/facebook-reels-scraperReels content
apify/facebook-photos-scraperPhoto extraction
apify/facebook-marketplace-scraperMarketplace listings
apify/facebook-followers-following-scraperFollower/following lists
TikTok Actors (14)
Actor IDBest For
clockworks/tiktok-scraperComprehensive TikTok data
clockworks/free-tiktok-scraperFree TikTok extraction
clockworks/tiktok-profile-scraperProfile data
clockworks/tiktok-video-scraperVideo details and metrics
clockworks/tiktok-comments-scraperComment extraction
clockworks/tiktok-followers-scraperFollower lists
clockworks/tiktok-user-search-scraperFind users by keywords
clockworks/tiktok-hashtag-scraperHashtag content
clockworks/tiktok-sound-scraperTrending sounds
clockworks/tiktok-ads-scraperAd content
clockworks/tiktok-discover-scraperDiscover page content
clockworks/tiktok-explore-scraperExplore content
clockworks/tiktok-trends-scraperTrending content
clockworks/tiktok-live-scraperLive stream data
YouTube Actors (5)
Actor IDBest For
streamers/youtube-scraperVideo data and metrics
streamers/youtube-channel-scraperChannel information
streamers/youtube-comments-scraperComment extraction
streamers/youtube-shorts-scraperShorts content
streamers/youtube-video-scraper-by-hashtagVideos by hashtag
Google Maps Actors (4)
Actor IDBest For
compass/crawler-google-placesBusiness listings, ratings, contact info
compass/google-maps-extractorDetailed business data
compass/Google-Maps-Reviews-ScraperReview extraction
poidata/google-maps-email-extractorEmail discovery from listings
X/Twitter Actors (2)
Actor IDBest For
xquik/x-tweet-scraperTweet lookup, search, timelines, lists, threads, replies, quotes, and engagement
xquik/x-follower-scraperFollowers, following, verified followers, lists, communities, and audience overlap

Check each Actor's live Apify pricing box before starting a paid run. Show the Actor, targets, result cap, and maximum charge. Get explicit approval. Set a conservative result cap. maxItems applies across the whole run.

Xquik is an independent third-party service. Not affiliated with X Corp. "Twitter" and "X" are trademarks of X Corp.

Other Actors (6)
Actor IDBest For
apify/google-search-scraperGoogle search results
apify/google-trends-scraperGoogle Trends data
voyager/booking-scraperBooking.com hotel data
voyager/booking-reviews-scraperBooking.com reviews
maxcopell/tripadvisor-reviewsTripAdvisor reviews
vdrmota/contact-info-scraperContact enrichment from URLs

Actor Selection by Use Case
Use CasePrimary Actors
Lead Generationcompass/crawler-google-places, poidata/google-maps-email-extractor, vdrmota/contact-info-scraper
Influencer Discoveryapify/instagram-profile-scraper, clockworks/tiktok-profile-scraper, streamers/youtube-channel-scraper
Brand Monitoringxquik/x-tweet-scraper, apify/instagram-tagged-scraper, apify/instagram-hashtag-scraper, compass/Google-Maps-Reviews-Scraper
Competitor Analysisapify/facebook-pages-scraper, apify/facebook-ads-scraper, apify/instagram-profile-scraper
Content Analyticsapify/instagram-post-scraper, clockworks/tiktok-scraper, streamers/youtube-scraper
Trend Researchapify/google-trends-scraper, clockworks/tiktok-trends-scraper, apify/instagram-hashtag-stats
Review Analysiscompass/Google-Maps-Reviews-Scraper, voyager/booking-reviews-scraper, maxcopell/tripadvisor-reviews
Audience Analysisxquik/x-follower-scraper, apify/instagram-followers-count-scraper, clockworks/tiktok-followers-scraper, apify/facebook-followers-following-scraper

Show full SKILL.md (317 more words)Show less
Multi-Actor Workflows

For complex tasks, chain multiple Actors:

WorkflowStep 1Step 2
Lead enrichmentcompass/crawler-google-places →vdrmota/contact-info-scraper
Influencer vettingapify/instagram-profile-scraper →apify/instagram-comment-scraper
Competitor deep-diveapify/facebook-pages-scraper →apify/facebook-posts-scraper
Local business analysiscompass/crawler-google-places →compass/Google-Maps-Reviews-Scraper
X audience contextxquik/x-follower-scraper →xquik/x-tweet-scraper
Can't Find a Suitable Actor?

If none of the Actors above match the user's request, search the Apify Store directly:

bash
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call search-actors keywords:="SEARCH_KEYWORDS" limit:=10 offset:=0 category:="" | jq -r '.content[0].text'

Replace SEARCH_KEYWORDS with 1-3 simple terms (e.g., "LinkedIn profiles", "Amazon products", "Twitter").

Step 2: Fetch Actor Schema

Fetch the Actor's input schema and details dynamically using mcpc:

bash
export $(grep APIFY_TOKEN .env | xargs) && mcpc --json mcp.apify.com --header "Authorization: Bearer $APIFY_TOKEN" tools-call fetch-actor-details actor:="ACTOR_ID" | jq -r ".content"

Replace ACTOR_ID with the selected Actor (e.g., compass/crawler-google-places).

This returns:

  • Actor description and README
  • Required and optional input parameters
  • Output fields (if available)
Step 3: Ask User Preferences

Before running, ask:

  1. Output format:
    • Quick answer - Display top few results in chat (no file saved)
    • CSV - Full export with all fields
    • JSON - Full export in JSON format
  2. Number of results: Based on character of use case
Step 4: Run the Script

Quick answer (display in chat, no file):

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT'

CSV:

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.csv \
  --format csv

JSON:

bash
node --env-file=.env ${CLAUDE_PLUGIN_ROOT}/reference/scripts/run_actor.js \
  --actor "ACTOR_ID" \
  --input 'JSON_INPUT' \
  --output YYYY-MM-DD_OUTPUT_FILE.json \
  --format json
Step 5: Summarize Results and Offer Follow-ups

After completion, report:

  • Number of results found
  • File location and name
  • Key fields available
  • Suggested follow-up workflows based on results:
If User GotSuggest Next
Business listingsEnrich with vdrmota/contact-info-scraper or get reviews
Influencer profilesAnalyze engagement with comment scrapers
Competitor pagesDeep-dive with post/ad scrapers
Trend dataValidate with platform-specific hashtag scrapers

Error Handling

APIFY_TOKEN not found - Ask user to create .env with APIFY_TOKEN=your_token mcpc not found - Ask user to install npm install -g @apify/mcpc Actor not found - Check Actor ID spelling Run FAILED - Ask user to check Apify console link in error output Timeout - Reduce input size or increase --timeout

Limitations

  • Use this skill only when the task clearly matches the scope described above.
  • Do not treat the output as a substitute for environment-specific validation, testing, or expert review.
  • Stop and ask for clarification if required inputs, permissions, safety boundaries, or success criteria are missing.

© sickn33, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file in skills/apify-ultimate-scraper of sickn33/agentic-awesome-skills.

  • SKILL.md
  • reference/scripts/run_actor.js

Open the folder on GitHubat commit 680176d

Used in 2 other repositories

We found 11 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 2 other GitHub owners. This page covers the copy in sickn33/agentic-awesome-skills, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Apify Ultimate Scraper next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Apify Ultimate Scraper compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Apify Ultimate Scraper this skillsickn33/agentic-awesome-skills47k2 repos~2.7kAutomated safety check: NotesMIT
Ig Audience Insightssergebulaev/instagram-skills328—~1.3kAutomated safety check: PassMIT
Apify Google Maps Leadsapify/awesome-skills265—~3.8kAutomated safety check: PassApache-2.0
Meta Ad Scrapergooseworks-ai/goose-skills1.2k1 repos~1.2kAutomated safety check: PassMIT
Luma Event Attendeesgooseworks-ai/goose-skills1.2k1 repos~1.7kAutomated safety check: NotesMIT
Apify Competitor IntelligenceaAAaqwq/AGI-Super-Team1053 repos~1.3kAutomated safety check: NotesMIT

Similar skills

  • Ig Audience Insights

    sergebulaev/instagram-skills

    Read your Instagram niche and profile from real data via Apify, no login.

    328 GitHub stars~1.3k tokensUpdated 2 days ago
    Data & AnalyticsAuto-check passed
  • Apify Google Maps Leads

    apify/awesome-skills

    Official

    Build a local-business lead database from Google Maps in one Apify pipeline: search by target audience + geography, enrich each place with company contacts from its website, leads enrichment (names…

    265 GitHub stars~3.8k tokensUpdated 16 days ago
    Data & AnalyticsAuto-check passed
  • Meta Ad Scraper

    gooseworks-ai/goose-skills

    Scrape competitor ads from Meta's Ad Library (Facebook, Instagram, Messenger, Threads, WhatsApp).

    1.2k GitHub starsUsed in 1 repo~1.2k tokens
    Data & AnalyticsAuto-check passed
  • Luma Event Attendees

    gooseworks-ai/goose-skills

    Find speakers, hosts, and guest profiles at conferences and events on Luma.

    1.2k GitHub starsUsed in 1 repo~1.7k tokens
    Data & AnalyticsAuto-check: notes
  • Apify Competitor Intelligence

    aAAaqwq/AGI-Super-Team

    Analyze competitor strategies, content, pricing, ads, and market positioning across Google Maps, Booking.com, Facebook, Instagram, YouTube, and TikTok.

    105 GitHub starsUsed in 3 repos~1.3k tokens
    Data & AnalyticsAuto-check: notes
  • Apify Creator Emails

    apify/awesome-skills

    Official

    Find creators and their published contact emails in one run.

    265 GitHub stars~3.9k tokensUpdated 16 days ago
    Data & AnalyticsAuto-check passed

More from sickn33/agentic-awesome-skills

All 1,493 skills in this repo
  • Liuguang Banlan UI

    sickn33/agentic-awesome-skills

    Implements an interface in one of two named color modes, iridescent white or colorful black, from a parameterized starter that reports measured color intensity.

    47k GitHub starsUsed in 1 repo~2.5k tokens
    Auto-check passed
  • User Thoughts Memory

    sickn33/agentic-awesome-skills

    Saves a user's project decisions, rules and preferences into a project-local mdbase so later sessions and other agents can recover the intent.

    47k GitHub starsUsed in 1 repo~2.5k tokens
    Auto-check passed
  • Using LWC Memory and Graphs

    sickn33/agentic-awesome-skills

    Keeps project decisions, research and verified results available across coding-agent sessions through LWC memory, a document Wiki graph and a CodeGraph code index.

    47k GitHub starsUsed in 1 repo~2k tokens
    Auto-check passed
  • Find Complementary Founders

    sickn33/agentic-awesome-skills

    Guides an agent through assessing its own owner for cofounder fit, publishing an approved profile, and ranking complementary profiles other agents published for their owners.

    47k GitHub starsUsed in 1 repo~4.8k tokens
    Auto-check passed
  • Whatsapp Cloud API

    sickn33/agentic-awesome-skills

    Integracao com WhatsApp Business Cloud API (Meta). An agent skill from sickn33/agentic-awesome-skills.

    47k GitHub starsUsed in 2 repos~4.5k tokens
    Auto-check passed
  • Cline Pilot

    sickn33/agentic-awesome-skills

    Acts as a proxy for the Cline CLI, dispatching coding tasks one at a time, monitoring runs by hard evidence, relaying decisions to you and learning per-project preferences.

    47k GitHub starsUsed in 1 repo~4.6k tokens
    Auto-check passed

Works with

Questions about Apify Ultimate Scraper

What does Apify Ultimate Scraper do?

AI-driven data extraction from 55+ Actors across all major platforms. Apify Ultimate Scraper is an agent skill from sickn33/agentic-awesome-skills. AI-driven data extraction from 55+ Actors across all major platforms.

When should I use Apify Ultimate Scraper?

Apify Ultimate Scraper fits situations like: tasks that involve Web scraping.

How do I install Apify Ultimate Scraper in Claude Code?

Run `npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper -a claude-code`. Or copy the skill folder (skills/apify-ultimate-scraper in sickn33/agentic-awesome-skills) into .claude/skills/apify-ultimate-scraper in your project. Claude Code loads it when a task matches its description.

How do I install Apify Ultimate Scraper in Codex?

Run `npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper -a codex`. Or copy the skill folder (skills/apify-ultimate-scraper in sickn33/agentic-awesome-skills) into .agents/skills/apify-ultimate-scraper in your project. Codex loads it when a task matches its description.

Can I use Apify Ultimate Scraper in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add sickn33/agentic-awesome-skills --skill apify-ultimate-scraper -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/apify-ultimate-scraper, .gemini/skills/apify-ultimate-scraper, .github/skills/apify-ultimate-scraper and .opencode/skills/apify-ultimate-scraper in your project.

What does Apify Ultimate Scraper need to run?

Going by SKILL.md and its folder, Apify Ultimate Scraper needs JavaScript for the scripts in its folder, the command-line tools its instructions call (node, jq and npm) and credentials named APIFY_TOKEN. Our summary lists: Node.js; A credential in APIFY_TOKEN.

Does Apify Ultimate Scraper access the network?

SKILL.md names 1 domain. As links in the text: apify.com. This is read from the text; nothing was executed.

Is Apify Ultimate Scraper safe to install?

Our automated static check of SKILL.md found notes only (mentions a .env file), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Apify Ultimate Scraper use?

Apify Ultimate Scraper is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Apify Ultimate Scraper use?

About 2.7k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Apify Ultimate Scraper?

Skills that share tags, products or a category with Apify Ultimate Scraper: Ig Audience Insights (sergebulaev/instagram-skills, 328 stars), Apify Google Maps Leads (apify/awesome-skills, 265 stars), Meta Ad Scraper (gooseworks-ai/goose-skills, 1.2k stars) and Luma Event Attendees (gooseworks-ai/goose-skills, 1.2k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Apify Ultimate Scraper?

sickn33 (a GitHub user) maintains it in sickn33/agentic-awesome-skills, which has 47,379 GitHub stars. The repository holds 1,493 skills in this directory. The repository was last updated on October 9, 2026.

Source: sickn33/agentic-awesome-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.