Agent skill

Apify Rate Limits

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Handle Apify API rate limits with proper backoff and request queuing.

Install Apify Rate Limits

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/apify-rate-limits .claude/skills/apify-rate-limits && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .claude/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/.curated/apify-rate-limits .agents/skills/apify-rate-limits && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .agents/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/.curated/apify-rate-limits .cursor/skills/apify-rate-limits && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .cursor/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/jeremylongshore/tons-of-skills-marketplace.git --path skills/.curated/apify-rate-limits

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/.curated/apify-rate-limits .gemini/skills/apify-rate-limits && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .gemini/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/.curated/apify-rate-limits .github/skills/apify-rate-limits && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .github/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install jeremylongshore/tons-of-skills-marketplace apify-rate-limits --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/.curated/apify-rate-limits .opencode/skills/apify-rate-limits && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "apify-rate-limits" agent skill from https://github.com/jeremylongshore/tons-of-skills-marketplace/tree/main/skills/.curated/apify-rate-limits into .opencode/skills/apify-rate-limits/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "apify-rate-limits", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: apify-rate-limits
GitHub stars: 2.8k
Token cost: ~1.3k tokens
SKILL.md length: 527 words
Files: 3 (incl. references)
Skills in repo: 3,342
Repo updated: Oct 10, 2026
First seen: Oct 8, 2026
Licence: MIT

At a glance

Handle Apify API rate limits with proper backoff and request queuing.

Works in 5 steps: Understand built-in retries —… → Batch operations (biggest lever) —… → Queue custom calls — gate raw API calls… → …
Hitting 429 errors
SKILL.md covers Overview, Prerequisites, Instructions and Output, plus 3 more sections
Calls npm; needs APIFY_TOKEN

What it does

Apify Rate Limits is an agent skill from jeremylongshore/tons-of-skills-marketplace. Handle Apify API rate limits with proper backoff and request queuing. Use when hitting 429 errors, optimizing API request throughput, or implementing rate-aware client wrappers. Trigger with "apify rate limit", "apify throttling", "apify 429", "apify retry", "apify backoff", "too many requests apify".

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files, including reference files (for example `references/examples.md` and `references/implementation.md`). Compatibility notes: Designed for Claude Code

It sits in Backend & APIs, covering Rate limiting and Web scraping. It works with Apify. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

Hitting 429 errors
Optimizing API request throughput
Implementing rate-aware client wrappers
With apify rate limit

Example prompts

“apify rate limit”
“apify throttling”
“apify 429”
“/apify-rate-limits”

Requirements

Node.js
A credential in APIFY_TOKEN
Compatibility (from SKILL.md): Designed for Claude Code
Pre-approved tools (allowed-tools): Read, Write, Edit

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

Understand built-in retries — apify-client already retries 429/500+ with
Batch operations (biggest lever) — collapse per-item loops into one batched
Queue custom calls — gate raw API calls through p-queue
Stagger Actor starts — insert a ~200 ms delay between start() calls so the
Monitor headers — feed X-RateLimit-* into a small monitor that warns before

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves these tools, so the agent can use them without asking each time:
- Read
- Write
- Edit
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
- npm
From the folder's file list and the shell code blocks in SKILL.md.
Network
Links to these hosts (documentation or services it may open):
- docs.apify.com
- github.com
- crawlee.dev
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names these keys or tokens, usually read from environment variables:
- APIFY_TOKEN
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Compatibility
Designed for Claude Code
From compatibility in the SKILL.md frontmatter.

Context cost

Apify Rate Limits loads about 1.3k tokens when it runs, and up to ~3.2k if it reads all its reference files. Until then it costs about 80 tokens; SKILL.md has 527 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~80
When it runs · the whole SKILL.md, loaded when a task matches: ~1.3k
With references · SKILL.md plus every file in references/, read only if the agent opens them: ~3.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 527 words, ~1,336 tokens.

Download SKILL.mdSave it as .claude/skills/apify-rate-limits/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.

name: apify-rate-limits
description: Handle Apify API rate limits with proper backoff and request queuing. Use when hitting 429 errors, optimizing API request throughput, or implementing rate-aware client wrappers. Trigger with "apify rate limit", "apify throttling", "apify 429", "apify retry", "apify backoff", "too many requests apify".
allowed-tools: Read, Write, Edit
compatibility: Designed for Claude Code
version: 1.5.0
license: MIT
author: Jeremy Longshore <jeremy@intentsolutions.io>
tags: saas, scraping, automation, apify

Apify Rate Limits

Overview

The Apify API enforces rate limits per resource. The apify-client library auto-retries 429s (up to 8 times with exponential backoff), so most workloads never notice a limit. You reach for this skill when bulk operations, custom API calls, or large fan-outs push past what the built-in retry can absorb — you then batch, queue, stagger, and monitor to stay under the ceiling.

Full runnable code for every step is in implementation.md; combined scenarios are in examples.md.

Apify rate limit rules

Scope	Limit	Notes
Per resource (default)	60 req/sec	Applies to each Actor, dataset, KV store independently
Dataset push	60 req/sec per dataset	Batch items to reduce call count
Actor runs	60 req/sec per Actor	Start runs in sequence or with delays
Platform-wide	Higher limit	Aggregate across all resources

"Per resource" means: calls to dataset A and dataset B each get 60 req/sec independently. Every response carries X-RateLimit-Limit, X-RateLimit-Remaining, and X-RateLimit-Reset (epoch seconds) headers.

Prerequisites

An Apify account with API access and APIFY_TOKEN set in the environment.
The apify-client package installed (npm install apify-client).
For custom queuing: p-queue (npm install p-queue); crawlee for sleep and crawler-level concurrency.

Instructions

The workflow is five steps. Each is summarized here with its core lever; the full runnable code for every step is in implementation.md.

Understand built-in retries — apify-client already retries 429/500+ with exponential backoff. Tune maxRetries / minDelayBetweenRetriesMillis only when the defaults are wrong for your endpoint:

typescript

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({
  token: process.env.APIFY_TOKEN,
  maxRetries: 5,                      // Default: 8
  minDelayBetweenRetriesMillis: 500,  // Default: 500
});

Batch operations (biggest lever) — collapse per-item loops into one batched call (up to 9 MB), chunking only for very large datasets:
typescript
```
await client.dataset(dsId).pushItems(items);   // 1 call, not N
```
Queue custom calls — gate raw API calls through p-queue (concurrency + intervalCap) so fan-out reads never exceed 60 req/sec. See implementation.md § Step 3.
Stagger Actor starts — insert a ~200 ms delay between start() calls so the runs endpoint never 429s, then waitForFinish() in parallel. See implementation.md § Step 4.
Monitor headers — feed X-RateLimit-* into a small monitor that warns before the wall and pauses exactly until reset. See implementation.md § Step 5.

Target-website throttling is a separate ceiling from the platform API — cap it with Crawlee's maxConcurrency / maxRequestsPerMinute (implementation.md § Crawlee-level concurrency).

Show full SKILL.md (178 more words)Show less

Output

Applying this skill produces a rate-aware Apify integration:

A configured ApifyClient with an explicit retry envelope.
Batched/chunked dataset writes that cut API-call count by orders of magnitude.
A p-queue-gated call path that holds requests under 60 req/sec per resource.
Staggered Actor starts and, optionally, a header-driven monitor that pauses before exhaustion — the net effect being zero (or transparently retried) 429s under load.

Error Handling

Scenario	Detection	Response
API 429	`apify-client` auto-retries	Usually transparent; increase delays if persistent
Target site 429	`statusCode === 429` in handler	Reduce `maxConcurrency`, add proxy rotation
Burst of starts	Starting 100+ runs at once	Stagger with 200ms delays
Large data push	Single 50MB dataset push	Chunk into 9MB batches

Examples

Worked end-to-end scenarios live in examples.md:

Bulk dataset push without 429s — 50,000 rows in ~50 calls via chunked batching.
Fan-out reads through a queue — 500 Actor reads held under 50 req/sec.
Launch 100 runs safely — staggered starts, then parallel wait-for-finish.
Pause on header-driven exhaustion — sleep exactly until the limit resets.

Resources

For security configuration, see apify-security-basics.

Files

SKILL.md and 2 other files (references) in skills/.curated/apify-rate-limits of jeremylongshore/tons-of-skills-marketplace.

SKILL.md
references/examples.md
references/implementation.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Apify Rate Limits next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Apify Rate Limits compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Apify Rate Limits this skilljeremylongshore/tons-of-skills-marketplace	2.8k	—	~1.3k	Automated safety check: Pass	MIT	yesterday
Fullenrich Event AttendeesOthmane-Khadri/YALC-the-GTM-operating-system	318	—	~1.4k	Automated safety check: Warn	MIT	1 mo ago
Fallback And Resilienceborski/travel-hacking-toolkit	688	—	~1.6k	Automated safety check: Pass	MIT	5 days ago
Apify Integration Developmentapify/agent-skills	2.4k	—	~3.4k	Automated safety check: Pass	None	2 days ago
Anti Bot Analyzerrevfactory/harness-100	1.3k	—	~1.1k	Automated safety check: Pass	Apache-2.0	6 mo ago
Apify Actorizationsickn33/agentic-awesome-skills	47k	2 repos	~1.7k	Automated safety check: Pass	MIT	yesterday

Similar skills

Fullenrich Event Attendees
Othmane-Khadri/YALC-the-GTM-operating-system
A skill your agent uses when the user says "enrich this LinkedIn event", "enrich attendees of this event", "enrich this attendees CSV", "scrape and enrich LinkedIn event {URL}", "FullEnrich event…
318 GitHub stars~1.4k tokensUpdated 1 mo ago
Backend & APIsAuto-check: warnings
Fallback And Resilience
borski/travel-hacking-toolkit
What to do when a tool fails, an API hits a rate limit, or a site blocks scraping.
688 GitHub stars~1.6k tokensUpdated 5 days ago
Backend & APIsAuto-check passed
Apify Integration Development
apify/agent-skills
Official
Guides designing and building an official Apify integration for a company's product: workflow-automation apps, AI agent plugins, AI framework packages or direct API clients.
2.4k GitHub stars~3.4k tokensUpdated 2 days ago
Backend & APIsAuto-check passed
Anti Bot Analyzer
revfactory/harness-100
A skill for analyzing website anti-bot defense mechanisms and developing legitimate evasion strategies.
1.3k GitHub stars~1.1k tokensUpdated 6 mo ago
Data & AnalyticsAuto-check passed
Apify Actorization
sickn33/agentic-awesome-skills
Actorization converts existing software into reusable serverless applications compatible with the Apify platform.
47k GitHub starsUsed in 2 repos~1.7k tokens
Data & AnalyticsAuto-check passed
Hacker News Scraper
gooseworks-ai/goose-skills
Search Hacker News stories and comments using the free Algolia API.
1.2k GitHub starsUsed in 1 repo~538 tokens
Data & AnalyticsAuto-check passed

Questions about Apify Rate Limits

What does Apify Rate Limits do?

Handle Apify API rate limits with proper backoff and request queuing. Apify Rate Limits is an agent skill from jeremylongshore/tons-of-skills-marketplace. Handle Apify API rate limits with proper backoff and request queuing.

When should I use Apify Rate Limits?

Apify Rate Limits fits situations like: hitting 429 errors; optimizing API request throughput; implementing rate-aware client wrappers; with apify rate limit.

How do I install Apify Rate Limits in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a claude-code`. Or copy the skill folder (skills/.curated/apify-rate-limits in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/apify-rate-limits in your project. Claude Code loads it when a task matches its description.

How do I install Apify Rate Limits in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a codex`. Or copy the skill folder (skills/.curated/apify-rate-limits in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/apify-rate-limits in your project. Codex loads it when a task matches its description.

Can I use Apify Rate Limits in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill apify-rate-limits -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/apify-rate-limits, .gemini/skills/apify-rate-limits, .github/skills/apify-rate-limits and .opencode/skills/apify-rate-limits in your project.

What does Apify Rate Limits need to run?

Going by SKILL.md and its folder, Apify Rate Limits needs the command-line tools its instructions call (npm) and credentials named APIFY_TOKEN. Our summary lists: Node.js; A credential in APIFY_TOKEN. Its frontmatter pre-approves these tools: Read, Write, Edit. Compatibility (from SKILL.md): Designed for Claude Code.

Does Apify Rate Limits access the network?

SKILL.md names 3 domains. As links in the text: docs.apify.com, github.com and crawlee.dev. This is read from the text; nothing was executed.

Is Apify Rate Limits safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Apify Rate Limits use?

Apify Rate Limits is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Apify Rate Limits use?

About 1.3k tokens (SKILL.md is roughly 5.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 1.9k tokens, read only when the agent opens those files.

What are the alternatives to Apify Rate Limits?

Skills that share tags, products or a category with Apify Rate Limits: Fullenrich Event Attendees (Othmane-Khadri/YALC-the-GTM-operating-system, 318 stars), Fallback And Resilience (borski/travel-hacking-toolkit, 688 stars), Apify Integration Development (apify/agent-skills, 2.4k stars) and Anti Bot Analyzer (revfactory/harness-100, 1.3k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Apify Rate Limits?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Install Apify Rate Limits

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Compatibility

Context cost

Safety

SKILL.md

Apify Rate Limits

Overview

Apify rate limit rules

Prerequisites

Instructions

Output

Error Handling

Examples

Resources

Files

Compare with similar skills

Similar skills

More from jeremylongshore/tons-of-skills-marketplace

Related

Questions about Apify Rate Limits