Implement API throttling policies to protect backend services from overload.

MITAuto-check passedBackend & APIs

Install Throttling APIs

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill throttling-apis -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace throttling-apis --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/throttling-apis .claude/skills/throttling-apis && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
throttling-apis
GitHub stars
2.8k
Token cost
~1.3k tokens
SKILL.md length
545 words
Files
4 (incl. references)
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Implement API throttling policies to protect backend services from overload.

  • Works in 8 steps: Analyze existing route handlers and… → Implement a concurrency limiter… → Add priority queue support that… → …
  • Controlling API request rates
  • SKILL.md covers Overview, Prerequisites, Instructions and Output, plus 3 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Throttling APIs is an agent skill from jeremylongshore/tons-of-skills-marketplace. Implement API throttling policies to protect backend services from overload. Use when controlling API request rates. Trigger with phrases like "throttle API", "control request rate", or "add throttling".

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. The skill folder holds 4 other files, including reference files (for example `references/errors.md`, `references/examples.md` and `references/implementation.md`). Compatibility notes: Designed for Claude Code

It sits in Backend & APIs, covering Rate limiting. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Controlling API request rates
  • With phrases like throttle API
  • Control request rate

Example prompts

  • “throttle API”
  • “control request rate”
  • “add throttling”
  • “/throttling-apis”

Requirements

  • Node.js
  • Compatibility (from SKILL.md): Designed for Claude Code
  • Pre-approved tools (allowed-tools): Read, Write, Edit, Grep, Glob, Bash(api:throttle-*)

Workflow steps

8 steps, taken from the first numbered list in SKILL.md.

  1. Analyze existing route handlers and middleware using Grep and Read to identify endpoints with high latency, database-heavy operations, or…
  2. Implement a concurrency limiter middleware that tracks in-flight requests per endpoint and rejects new requests with 503 Service…
  3. Add priority queue support that classifies requests by API key tier (free, pro, enterprise) and serves higher-tier requests first when…
  4. Build a circuit breaker for downstream service calls that opens after configurable failure thresholds (e.g., 5 failures in 10 seconds)…
  5. Configure adaptive throttling that monitors backend response latency percentiles (p95, p99) and automatically reduces concurrency limits…
  6. Add throttle state headers to all responses: X-Throttle-Limit, X-Throttle-Remaining, and X-Throttle-Reset for client-side awareness.
  7. Implement graceful degradation strategies per endpoint: serve cached responses, return partial results, or queue requests for deferred…
  8. Write load tests that verify throttle engagement at expected thresholds, proper 503 responses with Retry-After, and recovery behavior when…

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Write
    • Edit
    • Grep
    • Glob
    • Bash(api:throttle-*)

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Claude Code

    From compatibility in the SKILL.md frontmatter.

Context cost

Throttling APIs loads about 1.3k tokens when it runs, and up to ~3.5k if it reads all its reference files. Until then it costs about 55 tokens; SKILL.md has 545 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~55
When it runs · the whole SKILL.md, loaded when a task matches
~1.3k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~3.5k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 545 words, ~1,289 tokens.

Download SKILL.mdSave it as .claude/skills/throttling-apis/SKILL.md (or your agent's skills folder). This skill also uses 3 other files; get the full folder from GitHub.
name
throttling-apis
description
Implement API throttling policies to protect backend services from overload. Use when controlling API request rates. Trigger with phrases like "throttle API", "control request rate", or "add throttling".
allowed-tools
Read, Write, Edit, Grep, Glob, Bash(api:throttle-*)
compatibility
Designed for Claude Code
version
1.25.0
author
Jeremy Longshore <jeremy@intentsolutions.io>
license
MIT
tags
api, throttling-apis

Throttling APIs

Overview

Implement API throttling policies that protect backend services from overload by controlling request concurrency, queue depth, and processing rates. Apply backpressure mechanisms including concurrent request limits, priority queues, circuit breakers, and adaptive throttling that adjusts limits based on real-time backend health metrics.

Prerequisites

  • Middleware-capable web framework (Express, FastAPI, Spring Boot, Gin)
  • Redis or in-memory store for distributed throttle state tracking
  • Monitoring system exposing backend latency and error rate metrics (Prometheus, CloudWatch)
  • Load testing tool (k6, Artillery, wrk) for validating throttle behavior under pressure
  • Queue system for request buffering during throttle events (optional: Bull, SQS)

Instructions

  1. Analyze existing route handlers and middleware using Grep and Read to identify endpoints with high latency, database-heavy operations, or external service dependencies that need throttle protection.
  2. Implement a concurrency limiter middleware that tracks in-flight requests per endpoint and rejects new requests with 503 Service Unavailable when the concurrent limit is reached.
  3. Add priority queue support that classifies requests by API key tier (free, pro, enterprise) and serves higher-tier requests first when approaching throttle limits.
  4. Build a circuit breaker for downstream service calls that opens after configurable failure thresholds (e.g., 5 failures in 10 seconds), returning 503 with Retry-After during the open state.
  5. Configure adaptive throttling that monitors backend response latency percentiles (p95, p99) and automatically reduces concurrency limits when latency exceeds SLO thresholds.
  6. Add throttle state headers to all responses: X-Throttle-Limit, X-Throttle-Remaining, and X-Throttle-Reset for client-side awareness.
  7. Implement graceful degradation strategies per endpoint: serve cached responses, return partial results, or queue requests for deferred processing.
  8. Write load tests that verify throttle engagement at expected thresholds, proper 503 responses with Retry-After, and recovery behavior when load subsides.

See ${CLAUDE_SKILL_DIR}/references/implementation.md for the full implementation guide.

Output

  • ${CLAUDE_SKILL_DIR}/src/middleware/throttle.js - Concurrency and request rate throttling middleware
  • ${CLAUDE_SKILL_DIR}/src/middleware/circuit-breaker.js - Circuit breaker for downstream service protection
  • ${CLAUDE_SKILL_DIR}/src/middleware/priority-queue.js - Tier-based request prioritization
  • ${CLAUDE_SKILL_DIR}/src/config/throttle-config.js - Per-endpoint throttle policy definitions
  • ${CLAUDE_SKILL_DIR}/tests/throttle/ - Load tests validating throttle engagement and recovery
Show full SKILL.md (224 more words)Show less

Error Handling

ErrorCauseSolution
503 Service UnavailableConcurrency limit reached for the endpointReturn Retry-After header with estimated wait time; include throttle state headers
503 Circuit OpenCircuit breaker tripped due to downstream failuresReturn cached response if available; provide circuit reset time in response body
Queue overflowRequest buffer exceeded maximum depthReject with 503; alert operations team; consider scaling backend capacity
Stale throttle stateRedis connection lost; throttle counters become inaccurateFall back to in-process counters; reconnect with backoff; log state inconsistency
Priority starvationLow-tier requests never served under sustained high-tier loadReserve minimum throughput percentage for each tier to prevent complete starvation

Refer to ${CLAUDE_SKILL_DIR}/references/errors.md for comprehensive error patterns.

Examples

Database-heavy endpoint protection: Apply concurrency limit of 10 to a report generation endpoint that runs expensive aggregation queries, queueing additional requests with estimated wait times.

Multi-tier SaaS throttling: Enterprise tier gets 100 concurrent requests, Pro tier gets 25, Free tier gets 5, with priority queue ensuring enterprise requests are served first during contention.

Adaptive autoscaling trigger: Throttle middleware emits metrics that trigger horizontal pod autoscaling when throttle engagement rate exceeds 20% sustained over 5 minutes.

See ${CLAUDE_SKILL_DIR}/references/examples.md for additional examples.

Resources

  • Circuit Breaker pattern: Martin Fowler's design patterns
  • Resilience4j (Java) and cockatiel (Node.js) circuit breaker libraries
  • Netflix Concurrency Limits library for adaptive throttling
  • Token bucket and leaky bucket algorithm implementations

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 3 other files (references) in skills/.curated/throttling-apis of jeremylongshore/tons-of-skills-marketplace.

  • SKILL.md
  • references/errors.md
  • references/examples.md
  • references/implementation.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Throttling APIs next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Throttling APIs compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Throttling APIs this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.3kAutomated safety check: PassMIT
Add Hosted Keysimstudioai/sim30k—~3.6kAutomated safety check: PassApache-2.0
Upstash Ratelimit TSupstash/ratelimit-js2k—~313Automated safety check: PassMIT
Repo2skillzhangyanxs/repo2skill246—~3.6kAutomated safety check: PassNone
Better Auth Security Best PracticesEpicenterHQ/epicenter4.8k—~896Automated safety check: PassCustom licence
Dload Fetch Toolphp-internal/dload105—~1.1kAutomated safety check: PassBSD-3-Clause

Similar skills

  • Add Hosted Key

    simstudioai/sim

    Add hosted API key support to a tool so Sim provides the key (metered and billed to the workspace) when a user has not brought their own.

    30k GitHub stars~3.6k tokensUpdated today
    Backend & APIsAuto-check passed
  • Upstash Ratelimit TS

    upstash/ratelimit-js

    Official

    Lightweight guidance for using the Redis Rate Limit TypeScript SDK, including setup steps, basic usage, and pointers to advanced algorithm, features, pricing, and traffic‑protection docs.

    2k GitHub stars~313 tokensUpdated 16 days ago
    Backend & APIsAuto-check passed
  • Repo2skill

    zhangyanxs/repo2skill

    Convert GitHub/GitLab/Gitee repositories into comprehensive OpenCode Skills using embedded LLM calls with multiple mirrors and rate limit handling

    246 GitHub stars~3.6k tokensUpdated 7 mo ago
    Backend & APIsAuto-check passed
  • Better Auth security hardening: rate limits, secrets, CSRF, trusted origins, cookies, sessions, OAuth tokens, and audit logging.

    4.8k GitHub stars~896 tokensUpdated 3 days ago
    Backend & APIsAuto-check passed
  • Dload Fetch Tool

    php-internal/dload

    Get a CLI tool — native binary or PHAR — from a GitHub release into a project folder with dload (vendor/bin/dload).

    105 GitHub stars~1.1k tokensUpdated today
    Backend & APIsAuto-check passed
  • API Gateway

    itsmostafa/aws-agent-skills

    AWS API Gateway for REST and HTTP API management. An agent skill from itsmostafa/aws-agent-skills.

    1.2k GitHub stars~2.2k tokensUpdated 5 days ago
    Backend & APIsAuto-check passed

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo
  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes
  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed
  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Categories

Questions about Throttling APIs

What does Throttling APIs do?

Implement API throttling policies to protect backend services from overload. Throttling APIs is an agent skill from jeremylongshore/tons-of-skills-marketplace. Implement API throttling policies to protect backend services from overload.

When should I use Throttling APIs?

Throttling APIs fits situations like: controlling API request rates; with phrases like throttle API; control request rate.

How do I install Throttling APIs in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill throttling-apis -a claude-code`. Or copy the skill folder (skills/.curated/throttling-apis in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/throttling-apis in your project. Claude Code loads it when a task matches its description.

How do I install Throttling APIs in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill throttling-apis -a codex`. Or copy the skill folder (skills/.curated/throttling-apis in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/throttling-apis in your project. Codex loads it when a task matches its description.

Can I use Throttling APIs in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill throttling-apis -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/throttling-apis, .gemini/skills/throttling-apis, .github/skills/throttling-apis and .opencode/skills/throttling-apis in your project.

What does Throttling APIs need to run?

SKILL.md names no scripts, command-line tools or credentials: Throttling APIs is instructions for the agent only. Our summary lists: Node.js. Its frontmatter pre-approves these tools: Read, Write, Edit, Grep, Glob, Bash(api:throttle-*). Compatibility (from SKILL.md): Designed for Claude Code.

Does Throttling APIs access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Throttling APIs safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Throttling APIs use?

Throttling APIs is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Throttling APIs use?

About 1.3k tokens (SKILL.md is roughly 5.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 2.2k tokens, read only when the agent opens those files.

What are the alternatives to Throttling APIs?

Skills that share tags, products or a category with Throttling APIs: Add Hosted Key (simstudioai/sim, 30k stars), Upstash Ratelimit TS (upstash/ratelimit-js, 2k stars), Repo2skill (zhangyanxs/repo2skill, 246 stars) and Better Auth Security Best Practices (EpicenterHQ/epicenter, 4.8k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Throttling APIs?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.