Web scraping

Manage Apify datasets, key-value stores, and request queues programmatically, and orchestrate multi-Actor pipelines.

jeremylongshore/tons-of-skills-marketplace

Optimize Apify platform costs through memory tuning, compute unit management, and proxy budgeting.

jeremylongshore/tons-of-skills-marketplace

Collect Apify debug evidence for support tickets and troubleshooting.

jeremylongshore/tons-of-skills-marketplace

Deploy Apify Actors and integrate scraping into external applications.

jeremylongshore/tons-of-skills-marketplace

Run your first Apify Actor and retrieve results via apify-client.

jeremylongshore/tons-of-skills-marketplace

Install and configure Apify SDK, CLI, and API client authentication.

jeremylongshore/tons-of-skills-marketplace

Set up local Apify Actor development with the Apify CLI and Crawlee.

jeremylongshore/tons-of-skills-marketplace

Optimize Apify Actor performance: crawl speed, memory usage, concurrency, and proxy rotation.

jeremylongshore/tons-of-skills-marketplace

Production readiness checklist for Apify Actor deployments. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Handle Apify API rate limits with proper backoff and request queuing.

jeremylongshore/tons-of-skills-marketplace

Production-grade architecture patterns for Apify-powered applications.

jeremylongshore/tons-of-skills-marketplace

Production-ready patterns for Apify SDK and apify-client in TypeScript.

jeremylongshore/tons-of-skills-marketplace

Secure Apify API tokens, configure proxy access, and protect Actor data.

jeremylongshore/tons-of-skills-marketplace

Upgrade Apify SDK, apify-client, and Crawlee versions safely.

jeremylongshore/tons-of-skills-marketplace

Implement Apify webhooks for Actor run notifications and event-driven pipelines.

jeremylongshore/tons-of-skills-marketplace

Analyze and operate the Bright Data Web Scraper API async snapshot lifecycle with terminal-state and delivery controls.

jeremylongshore/tons-of-skills-marketplace

Design and review a bounded Bright Data worker deployment with separate proxy, Browser API, scraper, snapshot, and delivery responsibilities.

jeremylongshore/tons-of-skills-marketplace

Gate a Bright Data integration for production with authorization, reliability, cost, data, and rollback evidence.

jeremylongshore/tons-of-skills-marketplace

Wrap the official Bright Data Python SDK and REST contracts behind a typed, testable client boundary.

jeremylongshore/tons-of-skills-marketplace

Migrate Bright Data SDK, API, product, or response-header contracts with fixture evidence and a reversible canary.

jeremylongshore/tons-of-skills-marketplace

Isolate difficult Firecrawl v2 failures by separating caller, authentication, request, queue, rendering, origin, and result-processing evidence.

jeremylongshore/tons-of-skills-marketplace

Select a Firecrawl v2 architecture for interactive scrape, governed batch, scheduled crawl, search enrichment, or self-hosted processing.

jeremylongshore/tons-of-skills-marketplace

Build deterministic CI gates for a Firecrawl v2 integration using synthetic fixtures, pinned schemas, secret scanning, and an optional protected smoke test.

jeremylongshore/tons-of-skills-marketplace

Analyze and resolve current Firecrawl v2 validation, authentication, credit, policy, rate, concurrency, timeout, and server errors.

jeremylongshore/tons-of-skills-marketplace

Implement current Firecrawl v2 scrape and crawl flows with bounded discovery, pagination, content validation, and durable receipts.

jeremylongshore/tons-of-skills-marketplace

Combine Firecrawl v2 map, search, batch scrape, parse, and structured JSON extraction into a governed acquisition workflow.

jeremylongshore/tons-of-skills-marketplace

Measure and reduce Firecrawl credit consumption using explicit limits, endpoint selection, cache policy, format discipline, and spend controls.

jeremylongshore/tons-of-skills-marketplace

Validate, minimize, classify, deduplicate, retain, and dispose of Firecrawl documents and extracted JSON safely.

jeremylongshore/tons-of-skills-marketplace

Assemble a minimal, redacted Firecrawl diagnostic package for internal triage or vendor support.

jeremylongshore/tons-of-skills-marketplace

Deploy a Firecrawl v2 client integration or a reviewed self-hosted stack with secrets, canaries, health evidence, and rollback controls.

jeremylongshore/tons-of-skills-marketplace

Design and audit Firecrawl team roles, API-key ownership, endpoint and format restrictions, IP restrictions, SSO, and separation of duties.

jeremylongshore/tons-of-skills-marketplace

Create the smallest current Firecrawl v2 scrape and verify its provenance, origin status, and output without leaking credentials.

jeremylongshore/tons-of-skills-marketplace

Analyze and mitigate Firecrawl integration incidents involving outage, credits, throttling, policy denial, job failure, webhook loss, or unsafe content.

jeremylongshore/tons-of-skills-marketplace

Install the current Firecrawl Node or Python SDK, configure Cloud authentication, and verify package provenance and secret injection.

jeremylongshore/tons-of-skills-marketplace

Audit a Firecrawl integration for legacy v1 calls, unbounded crawls, incomplete pagination, unsafe retries, retention mistakes, and untrusted-content handling.

jeremylongshore/tons-of-skills-marketplace

Measure Firecrawl throughput under plan, team rate, browser concurrency, queue, timeout, target-policy, and credit constraints.

jeremylongshore/tons-of-skills-marketplace

Build a deterministic Firecrawl development loop with SDK fakes, recorded synthetic contracts, and an optional trusted-network self-hosted stack.

jeremylongshore/tons-of-skills-marketplace

Migrate a custom Puppeteer, Playwright, Cheerio, or third-party scraping workload to Firecrawl v2 with parity, policy, cost, and rollback evidence.

jeremylongshore/tons-of-skills-marketplace

Separate Firecrawl development, staging, and production identities, targets, budgets, policies, telemetry, and data stores.

jeremylongshore/tons-of-skills-marketplace

Instrument Firecrawl v2 requests, async jobs, queue pressure, credits, origin status, webhooks, output quality, and downstream delivery without logging content.

jeremylongshore/tons-of-skills-marketplace

Improve Firecrawl latency and throughput through measured scope, formats, cache freshness, async selection, pagination, and concurrency controls.

jeremylongshore/tons-of-skills-marketplace

Enforce domain authorization, robots and terms review, endpoint and format allowlists, scope, spend, retention, and unsafe-content controls around Firecrawl.

jeremylongshore/tons-of-skills-marketplace

Run a release gate for a Firecrawl v2 integration covering contracts, scope, identity, spend, retention, reliability, observability, and rollback.

jeremylongshore/tons-of-skills-marketplace

Implement bounded Firecrawl throttling and retry behavior using current team RPM, browser concurrency, queue status, timeouts, and Retry-After.

jeremylongshore/tons-of-skills-marketplace

Design a production Firecrawl v2 ingestion system with policy gateway, bounded acquisition, validation, provenance, storage, indexing, observability, and deletion.

jeremylongshore/tons-of-skills-marketplace

Implement bounded retries, durable async state, pagination, idempotency, reconciliation, circuit breaking, cancellation, and degraded modes for Firecrawl v2.

jeremylongshore/tons-of-skills-marketplace

Build a typed, testable Firecrawl v2 adapter for Node or Python with current methods, explicit options, errors, pagination, and dependency control.

jeremylongshore/tons-of-skills-marketplace

Secure Firecrawl identities, targets, request options, webhooks, untrusted content, retention, logs, and self-hosted exposure.

jeremylongshore/tons-of-skills-marketplace