Data pipelines and ETL

A Data Engineering interviewer focused on database performance.

PrepLabsAI/InterviewMentor

Retrieves comprehensive gene information including PubMed publication counts, NCBI summaries, and Ensembl transcript data.

aipoch/medical-research-skills

Azure Event Hubs library for Rust. An agent skill from microsoft/skills.

microsoft/skills

Create professional technical diagrams as standalone animated HTML files with SVG graphics, flowing effects, dark/light theme toggle, and export support.

mingchen666/Reviva

Profile and optimize ETL step performance — CPU time, memory usage, and I/O bottlenecks.

owid/etl

Fix ghost variable warnings by remapping charts from old to new variable IDs.

owid/etl

Sync upstream grapher schema changes (new chart types, config fields, enum values) into the ETL repo — vendored schema, multidim-schema, dataset-schema, and regenerated Python types.

owid/etl

Working with Owl — OWID's lightweight, single-folder pipeline runner for small datasets (an alternative to the full snapshot → meadow → garden → grapher chain).

owid/etl

Upgrades an MWAA environment to a newer Airflow version — within 2.x, within 3.x, or across the 2.x-to-3.x boundary.

aws/agent-toolkit-for-aws

VS-Enhanced Journal Matcher with Journal Intelligence MCP — Real-time journal data pipeline with checkpoint-based human decisions.

brycewang-stanford/Auto-Empirical-Research-Skills

RAG Builder with Parallel Document Processing Vector database construction with local embeddings (zero cost) Handles PDF download, text extraction, chunking, and vector database creation Absorbed B5…

brycewang-stanford/Auto-Empirical-Research-Skills

A skill your agent uses when starting empirical analysis, creating a data pipeline, generating results, or when data or model specifications change.

brycewang-stanford/Auto-Empirical-Research-Skills

DevOps knowledge reference covering Git workflows, testing strategies, DevSecOps, release pipeline orchestration (release.yml, multi-arch images, cosign integration), CI/CD pipelines, database…

telagod/code-abyss

A skill your agent uses to migrate course catalog data from external sources (CSV, PDF, website) and bulk-create Learning and LearningCourse records in Education Cloud.

forcedotcom/sf-skills

A skill your agent uses to configure or inspect Salesforce Data Cloud DataSpace access for permission sets.

forcedotcom/sf-skills

Citizen Intelligence Agency data model integration, riksdag data processing, political entity mapping

Hack23/cia

Design data systems by understanding storage engines, replication, partitioning, transactions, and consistency models.

wondelai/skills

Design and implement integration architectures connecting financial systems — APIs, FIX protocol, ISO 20022, event-driven patterns, batch feeds, idempotency, and resilience.

JoelLewis/finance_skills

A skill your agent uses when a user describes a custom PAIDF Orchestration pipeline — a specific ordered combination of stages such as augmentation only, auto-labeling only, detection+captioning…

NVIDIA/skills

Access the RCSB Protein Data Bank (PDB) to search, download, and programmatically retrieve 3D macromolecular structures and metadata; use when you need structure discovery (text/sequence/3D…

aipoch/medical-research-skills

Oura Ring data integration and analytics. An agent skill from sundial-org/awesome-openclaw-skills.

sundial-org/awesome-openclaw-skills

A skill your agent uses when automating ZBrush 2026: batch processing a folder of OBJ or ZTL files, a ZBrush Python script or ZScript, recording a macro to learn a palette path, the ZBrush -script…

scenario-labs/skills

Authors and deploys MWAA workflow artifacts: Python Airflow DAGs for provisioned environments or YAML workflow files for Serverless.

aws/agent-toolkit-for-aws

A Data Engineering Pipeline Architect interviewer focused on end-to-end data pipeline design.

PrepLabsAI/InterviewMentor

This skill should be used when you need the correct UNIT for a Taiwan MEP quantity (airflow, static pressure, water pressure, pipe diameter, per-person water demand, storage-tank volume, drainage…

h30190/HJPLUS_Taiwan_Architect_KB

The olm:v5 migration script, UpdateTagsService, batch processing, migratedat, ClassifyTagsService deprecated mappings, and data migration from v4 category tables.

OpenLitterMap/openlittermap-web

Create or edit a Grapher chart authored in ETL: a viz://chart step in etl/steps/viz/chart/, either a single chart (dimensions: [], one view) or a multidim (a chart with dropdown dimension selectors…

owid/etl

Create a brand-new OWID dataset in ETL from a data file the user provides — a local CSV/Excel, a downloaded file, or a web link to data (snapshot → meadow → garden → grapher → PR → staging server).

owid/etl

Author or modify an Our World in Data explorer (multi-dimensional dashboard with dropdown selectors, published from ETL via viz://explorer/<ns/latest/<short).

owid/etl

Draft answers for OWID's draft-data-update-slack-post Slack template using snapshot DVC + garden metadata + staging DB queries.

owid/etl

Adversarially review an ETL dataset's data and metadata for factual accuracy — verifies metadata claims against the producer's own documentation (fetched from the links in snapshot .dvc files and…

owid/etl

A skill your agent uses when creating or enriching metadata for OWID ETL datasets - generates comprehensive YAML metadata from dataset inspection, data exploration, and web research following OWID…

owid/etl

Review an OWID ETL data update PR end-to-end — runs the pipeline, compares snapshot fields against the previous version, verifies links, audits indicator metadata coverage, and cross-checks workflow…

owid/etl

Scale Clay enrichment pipelines for high-volume processing (10K-100K+ leads/month).

jeremylongshore/tons-of-skills-marketplace

Ingest data into ClickHouse from webhooks, Kafka, and streaming sources with batching, dedup, and exactly-once patterns.

jeremylongshore/tons-of-skills-marketplace

Advanced Evernote SDK patterns and best practices. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Build event-driven architectures with Groq streaming, batch processing, and async patterns.

jeremylongshore/tons-of-skills-marketplace

Process multiple video generation requests efficiently with Kling AI.

jeremylongshore/tons-of-skills-marketplace

Data synchronization, ETL patterns, and data management for MaintainX.

jeremylongshore/tons-of-skills-marketplace

Gate Navan integration changes with deterministic fixtures and an isolated optional live smoke.

jeremylongshore/tons-of-skills-marketplace

Implement a governed downstream booking-data workflow from Navan into an approved system.

jeremylongshore/tons-of-skills-marketplace

Synchronize Navan booking, expense, identity, and file-delivered data according to each documented source contract.

jeremylongshore/tons-of-skills-marketplace

Tune a Navan data pipeline against measured vendor, destination, privacy, and deadline constraints.

jeremylongshore/tons-of-skills-marketplace

Design and validate a Foundry Python transform pipeline with explicit datasets, compute choice, expectations, and incremental semantics.

jeremylongshore/tons-of-skills-marketplace

Plan and execute a phased migration of data pipelines, Ontology applications, or external integrations into Foundry.

jeremylongshore/tons-of-skills-marketplace

Design a production Foundry architecture spanning data pipelines, Ontology, OSDK or Platform APIs, deployment, governance, and operations.

jeremylongshore/tons-of-skills-marketplace

Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration.

rand/cc-polymath

Builds and operates data pipelines — ingestion, transformation, orchestration, quality testing, and reliability of data delivery.

cbrock84/headcount