Best Data pipelines and ETL skills, page 2

Run a selected coding-agent CLI programmatically, with latency, error, usage, cost, and trace logging.

swyxio/skills

Comprehensive guide for Go database access — parameterized queries, struct scanning, NULLable columns, transactions, isolation levels, SELECT FOR UPDATE, connection pool, batch processing, context…

unxed/f4

Create a new Whirl environment in the envs/ directory. An agent skill from godatadriven/whirl.

godatadriven/whirl

Finds authoritative public data sources for modeling tasks, prefers official APIs and bulk downloads, and outputs a reproducible fetch and cleaning plan with citations.

yushui2022/MathModel-Skill

Workflow and best practices for writing Apache Airflow DAGs.

astronomer/agents

Develop and modify nspl, a 2D scientific plotting library for Scala and Scala.js.

pityka/nspl

Bumps the dbt-artifacts-parser package semver, prepares a PyPI release, and aligns GitHub Releases with version.

yu-iskw/dbt-artifacts-parser

A skill your agent uses when writing, editing, reviewing, or running functional (end-to-end) tests for the Astronomer airflow-chart repository.

astronomer/airflow-chart

Decompose complex tasks into parallel sub-agents. An agent skill from shuyu-labs/WebCode.

shuyu-labs/WebCode

Sets up Dinobase, a local DuckDB database that syncs data from 100+ business sources, then answers questions across them with SQL joins and previewed write-backs.

kappa90/dinobase

Uses Ray Data to read, transform and write large datasets across a cluster for ML training and batch inference, with streaming execution and optional GPU steps.

Orchestra-Research/AI-Research-SKILLs

Guidance for using Ramda in transformation-heavy TypeScript or JavaScript.

valkey-io/valkey-admin

Create a new Whirl example project in the examples/ directory.

godatadriven/whirl

Deploys Airflow DAGs and projects. An agent skill from astronomer/agents.

astronomer/agents

Guides writing and tuning Apache Spark jobs: DataFrame and RDD code, Spark SQL, partitioning, caching, shuffle tuning and structured streaming.

Jeffallan/claude-skills

Sets up data quality checks with Great Expectations, dbt tests and data contracts, with checkpoints and pass-fail reports for pipelines.

wshobson/agents

Extracts pixel, video-frame, speech, music and visual-semantic features from image, video and audio files for research datasets, using local tools or the Gemini API.

TyrealQ/q-skills

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

benchflow-ai/skillsbench

Guides an agent through designing an MLOps pipeline that covers data preparation, training, validation and deployment, with DAG orchestration and reference guides.

wshobson/agents

Process multiple source documents with Extract-Then-Aggregate discipline.

kbanc85/claudia

Pre-PR code review gate. An agent skill from ByteDance-Seed/VeOmni.

ByteDance-Seed/VeOmni

Scaffold a new dbt-bouncer check class with tests. An agent skill from godatadriven/dbt-bouncer.

godatadriven/dbt-bouncer

Creates or modifies dbt models in line with a project's own conventions, then runs dbt build and dbt show to check the output instead of stopping at compile.

AltimateAI/data-engineering-skills

Patterns for writing production-ready Apache Airflow DAGs: task dependencies, custom operators and sensors, local testing, and rules for what to avoid.

wshobson/agents

Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies.

wshobson/agents

Speed up slow Apache Spark jobs by tuning partitions, shuffles, data skew, caching and executor memory, with do and don't rules for PySpark code.

wshobson/agents

Expert Django Celery guidance for asynchronous task processing.

vintasoftware/django-ai-plugins

Checks a Workers sync capability against a list of common bugs, such as stuck cursors, endless pagination and lost deletions, and reports by severity.

makenotion/workers-template

Apple HIG guidance for status and progress UI components including progress indicators, status bars, and activity rings.

raintree-technology/hig-doctor

Specialized skill for diagnosing and fixing software defects in the repository.

dbt-labs/terraform-provider-dbtcloud

Bump the Airflow or Python version across all project files.

godatadriven/whirl

更新编码套餐与 OpenRouter 指标/套餐 JSON、修复抓取失败或 pending。Use when: pricing:fetch, metrics:fetch, openrouter:plans:fetch, provider-pricing.json, dashboard 数据过期或 CI 定价 issue。

jqknono/coding-plans-for-copilot

Trace downstream data lineage and impact analysis. An agent skill from astronomer/agents.

astronomer/agents

A skill your agent uses for Helm chart work - creating charts, modifying existing charts, values design, testing.

astronomer/airflow-chart

Expert guidance for working with Dagster and the dg CLI. An agent skill from dagster-io/skills.

dagster-io/skills

Extracts research papers from .bib and .html venue files, filters them by relevance, labels them with a two-level taxonomy through Claude and rebuilds a website.

PurCL/ASE

File sentinel that monitors the working directory for changes and marker comments, then auto-triggers appropriate skills.

SethGammon/Citadel

Builds Windmill data pipelines as independent, pipeline-annotated scripts forming a DAG over shared storage, defaulting to DuckDB nodes that materialize into DuckLake tables.

windmill-labs/windmill

Walks through fixing dbt compilation, database and test errors: read the full error, check upstream models, apply a fix, then verify with dbt build and a data preview.

AltimateAI/data-engineering-skills

Design database schemas with Prisma/Drizzle, PostgreSQL index strategy (B-tree, GIN, GiST, BRIN, Hash), query optimization (EXPLAIN ANALYZE), migration safety (expand/contract, zero-downtime), and…

EliasOulkadi/shokunin

Run Python code in the cloud with serverless containers, GPUs, and autoscaling.

davila7/claude-code-templates

Trace upstream data lineage. An agent skill from astronomer/agents.

astronomer/agents

Microscopy data management platform. An agent skill from davila7/claude-code-templates.

davila7/claude-code-templates

Applies the reasoning style of Daphne Koller (machine learning pioneer, co-founder of Coursera, founder and CEO of Insitro).

K-Dense-AI/mimeo

Regenerate dbt test fixtures after dbtproject changes. An agent skill from godatadriven/dbt-bouncer.

godatadriven/dbt-bouncer

A skill your agent uses when the user asks to "check data usage", "list TCO policies", "reduce Coralogix costs", "optimize observability spend", "lower our logging bill", "data budget exceeded"…

coralogix/cx-cli

Analytics engineering across data modeling, dbt, transformation, and semantic layers.

borghei/Claude-Skills

Helps choose an incremental strategy, design a reliable unique_key and debug failing dbt incremental models, and says when a plain table is the better choice.

AltimateAI/data-engineering-skills