Best Data pipelines and ETL skills for Claude Code, Codex and other agents.

Stands up a throwaway local SQL Server 2022 backend, applies SQL fixtures and runs Airbyte spec, check, discover and read against source-mssql images.

airbytehq/airbyte

Builds validated architecture, workflow, sequence, data-flow and lifecycle diagrams as standalone interactive HTML from a small JSON spec, with optional motion and image export.

Unclecheng-li/AI_Animation

Stands up a throwaway local MySQL 8.0 backend, applies SQL fixtures and sweeps the Airbyte spec, check, discover and read commands against a source-mysql image.

airbytehq/airbyte

Create professional architecture, workflow, sequence, data-flow, and lifecycle/state diagrams as standalone HTML files with SVG graphics, a built-in dark/light theme toggle, and one-click export to…

molvqingtai/WebChat

A skill your agent uses whenever datasets, cloud storage buckets, or data pipelines are mentioned — creating, saving, querying, listing, exploring, deleting, or processing data in S3, GCS, Azure…

datachain-ai/datachain

Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.

smallnest/goclaw

Upgrade an AWS Glue ETL job from Glue version 0.9 or 1.0 to Glue 4.0.

aws-samples/aws-glue-samples

ClickHouse database patterns, query optimization, analytics, and data engineering best practices for high-performance analytical workloads.

hellangleZ/burn-in-cceverywhere-ralph

Migrate a legacy AWS Glue development endpoint to a Glue interactive session, following the official AWS migration checklist.

aws-samples/aws-glue-samples

Runs the Airbyte protocol sweep for a source-snowflake image against the shared Snowflake integration account, in an isolated per-run schema.

airbytehq/airbyte

Iterative code refinement through plan → code → evaluate → refine cycles.

EvoScientist/EvoSkills

Experiment executor and monitor for academic research. An agent skill from Imbad0202/experiment-agent.

Imbad0202/experiment-agent

A skill your agent uses for an open dbt-databricks pull request, including your own PR or a fork PR, to assess merge readiness and optionally repair selected gaps on the PR head branch.

databricks/dbt-databricks

Shows how to write custom cognee tasks, chain them into pipelines, store custom DataPoints and run enrichment over the existing graph.

topoteretes/cognee

Process multimedia files with FFmpeg (video/audio encoding, conversion, streaming, filtering, hardware acceleration), ImageMagick (image manipulation, format conversion, batch processing, effects…

ynulihao/AgentSkillOS

Designs ML pipeline infrastructure: experiment tracking with MLflow or Weights & Biases, Kubeflow and Airflow orchestration, Feast feature stores and model validation gates.

Jeffallan/claude-skills

Cut a dbt-materialize PyPI release: bump the version in version.py and setup.py, date the Unreleased CHANGELOG entry, and open the release PR with a Ship: <url body.

MaterializeInc/materialize

A skill your agent uses when adding support for a new model to VeOmni.

ByteDance-Seed/VeOmni

Walks you through designing a new sync for a Notion Worker, covering data source, mode, pagination and cursors, and then generates working code.

makenotion/workers-template

Define implementation contracts (APIs and data models) that developers will build against during PRD v0.6 Architecture.

mattgierhart/PRD-driven-context-engineering

Standard branch, commit, and pull-request workflow for this repo.

wgzhao/Addax

Stop and consult this skill whenever your response would include specific facts about Anthropic's products.

syahiidkamil/Software-Engineer-AI-Agent-Atlas

Friendly, step-by-step setup for ERD Studio in an existing dbt project, for people who may be new to dbt or data modelling.

liam-machine/erd-studio

Translate a Dagster or Prefect project to rivers, the Rust-powered asset orchestrator.

ion-elgreco/rivers

Selectively monitor important long-running or resource-intensive commands with Haoleme by prefixing them with hao, so status, output, and completion notifications sync to the mobile app.

HaolemeApp/Haoleme

An AI-Native skill for parsing PDF / Office / image files into Markdown with MinerU — a fast, zero-config document parser for AI agents.

Nebutra/MinerU-Skill

Queries the data warehouse with SQL and answers business questions about data.

astronomer/agents

Turns a Tushare API doc URL into a full data plugin for the stock_datasource repo: extractor, ClickHouse schema, query service, config and curl examples.

Yourdaylight/stock_datasource

A skill your agent uses when writing, editing, reviewing, or running Helm chart tests for the Astronomer airflow-chart repository.

astronomer/airflow-chart

Verify a Docglow change actually works before submitting or merging a PR.

docglow/docglow

Cleans raw credit data and screens variables before loan modeling, dropping unstable, noisy or redundant features and writing an Excel report of every step.

github/awesome-copilot

Reproduces MySQL binlog change-data-capture behavior for the Airbyte source-mysql connector on a local MySQL backend, with fixtures, a catalog and smoke cases.

airbytehq/airbyte

Stereopy project maintenance guide for code review, bug fixing, and feature development.

STOmics/Stereopy

Run flexynesis, a deep-learning suite for multi-omics data integration and clinical outcome prediction (drug response, cancer subtyping, survival analysis).

BIMSBbioinfo/flexynesis

Maps OpenMed-extracted, terminology-coded conditions, drugs and measurements into OMOP CDM v5.4 tables for OHDSI and ATLAS analytics.

maziyarpanahi/openmed

Queries, manages, and troubleshoots Apache Airflow using the af CLI.

astronomer/agents

Step-argument skill that formalizes writing an Aspire "What's new in N.N" release-notes page (src/frontend/src/content/docs/whats-new/aspire-N-N.mdx) as a repeatable lifecycle.

microsoft/aspire.dev

Debug and work with Meridian's ETL pipeline. An agent skill from Meridiona/meridian.

Meridiona/meridian

Design, build, or debug data processing pipelines. An agent skill from agulli/atlas-agents.

agulli/atlas-agents

Guide for migrating Dagster projects to Apache Airflow 3 on Astro.

astronomer/agents

Refreshes dbt artifact schemas from dbt-labs/dbt-core and regenerates Pydantic parser classes.

yu-iskw/dbt-artifacts-parser

Writes a new Dinobase YAML connector for a REST API that has no verified dlt source, covering auth, pagination, read and write endpoints and incremental loading.

kappa90/dinobase

Explains how to load text, files, folders, URLs, repositories and databases into cognee memory with remember(), including datasets, extractors and tags.

topoteretes/cognee

Guides the design of Notion Workers syncs, from choosing a simple replace sync or a backfill plus delta pair to pagination, consistency buffers, pacing and deletion handling.

makenotion/workers-template

Build, validate, and manage semantic models using Sidemantic.

sidequery/sidemantic

Reproduces PostgreSQL logical-decoding CDC behavior for Airbyte's source-postgres connector on a local backend, with CDC fixtures, a catalog and smoke case scripts.

airbytehq/airbyte

End-to-end AI-assisted meta-analysis pipeline orchestration from TOPIC.txt to final manuscript and reviewer responses.

htlin222/meta-pipe

Analyzes a dbt project and suggests dbt-bouncer checks that already pass (for existing projects) or a sensible starter config (for greenfield projects).

godatadriven/dbt-bouncer