Apache Airflow

Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value stores (taskstatestore, assetstatestore) and the crash-safe ResumableJobMixin.

astronomer/agents

Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML.

astronomer/agents

Run the PAIDF Orchestration Event Video Generation DAG on Kubernetes - image-to-video anomaly generation, auto-labeling, and anomaly dataset generation.

NVIDIA/skills

Run the PAIDF Orchestration Image Attribute Augmentation DAG on Kubernetes - person-crop clothing augmentation, attribute search, and augmented dataset generation.

NVIDIA/skills

Tests Amazon MWAA workflow execution end-to-end: trigger a run and monitor it to completion for Provisioned (Python DAG, via Airflow REST API) and Serverless (YAML workflow, via StartWorkflowRun).

aws/agent-toolkit-for-aws

Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns.

telagod/code-abyss

Turns a dbt Core project into an Airflow DAG/TaskGroup using Astronomer Cosmos.

astronomer/agents

Data engineering for batch and streaming pipelines with Airflow, dbt, Spark, and Kafka.

borghei/Claude-Skills

Upgrades an MWAA environment to a newer Airflow version — within 2.x, within 3.x, or across the 2.x-to-3.x boundary.

aws/agent-toolkit-for-aws

A skill your agent uses when a user describes a custom PAIDF Orchestration pipeline — a specific ordered combination of stages such as augmentation only, auto-labeling only, detection+captioning…

NVIDIA/skills

Authors and deploys MWAA workflow artifacts: Python Airflow DAGs for provisioned environments or YAML workflow files for Serverless.

aws/agent-toolkit-for-aws

This skill should be used when you need the correct UNIT for a Taiwan MEP quantity (airflow, static pressure, water pressure, pipe diameter, per-person water demand, storage-tank volume, drainage…

h30190/HJPLUS_Taiwan_Architect_KB

Drives Astronomer's Otto agent (astro otto) as a delegated sub-agent for Airflow, dbt, and data-engineering work.

astronomer/agents

Generate airflow dag generator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Create airflow operator creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace.

jeremylongshore/tons-of-skills-marketplace

Implement Hex reference architecture with best-practice project layout.

jeremylongshore/tons-of-skills-marketplace

Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster.

BagelHole/DevOps-Security-Agent-Skills

Expert data engineer for ETL/ELT pipelines, streaming, data warehousing.

curiositech/some_claude_skills

Automate ML workflows with Airflow, Kubeflow, MLflow. An agent skill from secondsky/claude-skills.

secondsky/claude-skills

Azure Data Factory (ADF) CI/CD, deployment, and pipeline development.

Kilo-Org/kilo-marketplace

Printing Press CLI for Airflow Admin. An agent skill from mvanhorn/printing-press-library.

mvanhorn/printing-press-library

A skill your agent uses when building or debugging data pipelines with Airflow or Prefect, writing dbt models or tests, designing incremental loads, implementing idempotent ETL/ELT jobs, validating…

kid-sid/claude-spellbook

Audit, prepare, and deploy PAIDF Orchestration on a Kubernetes GPU cluster - single-GPU H100/L40S hosts, managed Kubernetes, kubeadm, and similar.

NVIDIA/skills