Search

Apache Airflow · Data pipelines and ETL

65 skills found.
Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
1

A skill your agent uses when writing, editing, reviewing, or running Helm chart tests for the Astronomer airflow-chart repository.

astronomer/airflow-chart297—~2.8kAutomated safety check: PassUnknown3 days ago
2

Queries, manages, and troubleshoots Apache Airflow using the af CLI.

astronomer/agents4511 repo~3.8kAutomated safety check: PassApache-2.03 days ago
3

Guide for migrating Dagster projects to Apache Airflow 3 on Astro.

astronomer/agents451—~3.8kAutomated safety check: PassApache-2.03 days ago
4

Create a new Whirl environment in the envs/ directory. An agent skill from godatadriven/whirl.

godatadriven/whirl205—~1.9kAutomated safety check: PassApache-2.09 days ago
5

Workflow and best practices for writing Apache Airflow DAGs.

astronomer/agents4511 repo~1.8kAutomated safety check: PassApache-2.03 days ago
6

A skill your agent uses when writing, editing, reviewing, or running functional (end-to-end) tests for the Astronomer airflow-chart repository.

astronomer/airflow-chart297—~2.2kAutomated safety check: PassUnknown3 days ago
7

Create a new Whirl example project in the examples/ directory.

godatadriven/whirl205—~1.1kAutomated safety check: PassApache-2.09 days ago
8

Deploys Airflow DAGs and projects. An agent skill from astronomer/agents.

astronomer/agents4511 repo~2.8kAutomated safety check: PassApache-2.03 days ago
9

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

benchflow-ai/skillsbench1.8k—~5.9kAutomated safety check: PassMIT2 mo ago
10

Guides an agent through designing an MLOps pipeline that covers data preparation, training, validation and deployment, with DAG orchestration and reference guides.

wshobson/agents40k12 repos~1.8kAutomated safety check: PassMIT6 days ago
11

Patterns for writing production-ready Apache Airflow DAGs: task dependencies, custom operators and sensors, local testing, and rules for what to avoid.

wshobson/agents40k9 repos~784Automated safety check: PassMIT6 days ago
12

Expert Django Celery guidance for asynchronous task processing.

vintasoftware/django-ai-plugins153—~1.2kAutomated safety check: PassNo licence2 mo ago
13

Bump the Airflow or Python version across all project files.

godatadriven/whirl205—~1.2kAutomated safety check: PassApache-2.09 days ago
14

A skill your agent uses for Helm chart work - creating charts, modifying existing charts, values design, testing.

astronomer/airflow-chart297—~6.4kAutomated safety check: PassUnknown3 days ago
15

Builds human-in-the-loop (HITL) Airflow workflows - approval gates, form input, and human-driven branching.

astronomer/agents451—~1.8kAutomated safety check: PassApache-2.03 days ago
16

Build scalable data pipelines, modern data warehouses, and real-time streaming architectures.

davila7/claude-code-templates33k8 repos~2.8kAutomated safety check: PassMITtoday
17

Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

alirezarezvani/claude-skills28k3 repos~1.4kAutomated safety check: PassMIT1 mo ago
18

Annotate Airflow tasks with data lineage using inlets and outlets.

astronomer/agents451—~2.8kAutomated safety check: PassApache-2.03 days ago
19

Designs ML pipeline infrastructure: experiment tracking with MLflow or Weights & Biases, Kubeflow and Airflow orchestration, Feast feature stores and model validation gates.

Jeffallan/claude-skills12k—~1.9kAutomated safety check: PassMIT7 days ago
20

Writes Airflow task logic in Go using the Airflow Go SDK. An agent skill from astronomer/agents.

astronomer/agents451—~2.1kAutomated safety check: PassApache-2.03 days ago
21

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.

davila7/claude-code-templates33k1 repo~1.4kAutomated safety check: PassMITtoday
22

Writes Airflow task logic in Java, Kotlin, or any JVM language using the Airflow Java SDK.

astronomer/agents451—~2.6kAutomated safety check: PassApache-2.03 days ago
23

Data pipeline expert for ETL, Apache Spark, Airflow, dbt, and data quality

RightNow-AI/openfang18k—~847Automated safety check: PassApache-2.03 mo ago
24

The language-neutral foundation for Airflow language SDKs — implement task logic in a non-Python language while the DAG stays in Python.

astronomer/agents451—~1.8kAutomated safety check: PassApache-2.03 days ago
25

Quick data freshness check. An agent skill from astronomer/agents.

astronomer/agents451—~801Automated safety check: PassApache-2.03 days ago
26

Data pipelines, feature stores, and embedding generation for AI/ML systems.

ancoleman/ai-design-components525—~3.5kAutomated safety check: PassMIT10 mo ago
27

Transform raw data into analytical assets using ETL/ELT patterns, SQL (dbt), Python (pandas/polars/PySpark), and orchestration (Airflow).

ancoleman/ai-design-components525—~3kAutomated safety check: PassMIT10 mo ago
28

Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster.

sickn33/agentic-awesome-skills47k1 repo~2.5kAutomated safety check: PassMIT2 days ago
29

Provides guidance for migrating Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer).

google/skills21k—~3kAutomated safety check: PassApache-2.0yesterday
30

Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime/artifact on workers, and tune coordinator options.

astronomer/agents451—~2.3kAutomated safety check: NotesApache-2.03 days ago
31

Provides guidance for authoring Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer).

google/skills21k—~1.5kAutomated safety check: PassApache-2.0yesterday
32

Provides guidance for troubleshooting Apache Airflow DAGs (failed DAG runs and task instances) in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer).

google/skills21k—~4.1kAutomated safety check: PassApache-2.0yesterday
33

Create custom OpenLineage extractors for Airflow operators. An agent skill from astronomer/agents.

astronomer/agents451—~3.3kAutomated safety check: PassApache-2.03 days ago
34

Authors Apache Airflow DAGs declaratively from dag-factory YAML configs.

astronomer/agents451—~4.3kAutomated safety check: PassApache-2.03 days ago
35

Comprehensive DAG failure diagnosis and root-cause analysis with structured investigation and prevention recommendations.

astronomer/agents451—~1.9kAutomated safety check: PassApache-2.03 days ago
36

Builds, packs, and deploys compiled Airflow Go SDK bundles so the ExecutableCoordinator can run them.

astronomer/agents451—~1.8kAutomated safety check: NotesApache-2.03 days ago
37

Builds and deploys compiled Airflow Java SDK bundles so workers can run them.

astronomer/agents451—~2.8kAutomated safety check: NotesApache-2.03 days ago
38

Manage local Airflow environment with Astro CLI (Docker and standalone modes).

astronomer/agents451—~2kAutomated safety check: PassApache-2.03 days ago
39

Migrates Airflow projects from airflow-ai-sdk to apache-airflow-providers-common-ai 0.4.0+.

astronomer/agents451—~4.7kAutomated safety check: NotesApache-2.03 days ago
40

Guide for migrating Apache Airflow 2.x projects to Airflow 3.x.

astronomer/agents451—~2.3kAutomated safety check: PassApache-2.03 days ago
41

Initialize and configure Astro/Airflow projects. An agent skill from astronomer/agents.

astronomer/agents451—~802Automated safety check: PassApache-2.03 days ago
42

Complex DAG testing workflows with debugging and fixing cycles.

astronomer/agents451—~2.5kAutomated safety check: PassApache-2.03 days ago
43

Airflow adapter pattern for v2/v3 API compatibility. An agent skill from astronomer/agents.

astronomer/agents451—~228Automated safety check: PassApache-2.03 days ago
44

Builds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middleware, macros, and operator links directly into the Airflow UI.

astronomer/agents451—~6kAutomated safety check: NotesApache-2.03 days ago
45

Persists task and asset state across retries and DAG runs using Airflow 3.3's AIP-103 key/value stores (taskstatestore, assetstatestore) and the crash-safe ResumableJobMixin.

astronomer/agents451—~6.1kAutomated safety check: PassApache-2.03 days ago
46

Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML.

astronomer/agents451—~8.4kAutomated safety check: PassApache-2.03 days ago
47

Run the PAIDF Orchestration Image Attribute Augmentation DAG on Kubernetes - person-crop clothing augmentation, attribute search, and augmented dataset generation.

NVIDIA/skills3.6k—~4.2kAutomated safety check: PassApache-2.0yesterday
48

Tests Amazon MWAA workflow execution end-to-end: trigger a run and monitor it to completion for Provisioned (Python DAG, via Airflow REST API) and Serverless (YAML workflow, via StartWorkflowRun).

aws/agent-toolkit-for-aws2.8k—~3.8kAutomated safety check: PassApache-2.0yesterday