Topic · Data & Analytics
Best Data pipelines and ETL skills, page 4
Data pipelines and ETL skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 145 | Safely refactors dbt models with downstream impact analysis. | AltimateAI/ | 128 | — | ~1.2k | Automated safety check: Pass | MIT | 6 days ago |
| 146 | Python error handling patterns including input validation, exception hierarchies, and partial failure handling. | wshobson/ | 40k | — | ~1.5k | Automated safety check: Pass | MIT | 3 days ago |
| 147 | 147.Dbt Model Index Provide a lookup index of dbt models (BigQuery tables) to guide query writing against a data warehouse. | warpdotdev/ | 825 | — | ~915 | Automated safety check: Pass | MIT | 1 mo ago |
| 148 | Chief Data Officer advisory for startups: AI training data rights and consent provenance, data product strategy (warehouse vs lakehouse vs mesh, build-vs-buy), B2B customer-data-as-asset valuation… | alirezarezvani/ | 28k | — | ~2.9k | Automated safety check: Pass | MIT | 1 mo ago |
| 149 | A skill your agent uses when writing Snowflake SQL, building data pipelines with Dynamic Tables or Streams/Tasks, using Cortex AI functions, creating Cortex Agents, writing Snowpark Python… | alirezarezvani/ | 28k | — | ~3.2k | Automated safety check: Pass | MIT | 1 mo ago |
| 150 | 150.Ingesting Data Data ingestion patterns for loading data from cloud storage, APIs, files, and streaming sources into databases. | ancoleman/ | 526 | — | ~1.9k | Automated safety check: Pass | MIT | 10 mo ago |
| 151 | Transform raw data into analytical assets using ETL/ELT patterns, SQL (dbt), Python (pandas/polars/PySpark), and orchestration (Airflow). | ancoleman/ | 526 | — | ~3k | Automated safety check: Pass | MIT | 10 mo ago |
| 152 | Generate complete solutions for specific Dataverse SDK use cases with architecture recommendations | github/ | 40k | 1 repo | ~1.7k | Automated safety check: Pass | MIT | today |
| 153 | You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing. | aiskillstore/ | 430 | 9 repos | ~1.8k | Automated safety check: Pass | No licence | yesterday |
| 154 | Build reusable revenue models — MRR, ARR, gross revenue, new/expansion/contraction/churn, ARPU, LTV, and per-customer/per-account revenue — on either PostHog data-warehouse views (HogQL) or an… | PostHog/ | 40k | — | ~2.1k | Automated safety check: Pass | Unknown | today |
| 155 | 155.3dsmax Scripting Covers scripting Autodesk 3ds Max, the 3D modeling and rendering application, with MAXScript and Python (pymxs): scene manipulation, object creation, material assignment, camera and light setup… | TerminalSkills/ | 163 | — | ~3.2k | Automated safety check: Pass | Apache-2.0 | 4 days ago |
| 156 | A data engineer interviewer dealing with a revenue discrepancy before a board meeting. | PrepLabsAI/ | 112 | — | ~2.8k | Automated safety check: Pass | MIT | yesterday |
| 157 | Check user-facing indicator and chart metadata (titles, subtitles, descriptions, descriptionkey/WYSK, display names) against OWID's Writing and Style Guide, after a mechanical pass for whitespace… | owid/ | 158 | — | ~4.4k | Automated safety check: Pass | MIT | today |
| 158 | 158.Dynamic Archify Create professional architecture, workflow, sequence, data-flow, and lifecycle/state diagrams as standalone animated HTML files with SVG graphics, flowing animation effects, a built-in dark/light… | OWWZO/ | 186 | 1 repo | ~5.5k | Automated safety check: Pass | MIT | 19 days ago |
| 159 | Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster. | sickn33/ | 47k | 1 repo | ~2.5k | Automated safety check: Pass | MIT | yesterday |
| 160 | 160.API Integration Designs event-driven architectures, webhook systems, API chaining flows, ETL pipelines, and integration patterns between services. | sickn33/ | 47k | 1 repo | ~1.3k | Automated safety check: Pass | MIT | yesterday |
| 161 | Diagnoses pipeline performance issues -- slow jobs, expensive queries, latency trends -- using Monte Carlo's cross-platform observability. | sickn33/ | 47k | 1 repo | ~2k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 162 | Provides guidance for migrating Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~3k | Automated safety check: Pass | Apache-2.0 | today |
| 163 | The language-neutral foundation for Airflow language SDKs — implement task logic in a non-Python language while the DAG stays in Python. | astronomer/ | 451 | — | ~1.8k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 164 | Azure Event Hubs SDK for Rust. An agent skill from aiskillstore/marketplace. | aiskillstore/ | 430 | 5 repos | ~936 | Automated safety check: Pass | No licence | yesterday |
| 165 | 165.Serverless Modal Run GPU workloads on Modal — training, fine-tuning, inference, batch processing. | AI4Scientist/ | 128 | 4 repos | ~3.1k | Automated safety check: Notes | No licence | 4 mo ago |
| 166 | A skill your agent uses when automating ZBrush 2026: batch processing a folder of OBJ or ZTL files, a ZBrush Python script or ZScript, recording a macro to learn a palette path, the ZBrush -script… | scenario-labs/ | 913 | — | ~4.7k | Automated safety check: Pass | MIT | yesterday |
| 167 | Adds schema tests and data quality validation to dbt models. | AltimateAI/ | 128 | — | ~1.1k | Automated safety check: Pass | MIT | 6 days ago |
| 168 | A skill your agent uses when writing scripts, cron jobs, data pipelines, or any automated process that may be run multiple times. | aiming-lab/ | 3.5k | — | ~249 | Automated safety check: Pass | MIT | 4 mo ago |
| 169 | Surfaces Monte Carlo data observability context (table health, alerts, lineage, blast radius) before SQL/dbt edits. | sickn33/ | 47k | 1 repo | ~3.3k | Automated safety check: Pass | MIT | yesterday |
| 170 | Build features guided by data insights, A/B testing, and continuous measurement using specialized agents for analysis, implementation, and experimentation. | aiskillstore/ | 430 | 7 repos | ~3k | Automated safety check: Pass | No licence | yesterday |
| 171 | 171.Database Admin Expert database administrator specializing in modern cloud databases, automation, and reliability engineering. | aiskillstore/ | 430 | 7 repos | ~2.5k | Automated safety check: Pass | No licence | yesterday |
| 172 | Adds and runs data quality checks (dbt-test style assertions) on a project's warehouse tables and saved-query views, and HogQL catalog metrics: not-null, uniqueness, accepted values, referential… | PostHog/ | 40k | — | ~2.8k | Automated safety check: Pass | Unknown | today |
| 173 | Running experiments out of the data warehouse instead of via dedicated experiment platforms. | rampstackco/ | 940 | — | ~7.3k | Automated safety check: Pass | MIT | yesterday |
| 174 | Build reusable activation models — an activation-rate metric and a per-user/per-account activated flag — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | today |
| 175 | Build reusable conversion models — funnel/step conversion rates, drop-off, and time-to-convert — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | today |
| 176 | Build reusable dimension / lookup tables for a star schema — country/region, timezone, currency, date, plan/product, and other descriptive attributes — on either PostHog data-warehouse views (HogQL)… | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | today |
| 177 | Build reusable product-usage and engagement models — retention, stickiness, and lifecycle — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.3k | Automated safety check: Pass | Unknown | today |
| 178 | Shared foundations for building reusable data models in PostHog, on either of two stacks: PostHog-native data-warehouse views / materialized views (HogQL, via the view- MCP tools), or an external… | PostHog/ | 40k | — | ~2.1k | Automated safety check: Pass | Unknown | today |
| 179 | Provides guidance for authoring Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~1.5k | Automated safety check: Pass | Apache-2.0 | today |
| 180 | Provides guidance for troubleshooting Apache Airflow DAGs (failed DAG runs and task instances) in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~4.1k | Automated safety check: Pass | Apache-2.0 | today |
| 181 | 181.Diagrammer Render clean blueprint-style SVG diagrams from JSON specs. An agent skill from davila7/claude-code-templates. | davila7/ | 32k | — | ~494 | Automated safety check: Pass | MIT | today |
| 182 | 182.Data Architect A virtual data architect for teams who don't have one. An agent skill from magnus919/hermes-profiles. | magnus919/ | 281 | — | ~3.4k | Automated safety check: Pass | MIT | 3 mo ago |
| 183 | Process multiple sequence files in batch using Biopython. An agent skill from FreedomIntelligence/OpenClaw-Medical-Skills. | FreedomIntelligence/ | 3.1k | 1 repo | ~2.2k | Automated safety check: Pass | No licence | 2 mo ago |
| 184 | Quick data freshness check. An agent skill from astronomer/agents. | astronomer/ | 451 | — | ~801 | Automated safety check: Pass | Apache-2.0 | yesterday |
| 185 | Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime/artifact on workers, and tune coordinator options. | astronomer/ | 451 | — | ~2.3k | Automated safety check: Notes | Apache-2.0 | yesterday |
| 186 | Create custom OpenLineage extractors for Airflow operators. An agent skill from astronomer/agents. | astronomer/ | 451 | — | ~3.3k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 187 | 187.Dag Factory Authors Apache Airflow DAGs declaratively from dag-factory YAML configs. | astronomer/ | 451 | — | ~4.3k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 188 | 188.Debugging Dags Comprehensive DAG failure diagnosis and root-cause analysis with structured investigation and prevention recommendations. | astronomer/ | 451 | — | ~1.9k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 189 | Builds, packs, and deploys compiled Airflow Go SDK bundles so the ExecutableCoordinator can run them. | astronomer/ | 451 | — | ~1.8k | Automated safety check: Notes | Apache-2.0 | yesterday |
| 190 | Builds and deploys compiled Airflow Java SDK bundles so workers can run them. | astronomer/ | 451 | — | ~2.8k | Automated safety check: Notes | Apache-2.0 | yesterday |
| 191 | Manage local Airflow environment with Astro CLI (Docker and standalone modes). | astronomer/ | 451 | — | ~2k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 192 | Migrates Airflow projects from airflow-ai-sdk to apache-airflow-providers-common-ai 0.4.0+. | astronomer/ | 451 | — | ~4.7k | Automated safety check: Notes | Apache-2.0 | yesterday |