Search
Data pipelines and ETL
Skills
Sort:BestMost starsTrending todayTrending this weekTrending this monthNewestRecently updatedName
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 145 | 145.Dbt Model Index Provide a lookup index of dbt models (BigQuery tables) to guide query writing against a data warehouse. | warpdotdev/ | 824 | — | ~915 | Automated safety check: Pass | MIT | 1 mo ago |
| 146 | Chief Data Officer advisory for startups: AI training data rights and consent provenance, data product strategy (warehouse vs lakehouse vs mesh, build-vs-buy), B2B customer-data-as-asset valuation… | alirezarezvani/ | 28k | — | ~2.9k | Automated safety check: Pass | MIT | 1 mo ago |
| 147 | A skill your agent uses when writing Snowflake SQL, building data pipelines with Dynamic Tables or Streams/Tasks, using Cortex AI functions, creating Cortex Agents, writing Snowpark Python… | alirezarezvani/ | 28k | — | ~3.2k | Automated safety check: Pass | MIT | 1 mo ago |
| 148 | Data pipelines, feature stores, and embedding generation for AI/ML systems. | ancoleman/ | 525 | — | ~3.5k | Automated safety check: Pass | MIT | 10 mo ago |
| 149 | 149.Ingesting Data Data ingestion patterns for loading data from cloud storage, APIs, files, and streaming sources into databases. | ancoleman/ | 525 | — | ~1.9k | Automated safety check: Pass | MIT | 10 mo ago |
| 150 | Transform raw data into analytical assets using ETL/ELT patterns, SQL (dbt), Python (pandas/polars/PySpark), and orchestration (Airflow). | ancoleman/ | 525 | — | ~3k | Automated safety check: Pass | MIT | 10 mo ago |
| 151 | Generate complete solutions for specific Dataverse SDK use cases with architecture recommendations | github/ | 40k | 1 repo | ~1.7k | Automated safety check: Pass | MIT | 2 days ago |
| 152 | Process, analyze, and visualize geospatial data at scale. An agent skill from curiositech/some_claude_skills. | curiositech/ | 244 | — | ~3k | Automated safety check: Pass | MIT | 1 mo ago |
| 153 | You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing. | aiskillstore/ | 433 | 9 repos | ~1.8k | Automated safety check: Pass | No licence | yesterday |
| 154 | Build reusable revenue models — MRR, ARR, gross revenue, new/expansion/contraction/churn, ARPU, LTV, and per-customer/per-account revenue — on either PostHog data-warehouse views (HogQL) or an… | PostHog/ | 40k | — | ~2.1k | Automated safety check: Pass | Unknown | yesterday |
| 155 | 155.3dsmax Scripting Covers scripting Autodesk 3ds Max, the 3D modeling and rendering application, with MAXScript and Python (pymxs): scene manipulation, object creation, material assignment, camera and light setup… | TerminalSkills/ | 163 | — | ~3.2k | Automated safety check: Pass | Apache-2.0 | 7 days ago |
| 156 | A data engineer interviewer dealing with a revenue discrepancy before a board meeting. | PrepLabsAI/ | 112 | — | ~2.8k | Automated safety check: Pass | MIT | 4 days ago |
| 157 | Discover OPC UA servers, connect MATLAB clients, and browse/navigate server nodes using opcuaserverinfo, the Local Discovery Service (LDS), opcua, connect, setSecurityModel, certificate-trust… | matlab/ | 1.1k | — | ~4.4k | Automated safety check: Pass | Unknown | 2 days ago |
| 158 | Check user-facing indicator and chart metadata (titles, subtitles, descriptions, descriptionkey/WYSK, display names) against OWID's Writing and Style Guide, after a mechanical pass for whitespace… | owid/ | 159 | — | ~4.2k | Automated safety check: Pass | MIT | yesterday |
| 159 | 159.Dynamic Archify Create professional architecture, workflow, sequence, data-flow, and lifecycle/state diagrams as standalone animated HTML files with SVG graphics, flowing animation effects, a built-in dark/light… | OWWZO/ | 189 | 1 repo | ~5.5k | Automated safety check: Pass | MIT | yesterday |
| 160 | Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster. | sickn33/ | 47k | 1 repo | ~2.5k | Automated safety check: Pass | MIT | 2 days ago |
| 161 | 161.API Integration Designs event-driven architectures, webhook systems, API chaining flows, ETL pipelines, and integration patterns between services. | sickn33/ | 47k | 1 repo | ~1.3k | Automated safety check: Pass | MIT | 2 days ago |
| 162 | Diagnoses pipeline performance issues -- slow jobs, expensive queries, latency trends -- using Monte Carlo's cross-platform observability. | sickn33/ | 47k | 1 repo | ~2k | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 163 | Provides guidance for migrating Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~3k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 164 | Configures Airflow to run language SDK tasks (Java, Go, and future native SDKs) — register a coordinator, map a queue to it, ensure the runtime/artifact on workers, and tune coordinator options. | astronomer/ | 451 | — | ~2.3k | Automated safety check: Notes | Apache-2.0 | 3 days ago |
| 165 | Adds schema tests and data quality validation to dbt models. | AltimateAI/ | 128 | — | ~1.1k | Automated safety check: Pass | MIT | 3 days ago |
| 166 | A skill your agent uses when writing scripts, cron jobs, data pipelines, or any automated process that may be run multiple times. | aiming-lab/ | 3.5k | — | ~249 | Automated safety check: Pass | MIT | 4 mo ago |
| 167 | Build features guided by data insights, A/B testing, and continuous measurement using specialized agents for analysis, implementation, and experimentation. | aiskillstore/ | 433 | 7 repos | ~3k | Automated safety check: Pass | No licence | yesterday |
| 168 | 168.Database Admin Expert database administrator specializing in modern cloud databases, automation, and reliability engineering. | aiskillstore/ | 433 | 7 repos | ~2.5k | Automated safety check: Pass | No licence | yesterday |
| 169 | Surfaces Monte Carlo data observability context (table health, alerts, lineage, blast radius) before SQL/dbt edits. | sickn33/ | 47k | 1 repo | ~3.3k | Automated safety check: Pass | MIT | 2 days ago |
| 170 | Adds and runs data quality checks (dbt-test style assertions) on a project's warehouse tables and saved-query views, and HogQL catalog metrics: not-null, uniqueness, accepted values, referential… | PostHog/ | 40k | — | ~2.8k | Automated safety check: Pass | Unknown | yesterday |
| 171 | Running experiments out of the data warehouse instead of via dedicated experiment platforms. | rampstackco/ | 945 | — | ~7.3k | Automated safety check: Pass | MIT | 4 days ago |
| 172 | Azure Event Hubs SDK for Rust. An agent skill from aiskillstore/marketplace. | aiskillstore/ | 433 | 4 repos | ~936 | Automated safety check: Pass | No licence | yesterday |
| 173 | Build reusable activation models — an activation-rate metric and a per-user/per-account activated flag — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | yesterday |
| 174 | Build reusable conversion models — funnel/step conversion rates, drop-off, and time-to-convert — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | yesterday |
| 175 | Build reusable dimension / lookup tables for a star schema — country/region, timezone, currency, date, plan/product, and other descriptive attributes — on either PostHog data-warehouse views (HogQL)… | PostHog/ | 40k | — | ~1.4k | Automated safety check: Pass | Unknown | yesterday |
| 176 | Build reusable product-usage and engagement models — retention, stickiness, and lifecycle — on either PostHog data-warehouse views (HogQL) or an external dbt project. | PostHog/ | 40k | — | ~1.3k | Automated safety check: Pass | Unknown | yesterday |
| 177 | Shared foundations for building reusable data models in PostHog, on either of two stacks: PostHog-native data-warehouse views / materialized views (HogQL, via the view- MCP tools), or an external… | PostHog/ | 40k | — | ~2.1k | Automated safety check: Pass | Unknown | yesterday |
| 178 | Provides guidance for authoring Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~1.5k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 179 | Provides guidance for troubleshooting Apache Airflow DAGs (failed DAG runs and task instances) in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). | google/ | 21k | — | ~4.1k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 180 | 180.Serverless Modal Run GPU workloads on Modal — training, fine-tuning, inference, batch processing. | AI4Scientist/ | 128 | 3 repos | ~3.1k | Automated safety check: Notes | No licence | 4 mo ago |
| 181 | 181.Data Architect A virtual data architect for teams who don't have one. An agent skill from magnus919/hermes-profiles. | magnus919/ | 289 | — | ~3.4k | Automated safety check: Pass | MIT | 3 mo ago |
| 182 | 182.Diagrammer Render clean blueprint-style SVG diagrams from JSON specs. An agent skill from davila7/claude-code-templates. | davila7/ | 33k | — | ~494 | Automated safety check: Pass | MIT | yesterday |
| 183 | Trace downstream data lineage and impact analysis. An agent skill from astronomer/agents. | astronomer/ | 451 | — | ~1.2k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 184 | Trace upstream data lineage. An agent skill from astronomer/agents. | astronomer/ | 451 | — | ~1.1k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 185 | Create custom OpenLineage extractors for Airflow operators. An agent skill from astronomer/agents. | astronomer/ | 451 | — | ~3.3k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 186 | 186.Dag Factory Authors Apache Airflow DAGs declaratively from dag-factory YAML configs. | astronomer/ | 451 | — | ~4.3k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 187 | 187.Debugging Dags Comprehensive DAG failure diagnosis and root-cause analysis with structured investigation and prevention recommendations. | astronomer/ | 451 | — | ~1.9k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 188 | Builds, packs, and deploys compiled Airflow Go SDK bundles so the ExecutableCoordinator can run them. | astronomer/ | 451 | — | ~1.8k | Automated safety check: Notes | Apache-2.0 | 3 days ago |
| 189 | Builds and deploys compiled Airflow Java SDK bundles so workers can run them. | astronomer/ | 451 | — | ~2.8k | Automated safety check: Notes | Apache-2.0 | 3 days ago |
| 190 | Manage local Airflow environment with Astro CLI (Docker and standalone modes). | astronomer/ | 451 | — | ~2k | Automated safety check: Pass | Apache-2.0 | 3 days ago |
| 191 | Migrates Airflow projects from airflow-ai-sdk to apache-airflow-providers-common-ai 0.4.0+. | astronomer/ | 451 | — | ~4.7k | Automated safety check: Notes | Apache-2.0 | 3 days ago |
| 192 | Guide for migrating Apache Airflow 2.x projects to Airflow 3.x. | astronomer/ | 451 | — | ~2.3k | Automated safety check: Pass | Apache-2.0 | 3 days ago |