Search

Data pipelines and ETL

413 skills found, page 2.
Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
49

Comprehensive guide for Go database access — parameterized queries, struct scanning, NULLable columns, transactions, isolation levels, SELECT FOR UPDATE, connection pool, batch processing, context…

unxed/f42442 repos~2.9kAutomated safety check: PassMITtoday
50

Create a new Whirl environment in the envs/ directory. An agent skill from godatadriven/whirl.

godatadriven/whirl205—~1.9kAutomated safety check: PassApache-2.09 days ago
51

Finds authoritative public data sources for modeling tasks, prefers official APIs and bulk downloads, and outputs a reproducible fetch and cleaning plan with citations.

yushui2022/MathModel-Skill4541 repo~1.1kAutomated safety check: PassMIT4 days ago
52

Workflow and best practices for writing Apache Airflow DAGs.

astronomer/agents4511 repo~1.8kAutomated safety check: PassApache-2.03 days ago
53

Develop and modify nspl, a 2D scientific plotting library for Scala and Scala.js.

pityka/nspl101—~4.1kAutomated safety check: PassMIT15 days ago
54

Bumps the dbt-artifacts-parser package semver, prepares a PyPI release, and aligns GitHub Releases with version.

yu-iskw/dbt-artifacts-parser118—~700Automated safety check: PassApache-2.03 days ago
55

A skill your agent uses when writing, editing, reviewing, or running functional (end-to-end) tests for the Astronomer airflow-chart repository.

astronomer/airflow-chart297—~2.2kAutomated safety check: PassUnknown3 days ago
56

Decompose complex tasks into parallel sub-agents. An agent skill from shuyu-labs/WebCode.

shuyu-labs/WebCode278—~948Automated safety check: PassUnknown3 mo ago
57

Sets up Dinobase, a local DuckDB database that syncs data from 100+ business sources, then answers questions across them with SQL joins and previewed write-backs.

kappa90/dinobase263—~1.5kAutomated safety check: PassUnknown3 mo ago
58

A skill your agent uses when adding, changing or fixing write-only (wo) attributes, woversion fields or any secret attribute (password, token, private key) on a resource, data source or semantic…

dbt-labs/terraform-provider-dbtcloud117—~1.1kAutomated safety check: PassMITyesterday
59

Uses Ray Data to read, transform and write large datasets across a cluster for ML training and batch inference, with streaming execution and optional GPU steps.

Orchestra-Research/AI-Research-SKILLs13k3 repos~1.8kAutomated safety check: PassMIT3 mo ago
60

Guidance for using Ramda in transformation-heavy TypeScript or JavaScript.

valkey-io/valkey-admin148—~535Automated safety check: PassApache-2.0yesterday
61

Create a new Whirl example project in the examples/ directory.

godatadriven/whirl205—~1.1kAutomated safety check: PassApache-2.09 days ago
62

Deploys Airflow DAGs and projects. An agent skill from astronomer/agents.

astronomer/agents4511 repo~2.8kAutomated safety check: PassApache-2.03 days ago
63

Sets up data quality checks with Great Expectations, dbt tests and data contracts, with checkpoints and pass-fail reports for pipelines.

wshobson/agents40k11 repos~1.1kAutomated safety check: PassMIT6 days ago
64

Extracts pixel, video-frame, speech, music and visual-semantic features from image, video and audio files for research datasets, using local tools or the Gemini API.

TyrealQ/q-skills108—~2kAutomated safety check: NotesMIT17 days ago
65

World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.

benchflow-ai/skillsbench1.8k—~5.9kAutomated safety check: PassMIT2 mo ago
66

Process multiple source documents with Extract-Then-Aggregate discipline.

kbanc85/claudia296—~2.5kAutomated safety check: PassUnknown1 mo ago
67

Pre-PR code review gate. An agent skill from ByteDance-Seed/VeOmni.

ByteDance-Seed/VeOmni2.2k—~1.9kAutomated safety check: PassApache-2.0today
68

Scaffold a new dbt-bouncer check class with tests. An agent skill from godatadriven/dbt-bouncer.

godatadriven/dbt-bouncer136—~1.1kAutomated safety check: PassMITyesterday
69

Guides an agent through designing an MLOps pipeline that covers data preparation, training, validation and deployment, with DAG orchestration and reference guides.

wshobson/agents40k12 repos~1.8kAutomated safety check: PassMIT6 days ago
70

Creates or modifies dbt models in line with a project's own conventions, then runs dbt build and dbt show to check the output instead of stopping at compile.

AltimateAI/data-engineering-skills128—~890Automated safety check: PassMIT3 days ago
71

Patterns for writing production-ready Apache Airflow DAGs: task dependencies, custom operators and sensors, local testing, and rules for what to avoid.

wshobson/agents40k9 repos~784Automated safety check: PassMIT6 days ago
72

Master dbt (data build tool) for analytics engineering with model organization, testing, documentation, and incremental strategies.

wshobson/agents40k9 repos~781Automated safety check: PassMIT6 days ago
73

Speed up slow Apache Spark jobs by tuning partitions, shuffles, data skew, caching and executor memory, with do and don't rules for PySpark code.

wshobson/agents40k9 repos~789Automated safety check: PassMIT6 days ago
74

Expert Django Celery guidance for asynchronous task processing.

vintasoftware/django-ai-plugins153—~1.2kAutomated safety check: PassNo licence2 mo ago
75

Checks a Workers sync capability against a list of common bugs, such as stuck cursors, endless pagination and lost deletions, and reports by severity.

makenotion/workers-template4391 repo~1.2kAutomated safety check: NotesMIT29 days ago
76

Apple HIG guidance for status and progress UI components including progress indicators, status bars, and activity rings.

raintree-technology/hig-doctor1445 repos~963Automated safety check: PassMITtoday
77

Bump the Airflow or Python version across all project files.

godatadriven/whirl205—~1.2kAutomated safety check: PassApache-2.09 days ago
78

更新编码套餐与 OpenRouter 指标/套餐 JSON、修复抓取失败或 pending。Use when: pricing:fetch, metrics:fetch, openrouter:plans:fetch, provider-pricing.json, dashboard 数据过期或 CI 定价 issue。

jqknono/coding-plans-for-copilot138—~263Automated safety check: NotesMITtoday
79

A skill your agent uses for Helm chart work - creating charts, modifying existing charts, values design, testing.

astronomer/airflow-chart297—~6.4kAutomated safety check: PassUnknown3 days ago
80
80.Dagster ExpertOfficial

Expert guidance for working with Dagster and the dg CLI. An agent skill from dagster-io/skills.

dagster-io/skills211—~2kAutomated safety check: PassApache-2.0yesterday
81

Extracts research papers from .bib and .html venue files, filters them by relevance, labels them with a two-level taxonomy through Claude and rebuilds a website.

PurCL/ASE637—~5.2kAutomated safety check: WarnNo licence2 mo ago
82

File sentinel that monitors the working directory for changes and marker comments, then auto-triggers appropriate skills.

SethGammon/Citadel923—~2.9kAutomated safety check: PassMITtoday
83

Builds Windmill data pipelines as independent, pipeline-annotated scripts forming a DAG over shared storage, defaulting to DuckDB nodes that materialize into DuckLake tables.

windmill-labs/windmill18k—~4kAutomated safety check: PassUnknowntoday
84

Walks through fixing dbt compilation, database and test errors: read the full error, check upstream models, apply a fix, then verify with dbt build and a data preview.

AltimateAI/data-engineering-skills128—~1.1kAutomated safety check: PassMIT3 days ago
85

Design database schemas with Prisma/Drizzle, PostgreSQL index strategy (B-tree, GIN, GiST, BRIN, Hash), query optimization (EXPLAIN ANALYZE), migration safety (expand/contract, zero-downtime), and…

EliasOulkadi/shokunin114—~3.1kAutomated safety check: NotesMIT6 days ago
86

Microscopy data management platform. An agent skill from davila7/claude-code-templates.

davila7/claude-code-templates33k11 repos~2kAutomated safety check: PassMITtoday
87

Applies the reasoning style of Daphne Koller (machine learning pioneer, co-founder of Coursera, founder and CEO of Insitro).

K-Dense-AI/mimeo282—~1.8kAutomated safety check: PassMIT1 mo ago
88

Run Python code in the cloud with serverless containers, GPUs, and autoscaling.

davila7/claude-code-templates33k7 repos~2.6kAutomated safety check: PassMITtoday
89

Regenerate dbt test fixtures after dbtproject changes. An agent skill from godatadriven/dbt-bouncer.

godatadriven/dbt-bouncer136—~399Automated safety check: PassMITyesterday
90

A skill your agent uses when the user asks to "check data usage", "list TCO policies", "reduce Coralogix costs", "optimize observability spend", "lower our logging bill", "data budget exceeded"…

coralogix/cx-cli121—~3.4kAutomated safety check: PassApache-2.04 days ago
91
91.Bug FixerOfficial

Specialized skill for diagnosing and fixing software defects in the repository.

dbt-labs/terraform-provider-dbtcloud117—~269Automated safety check: PassMITyesterday
92

Helps choose an incremental strategy, design a reliable unique_key and debug failing dbt incremental models, and says when a plain table is the better choice.

AltimateAI/data-engineering-skills128—~2.3kAutomated safety check: PassMIT3 days ago
93

Build or refresh an OWID static visualization end to end — resolve what data it needs from an old static viz image, an indicator, or a grapher chart; check both the ETL catalog and the producer's…

owid/etl159—~7.8kAutomated safety check: PassMITtoday
94

Describe images (charts, diagrams, tables, screenshots) using Vision AI.

Wide-Moat/open-computer-use126—~732Automated safety check: PassUnknown5 days ago
95
95.Dagster ExpertOfficial

A skill your agent uses for any task involving Dagster, the dg CLI, assets, materialization, components, data tools or data pipelines, matching the situations the Dagster skill handles.

dagster-io/skills211—~321Automated safety check: PassApache-2.0yesterday
96

Builds human-in-the-loop (HITL) Airflow workflows - approval gates, form input, and human-driven branching.

astronomer/agents451—~1.8kAutomated safety check: PassApache-2.03 days ago