Topic · Data & Analytics
Best Data pipelines and ETL skills, page 8
Data pipelines and ETL skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 337 | Optimize Fathom API performance with caching and batch processing. | jeremylongshore/ | 2.8k | — | ~1.3k | Automated safety check: Pass | MIT | today |
| 338 | Production-ready Fathom API client patterns in Python and TypeScript. | jeremylongshore/ | 2.8k | — | ~1.1k | Automated safety check: Pass | MIT | today |
| 339 | Convert file format converter operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~569 | Automated safety check: Pass | MIT | today |
| 340 | A skill your agent uses whenever the user wants to find, shortlist, vet, or enrich US AI/ML/data consulting firms (consultancies) — AI/ML development, MLOps, generative AI / LLM apps (RAG, chatbots… | jeremylongshore/ | 2.8k | — | ~4k | Automated safety check: Notes | MIT | today |
| 341 | A skill your agent uses whenever the user wants to find, shortlist, vet, or enrich US software development firms — custom software, web development, mobile app development, backend/API development… | jeremylongshore/ | 2.8k | — | ~3.7k | Automated safety check: Notes | MIT | today |
| 342 | Integration patterns for Finta fundraising CRM with email and calendar APIs. | jeremylongshore/ | 2.8k | — | ~1.2k | Automated safety check: Pass | MIT | today |
| 343 | Create flink job creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~556 | Automated safety check: Pass | MIT | today |
| 344 | 344.Flux Pipeline Build a data pipeline — ETL/ELT with extraction, transformation, loading, error handling, and scheduling. | jeremylongshore/ | 2.8k | — | ~817 | Automated safety check: Notes | MIT | today |
| 345 | Configure incremental load setup operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~575 | Automated safety check: Pass | MIT | today |
| 346 | Process kafka stream processor operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~573 | Automated safety check: Pass | MIT | today |
| 347 | Generate luigi task generator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~567 | Automated safety check: Pass | MIT | today |
| 348 | Process metadata extractor operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~562 | Automated safety check: Pass | MIT | today |
| 349 | Configure pipeline monitoring setup operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~577 | Automated safety check: Pass | MIT | today |
| 350 | Build prefect flow builder operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~567 | Automated safety check: Pass | MIT | today |
| 351 | Transform pyspark transformer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~566 | Automated safety check: Pass | MIT | today |
| 352 | 352.Schema Validator Validate schema validator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~555 | Automated safety check: Pass | MIT | today |
| 353 | Create spark job creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~556 | Automated safety check: Pass | MIT | today |
| 354 | Optimize spark sql optimizer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~564 | Automated safety check: Pass | MIT | today |
| 355 | Assist with sql transform helper operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~565 | Automated safety check: Pass | MIT | today |
| 356 | Automate repetitive research tasks with pipelines, schedulers, and scripting | wentorai/ | 298 | 1 repo | ~1.9k | Automated safety check: Pass | MIT | 3 mo ago |
| 357 | UiPath Process Mining via uip pm — build and operate a process app end-to-end from a CSV / event log: templates, data mapping, upload, ingest, the dbt (Snowflake) transformation layer, publish, and… | UiPath/ | 167 | — | ~4.3k | Automated safety check: Notes | MIT | today |
| 358 | 358.Discover Data Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration. | rand/ | 181 | — | ~915 | Automated safety check: Pass | MIT | 7 mo ago |
| 359 | Expert data engineer for ETL/ELT pipelines, streaming, data warehousing. | curiositech/ | 243 | — | ~1.5k | Automated safety check: Pass | MIT | 1 mo ago |
| 360 | Creates realistic cloud effects for web using SVG filters (feTurbulence, feDisplacementMap), CSS animations, and layering techniques. | curiositech/ | 243 | — | ~4.5k | Automated safety check: Notes | MIT | 1 mo ago |
| 361 | 361.Adf Master Azure Data Factory (ADF) CI/CD, deployment, and pipeline development. | Kilo-Org/ | 190 | — | ~3.2k | Automated safety check: Pass | MIT | 9 days ago |
| 362 | A skill your agent uses when creating or modifying dbt Semantic Layer components — semantic models, metrics, dimensions, entities, measures, or time spines. | Kilo-Org/ | 190 | — | ~2.4k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 363 | Generates MCP server configuration JSON, resolves authentication setup, and validates server connectivity for dbt. | Kilo-Org/ | 190 | — | ~2.5k | Automated safety check: Notes | Apache-2.0 | 9 days ago |
| 364 | Builds and modifies dbt models, writes SQL transformations using ref() and source(), creates tests, and validates results with dbt show. | Kilo-Org/ | 190 | — | ~1.9k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 365 | Interactive tutorial that teaches Snowflake Dynamic Tables hands-on. | Kilo-Org/ | 190 | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 366 | 366.Glue Diagnostics A skill your agent uses to investigate and troubleshoot AWS Glue problems by analyzing ETL jobs, crawlers, connections, Data Catalog, DPU utilization, Spark execution, and job bookmarks following… | Kilo-Org/ | 190 | — | ~2k | Automated safety check: Pass | MIT | 9 days ago |
| 367 | Classifies dbt-core to Fusion migration errors into actionable categories (auto-fixable, guided fixes, needs input, blocked). | Kilo-Org/ | 190 | — | ~3.1k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 368 | A skill your agent uses when migrating a dbt project from one data platform or data warehouse to another (e.g., Snowflake to Databricks, Databricks to Snowflake) using dbt Fusion's real-time… | Kilo-Org/ | 190 | — | ~3.9k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 369 | Diagnoses dbt Cloud/platform job failures by analyzing run logs, querying the Admin API, reviewing git history, and investigating data issues. | Kilo-Org/ | 190 | — | ~2.6k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 370 | Builds and modifies dbt models, writes SQL transformations using ref() and source(), creates tests, and validates results with dbt show. | Kilo-Org/ | 190 | — | ~1.6k | Automated safety check: Pass | Apache-2.0 | 9 days ago |
| 371 | Design an ETL/ELT data pipeline specification. An agent skill from mohitagw15856/pm-claude-skills. | mohitagw15856/ | 1.4k | — | ~2.5k | Automated safety check: Pass | MIT | yesterday |
| 372 | Design the data quality checks for a table or pipeline across the standard dimensions. | mohitagw15856/ | 1.4k | — | ~919 | Automated safety check: Pass | MIT | yesterday |
| 373 | 373.Dbt Model Spec Spec a dbt model — its grain, sources, transformations, tests, and materialization. | mohitagw15856/ | 1.4k | — | ~939 | Automated safety check: Pass | MIT | yesterday |
| 374 | Define a metric in a semantic layer so it means one thing everywhere. | mohitagw15856/ | 1.4k | — | ~956 | Automated safety check: Pass | MIT | yesterday |
| 375 | 375.Shippo Official Ship packages with Shippo. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~4.3k | Automated safety check: Pass | MIT | 2 mo ago |
| 376 | A skill your agent uses for Anomalib benchmark pipelines, tiled ensemble workflows, and advanced pipeline orchestration helpers while keeping experimental execution paths explicit. | VectorSpaceLab/ | 328 | — | ~952 | Automated safety check: Pass | Apache-2.0 | 1 mo ago |
| 377 | Bootstrap a brand-new dbt data product from scratch — create dbtproject.yml, the Entropy Data model layout (inputports, staging, intermediate, outputports/v1), README with uv install instructions… | hashgraph-online/ | 1.2k | — | ~3.8k | Automated safety check: Pass | Apache-2.0 | today |
| 378 | 378.Dataproduct Dbt Build out the transformation layers (staging/, intermediate/) of a data product and run dbt against them, following project-wide conventions adapted from dbt's best practices (v1.12). | hashgraph-online/ | 1.2k | — | ~4.3k | Automated safety check: Pass | Apache-2.0 | today |
| 379 | Extract a small sample of rows from a dbt output port using a non-production profile, scrub anything classified as PII or sensitive in the data contract, and upload the scrubbed sample to Entropy… | hashgraph-online/ | 1.2k | — | ~2k | Automated safety check: Pass | Apache-2.0 | today |
| 380 | Given an Entropy Data data product URL or id, fetch its data contracts (output port ODCS files written next to the SQL under models/outputports/v<N/, input port ODCS files cached next to their dbt… | hashgraph-online/ | 1.2k | — | ~4.9k | Automated safety check: Pass | Apache-2.0 | today |
| 381 | Audit a dbt project against the Entropy Data reference layout and add anything missing — Open Data Product Specification (ODPS), Open Data Contract Standard (ODCS), OpenLineage transport config… | hashgraph-online/ | 1.2k | — | ~4.6k | Automated safety check: Pass | Apache-2.0 | today |
| 382 | List the teams configured in Entropy Data so the user can pick one as the owner (team.name in ODPS) of a data product. | hashgraph-online/ | 1.2k | — | ~1.4k | Automated safety check: Pass | Apache-2.0 | today |
| 383 | Design data pipelines covering ETL vs ELT architectures, data source integration, scheduling, quality checks, and warehouse design. | asgard-ai-platform/ | 241 | — | ~1.5k | Automated safety check: Pass | MIT | 4 mo ago |
| 384 | 384.Pp Airflow Admin Printing Press CLI for Airflow Admin. An agent skill from mvanhorn/printing-press-library. | mvanhorn/ | 2.1k | — | ~2.8k | Automated safety check: Notes | Apache-2.0 | yesterday |