Topic · Data & Analytics
Best Data pipelines and ETL skills, page 7
Data pipelines and ETL skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 289 | 289.Navan Data Sync Synchronize Navan booking, expense, identity, and file-delivered data according to each documented source contract. | jeremylongshore/ | 2.8k | — | ~967 | Automated safety check: Pass | MIT | today |
| 290 | Tune a Navan data pipeline against measured vendor, destination, privacy, and deadline constraints. | jeremylongshore/ | 2.8k | — | ~924 | Automated safety check: Pass | MIT | today |
| 291 | Design and validate a Foundry Python transform pipeline with explicit datasets, compute choice, expectations, and incremental semantics. | jeremylongshore/ | 2.8k | — | ~1.3k | Automated safety check: Pass | MIT | today |
| 292 | Plan and execute a phased migration of data pipelines, Ontology applications, or external integrations into Foundry. | jeremylongshore/ | 2.8k | — | ~1.4k | Automated safety check: Pass | MIT | today |
| 293 | Design a production Foundry architecture spanning data pipelines, Ontology, OSDK or Platform APIs, deployment, governance, and operations. | jeremylongshore/ | 2.8k | — | ~1.4k | Automated safety check: Pass | MIT | today |
| 294 | 294.Data Engineering Builds and operates data pipelines — ingestion, transformation, orchestration, quality testing, and reliability of data delivery. | cbrock84/ | 2k | — | ~937 | Automated safety check: Pass | MIT | 21 days ago |
| 295 | Creates unit test YAML definitions that mock upstream model inputs and validate expected outputs. | Kilo-Org/ | 190 | — | ~4.2k | Automated safety check: Pass | Apache-2.0 | 10 days ago |
| 296 | Patterns for loops, aggregates, batch processing and list transformation — including which retrieve source is legal where, and why nested loops are the wrong tool. | mendixlabs/ | 128 | — | ~2.9k | Automated safety check: Pass | Apache-2.0 | today |
| 297 | Process large datasets with Doctrine (ORM 3 toIterable, flush+clear, bulk DQL) and memory management | dev-toolings/ | 222 | — | ~464 | Automated safety check: Notes | MIT | 3 days ago |
| 298 | 298.Pp Customer Io Every Customer.io action a marketer or ops engineer takes — campaigns, broadcasts, segments, deliveries, exports, suppressions, Reverse-ETL — wrapped in named verbs, backed by a local SQLite cache… | mvanhorn/ | 2.1k | — | ~4.3k | Automated safety check: Notes | Apache-2.0 | yesterday |
| 299 | 299.Filesystem Advanced filesystem operations - listing, searching, batch processing, and directory analysis for Clawdbot | sundial-org/ | 663 | 1 repo | ~1.6k | Automated safety check: Pass | MIT | 7 mo ago |
| 300 | 300.Data Quality Design and operate data quality programs for financial data — validation rules, pricing validation, data lineage, exception management, profiling, and governance. | JoelLewis/ | 205 | — | ~11k | Automated safety check: Pass | MIT | 2 mo ago |
| 301 | Convert between IUPAC names, SMILES strings, molecular formulas, and common names for chemical compounds. | aipoch/ | 2k | — | ~1.7k | Automated safety check: Pass | MIT | 21 days ago |
| 302 | Fix garbled text in PDF/SVG vector graphics caused by font encoding issues, making files editable in AI tools. | aipoch/ | 2k | — | ~1.7k | Automated safety check: Pass | MIT | 21 days ago |
| 303 | Evidence-based CBT and DBT intervention skills — guided thought records, opposite action, DEAR MAN roleplay, crisis skills with optional HRV biofeedback. | glebis/ | 389 | — | ~1.1k | Automated safety check: Pass | MIT | 12 days ago |
| 304 | Data pipeline design, ETL processes, Spring Integration patterns, batch processing for political data | Hack23/ | 239 | — | ~1.9k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 305 | 305.Data Profiler Profile construction data to understand characteristics, distributions, quality metrics, and patterns. | datadrivenconstruction/ | 344 | 1 repo | ~4.5k | Automated safety check: Pass | MIT | 1 mo ago |
| 306 | Follow the bundled weighted data-processing pipeline. An agent skill from Jinze-Lee/codex-skills-workbench. | Jinze-Lee/ | 108 | — | ~290 | Automated safety check: Pass | No licence | 5 mo ago |
| 307 | 307.Create Etl Steps Create vanilla meadow, garden, and grapher ETL step files by invoking the wizard's cookiecutter templates, given a snapshot path. | owid/ | 158 | — | ~2.8k | Automated safety check: Pass | MIT | today |
| 308 | 308.Kreuzberg Extract text, tables, metadata, and images from 91+ document formats (PDF, Office, images, HTML, email, archives, academic) using Kreuzberg. | hashgraph-online/ | 1.2k | — | ~4.2k | Automated safety check: Pass | Elastic-2.0 | today |
| 309 | Process a large email backlog after time away: assess by category, batch-archive noise, and surface what needs attention. | readdle/ | 149 | — | ~975 | Automated safety check: Pass | MIT | yesterday |
| 310 | 310.E3 Agent E3 - Mixed Methods Integration Specialist - Qual-Quant data integration and meta-inference. | brycewang-stanford/ | 4.5k | — | ~3.9k | Automated safety check: Pass | Unknown | 3 days ago |
| 311 | 311.Data Architect A skill your agent uses to assess, design, and evolve data architectures, including data platforms, data products, data mesh adoption, event-driven data flows, governance, modeling, and migration… | magnus919/ | 113 | — | ~3.5k | Automated safety check: Pass | MIT | 2 days ago |
| 312 | 312.Documents Generate, inspect, validate, and fix PDF, Word (.docx), Excel (.xlsx), and PowerPoint (.pptx) documents: turn structured content into render-ready artifacts, verify structural and output quality… | magnus919/ | 113 | — | ~2.3k | Automated safety check: Pass | MIT | 2 days ago |
| 313 | 313.Postgres Operate PostgreSQL instances safely: configuration review, index and query-plan analysis, vacuum and bloat management, WAL archiving and point-in-time recovery, replication and failover, extensions… | magnus919/ | 113 | — | ~4k | Automated safety check: Pass | MIT | 2 days ago |
| 314 | Drives Astronomer's Otto agent (astro otto) as a delegated sub-agent for Airflow, dbt, and data-engineering work. | astronomer/ | 451 | — | ~3.9k | Automated safety check: Warn | Apache-2.0 | yesterday |
| 315 | A skill your agent uses when targeting IEEE International Conference on Data Engineering (ICDE) or deciding whether a computer-science manuscript fits this venue. | franklee16/ | 223 | 1 repo | ~2k | Automated safety check: Pass | No licence | 20 days ago |
| 316 | 316.Modal Cloud computing platform for running Python on GPUs and serverless infrastructure. | BioTender-max/ | 197 | — | ~3.1k | Automated safety check: Notes | Apache-2.0 | 3 mo ago |
| 317 | 317.Dagster Dagster is a data pipeline orchestrator built around the concept of software-defined assets. | Kilo-Org/ | 190 | 1 repo | ~1.4k | Automated safety check: Pass | Apache-2.0 | 10 days ago |
| 318 | 318.Prefect Prefect is a modern workflow orchestration framework for Python data pipelines. | Kilo-Org/ | 190 | 1 repo | ~1.4k | Automated safety check: Pass | Apache-2.0 | 10 days ago |
| 319 | Data pipeline contract enforcer. An agent skill from LeoYeAI/openclaw-master-skills. | LeoYeAI/ | 2.2k | — | ~4.7k | Automated safety check: Pass | Apache-2.0 | 2 mo ago |
| 320 | 320.Filesystem Advanced filesystem operations for listing files, searching content, batch processing, and directory analysis. | LeoYeAI/ | 2.2k | — | ~1.1k | Automated safety check: Pass | MIT | 2 mo ago |
| 321 | Tools and methodologies for analyzing codebase dependency graphs and quantitatively measuring coupling/cohesion. | revfactory/ | 1.3k | — | ~1.2k | Automated safety check: Pass | Apache-2.0 | 6 mo ago |
| 322 | RDBMS-to-RDBMS data type mapping tables, RDBMS-to-NoSQL conversion patterns, character set/collation conversion, and special type handling guide. | revfactory/ | 1.3k | — | ~1.7k | Automated safety check: Pass | Apache-2.0 | 6 mo ago |
| 323 | Generate airflow dag generator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~571 | Automated safety check: Pass | MIT | today |
| 324 | Create airflow operator creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~579 | Automated safety check: Pass | MIT | today |
| 325 | Build beam pipeline builder operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~568 | Automated safety check: Pass | MIT | today |
| 326 | Create cdc pipeline creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~565 | Automated safety check: Pass | MIT | today |
| 327 | Optimize compression optimizer operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~573 | Automated safety check: Pass | MIT | today |
| 328 | Handle training data and model artifacts on CoreWeave persistent storage. | jeremylongshore/ | 2.8k | — | ~1.8k | Automated safety check: Pass | MIT | today |
| 329 | Create dagster pipeline creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~579 | Automated safety check: Pass | MIT | today |
| 330 | Process data augmentation pipeline operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~584 | Automated safety check: Pass | MIT | today |
| 331 | Process data catalog updater operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~566 | Automated safety check: Pass | MIT | today |
| 332 | Track data lineage tracker operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~565 | Automated safety check: Pass | MIT | today |
| 333 | 333.Data Partitioner Process data partitioner operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~555 | Automated safety check: Pass | MIT | today |
| 334 | Validate data quality checker operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~566 | Automated safety check: Pass | MIT | today |
| 335 | Generate dbt model generator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~563 | Automated safety check: Pass | MIT | today |
| 336 | 336.Dbt Test Creator Create dbt test creator operations. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~547 | Automated safety check: Pass | MIT | today |