Topic · Data & Analytics
Best Data pipelines and ETL skills, page 6
Data pipelines and ETL skills, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 241 | Build structured semantic layer documentation for metrics, dimensions, and entities. | nimrodfisher/ | 465 | — | ~647 | Automated safety check: Pass | MIT | 13 days ago |
| 242 | 242.Database Database development and operations workflow covering SQL, NoSQL, database design, migrations, optimization, and data engineering. | aiskillstore/ | 430 | 3 repos | ~1.2k | Automated safety check: Pass | No licence | yesterday |
| 243 | 243.Data Pipeline Data pipeline and ETL automation - extract, transform, load workflows for data integration and analytics | claude-office-skills/ | 499 | — | ~2.4k | Automated safety check: Pass | MIT | 8 mo ago |
| 244 | A Data Engineering interviewer focused on database performance. | PrepLabsAI/ | 112 | — | ~2.1k | Automated safety check: Pass | MIT | yesterday |
| 245 | 245.Gene Info Retrieves comprehensive gene information including PubMed publication counts, NCBI summaries, and Ensembl transcript data. | aipoch/ | 2k | — | ~2.3k | Automated safety check: Pass | MIT | 21 days ago |
| 246 | Azure Event Hubs library for Rust. An agent skill from microsoft/skills. | microsoft/ | 3.1k | — | ~1.7k | Automated safety check: Pass | MIT | 2 days ago |
| 247 | 247.Qwen Delegation Delegates tasks to Qwen CLI via delegation-core for Alibaba's models. | athola/ | 342 | 1 repo | ~1.1k | Automated safety check: Pass | MIT | 2 days ago |
| 248 | 248.Profile Etl Step Profile and optimize ETL step performance — CPU time, memory usage, and I/O bottlenecks. | owid/ | 158 | — | ~2.1k | Automated safety check: Pass | MIT | today |
| 249 | Fix ghost variable warnings by remapping charts from old to new variable IDs. | owid/ | 158 | — | ~1.2k | Automated safety check: Pass | MIT | today |
| 250 | Sync upstream grapher schema changes (new chart types, config fields, enum values) into the ETL repo — vendored schema, multidim-schema, dataset-schema, and regenerated Python types. | owid/ | 158 | — | ~2.7k | Automated safety check: Pass | MIT | today |
| 251 | 251.Tool Owl Working with Owl — OWID's lightweight, single-folder pipeline runner for small datasets (an alternative to the full snapshot → meadow → garden → grapher chain). | owid/ | 158 | — | ~1.4k | Automated safety check: Pass | MIT | today |
| 252 | Upgrades an MWAA environment to a newer Airflow version — within 2.x, within 3.x, or across the 2.x-to-3.x boundary. | aws/ | 2.8k | — | ~7.3k | Automated safety check: Pass | Apache-2.0 | today |
| 253 | Create professional technical diagrams as standalone animated HTML files with SVG graphics, flowing effects, dark/light theme toggle, and export support. | mingchen666/ | 237 | — | ~5.7k | Automated safety check: Pass | MIT | 17 days ago |
| 254 | 254.G1 VS-Enhanced Journal Matcher with Journal Intelligence MCP — Real-time journal data pipeline with checkpoint-based human decisions. | brycewang-stanford/ | 4.5k | — | ~3.7k | Automated safety check: Pass | Unknown | 3 days ago |
| 255 | 255.I3 RAG Builder with Parallel Document Processing Vector database construction with local embeddings (zero cost) Handles PDF download, text extraction, chunking, and vector database creation Absorbed B5… | brycewang-stanford/ | 4.5k | — | ~1.8k | Automated safety check: Pass | Unknown | 3 days ago |
| 256 | A skill your agent uses when starting empirical analysis, creating a data pipeline, generating results, or when data or model specifications change. | brycewang-stanford/ | 4.5k | — | ~1.7k | Automated safety check: Pass | Unknown | 3 days ago |
| 257 | DevOps knowledge reference covering Git workflows, testing strategies, DevSecOps, release pipeline orchestration (release.yml, multi-arch images, cosign integration), CI/CD pipelines, database… | telagod/ | 243 | — | ~422 | Automated safety check: Pass | MIT | 2 mo ago |
| 258 | A skill your agent uses to migrate course catalog data from external sources (CSV, PDF, website) and bulk-create Learning and LearningCourse records in Education Cloud. | forcedotcom/ | 1.1k | — | ~5.4k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 259 | A skill your agent uses to configure or inspect Salesforce Data Cloud DataSpace access for permission sets. | forcedotcom/ | 1.1k | — | ~4.7k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 260 | Citizen Intelligence Agency data model integration, riksdag data processing, political entity mapping | Hack23/ | 239 | — | ~1.8k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 261 | 261.Ddia Systems Design data systems by understanding storage engines, replication, partitioning, transactions, and consistency models. | wondelai/ | 2.4k | — | ~4.2k | Automated safety check: Pass | MIT | 27 days ago |
| 262 | Build Zerobus Ingest clients for near real-time data ingestion into Databricks Delta tables via gRPC. | databricks/ | 345 | — | ~3.1k | Automated safety check: Pass | Unknown | today |
| 263 | A skill your agent uses when a user describes a custom PAIDF Orchestration pipeline — a specific ordered combination of stages such as augmentation only, auto-labeling only, detection+captioning… | NVIDIA/ | 3.5k | — | ~8.2k | Automated safety check: Pass | Apache-2.0 | yesterday |
| 264 | 264.Oura Analytics Oura Ring data integration and analytics. An agent skill from sundial-org/awesome-openclaw-skills. | sundial-org/ | 663 | — | ~1.1k | Automated safety check: Pass | No licence | 7 mo ago |
| 265 | Design and implement integration architectures connecting financial systems — APIs, FIX protocol, ISO 20022, event-driven patterns, batch feeds, idempotency, and resilience. | JoelLewis/ | 205 | — | ~10k | Automated safety check: Pass | MIT | 2 mo ago |
| 266 | 266.Pdb Database Access the RCSB Protein Data Bank (PDB) to search, download, and programmatically retrieve 3D macromolecular structures and metadata; use when you need structure discovery (text/sequence/3D… | aipoch/ | 2k | — | ~1.6k | Automated safety check: Pass | MIT | 21 days ago |
| 267 | Authors and deploys MWAA workflow artifacts: Python Airflow DAGs for provisioned environments or YAML workflow files for Serverless. | aws/ | 2.8k | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | today |
| 268 | Create efficient data pipelines with tf.data. An agent skill from TheBushidoCollective/han. | TheBushidoCollective/ | 198 | 2 repos | ~4.4k | Automated safety check: Notes | Unknown | 1 mo ago |
| 269 | Advanced CV for infrastructure inspection including forest fire detection, wildfire precondition assessment, roof inspection, hail damage analysis, thermal imaging, and 3D Gaussian Splatting… | curiositech/ | 243 | 1 repo | ~2.2k | Automated safety check: Pass | MIT | 1 mo ago |
| 270 | A Data Engineering Pipeline Architect interviewer focused on end-to-end data pipeline design. | PrepLabsAI/ | 112 | — | ~5.7k | Automated safety check: Pass | MIT | yesterday |
| 271 | 271.Quicknode Quicknode blockchain infrastructure for Solana — RPC endpoints, DAS API (Digital Asset Standard) for NFTs and compressed assets, Yellowstone gRPC streaming, Priority Fee API, Streams (real-time data… | sendaifun/ | 130 | 1 repo | ~5.5k | Automated safety check: Notes | Apache-2.0 | 2 mo ago |
| 272 | This skill should be used when you need the correct UNIT for a Taiwan MEP quantity (airflow, static pressure, water pressure, pipe diameter, per-person water demand, storage-tank volume, drainage… | h30190/ | 157 | — | ~1.4k | Automated safety check: Pass | CC-BY-SA-4.0 | 2 days ago |
| 273 | 273.V5 Migration The olm:v5 migration script, UpdateTagsService, batch processing, migratedat, ClassifyTagsService deprecated mappings, and data migration from v4 category tables. | OpenLitterMap/ | 134 | — | ~1.7k | Automated safety check: Pass | GPL-3.0 | 24 days ago |
| 274 | 274.Create Chart Create or edit a Grapher chart authored in ETL: a viz://chart step in etl/steps/viz/chart/, either a single chart (dimensions: [], one view) or a multidim (a chart with dropdown dimension selectors… | owid/ | 158 | — | ~5.9k | Automated safety check: Notes | MIT | today |
| 275 | 275.Create Dataset Create a brand-new OWID dataset in ETL from a data file the user provides — a local CSV/Excel, a downloaded file, or a web link to data (snapshot → meadow → garden → grapher → PR → staging server). | owid/ | 158 | — | ~7.1k | Automated safety check: Pass | MIT | today |
| 276 | 276.Create Explorer Author or modify an Our World in Data explorer (multi-dimensional dashboard with dropdown selectors, published from ETL via viz://explorer/<ns/latest/<short). | owid/ | 158 | — | ~7.2k | Automated safety check: Pass | MIT | today |
| 277 | Draft answers for OWID's draft-data-update-slack-post Slack template using snapshot DVC + garden metadata + staging DB queries. | owid/ | 158 | — | ~7.4k | Automated safety check: Pass | MIT | today |
| 278 | Adversarially review an ETL dataset's data and metadata for factual accuracy — verifies metadata claims against the producer's own documentation (fetched from the links in snapshot .dvc files and… | owid/ | 158 | — | ~7.1k | Automated safety check: Pass | MIT | today |
| 279 | A skill your agent uses when creating or enriching metadata for OWID ETL datasets - generates comprehensive YAML metadata from dataset inspection, data exploration, and web research following OWID… | owid/ | 158 | — | ~6.8k | Automated safety check: Pass | MIT | today |
| 280 | 280.Review Data PR Review an OWID ETL data update PR end-to-end — runs the pipeline, compares snapshot fields against the previous version, verifies links, audits indicator metadata coverage, and cross-checks workflow… | owid/ | 158 | — | ~15k | Automated safety check: Notes | MIT | today |
| 281 | 281.Clay Load Scale Scale Clay enrichment pipelines for high-volume processing (10K-100K+ leads/month). | jeremylongshore/ | 2.8k | — | ~2.4k | Automated safety check: Pass | MIT | today |
| 282 | Ingest data into ClickHouse from webhooks, Kafka, and streaming sources with batching, dedup, and exactly-once patterns. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | today |
| 283 | Advanced Evernote SDK patterns and best practices. An agent skill from jeremylongshore/tons-of-skills-marketplace. | jeremylongshore/ | 2.8k | — | ~1.2k | Automated safety check: Pass | MIT | today |
| 284 | Build event-driven architectures with Groq streaming, batch processing, and async patterns. | jeremylongshore/ | 2.8k | — | ~1.7k | Automated safety check: Pass | MIT | today |
| 285 | Process multiple video generation requests efficiently with Kling AI. | jeremylongshore/ | 2.8k | — | ~2.4k | Automated safety check: Pass | MIT | today |
| 286 | Data synchronization, ETL patterns, and data management for MaintainX. | jeremylongshore/ | 2.8k | — | ~1.9k | Automated safety check: Pass | MIT | today |
| 287 | Gate Navan integration changes with deterministic fixtures and an isolated optional live smoke. | jeremylongshore/ | 2.8k | — | ~906 | Automated safety check: Pass | MIT | today |
| 288 | Implement a governed downstream booking-data workflow from Navan into an approved system. | jeremylongshore/ | 2.8k | — | ~960 | Automated safety check: Pass | MIT | today |