Senior Data Engineer
borghei/Claude-Skills
Data engineering for batch and streaming pipelines with Airflow, dbt, Spark, and Kafka.
Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns.
Install Engineering Data Pipelines
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install telagod/code-abyss engineering-data-pipelines --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/engineering-data-pipelines .claude/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .claude/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelinesType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install telagod/code-abyss engineering-data-pipelines --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/engineering-data-pipelines .agents/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .agents/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install telagod/code-abyss engineering-data-pipelines --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/engineering-data-pipelines .cursor/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .cursor/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/telagod/code-abyss.git --path skills/engineering-data-pipelines--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install telagod/code-abyss engineering-data-pipelines --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/engineering-data-pipelines .gemini/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .gemini/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install telagod/code-abyss engineering-data-pipelinesInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/engineering-data-pipelines .github/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .github/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add telagod/code-abyss --skill engineering-data-pipelines -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install telagod/code-abyss engineering-data-pipelines --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/telagod/code-abyss.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/engineering-data-pipelines .opencode/skills/engineering-data-pipelines && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "engineering-data-pipelines" agent skill from https://github.com/telagod/code-abyss/tree/main/skills/engineering-data-pipelines into .opencode/skills/engineering-data-pipelines/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "engineering-data-pipelines", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
engineering-data-pipelines- GitHub stars
- 244
- Token cost
- ~236 tokens
- SKILL.md length
- 41 words
- Files
- 2 (incl. references)
- Skills in repo
- 38
- Repo updated
- First seen
- Licence
- MIT
At a glance
Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns.
- Building data pipelines
- SKILL.md covers 编排检查项, 流处理检查项 and 质量检查项
- Calls dbt
- Stream processing
What it does
Engineering Data Pipelines is an agent skill from telagod/code-abyss. Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns. Use when building data pipelines, ETL workflows, stream processing, or data quality checks.
Its SKILL.md is about 240 tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/details.md`).
It sits in Data & Analytics, covering Data pipelines and ETL. It works with dbt, Apache Airflow, Apache Kafka and Dagster. The repository describes itself as: Give your AI coding agent a personality. Composable persona + style + skills for Claude Code, Codex, Gemini CLI & OpenClaw. Ships Tech Persona Card v1.0 spec. The licence is MIT.
When your agent uses it
- Building data pipelines
- Stream processing
- Data quality checks
Example prompts
- “/engineering-data-pipelines”
What it can do on your machine
Read from SKILL.md and the folder at commit 2544577. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
dbt
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Engineering Data Pipelines loads about 236 tokens when it runs, and up to ~696 if it reads all its reference files. Until then it costs about 59 tokens; SKILL.md has 41 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from telagod/code-abyss at commit 2544577, republished under its MIT licence (© telagod). 41 words, ~236 tokens.
Download SKILL.mdSave it as
.claude/skills/engineering-data-pipelines/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.- name
- engineering-data-pipelines
- description
- Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns. Use when building data pipelines, ETL workflows, stream processing, or data quality checks.
- user-invocable
- false
数据工程域 · Data Engineering
判断先于执行：决定「是否做 / 选什么 / 如何取舍」（栈、方案、架构、权衡）前，先读领域判断内核
skills/_kernel/backend/SKILL.md——它管 judgment，本秘典管 execution；冲突时以内核判断为准。
编排：Airflow(调度) | Dagster(资产) | Prefect(现代流)
流处理：Kafka Streams(嵌入式) | Flink(集群) | Spark Streaming
质量：Great Expectations | dbt tests | Soda Core编排检查项
幂等(UPSERT/分区覆盖) | 增量(WHERE updated_at > last_run) | 事件驱动触发 | 跨 DAG 依赖 | 数据血缘(ref()/Asset deps)
流处理检查项
时间语义选择 | Watermark 乱序容忍 | 状态 TTL 防膨胀 | Checkpoint 间隔 | 端到端 Exactly-Once | 背压监控
质量检查项
分层验证(源→转换→目标) | 完整性+准确性+一致性 | 及时性阈值 | 加权评分 | 告警(Slack/PagerDuty)
工具对比、API 用法、质量维度详见 references/details.md
© telagod, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
SKILL.md and 1 other file (references) in skills/engineering-data-pipelines of telagod/code-abyss.
- SKILL.md
- references/details.md
Open the folder on GitHubat commit 2544577
Compare with similar skills
Engineering Data Pipelines next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Engineering Data Pipelines this skilltelagod/code-abyss | 244 | — | ~236 | Automated safety check: Pass | MIT | |
| Senior Data Engineerborghei/Claude-Skills | 874 | — | ~1.4k | Automated safety check: Pass | MIT | |
| Migrating Dagster To Airflowastronomer/agents | 450 | — | ~3.8k | Automated safety check: Pass | Apache-2.0 | |
| Senior Data Engineerbenchflow-ai/skillsbench | 1.8k | — | ~5.9k | Automated safety check: Pass | MIT | |
| Senior Data Engineeralirezarezvani/claude-skills | 28k | 3 repos | ~1.4k | Automated safety check: Pass | MIT | |
| Senior Data Engineerdavila7/claude-code-templates | 32k | 1 repos | ~1.4k | Automated safety check: Pass | MIT |
Similar skills
Migrating Dagster To Airflow
astronomer/agents
Guide for migrating Dagster projects to Apache Airflow 3 on Astro.
Senior Data Engineer
benchflow-ai/skillsbench
World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, real-time streaming, and data infrastructure.
Senior Data Engineer
alirezarezvani/claude-skills
Data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.
Senior Data Engineer
davila7/claude-code-templates
World-class data engineering skill for building scalable data pipelines, ETL/ELT systems, and data infrastructure.
AI Data Engineering
ancoleman/ai-design-components
Data pipelines, feature stores, and embedding generation for AI/ML systems.
More from telagod/code-abyss
All 38 skills in this repoSecurity Gate Scanner
telagod/code-abyss
Scans code with a bundled Node scanner for injection, secret leaks and other dangerous patterns, and requires documented decisions for accepted risks.
Persona Voice Card Builder
telagod/code-abyss
Distills a recurring agent voice from conversations into a restricted Persona Voice Card, validates it for schema, safety and distinctness, and prepares it for community submission.
Skill Cultivation Funnel
telagod/code-abyss
Distills repeated workflows into new skills, improves existing ones and promotes them through local, project and community tiers after a default-deny safety scan.
DOCX Processing Toolkit
telagod/code-abyss
Routes Word document tasks to the right tool: pandoc for text, raw OOXML for structure and comments, docx-js for new files, and a mandatory redlining flow for edits to others' documents.
PDF Processing Toolkit
telagod/code-abyss
Picks the right Python library or CLI tool for a PDF task, text and table extraction, merging, splitting, OCR, watermarking or form filling, and points to a matching recipe.
Code Change Analysis Gate
telagod/code-abyss
Checks what a code change touched, how far its impact reaches and whether design docs, tests and README files kept up, before commit or in review.
Related
Works with
Categories
Questions about Engineering Data Pipelines
What does Engineering Data Pipelines do?
Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns. Engineering Data Pipelines is an agent skill from telagod/code-abyss. Data engineering knowledge reference covering Airflow, Dagster, Kafka Streams, Flink, dbt, and data quality patterns.
When should I use Engineering Data Pipelines?
Engineering Data Pipelines fits situations like: building data pipelines; stream processing; data quality checks.
How do I install Engineering Data Pipelines in Claude Code?
Run `npx skills add telagod/code-abyss --skill engineering-data-pipelines -a claude-code`. Or copy the skill folder (skills/engineering-data-pipelines in telagod/code-abyss) into .claude/skills/engineering-data-pipelines in your project. Claude Code loads it when a task matches its description.
How do I install Engineering Data Pipelines in Codex?
Run `npx skills add telagod/code-abyss --skill engineering-data-pipelines -a codex`. Or copy the skill folder (skills/engineering-data-pipelines in telagod/code-abyss) into .agents/skills/engineering-data-pipelines in your project. Codex loads it when a task matches its description.
Can I use Engineering Data Pipelines in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add telagod/code-abyss --skill engineering-data-pipelines -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/engineering-data-pipelines, .gemini/skills/engineering-data-pipelines, .github/skills/engineering-data-pipelines and .opencode/skills/engineering-data-pipelines in your project.
What does Engineering Data Pipelines need to run?
Going by SKILL.md and its folder, Engineering Data Pipelines needs the command-line tools its instructions call (dbt).
Does Engineering Data Pipelines access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Engineering Data Pipelines safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Engineering Data Pipelines use?
Engineering Data Pipelines is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Engineering Data Pipelines use?
About 236 tokens (SKILL.md is roughly 944 characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 460 tokens, read only when the agent opens those files.
What are the alternatives to Engineering Data Pipelines?
Skills that share tags, products or a category with Engineering Data Pipelines: Senior Data Engineer (borghei/Claude-Skills, 874 stars), Migrating Dagster To Airflow (astronomer/agents, 450 stars), Senior Data Engineer (benchflow-ai/skillsbench, 1.8k stars) and Senior Data Engineer (alirezarezvani/claude-skills, 28k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Engineering Data Pipelines?
telagod (a GitHub user) maintains it in telagod/code-abyss, which has 244 GitHub stars. The repository holds 38 skills in this directory. The repository was last updated on July 19, 2026.
Source: telagod/code-abyss on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.