Agent skill

Discover Data

Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration.

MITAuto-check passedData & Analytics

Install Discover Data

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/discover-data .claude/skills/discover-data && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Paste into Claude Code

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .claude/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

$skill-installer

$skill-installer install https://github.com/rand/cc-polymath/tree/main/skills/discover-data

Type this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a codex

Project install goes to .agents/skills/; add -g for ~/.codex/skills/.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data --agent codex

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/discover-data .agents/skills/discover-data && rm -rf skills-src

Use ~/.agents/skills/ instead of .agents/skills for a personal install.

Codex skills documentation · loads skills from .agents/skills/

Paste into Codex

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .agents/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a cursor

Project install goes to .agents/skills/; add -g for ~/.cursor/skills/.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data --agent cursor

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/discover-data .cursor/skills/discover-data && rm -rf skills-src

Use ~/.cursor/skills/ instead of .cursor/skills for a personal install.

Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/

Paste into Cursor

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .cursor/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

gemini skills install

$ gemini skills install https://github.com/rand/cc-polymath.git --path skills/discover-data

--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a gemini-cli

Project install goes to .agents/skills/; add -g for ~/.gemini/skills/.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data --agent gemini-cli

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/discover-data .gemini/skills/discover-data && rm -rf skills-src

Use ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.

Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/

Paste into Gemini CLI

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .gemini/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data

Installs for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a github-copilot

Project install goes to .agents/skills/; add -g for ~/.copilot/skills/.

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/discover-data .github/skills/discover-data && rm -rf skills-src

Use ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.

GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/

Paste into GitHub Copilot

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .github/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

skills CLI

$ npx skills add rand/cc-polymath --skill discover-data -a opencode

OpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.

GitHub CLI

$ gh skill install rand/cc-polymath discover-data --agent opencode

Project scope by default (.agents/skills/); add --scope user for a personal install.

Manual copy

$ git clone --depth 1 https://github.com/rand/cc-polymath.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/discover-data .opencode/skills/discover-data && rm -rf skills-src

Use ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.

OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/

Paste into OpenCode

Install the "discover-data" agent skill from https://github.com/rand/cc-polymath/tree/main/skills/discover-data into .opencode/skills/discover-data/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "discover-data", then confirm the skill loads.

OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.

Facts

Skill name: discover-data
GitHub stars: 181
Token cost: ~915 tokens
SKILL.md length: 323 words
Files: 1
Skills in repo: 26
Repo updated: Feb 28, 2026
First seen: Oct 7, 2026
Licence: MIT

At a glance

Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration.

Works in 9 steps: batch-processing - Orchestrating complex… → data-validation - Validating data schema… → dataflow-coordination - Coordination… → …
Tasks that involve Data pipelines and ETL
SKILL.md covers When This Skill Activates, Available Skills, Common Workflow Combinations and Progressive Loading, plus 1 more section
Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Discover Data is an agent skill from rand/cc-polymath. Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration. Activates for data development tasks.

Its SKILL.md is about 920 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts. Compatibility notes: Designed for Claude Code. Compatible with any agent supporting the Agent Skills format.

It sits in Data & Analytics, covering Data pipelines and ETL. The repository describes itself as: Claude Code skills and workflows, optimized for context-efficiency and skill quality. Skills ranging from cloud infrastructure to design to advanced maths. The licence is MIT.

When your agent uses it

Tasks that involve Data pipelines and ETL

Example prompts

“/discover-data”

Requirements

Compatibility (from SKILL.md): Designed for Claude Code. Compatible with any agent supporting the Agent Skills format.

Workflow steps

9 steps, taken from the first numbered list in SKILL.md.

batch-processing - Orchestrating complex data pipelines with dependencies
data-validation - Validating data schema before processing
dataflow-coordination - Coordination patterns for distributed dataflow systems
differential-dataflow - Differential computation for incremental updates and efficient joins
etl-patterns - Designing data extraction from multiple sources
pipeline-orchestration - Coordinating complex multi-step data workflows
stream-processing - Processing real-time event streams (Kafka, Flink)
streaming-aggregations - Windowing, sessionization, time-series aggregation
timely-dataflow - Low-latency streaming computation with progress tracking

What it can do on your machine

Read from SKILL.md and the folder at commit baa2df1. It shows what the files ask for, not the result of running them.

Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Compatibility
Designed for Claude Code. Compatible with any agent supporting the Agent Skills format.
From compatibility in the SKILL.md frontmatter.

Context cost

Discover Data loads about 915 tokens when it runs. Until then it costs about 54 tokens; SKILL.md has 323 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it: ~54
When it runs · the whole SKILL.md, loaded when a task matches: ~915

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from rand/cc-polymath at commit baa2df1, republished under its MIT licence (© rand). 323 words, ~915 tokens.

Download SKILL.mdSave it as .claude/skills/discover-data/SKILL.md (or your agent's skills folder).

name: discover-data
description: Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration. Activates for data development tasks.
compatibility: Designed for Claude Code. Compatible with any agent supporting the Agent Skills format.
license: MIT
metadata.author: rand
metadata.version: 4.0

Data Skills Discovery

Provides automatic access to comprehensive data skills.

When This Skill Activates

This skill auto-activates when you're working with:

ETL
data pipelines
batch processing
stream processing
data validation
orchestration
Airflow
timely dataflow
differential dataflow
streaming aggregations
windowing
real-time analytics

Available Skills

Quick Reference

The Data category contains 9 skills:

batch-processing - Orchestrating complex data pipelines with dependencies
data-validation - Validating data schema before processing
dataflow-coordination - Coordination patterns for distributed dataflow systems
differential-dataflow - Differential computation for incremental updates and efficient joins
etl-patterns - Designing data extraction from multiple sources
pipeline-orchestration - Coordinating complex multi-step data workflows
stream-processing - Processing real-time event streams (Kafka, Flink)
streaming-aggregations - Windowing, sessionization, time-series aggregation
timely-dataflow - Low-latency streaming computation with progress tracking

Load Full Category Details

For complete descriptions and workflows:

Read ../data/INDEX.md

This loads the full Data category index with:

Detailed skill descriptions
Usage triggers for each skill
Common workflow combinations
Cross-references to related skills

Load Specific Skills

Load individual skills as needed:

Traditional ETL/Batch

Read ../data/batch-processing.md Read ../data/data-validation.md Read ../data/etl-patterns.md Read ../data/pipeline-orchestration.md

Stream Processing

Read ../data/stream-processing.md Read ../data/streaming-aggregations.md

Advanced Dataflow Systems

Read ../data/timely-dataflow.md Read ../data/differential-dataflow.md Read ../data/dataflow-coordination.md

Common Workflow Combinations

Real-Time Analytics Pipeline

Load these skills together:

Read ../data/stream-processing.md # Kafka setup Read ../data/streaming-aggregations.md # Windowing patterns Read ../data/dataflow-coordination.md # Coordination

Incremental Computation System

Load these skills together:

Read ../data/timely-dataflow.md # Foundation Read ../data/differential-dataflow.md # Incremental updates Read ../data/dataflow-coordination.md # Distributed coordination

Hybrid Batch + Stream

Load these skills together:

Read ../data/batch-processing.md # Batch jobs Read ../data/stream-processing.md # Stream processing Read ../data/pipeline-orchestration.md # Overall coordination

Progressive Loading

This gateway skill enables progressive loading:

Level 1: Gateway loads automatically (you're here now)
Level 2: Load category INDEX.md for full overview
Level 3: Load specific skills as needed

Usage Instructions

Auto-activation: This skill loads automatically when Claude Code detects data work
Browse skills: Run Read ../data/INDEX.md for full category overview
Load specific skills: Use bash commands above to load individual skills

Next Steps: Run Read ../data/INDEX.md to see full category details.

Files

Just SKILL.md in skills/discover-data of rand/cc-polymath.

Open the folder on GitHubat commit baa2df1

Compare with similar skills

Discover Data next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Discover Data compared with similar skills
Skill	Stars	Used in	Tokens	Auto-check	Licence	Repo updated
Discover Data this skillrand/cc-polymath	181	—	~915	Automated safety check: Pass	MIT	7 mo ago
Crawl4AI Web Scrapingsmallnest/goclaw	598	1 repos	~2.5k	Automated safety check: Pass	MIT	6 mo ago
Glue 09 10 Migrationaws-samples/aws-glue-samples	1.5k	—	~2.4k	Automated safety check: Pass	MIT-0	1 mo ago
Migrate Glue Devendpoint To Interactive Sessionsaws-samples/aws-glue-samples	1.5k	—	~3.6k	Automated safety check: Pass	MIT-0	1 mo ago
Dbt Databricks PR Readydatabricks/dbt-databricks	379	—	~2.8k	Automated safety check: Pass	Apache-2.0	today
Mz Dbt ReleaseMaterializeInc/materialize	6.4k	—	~1.2k	Automated safety check: Pass	Custom licence	today

Similar skills

Crawl4AI Web Scraping
smallnest/goclaw
Scrapes sites, handles JavaScript-heavy pages and extracts structured data with Crawl4AI, through its crwl CLI or Python SDK, including schema-based extraction without an LLM.
598 GitHub starsUsed in 1 repo~2.5k tokens
Data & AnalyticsAuto-check passed
Glue 09 10 Migration
aws-samples/aws-glue-samples
Official
Upgrade an AWS Glue ETL job from Glue version 0.9 or 1.0 to Glue 4.0.
1.5k GitHub stars~2.4k tokensUpdated 1 mo ago
Data & AnalyticsAuto-check passed
Migrate Glue Devendpoint To Interactive Sessions
aws-samples/aws-glue-samples
Official
Migrate a legacy AWS Glue development endpoint to a Glue interactive session, following the official AWS migration checklist.
1.5k GitHub stars~3.6k tokensUpdated 1 mo ago
Data & AnalyticsAuto-check passed
Dbt Databricks PR Ready
databricks/dbt-databricks
Official
A skill your agent uses for an open dbt-databricks pull request, including your own PR or a fork PR, to assess merge readiness and optionally repair selected gaps on the PR head branch.
379 GitHub stars~2.8k tokensUpdated today
Data & AnalyticsAuto-check passed
Mz Dbt Release
MaterializeInc/materialize
Cut a dbt-materialize PyPI release: bump the version in version.py and setup.py, date the Unreleased CHANGELOG entry, and open the release PR with a Ship: <url body.
6.4k GitHub stars~1.2k tokensUpdated today
Data & AnalyticsAuto-check passed
Erd Studio Setup
liam-machine/erd-studio
Friendly, step-by-step setup for ERD Studio in an existing dbt project, for people who may be new to dbt or data modelling.
165 GitHub stars~8.5k tokensUpdated 3 days ago
Data & AnalyticsAuto-check passed

Questions about Discover Data

What does Discover Data do?

Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration. Discover Data is an agent skill from rand/cc-polymath. Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration.

When should I use Discover Data?

Discover Data fits situations like: tasks that involve Data pipelines and ETL.

How do I install Discover Data in Claude Code?

Run `npx skills add rand/cc-polymath --skill discover-data -a claude-code`. Or copy the skill folder (skills/discover-data in rand/cc-polymath) into .claude/skills/discover-data in your project. Claude Code loads it when a task matches its description.

How do I install Discover Data in Codex?

Run `npx skills add rand/cc-polymath --skill discover-data -a codex`. Or copy the skill folder (skills/discover-data in rand/cc-polymath) into .agents/skills/discover-data in your project. Codex loads it when a task matches its description.

Can I use Discover Data in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add rand/cc-polymath --skill discover-data -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/discover-data, .gemini/skills/discover-data, .github/skills/discover-data and .opencode/skills/discover-data in your project.

What does Discover Data need to run?

SKILL.md names no scripts, command-line tools or credentials: Discover Data is instructions for the agent only. Compatibility (from SKILL.md): Designed for Claude Code. Compatible with any agent supporting the Agent Skills format..

Does Discover Data access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Discover Data safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Discover Data use?

Discover Data is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Discover Data use?

About 915 tokens (SKILL.md is roughly 3.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Discover Data?

Skills that share tags, products or a category with Discover Data: Crawl4AI Web Scraping (smallnest/goclaw, 598 stars), Glue 09 10 Migration (aws-samples/aws-glue-samples, 1.5k stars), Migrate Glue Devendpoint To Interactive Sessions (aws-samples/aws-glue-samples, 1.5k stars) and Dbt Databricks PR Ready (databricks/dbt-databricks, 379 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Discover Data?

rand (a GitHub user) maintains it in rand/cc-polymath, which has 181 GitHub stars. The repository holds 26 skills in this directory. The repository was last updated on February 28, 2026.

Source: rand/cc-polymath on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.

Install Discover Data

Facts

At a glance

What it does

When your agent uses it

Example prompts

Requirements

Workflow steps

What it can do on your machine

Tool permissions

Runs code

Network

Credentials

Compatibility

Context cost

Safety

SKILL.md

Data Skills Discovery

When This Skill Activates

Available Skills

Quick Reference

Load Full Category Details

Load Specific Skills

Traditional ETL/Batch

Stream Processing

Advanced Dataflow Systems

Common Workflow Combinations

Real-Time Analytics Pipeline

Load these skills together:

Incremental Computation System

Load these skills together:

Hybrid Batch + Stream

Load these skills together:

Progressive Loading

Usage Instructions

Files

Compare with similar skills

Similar skills

More from rand/cc-polymath

Related

Questions about Discover Data