New: 97,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Using Duckdb

by data-goblin in data-goblin/power-bi-agentic-development

Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook.

GPL-3.0Auto-check passedData & Analytics

Install Using Duckdb

skills CLI
$ npx skills add data-goblin/power-bi-agentic-development --skill using-duckdb -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install data-goblin/power-bi-agentic-development using-duckdb --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/data-goblin/power-bi-agentic-development.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/etl/skills/using-duckdb .claude/skills/using-duckdb && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
using-duckdb
GitHub stars
1k
Token cost
~1.2k tokens
SKILL.md length
243 words
Files
3 (incl. references)
Skills in repo
33
Repo updated
First seen
Licence
GPL-3.0

At a glance

Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook.

  • Mentions DuckDB
  • SKILL.md covers Two Modes, Local: Prerequisites, Local: Querying Delta Tables and Local: Querying Raw Files, plus 4 more sections
  • Calls duckdb, az and brew; needs ACCESS_TOKEN
  • Query Delta tables locally

What it does

Using Duckdb is an agent skill from data-goblin/power-bi-agentic-development. Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook. Automatically invoke when the user mentions "DuckDB", "query Delta tables locally", or asks to "attach DuckDB to a lakehouse", "query OneLake data", "explore lakehouse data", "data freshness check", "validate data quality", "use DuckDB in Fabric".

Its SKILL.md is about 1.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files, including reference files (for example `references/common-patterns.md` and `references/in-notebook-setup.md`).

It sits in Data & Analytics, covering Data warehousing and Data cleaning. It works with DuckDB and Microsoft Azure. The repository describes itself as: Power BI AI skills and Power BI agents for Claude Code and GitHub Copilot: a plugin marketplace of Power BI skills, subagents, and hooks for semantic models, DAX, TMDL, reports… The licence is GPL-3.0.

When your agent uses it

  • Mentions DuckDB
  • Query Delta tables locally
  • Asks to attach DuckDB to a lakehouse
  • Query OneLake data

Example prompts

  • “DuckDB”
  • “query Delta tables locally”
  • “attach DuckDB to a lakehouse”
  • “/using-duckdb”

Requirements

  • Python 3
  • A credential in ACCESS_TOKEN

What it can do on your machine

Read from SKILL.md and the folder at commit 41886f2. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • duckdb
    • az
    • brew

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • duckdb.org
    • github.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • ACCESS_TOKEN

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Using Duckdb loads about 1.2k tokens when it runs, and up to ~2.1k if it reads all its reference files. Until then it costs about 90 tokens; SKILL.md has 243 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~90
When it runs · the whole SKILL.md, loaded when a task matches
~1.2k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~2.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from data-goblin/power-bi-agentic-development at commit 41886f2, republished under its GPL-3.0 licence (© data-goblin). 243 words, ~1,173 tokens.

Download SKILL.mdSave it as .claude/skills/using-duckdb/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.
name
using-duckdb
description
Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook. Automatically invoke when the user mentions "DuckDB", "query Delta tables locally", or asks to "attach DuckDB to a lakehouse", "query OneLake data", "explore lakehouse data", "data freshness check", "validate data quality", "use DuckDB in Fabric".

Using DuckDB with Fabric

Query Delta Lake tables and raw files in OneLake using DuckDB. Works both locally (CLI/Python) and inside Fabric notebooks. Read-only; for writes, use the executing-spark skill.

Two Modes

ModeWhere it runsAuthBest for
LocalDeveloper machineAzure CLI (az login)Exploration, validation, ad-hoc analysis
In-notebookFabric Spark containernotebookutils.credentials.getToken('storage')Combining DuckDB speed with Spark write-back

Local: Prerequisites

  • DuckDB installed (brew install duckdb on macOS)
  • Azure CLI authenticated (az login)
  • Extensions installed: INSTALL delta; INSTALL azure; (one-time)

Local: Querying Delta Tables

bash
WS_ID=$(fab get "Workspace.Workspace" -q "id" | tr -d '"')
LH_ID=$(fab get "Workspace.Workspace/LH.Lakehouse" -q "id" | tr -d '"')

duckdb -c "
LOAD delta; LOAD azure;
CREATE SECRET (TYPE azure, PROVIDER credential_chain, CHAIN 'cli');

SELECT * FROM delta_scan(
  'abfss://${WS_ID}@onelake.dfs.fabric.microsoft.com/${LH_ID}/Tables/schema/table'
) LIMIT 10;
"

The CHAIN 'cli' parameter uses Azure CLI credentials. Without it, DuckDB tries managed identity first (fails on local machines).

Local: Querying Raw Files

bash
BASE="abfss://${WS_ID}@onelake.dfs.fabric.microsoft.com/${LH_ID}/Files"

duckdb -c "
LOAD azure;
CREATE SECRET (TYPE azure, PROVIDER credential_chain, CHAIN 'cli');

SELECT * FROM read_csv('${BASE}/data.csv') LIMIT 10;
SELECT * FROM read_parquet('${BASE}/facts.parquet') LIMIT 10;
SELECT * FROM read_json('${BASE}/events/*.json');
"

Glob patterns (*, **) work for reading multiple files.

In-Notebook: Attaching DuckDB to a Lakehouse

Inside a Fabric notebook, DuckDB can query lakehouse Delta tables directly using a storage token. This approach is faster than Spark SQL for analytical queries on single-node data.

python
import duckdb
import time

# Get storage token from notebook context
token = notebookutils.credentials.getToken('storage')

# Create DuckDB connection
con = duckdb.connect(f'temp_{time.time_ns()}.duckdb')
con.sql('SET enable_object_cache=true')

# Register OneLake secret
con.sql(f"""
    CREATE OR REPLACE SECRET onelake (
        TYPE AZURE,
        PROVIDER ACCESS_TOKEN,
        ACCESS_TOKEN '{token}'
    )
""")

# Query Delta tables
workspace = "<workspace-id>"
lakehouse = "<lakehouse-name>"
path = f"abfss://{workspace}@onelake.dfs.fabric.microsoft.com/{lakehouse}.Lakehouse/Tables"

df = con.sql(f"""
    SELECT * FROM delta_scan('{path}/schema/table_name') LIMIT 100
""").df()
print(df)
Auto-Discovering Tables

Dynamically find all Delta tables in a lakehouse:

python
tables = con.sql(f"""
    SELECT DISTINCT split_part(file, '_delta_log', 1) as table_path
    FROM glob('{path}/*/*/*_delta_log/*.json')
""").df()['table_path'].tolist()

for t in tables:
    view_name = t.split('/')[-1]
    con.sql(f"CREATE OR REPLACE VIEW {view_name} AS SELECT * FROM delta_scan('{t}')")
    print(f"Created view: {view_name}")

OneLake Path Format

abfss://<workspace-id>@onelake.dfs.fabric.microsoft.com/<item-id>/Tables/<schema>/<table>
abfss://<workspace-id>@onelake.dfs.fabric.microsoft.com/<item-id>/Files/<path>
Item typeID source
Lakehousefab get "ws/LH.Lakehouse" -q "id"
Warehousefab get "ws/WH.Warehouse" -q "id"
SQL Databasefab get "ws/DB.SQLDatabase" -q "id"

Cross-item joins work in a single DuckDB query; use different abfss:// paths.

Common Patterns

For data freshness checks, quality validation, schema discovery, cross-table joins, and row count audits, see references/common-patterns.md.

References

© data-goblin, GPL-3.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 2 other files (references) in plugins/etl/skills/using-duckdb of data-goblin/power-bi-agentic-development.

  • SKILL.md
  • references/common-patterns.md
  • references/in-notebook-setup.md

Open the folder on GitHubat commit 41886f2

Compare with similar skills

Using Duckdb next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Using Duckdb compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Using Duckdb this skilldata-goblin/power-bi-agentic-development1k—~1.2kAutomated safety check: PassGPL-3.0
Datalineage Summarygoogle/skills21k—~1.7kAutomated safety check: PassApache-2.0
Google Cloud Solution Agentic Analytics Spark Knowledge Cataloggoogle/skills21k—~4.4kAutomated safety check: PassApache-2.0
Bloodhound AnalysisSpecterOps/skills702—~1.4kAutomated safety check: PassMIT
Ga4 Auditcognyai/claude-code-marketing-skills104—~1.6kAutomated safety check: PassNone
Duckdb Experttheneoai/awesome-skills183—~4.2kAutomated safety check: PassMIT

Similar skills

  • Datalineage Summary

    google/skills

    Official

    Summarizes Google Cloud Data Lineage graphs to help users debug data quality issues and understand data provenance for BQ/GCS.

    21k GitHub stars~1.7k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Google Cloud Solution Agentic Analytics Spark Knowledge Catalog

    google/skills

    Official

    Discovers requirements and designs an end-to-end governed agentic analytics solution using Knowledge Catalog and Managed Service for Apache Spark (Lightning Engine).

    21k GitHub stars~4.4k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed

  • Bloodhound Analysis

    SpecterOps/skills

    Use as the default router for generic BloodHound asks: check the BloodHound connection, verify MCP health, analyze BloodHound data, find or explain a path, inspect shortest paths, find a path to…

    702 GitHub stars~1.4k tokensUpdated 14 days ago
    Data & AnalyticsAuto-check passed

  • Ga4 Audit

    cognyai/claude-code-marketing-skills

    Google Analytics 4 configuration and data-quality audit — key events, data streams, custom dimensions, attribution, retention, PII, Ads link, BigQuery export

    104 GitHub stars~1.6k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed

  • Duckdb Expert

    theneoai/awesome-skills

    DuckDB expert for embedded OLAP analytics, Parquet/CSV querying, and high-performance analytical SQL on local data.

    183 GitHub stars~4.2k tokensUpdated 4 mo ago
    Data & AnalyticsAuto-check passed

  • Investigate Data

    walkthru-earth/geocoding-playground

    Investigates geocoder data quality issues by querying live S3 parquet files via MotherDuck MCP.

    153 GitHub stars~935 tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed

More from data-goblin/power-bi-agentic-development

All 33 skills in this repo

  • Paginated Report

    data-goblin/power-bi-agentic-development

    Author, validate, publish, and test Power BI paginated reports in the RDL format.

    1k GitHub stars~3.5k tokensUpdated 2 days ago
    Auto-check passed

  • Audit Tenant Settings

    data-goblin/power-bi-agentic-development

    Automatically invoke this skill whenever the user asks about Fabric tenant settings or Power BI tenant settings or auditing tenant settings.

    1k GitHub stars~4.7k tokensUpdated 2 days ago
    Auto-check passed

  • Bpa Rules

    data-goblin/power-bi-agentic-development

    Interactive BPA rule generation for Power BI semantic models; guided discovery, model investigation, and expert rule authoring.

    1k GitHub stars~4.4k tokensUpdated 2 days ago
    Auto-check passed

  • Pbip

    data-goblin/power-bi-agentic-development

    Guidance for Power BI Project (PBIP) structure, thick and thin reports, project renames, forks, and validation.

    1k GitHub stars~3.8k tokensUpdated 2 days ago
    Auto-check passed

  • Review Report

    data-goblin/power-bi-agentic-development

    Actionable feedback on the quality, usage, and effectiveness of Power BI reports.

    1k GitHub stars~4.2k tokensUpdated 2 days ago
    Auto-check passed

  • Semantic Model

    data-goblin/power-bi-agentic-development

    This skill should be used whenever the user mentions a "semantic model", "data model", or "dataset", or asks to "build", "model", "design", "optimize", "review", or "audit" one, or to "add a…

    1k GitHub stars~2.8k tokensUpdated 2 days ago
    Auto-check passed

Works with

Categories

Questions about Using Duckdb

What does Using Duckdb do?

Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook. Using Duckdb is an agent skill from data-goblin/power-bi-agentic-development. Query Fabric lakehouse and warehouse data using DuckDB, either locally or inside a Fabric notebook.

When should I use Using Duckdb?

Using Duckdb fits situations like: mentions DuckDB; query Delta tables locally; asks to attach DuckDB to a lakehouse; query OneLake data.

How do I install Using Duckdb in Claude Code?

Run `npx skills add data-goblin/power-bi-agentic-development --skill using-duckdb -a claude-code`. Or copy the skill folder (plugins/etl/skills/using-duckdb in data-goblin/power-bi-agentic-development) into .claude/skills/using-duckdb in your project. Claude Code loads it when a task matches its description.

How do I install Using Duckdb in Codex?

Run `npx skills add data-goblin/power-bi-agentic-development --skill using-duckdb -a codex`. Or copy the skill folder (plugins/etl/skills/using-duckdb in data-goblin/power-bi-agentic-development) into .agents/skills/using-duckdb in your project. Codex loads it when a task matches its description.

Can I use Using Duckdb in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add data-goblin/power-bi-agentic-development --skill using-duckdb -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/using-duckdb, .gemini/skills/using-duckdb, .github/skills/using-duckdb and .opencode/skills/using-duckdb in your project.

What does Using Duckdb need to run?

Going by SKILL.md and its folder, Using Duckdb needs the command-line tools its instructions call (duckdb, az and brew) and credentials named ACCESS_TOKEN. Our summary lists: Python 3; A credential in ACCESS_TOKEN.

Does Using Duckdb access the network?

SKILL.md names 2 domains. As links in the text: duckdb.org and github.com. This is read from the text; nothing was executed.

Is Using Duckdb safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Using Duckdb use?

Using Duckdb is published under the GPL-3.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Using Duckdb use?

About 1.2k tokens (SKILL.md is roughly 4.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 889 tokens, read only when the agent opens those files.

What are the alternatives to Using Duckdb?

Skills that share tags, products or a category with Using Duckdb: Datalineage Summary (google/skills, 21k stars), Google Cloud Solution Agentic Analytics Spark Knowledge Catalog (google/skills, 21k stars), Bloodhound Analysis (SpecterOps/skills, 702 stars) and Ga4 Audit (cognyai/claude-code-marketing-skills, 104 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Using Duckdb?

data-goblin (a GitHub user) maintains it in data-goblin/power-bi-agentic-development, which has 1,026 GitHub stars. The repository holds 33 skills in this directory. The repository was last updated on October 5, 2026.

Source: data-goblin/power-bi-agentic-development on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.