Investigate Data
walkthru-earth/geocoding-playground
Investigates geocoder data quality issues by querying live S3 parquet files via MotherDuck MCP.
QuantDB 服务器数据结构与读取口径 — 数据目录组织(1klinedata~6mldatasets)、Hive 分区规律(dt=YYYYMMDD 整数)、单文件 {symbol}.parquet、parquet 后缀式代码 600519.SH 与 PG 前缀式 SH600519 的转换口径、quantdbhub.py 单一读取入口与 DuckDB…
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install qusong0627/QuantMind quantdb-data-structure --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/quantdb-data-structure .claude/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .claude/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structureType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install qusong0627/QuantMind quantdb-data-structure --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/quantdb-data-structure .agents/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .agents/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install qusong0627/QuantMind quantdb-data-structure --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/quantdb-data-structure .cursor/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .cursor/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/qusong0627/QuantMind.git --path skills/quantdb-data-structure--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install qusong0627/QuantMind quantdb-data-structure --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/quantdb-data-structure .gemini/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .gemini/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install qusong0627/QuantMind quantdb-data-structureInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/quantdb-data-structure .github/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .github/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install qusong0627/QuantMind quantdb-data-structure --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/qusong0627/QuantMind.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/quantdb-data-structure .opencode/skills/quantdb-data-structure && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "quantdb-data-structure" agent skill from https://github.com/qusong0627/QuantMind/tree/master/skills/quantdb-data-structure into .opencode/skills/quantdb-data-structure/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "quantdb-data-structure", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
quantdb-data-structureQuantDB 服务器数据结构与读取口径 — 数据目录组织(1klinedata~6mldatasets)、Hive 分区规律(dt=YYYYMMDD 整数)、单文件 {symbol}.parquet、parquet 后缀式代码 600519.SH 与 PG 前缀式 SH600519 的转换口径、quantdbhub.py 单一读取入口与 DuckDB…
Quantdb Data Structure is an agent skill from qusong0627/QuantMind. QuantDB 服务器数据结构与读取口径 — 数据目录组织(1klinedata~6mldatasets)、Hive 分区规律(dt=YYYYMMDD 整数)、单文件 {symbol}.parquet、parquet 后缀式代码 600519.SH 与 PG 前缀式 SH600519 的转换口径、quantdbhub.py 单一读取入口与 DuckDB 视图清单、服务器路径映射(/opt/quantmind/data/quantdb → 容器 /data/quantdb)。凡需要读写/探查/补数/验证 QuantDB 本地 parquet 数据、查目录结构、写 DuckDB 查询、排查查不到数据问题时使用。触发词:quantdb 结构、数据目录、dt 分区、hive 分区、parquet 路径、数据在哪里、600519.SH、代码格式、qdb 视图、quantdbhub、增量同步、数据缺失排查
Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Data & Analytics, covering DataFrames. It works with DuckDB. The repository describes itself as: QuantMind(量化大脑)开源版是一款面向个人开发者与投研团队的 AI 原生多市场量化交易平台。深度集成微软 Qlib、RD-Agent 因子演化与 QuantBot全能工作台,提供从 300+ 维因子挖掘、13 种机器学习与深度学习模型工场、Qlib 高性能回测、截面批量推理、7x24… The licence is AGPL-3.0.
4 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 17c9e29. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
dockerFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use docker, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names these keys or tokens, usually read from environment variables:
QUANTDB_API_KEYFrom names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Quantdb Data Structure loads about 1.3k tokens when it runs. Until then it costs about 108 tokens; SKILL.md has 234 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from qusong0627/QuantMind at commit 17c9e29, republished under its AGPL-3.0 licence (© qusong0627). 234 words, ~1,282 tokens.
.claude/skills/quantdb-data-structure/SKILL.md (or your agent's skills folder).⚙️ 本技能遵循公共运行环境契约(最高优先级,先于本文其余内容执行): 详见 _shared/env-contract.md,执行前先读它。
写任何触碰 QuantDB 本地数据的代码/查询前必读。字段单位与口径陷阱另见
skills/quantdb-fields/SKILL.md(本技能管「数据在哪、怎么组织、怎么读」)。
| 位置 | 路径 |
|---|---|
| 生产服务器宿主机 | /opt/quantmind/data/quantdb |
容器内(./data:/data bind mount) | /data/quantdb |
| 本地仓库 | <项目根>/data/quantdb |
| 用户自定义数据集(产出区) | /data/quantcustom(宿主机 /opt/quantmind/data/quantcustom) |
⚠️
quantdb/是官方只读数据;quantcustom/是用户/挖掘产出(因子挖掘、因子工厂的落盘区,QM_QUANTCUSTOM_DATA_DIR)。两者结构同为 6 大类,但写入一律进quantcustom,不要污染 quantdb。
数据目录解析优先级(quantdb_hub.py._resolve_data_dir):
环境变量 QM_QUANTDB_DATA_DIR → /data/quantdb → /app/data/quantdb → D:/quant_data → 项目根 data/quantdb。
| 目录 | 内容 | 组织方式 |
|---|---|---|
1_kline_data/ | 日K(daily_forward/backward/unadjusted 三种复权)、index_daily、min1_kline、min5_kline、tick | 日K/指数=分区;分钟线=单文件 |
2_base_sector/ | instrument_detail、sector_concept、trading_calendar、index_weights、margin_trading、hsgt_north | 混合 |
3_financial_data/ | balance/income/cashflow/股本/分红因子等财务报表 | 单文件为主 |
4_bond_etf/ | 债券 / ETF | 单文件 |
5_technical_derived/ | valuation(估值)、technical_indicators、market_sentiment | 分区 |
6_ml_datasets/ | features_daily、l1_factors、l2_factors、l1_l2_factors、alpha_library(Alpha101+GTJA191+Alpha158 三库因子) | 分区 |
辅助文件:releases/(数据包版本)、.sync_state / quantdb_sync.sqlite(增量同步状态)、.qlib_cache、_meta。
quantcustom/6_ml_datasets/挖掘产物统一落 data/quantcustom/6_ml_datasets/<数据集>/(结构与 quantdb 一致,按 dt=YYYYMMDD/ 分区):
| 数据集 | 来源 | 附加文件 |
|---|---|---|
l1_factors | ① RD-Agent 因子 export ② 因子工厂(backend/scripts/factor_factory.py) | MANIFEST.csv(factor_name/expression/ic/icir/coverage/kept)、PROPOSALS.json |
QuantDBFactorReader(mode="CUSTOM")(QM_QUANTCUSTOM_DATA_DIR,默认 /data/quantcustom)。GET /api/v1/alpha-agent/factory-factors(读 l1_factors/MANIFEST.csv,只回显不回测)。backend/services/api/routers/admin/alpha_factor_pipeline.py。<数据集>/dt=YYYYMMDD/data.parquet。dt 是 Hive 分区列,整数(如 20260828),DuckDB 过滤 WHERE dt BETWEEN 20260101 AND 20260828 可走谓词下推,不要写字符串。<数据集>/{symbol}.parquet(财务报表、分钟K)或整表单文件(instrument_detail.parquet),用 pd.read_parquet 直读。6_ml_datasets/l1_factors/ 同时存在平铺 l1_factors_YYYYMMDD.parquet 与 dt=YYYYMMDD/ 分区——只读 dt=* 分区目录,避免混入平铺文件。2_base_sector/hsgt_north/ 日频在 daily_freq/*.parquet(无分区),季度快照用 quarter=YYYYQN Hive 分区(2024-08 起季度披露)。| 存储位置 | 格式 | 示例 |
|---|---|---|
QuantDB parquet 的 symbol/wind_code | 后缀式 | 600519.SH、000001.SZ |
PG 表 stock_daily_latest 等内部表 | 前缀式 | SH600519、SZ000001 |
backend/shared/stock_utils.py 的 StockCodeUtil.to_suffix(code);前端 normalizeStockCode。source_used 字段。唯一推荐入口:backend/services/engine/data_platform/quantdb_hub.py(QuantDBDataHub)——懒加载、线程安全、自动做列名映射(time→trade_date、wind_code→symbol、volinstock/vol_in_stock→volume)。不要绕过它自己拼 parquet 路径,除非做数据巡检。
分区数据集挂载的 DuckDB 视图(hive_partitioning=1, union_by_name=true):
| 视图 | 数据 |
|---|---|
qdb_daily_forward / qdb_daily_backward / qdb_daily_unadjusted | 前复权 / 后复权 / 不复权日K |
qdb_index_daily | 指数日K |
qdb_valuation | 估值 |
qdb_technical_indicators | 技术指标 |
qdb_market_sentiment | 市场情绪 |
qdb_features_daily | 每日特征 |
qdb_margin_trading | 融资融券 |
qdb_l2_factors / qdb_l1_l2_factors | L2 / L1+L2 因子 |
qdb_l1_factors | L1 因子(仅当存在 dt=* 分区时挂载) |
qdb_alpha_library | 三库因子 429 列(训练直读) |
qdb_hsgt_north_daily / qdb_hsgt_north | 北向资金日频 / 季度 |
临时探查可直接 DuckDB 查文件:
SELECT * FROM read_parquet('/data/quantdb/1_kline_data/daily_forward/dt=20260828/data.parquet')
WHERE symbol = '600519.SH';# 目录与体量
ls /opt/quantmind/data/quantdb && du -sh /opt/quantmind/data/quantdb/*
# 容器内可见性
docker exec quantmind ls /data/quantdb
# 某交易日数据是否到位(以日K为例)
ls /opt/quantmind/data/quantdb/1_kline_data/daily_forward/dt=20260828/数据更新后服务未感知时:docker compose restart quantmind celery-worker(数据走 bind mount,无需重建镜像)。增量同步需先在【个人中心】→【数据平台】绑定 QUANTDB_API_KEY 后 docker exec 触发。
QM_QUANTDB_DATA_DIR/默认目录解析,而不是写死路径?dt,范围合理(不跨年全表扫)?quantdb-fields 技能?© qusong0627, AGPL-3.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/quantdb-data-structure of qusong0627/QuantMind.
Open the folder on GitHubat commit 17c9e29
Quantdb Data Structure next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Quantdb Data Structure this skillqusong0627/QuantMind | 1.7k | — | ~1.3k | Automated safety check: Pass | AGPL-3.0 | |
| Investigate Datawalkthru-earth/geocoding-playground | 153 | — | ~935 | Automated safety check: Pass | CC-BY-4.0 | |
| Centia Snapshot Catalogmapcentia/geocloud2 | 152 | — | ~2.3k | Automated safety check: Pass | AGPL-3.0 | |
| Querying Big Datasetsflyrank-bih/flyrank-ml-internship-starter | 140 | — | ~750 | Automated safety check: Pass | Custom licence | |
| Hybrid-Engine Data Analysiscode-yeongyu/oh-my-openagent | 70k | — | ~1.4k | Automated safety check: Pass | Custom licence | |
| Exploring Dataoaustegard/claude-skills | 150 | — | ~1.7k | Automated safety check: Pass | MIT |
walkthru-earth/geocoding-playground
Investigates geocoder data quality issues by querying live S3 parquet files via MotherDuck MCP.
mapcentia/geocloud2
Analyse GC2/Centia Parquet snapshots with DuckDB by walking the STAC catalog.json in the snapshot store — find datasets, decide whether a dataset has geometry (and in which CRS), read one snapshot…
flyrank-bih/flyrank-ml-internship-starter
Works with datasets far too big to download or load in pandas — SQL over remote Parquet with DuckDB, aggregate-then-model, iterate on samples.
code-yeongyu/oh-my-openagent
Analyzes CSV, Parquet and JSON data with DuckDB, Polars, numpy and matplotlib, preferring a persistent kernel over repeated one-shot processes.
oaustegard/claude-skills
Exploratory data analysis. An agent skill from oaustegard/claude-skills.
ericrisco/rsc-harness
A skill your agent uses when a raw table is too dirty to trust — nulls, sentinels, duplicate rows, category sprawl, mixed types, bad dates — and you need a re-runnable clean() plus a schema gate…
qusong0627/QuantMind
Produces a post-market review report for the China A-share market from local QuantDB data, news sentiment and model signals, ending in a next-day direction call.
qusong0627/QuantMind
Queries Futu quotes, options, fundamentals and accounts and places orders through the Futu OpenAPI Python SDK, defaulting to simulated trading.
qusong0627/QuantMind
Turns a plain-language model training request into a validated QuantMind training config file that can be imported from the Model Training page.
qusong0627/QuantMind
Covers the Tiger Brokers OpenAPI Python SDK for market data, stock, futures and options trading, push subscriptions, a CLI and an MCP server, defaulting to paper trading.
qusong0627/QuantMind
Guides an agent through the Tiger Brokers OpenAPI C++ SDK for build setup, market data, orders and real-time push, defaulting to paper trading.
qusong0627/QuantMind
Guides building C# and .NET apps on the Tiger Brokers OpenAPI SDK: setup, market data, orders, accounts, options and real-time push, defaulting to paper trading.
Works with
Categories
QuantDB 服务器数据结构与读取口径 — 数据目录组织(1klinedata~6mldatasets)、Hive 分区规律(dt=YYYYMMDD 整数)、单文件 {symbol}.parquet、parquet 后缀式代码 600519.SH 与 PG 前缀式 SH600519 的转换口径、quantdbhub.py 单一读取入口与 DuckDB…. Quantdb Data Structure is an agent skill from qusong0627/QuantMind.
Quantdb Data Structure fits situations like: tasks that involve DataFrames.
Run `npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a claude-code`. Or copy the skill folder (skills/quantdb-data-structure in qusong0627/QuantMind) into .claude/skills/quantdb-data-structure in your project. Claude Code loads it when a task matches its description.
Run `npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a codex`. Or copy the skill folder (skills/quantdb-data-structure in qusong0627/QuantMind) into .agents/skills/quantdb-data-structure in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add qusong0627/QuantMind --skill quantdb-data-structure -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/quantdb-data-structure, .gemini/skills/quantdb-data-structure, .github/skills/quantdb-data-structure and .opencode/skills/quantdb-data-structure in your project.
Going by SKILL.md and its folder, Quantdb Data Structure needs the command-line tools its instructions call (docker) and credentials named QUANTDB_API_KEY. Our summary lists: Docker; A credential in QUANTDB_API_KEY.
SKILL.md contains no URLs. Its commands use docker, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Quantdb Data Structure is published under the AGPL-3.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.3k tokens (SKILL.md is roughly 5.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Quantdb Data Structure: Investigate Data (walkthru-earth/geocoding-playground, 153 stars), Centia Snapshot Catalog (mapcentia/geocloud2, 152 stars), Querying Big Datasets (flyrank-bih/flyrank-ml-internship-starter, 140 stars) and Hybrid-Engine Data Analysis (code-yeongyu/oh-my-openagent, 70k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
qusong0627 (a GitHub user) maintains it in qusong0627/QuantMind, which has 1,711 GitHub stars. The repository holds 27 skills in this directory. The repository was last updated on October 6, 2026.
Source: qusong0627/QuantMind on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.