Google Cloud Storage Basics
google/skills
Stores, retrieves, and manages data as objects in Cloud Storage on Google Cloud (also known colloquially as GCS) buckets.
Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .claude/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .claude/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .claude/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestratorType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .agents/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .agents/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .agents/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .cursor/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .cursor/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/GoogleCloudPlatform/DataflowTemplates.git --path v2/spanner-common/.agents/skills/meta-test-orchestrator--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .gemini/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .gemini/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestratorInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .github/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .github/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .github/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .opencode/skills/meta-test-orchestrator && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "meta-test-orchestrator" agent skill from https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/main/v2/spanner-common/.agents/skills/meta-test-orchestrator into .opencode/skills/meta-test-orchestrator/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "meta-test-orchestrator", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
meta-test-orchestratorTemplate-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.
Meta Test Orchestrator is an agent skill from GoogleCloudPlatform/DataflowTemplates. Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.
Its SKILL.md is about 2.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Agent Workflows. It works with Google Cloud and Google BigQuery. The repository describes itself as: Cloud Dataflow Google-provided templates for solving in-Cloud data tasks. The licence is Apache-2.0.
6 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit c95daba. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
sshmvnFrom the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
raw.githubusercontent.comFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Meta Test Orchestrator loads about 2.8k tokens when it runs. Until then it costs about 54 tokens; SKILL.md has 1,069 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from GoogleCloudPlatform/DataflowTemplates at commit c95daba, republished under its Apache-2.0 licence (© GoogleCloudPlatform). 1,069 words, ~2,784 tokens.
.claude/skills/meta-test-orchestrator/SKILL.md (or your agent's skills folder).This skill instructs an AI Agent to act as the "Project Manager" for onboarding a new database source into ANY given Dataflow testing template. It automates the generation and execution of the template's entire testing suite by spawning specialized subagents.
Orchestrate a fully automated, pipeline to build, test, and verify every single scenario defined in the template's src/test/manifest.yaml.
You MUST execute all spawned subagents sequentially. Do NOT run subagents concurrently, to prevent Maven staging conflicts.
[!CRITICAL] Resilience & Subagent Monitoring Rule: Because the full execution pipeline can take hours, backend server maintenance restarts might occasionally drop background polling scripts, leaving your subagents stranded in a "waiting" state while tests actually finish in the cloud.
- As the Orchestrator, you MUST maintain a proactive heartbeat.
- You MUST set a recurring
scheduletool timer (e.g.CronExpression: "*/2 * * * *",IsDaemon: false) dedicated to babysitting.- Whenever the heartbeat timer fires, explicitly use
manage_subagents listto check statuses. If you notice a subagent stuck inwaiting_for_messagefor an extended period, you must manually runssh ... tailagainst the remote logs to check the pipeline's true status, and then explicitly usesend_messageto blast the subagent awake with the logs so it resumes working.
When a user begins a session with this Meta-Skill, ensure you have the following inputs before starting:
testing_execution.env is populated in the workspace root.[!IMPORTANT] Mapping Matrix Schema Validation: You must dynamically validate the user's provided
.csvmapping file against the canonical schema before proceeding with any orchestration or code generation.
- Use the
read_url_contenttool to fetch the raw canonical reference from:https://raw.githubusercontent.com/GoogleCloudPlatform/spanner-migration-tool/master/.agents/skills/source_research_helper/sampleOutput/mysql_datatype_mapping_matrix.csv- Parse the headers (first line) of both the fetched sample matrix and the local file at
Reference Datatype Mapping Matrix File Path.- Verify that every column header present in the fetched sample is also present in the local provided matrix (a subset match; the local matrix may contain extra custom columns, which is fine).
If ANY of the prompt inputs are missing, or if the testing_execution.env file does not exist in the root directory, or if the provided matrix is missing canonical headers, you MUST HALT EXECUTION IMMEDIATELY. Do not attempt to guess, hallucinate paths, or proceed. Output a direct question asking the user to provide the missing inputs, create the missing environment file, or fix the explicitly missing columns.
template_onboarding_report.md.5 / 20 scenarios completed).<Target_Template_Path> source code.test_automation_migration_report.md and live_logs) into their isolated 'brain' execution sandboxes. As the parent Orchestrator, upon validating a subagent's success, you MUST natively copy their generated reports out of their system-isolated directories and move them directly into the correct workspace root directory using the following exact structure:src/test/resources/<target_db_name_lowercase>/reports/datatype_testing/<Scenario_ID>_<Timestamp>/src/test/resources/<target_db_name_lowercase>/reports/functional_testing/<Scenario_ID>_<Timestamp>/template_onboarding_report.md) and orchestration execution logs to a persistent directory in the workspace at src/test/resources/<target_db_name_lowercase>/reports/meta-reports/ right from the beginning, and you must constantly update/overwrite this workspace file as tests run and statuses change iteratively!You must guide the workflow through these steps sequentially, waiting for one subagent to complete successfully before advancing or spinning up the next.
Goal: Prove the infrastructure and testing_execution.env works before adding complex data types.
Action: Spawn a subagent using Prompt Template A targeting only the scenarios provided in the Smoke Test Scenarios input list (e.g., bulk-simple).
Goal: Validate all datatypes for the template (including alternate dialects like PostgreSQL Spanner deployments) using the provided reference mapping file. Action: Spawn subagents sequentially using Prompt Template B for the explicit scenarios provided in the Datatype Test Scenarios input list.
Once those are complete, aggressively scan the provided Manifest File Path for any additional scenarios tagged with type: datatypes (that you haven't executed yet) and spawn subagents for them one at a time. Wait for each subagent to complete before spawning the next.
Goal: Translate the remaining complex features (e.g., sharding, foreign keys, limits). Action: Scan the provided Manifest File Path for all remaining functional scenarios (not covered in the previous steps).
Goal: Run a complete verification regression suite across all generated tests to guarantee zero regressions. Action:
v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md to learn how to natively assemble the mvn verify parameter list from the environment configs. -Dtest=Oracle*IT).-DdirectRunnerTest flag to run the regression safely and rapidly. Execute this on the remote test VM.Use this prompt when invoking subagents for Smoke Tests and Functional Scenarios.
Skill to load: v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md
Please load and execute the `v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md` skill to generate a functional integration test.
Inputs:
1. Scenario ID: [INSERT_SCENARIO_ID]
2. Manifest File Path: [INSERT_MANIFEST_FILE_PATH]
3. Target Source Database Name: [INSERT_DB_NAME]
4. Reference Datatype Mapping Matrix File Path: [INSERT_MAPPING_FILE_PATH]
5. Testing Environment Setup Path: [INSERT_ENV_PATH]
CRITICAL CONSTRAINTS:
- Treat the provided Reference Mapping File as your absolute source of truth to derive baseline mapping schemas. You MUST strictly use this matrix to generate testing mappings. Do NOT perform independent type research.
- Load execution strategy from `testing_execution.env`.
- Follow the Production Code Priority Rule: if tests fail, investigate the target template source code before assuming the test is wrong.
- Use the `-DdirectRunnerTest` flag for iterative testing. Once the DirectRunner loop passes, you MUST perform a final execution directly against Cloud Dataflow (omitting the flag) and ensure that run completely succeeds before generating your final report.
- Upon completing your artifact report, ensure `RequestFeedback: false` is set so your status naturally changes back to idle. Do NOT pause waiting for conversational human feedback.
Use this prompt when invoking subagents for Datatypes Validation.
Skill to load: v2/spanner-common/.agents/skills/add-source-datatype-integ-test/SKILL.md
Please load and execute the `v2/spanner-common/.agents/skills/add-source-datatype-integ-test/SKILL.md` skill to generate a datatype integration test.
Inputs:
1. Scenario ID: [INSERT_SCENARIO_ID]
2. Manifest File Path: [INSERT_MANIFEST_FILE_PATH]
3. Target Source Database Name: [INSERT_DB_NAME]
4. Reference Datatype Mapping Matrix File Path: [INSERT_MAPPING_FILE_PATH]
5. Testing Environment Setup Path: [INSERT_ENV_PATH]
CRITICAL CONSTRAINTS:
- Treat the provided Reference Mapping File as your absolute source of truth to derive baseline mapping schemas. You MUST strictly use this matrix to generate testing mappings. Do NOT perform independent type research.
- Load execution strategy from `testing_execution.env`.
- Use the `-DdirectRunnerTest` flag for iterative testing.Once the DirectRunner loop passes, you MUST perform a final execution directly against Cloud Dataflow (omitting the flag) and ensure that run completely succeeds before generating your final report.
- Upon completing your artifact report, ensure `RequestFeedback: false` is set so your status naturally changes back to idle. Do NOT pause waiting for conversational human feedback.
© GoogleCloudPlatform, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in v2/spanner-common/.agents/skills/meta-test-orchestrator of GoogleCloudPlatform/DataflowTemplates.
Open the folder on GitHubat commit c95daba
Meta Test Orchestrator next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Meta Test Orchestrator this skillGoogleCloudPlatform/DataflowTemplates | 1.3k | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | |
| Google Cloud Storage Basicsgoogle/skills | 21k | — | ~2.8k | Automated safety check: Pass | Apache-2.0 | |
| Io ConnectorsKilo-Org/kilo-marketplace | 189 | — | ~1.3k | Automated safety check: Pass | Apache-2.0 | |
| Retail Product Search Agentgoogle/adk-recipes | 10k | — | ~3k | Automated safety check: Pass | Apache-2.0 | |
| Cxas Configurable DashboardsGoogleCloudPlatform/cxas-scrapi | 106 | — | ~1.8k | Automated safety check: Pass | Apache-2.0 | |
| GCP DrawIO Diagram Generatora5c-ai/babysitter | 1.8k | — | ~3.7k | Automated safety check: Pass | MIT |
google/skills
Stores, retrieves, and manages data as objects in Cloud Storage on Google Cloud (also known colloquially as GCS) buckets.
Kilo-Org/kilo-marketplace
Guides development and usage of I/O connectors in Apache Beam.
google/adk-recipes
Builds a retail product search agent on Google Cloud, from catalog ingestion into BigQuery and Vector Search to ADK scaffolding, evaluation and Cloud Run deployment.
GoogleCloudPlatform/cxas-scrapi
Author, validate, and manage Contact Center AI (CCAI) Insights Configurable Dashboards.
a5c-ai/babysitter
Creates DrawIO XML diagrams of Google Cloud architectures from text or images, and analyzes existing .drawio files to list their GCP components.
google/skills
Analyzes BigQuery slot use, query costs and execution bottlenecks from INFORMATION_SCHEMA to diagnose slow queries, slot contention and unpartitioned scans.
GoogleCloudPlatform/DataflowTemplates
Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g.
GoogleCloudPlatform/DataflowTemplates
Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals.
GoogleCloudPlatform/DataflowTemplates
Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.
GoogleCloudPlatform/DataflowTemplates
Specific runner skill that creates integration tests for the gcs-spanner-dv (Data Validation) template.
GoogleCloudPlatform/DataflowTemplates
Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.
GoogleCloudPlatform/DataflowTemplates
Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.
Works with
Categories
Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. Meta Test Orchestrator is an agent skill from GoogleCloudPlatform/DataflowTemplates. Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.
Meta Test Orchestrator fits situations like: agent Workflows work in your project.
Run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a claude-code`. Or copy the skill folder (v2/spanner-common/.agents/skills/meta-test-orchestrator in GoogleCloudPlatform/DataflowTemplates) into .claude/skills/meta-test-orchestrator in your project. Claude Code loads it when a task matches its description.
Run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a codex`. Or copy the skill folder (v2/spanner-common/.agents/skills/meta-test-orchestrator in GoogleCloudPlatform/DataflowTemplates) into .agents/skills/meta-test-orchestrator in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/meta-test-orchestrator, .gemini/skills/meta-test-orchestrator, .github/skills/meta-test-orchestrator and .opencode/skills/meta-test-orchestrator in your project.
Going by SKILL.md and its folder, Meta Test Orchestrator needs the command-line tools its instructions call (ssh and mvn).
SKILL.md names 1 domain. In commands or code: raw.githubusercontent.com; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Meta Test Orchestrator is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 2.8k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Meta Test Orchestrator: Google Cloud Storage Basics (google/skills, 21k stars), Io Connectors (Kilo-Org/kilo-marketplace, 189 stars), Retail Product Search Agent (google/adk-recipes, 10k stars) and Cxas Configurable Dashboards (GoogleCloudPlatform/cxas-scrapi, 106 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
GoogleCloudPlatform (a GitHub organization) maintains it in GoogleCloudPlatform/DataflowTemplates, which has 1,315 GitHub stars. The repository holds 12 skills in this directory. The repository was last updated on October 7, 2026.
Source: GoogleCloudPlatform/DataflowTemplates on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.