Agent skill

Meta Test Orchestrator

by GoogleCloudPlatform in GoogleCloudPlatform/DataflowTemplates

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.

Apache-2.0Auto-check passedAgent Workflows

Install Meta Test Orchestrator

skills CLI
$ npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install GoogleCloudPlatform/DataflowTemplates meta-test-orchestrator --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/GoogleCloudPlatform/DataflowTemplates.git skills-src && mkdir -p .claude/skills && cp -r skills-src/v2/spanner-common/.agents/skills/meta-test-orchestrator .claude/skills/meta-test-orchestrator && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
meta-test-orchestrator
GitHub stars
1.3k
Token cost
~2.8k tokens
SKILL.md length
1,069 words
Files
1
Skills in repo
12
Repo updated
First seen
Licence
Apache-2.0

At a glance

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.

  • Works in 6 steps: Goal → Global Constraint: Orchestrator Heartbeats → Initialization Requirements → …
  • Agent Workflows work in your project
  • SKILL.md covers 1. Goal, 2. Global Constraint:…, 3. Initialization Requirements and 4. Orchestration Rules, plus 2 more sections
  • Calls ssh and mvn; reaches raw.githubusercontent.com

What it does

Meta Test Orchestrator is an agent skill from GoogleCloudPlatform/DataflowTemplates. Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

Its SKILL.md is about 2.8k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Agent Workflows. It works with Google Cloud and Google BigQuery. The repository describes itself as: Cloud Dataflow Google-provided templates for solving in-Cloud data tasks. The licence is Apache-2.0.

When your agent uses it

  • Agent Workflows work in your project

Example prompts

  • “/meta-test-orchestrator”

Workflow steps

6 steps, taken from the step headings in SKILL.md.

  1. Goal
  2. Global Constraint: Orchestrator Heartbeats
  3. Initialization Requirements
  4. Orchestration Rules
  5. The Execution Pipeline
  6. Subagent Prompt Templates

What it can do on your machine

Read from SKILL.md and the folder at commit c95daba. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • ssh
    • mvn

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • raw.githubusercontent.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Meta Test Orchestrator loads about 2.8k tokens when it runs. Until then it costs about 54 tokens; SKILL.md has 1,069 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~54
When it runs · the whole SKILL.md, loaded when a task matches
~2.8k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from GoogleCloudPlatform/DataflowTemplates at commit c95daba, republished under its Apache-2.0 licence (© GoogleCloudPlatform). 1,069 words, ~2,784 tokens.

Download SKILL.mdSave it as .claude/skills/meta-test-orchestrator/SKILL.md (or your agent's skills folder).
name
meta-test-orchestrator
description
Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. It will generate the functional and datatype related test for the source.

Template-Agnostic Orchestrator Meta-Skill

This skill instructs an AI Agent to act as the "Project Manager" for onboarding a new database source into ANY given Dataflow testing template. It automates the generation and execution of the template's entire testing suite by spawning specialized subagents.


1. Goal

Orchestrate a fully automated, pipeline to build, test, and verify every single scenario defined in the template's src/test/manifest.yaml.

You MUST execute all spawned subagents sequentially. Do NOT run subagents concurrently, to prevent Maven staging conflicts.


2. Global Constraint: Orchestrator Heartbeats

[!CRITICAL] Resilience & Subagent Monitoring Rule: Because the full execution pipeline can take hours, backend server maintenance restarts might occasionally drop background polling scripts, leaving your subagents stranded in a "waiting" state while tests actually finish in the cloud.

  • As the Orchestrator, you MUST maintain a proactive heartbeat.
  • You MUST set a recurring schedule tool timer (e.g. CronExpression: "*/2 * * * *", IsDaemon: false) dedicated to babysitting.
  • Whenever the heartbeat timer fires, explicitly use manage_subagents list to check statuses. If you notice a subagent stuck in waiting_for_message for an extended period, you must manually run ssh ... tail against the remote logs to check the pipeline's true status, and then explicitly use send_message to blast the subagent awake with the logs so it resumes working.

3. Initialization Requirements

When a user begins a session with this Meta-Skill, ensure you have the following inputs before starting:

  1. Target Source Database Name:
  2. Reference Mapping Matrix File Path:
  3. Testing Environment Setup Path: Confirm that testing_execution.env is populated in the workspace root.
  4. Target Template Path:
  5. Smoke Test Scenarios: (comma-separated list of scenario IDs)
  6. Datatype Test Scenarios: (comma-separated list of scenario IDs)
  7. Manifest File Path:

[!IMPORTANT] Mapping Matrix Schema Validation: You must dynamically validate the user's provided .csv mapping file against the canonical schema before proceeding with any orchestration or code generation.

  1. Use the read_url_content tool to fetch the raw canonical reference from: https://raw.githubusercontent.com/GoogleCloudPlatform/spanner-migration-tool/master/.agents/skills/source_research_helper/sampleOutput/mysql_datatype_mapping_matrix.csv
  2. Parse the headers (first line) of both the fetched sample matrix and the local file at Reference Datatype Mapping Matrix File Path.
  3. Verify that every column header present in the fetched sample is also present in the local provided matrix (a subset match; the local matrix may contain extra custom columns, which is fine).

If ANY of the prompt inputs are missing, or if the testing_execution.env file does not exist in the root directory, or if the provided matrix is missing canonical headers, you MUST HALT EXECUTION IMMEDIATELY. Do not attempt to guess, hallucinate paths, or proceed. Output a direct question asking the user to provide the missing inputs, create the missing environment file, or fix the explicitly missing columns.


4. Orchestration Rules

  1. Sequential Threading: You may only have one active subagent running at any time.
  2. Template Onboarding Report: You MUST maintain a live markdown artifact called template_onboarding_report.md.
    • Progress Tracker: Maintain a high-level counter (e.g., 5 / 20 scenarios completed).
    • Consolidated Bug Log: Aggregate all source-code bugs discovered by subagents and the fixes applied to the <Target_Template_Path> source code.
    • Challenges: Summarize any roadblocks or unsupported features (e.g., missing Spanner APIs).
  3. Error Escalation: If a subagent exhausts its self-healing retries and fails, report back to the user with a summary of the roadblock before halting the pipeline.
  4. Artifact Relocation & Syncing: Subagents frequently save their final migration reports (e.g., test_automation_migration_report.md and live_logs) into their isolated 'brain' execution sandboxes. As the parent Orchestrator, upon validating a subagent's success, you MUST natively copy their generated reports out of their system-isolated directories and move them directly into the correct workspace root directory using the following exact structure:
    • For Datatype tests: src/test/resources/<target_db_name_lowercase>/reports/datatype_testing/<Scenario_ID>_<Timestamp>/
    • For Functional tests: src/test/resources/<target_db_name_lowercase>/reports/functional_testing/<Scenario_ID>_<Timestamp>/
  5. Continuous Meta-Report Syncing: You MUST copy the overarching meta-skill report (template_onboarding_report.md) and orchestration execution logs to a persistent directory in the workspace at src/test/resources/<target_db_name_lowercase>/reports/meta-reports/ right from the beginning, and you must constantly update/overwrite this workspace file as tests run and statuses change iteratively!

Show full SKILL.md (424 more words)Show less

5. The Execution Pipeline

You must guide the workflow through these steps sequentially, waiting for one subagent to complete successfully before advancing or spinning up the next.

Infrastructure Smoke Tests

Goal: Prove the infrastructure and testing_execution.env works before adding complex data types. Action: Spawn a subagent using Prompt Template A targeting only the scenarios provided in the Smoke Test Scenarios input list (e.g., bulk-simple).

Complete Datatypes Validation

Goal: Validate all datatypes for the template (including alternate dialects like PostgreSQL Spanner deployments) using the provided reference mapping file. Action: Spawn subagents sequentially using Prompt Template B for the explicit scenarios provided in the Datatype Test Scenarios input list.

Once those are complete, aggressively scan the provided Manifest File Path for any additional scenarios tagged with type: datatypes (that you haven't executed yet) and spawn subagents for them one at a time. Wait for each subagent to complete before spawning the next.

Functional Scenarios Scale-Out

Goal: Translate the remaining complex features (e.g., sharding, foreign keys, limits). Action: Scan the provided Manifest File Path for all remaining functional scenarios (not covered in the previous steps).

  • Spawn subagents for each scenario one at a time using Prompt Template A.
  • Crucial Rule: As soon as one subagent completes successfully, instantly capture its logs and reports, update your tracker, and proactively move linearly to spawn the next subagent scenario. Do absolutely NOT halt the pipeline or wait for user input/confirmation between scenarios!
Final Validation

Goal: Run a complete verification regression suite across all generated tests to guarantee zero regressions. Action:

  1. To construct the final regression test command, read v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md to learn how to natively assemble the mvn verify parameter list from the environment configs.
  2. Once assembled, swap the target class name parameter for the overarching wildcard corresponding to the dialect (e.g., -Dtest=Oracle*IT).
  3. Maintain the -DdirectRunnerTest flag to run the regression safely and rapidly. Execute this on the remote test VM.
  4. If the regression suite fails on any specific test, you must re-invoke a subagent dedicated to that specific failing test scenario, passing it the failure logs and instructing it to self-heal the source code and verify its individual test again.
  5. Capture the final outcome of the regression run in your meta-report and securely copy the final executed regression logs to the workspace.

6. Subagent Prompt Templates

Prompt Template A (Functional Worker)

Use this prompt when invoking subagents for Smoke Tests and Functional Scenarios. Skill to load: v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md

text
Please load and execute the `v2/spanner-common/.agents/skills/add-source-functional-integ-test/SKILL.md` skill to generate a functional integration test.

Inputs:
1. Scenario ID: [INSERT_SCENARIO_ID]
2. Manifest File Path: [INSERT_MANIFEST_FILE_PATH]
3. Target Source Database Name: [INSERT_DB_NAME]
4. Reference Datatype Mapping Matrix File Path: [INSERT_MAPPING_FILE_PATH]
5. Testing Environment Setup Path: [INSERT_ENV_PATH]

CRITICAL CONSTRAINTS:
- Treat the provided Reference Mapping File as your absolute source of truth to derive baseline mapping schemas. You MUST strictly use this matrix to generate testing mappings. Do NOT perform independent type research.
- Load execution strategy from `testing_execution.env`.
- Follow the Production Code Priority Rule: if tests fail, investigate the target template source code before assuming the test is wrong.
- Use the `-DdirectRunnerTest` flag for iterative testing. Once the DirectRunner loop passes, you MUST perform a final execution directly against Cloud Dataflow (omitting the flag) and ensure that run completely succeeds before generating your final report.
- Upon completing your artifact report, ensure `RequestFeedback: false` is set so your status naturally changes back to idle. Do NOT pause waiting for conversational human feedback.
Prompt Template B (Datatype Worker)

Use this prompt when invoking subagents for Datatypes Validation. Skill to load: v2/spanner-common/.agents/skills/add-source-datatype-integ-test/SKILL.md

text
Please load and execute the `v2/spanner-common/.agents/skills/add-source-datatype-integ-test/SKILL.md` skill to generate a datatype integration test.

Inputs:
1. Scenario ID: [INSERT_SCENARIO_ID]
2. Manifest File Path: [INSERT_MANIFEST_FILE_PATH]
3. Target Source Database Name: [INSERT_DB_NAME]
4. Reference Datatype Mapping Matrix File Path: [INSERT_MAPPING_FILE_PATH]
5. Testing Environment Setup Path: [INSERT_ENV_PATH]

CRITICAL CONSTRAINTS:
- Treat the provided Reference Mapping File as your absolute source of truth to derive baseline mapping schemas. You MUST strictly use this matrix to generate testing mappings. Do NOT perform independent type research.
- Load execution strategy from `testing_execution.env`.
- Use the `-DdirectRunnerTest` flag for iterative testing.Once the DirectRunner loop passes, you MUST perform a final execution directly against Cloud Dataflow (omitting the flag) and ensure that run completely succeeds before generating your final report.
- Upon completing your artifact report, ensure `RequestFeedback: false` is set so your status naturally changes back to idle. Do NOT pause waiting for conversational human feedback.

© GoogleCloudPlatform, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in v2/spanner-common/.agents/skills/meta-test-orchestrator of GoogleCloudPlatform/DataflowTemplates.

Open the folder on GitHubat commit c95daba

Compare with similar skills

Meta Test Orchestrator next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Meta Test Orchestrator compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Meta Test Orchestrator this skillGoogleCloudPlatform/DataflowTemplates1.3k—~2.8kAutomated safety check: PassApache-2.0
Google Cloud Storage Basicsgoogle/skills21k—~2.8kAutomated safety check: PassApache-2.0
Io ConnectorsKilo-Org/kilo-marketplace189—~1.3kAutomated safety check: PassApache-2.0
Retail Product Search Agentgoogle/adk-recipes10k—~3kAutomated safety check: PassApache-2.0
Cxas Configurable DashboardsGoogleCloudPlatform/cxas-scrapi106—~1.8kAutomated safety check: PassApache-2.0
GCP DrawIO Diagram Generatora5c-ai/babysitter1.8k—~3.7kAutomated safety check: PassMIT

Similar skills

  • Official

    Stores, retrieves, and manages data as objects in Cloud Storage on Google Cloud (also known colloquially as GCS) buckets.

    21k GitHub stars~2.8k tokensUpdated yesterday
    Agent WorkflowsAuto-check passed
  • Io Connectors

    Kilo-Org/kilo-marketplace

    Guides development and usage of I/O connectors in Apache Beam.

    189 GitHub stars~1.3k tokensUpdated 9 days ago
    Testing & QAAuto-check passed
  • Retail Product Search Agent

    google/adk-recipes

    Official

    Builds a retail product search agent on Google Cloud, from catalog ingestion into BigQuery and Vector Search to ADK scaffolding, evaluation and Cloud Run deployment.

    10k GitHub stars~3k tokensUpdated 2 days ago
    AI & LLM EngineeringAuto-check passed
  • Cxas Configurable Dashboards

    GoogleCloudPlatform/cxas-scrapi

    Author, validate, and manage Contact Center AI (CCAI) Insights Configurable Dashboards.

    106 GitHub stars~1.8k tokensUpdated yesterday
    DatabasesAuto-check passed
  • Creates DrawIO XML diagrams of Google Cloud architectures from text or images, and analyzes existing .drawio files to list their GCP components.

    1.8k GitHub stars~3.7k tokensUpdated 21 days ago
    DevOps & CloudAuto-check passed
  • Official

    Analyzes BigQuery slot use, query costs and execution bottlenecks from INFORMATION_SCHEMA to diagnose slow queries, slot contention and unpartitioned scans.

    21k GitHub stars~2.3k tokensUpdated yesterday
    DatabasesAuto-check passed

More from GoogleCloudPlatform/DataflowTemplates

All 12 skills in this repo
  • Smt E2E Dataflow Debugging

    GoogleCloudPlatform/DataflowTemplates

    Debugs logical errors and data discrepancies in Dataflow templates by launching jobs via Terraform and comparing source (e.g.

    1.3k GitHub stars~1.8k tokensUpdated today
    Auto-check passed
  • Smt Functional Testing

    GoogleCloudPlatform/DataflowTemplates

    Functionally tests local Dataflow pipeline changes against the main branch using ephemeral GCP resources and gated approvals.

    1.3k GitHub stars~2.8k tokensUpdated today
    Auto-check: notes
  • Add Integ Tests Datastream To Spanner

    GoogleCloudPlatform/DataflowTemplates

    Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the datastream-to-spanner (CDC) template.

    1.3k GitHub stars~572 tokensUpdated today
    Auto-check passed
  • Add Integ Tests Gcs Spanner Dv

    GoogleCloudPlatform/DataflowTemplates

    Specific runner skill that creates integration tests for the gcs-spanner-dv (Data Validation) template.

    1.3k GitHub stars~517 tokensUpdated today
    Auto-check passed
  • Add Integ Tests Sourcedb To Spanner

    GoogleCloudPlatform/DataflowTemplates

    Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the sourcedb-to-spanner (Bulk) template.

    1.3k GitHub stars~475 tokensUpdated today
    Auto-check passed
  • Add Integ Tests Spanner To Sourcedb

    GoogleCloudPlatform/DataflowTemplates

    Specific runner skill that delegates to the Template-Agnostic Meta-Test Orchestrator for the spanner-to-sourcedb (Reverse Migration) template.

    1.3k GitHub stars~479 tokensUpdated today
    Auto-check passed

Questions about Meta Test Orchestrator

What does Meta Test Orchestrator do?

Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template. Meta Test Orchestrator is an agent skill from GoogleCloudPlatform/DataflowTemplates. Template-agnostic Orchestrator Skill for generating and executing exhaustive testing suites for any migration template.

When should I use Meta Test Orchestrator?

Meta Test Orchestrator fits situations like: agent Workflows work in your project.

How do I install Meta Test Orchestrator in Claude Code?

Run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a claude-code`. Or copy the skill folder (v2/spanner-common/.agents/skills/meta-test-orchestrator in GoogleCloudPlatform/DataflowTemplates) into .claude/skills/meta-test-orchestrator in your project. Claude Code loads it when a task matches its description.

How do I install Meta Test Orchestrator in Codex?

Run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a codex`. Or copy the skill folder (v2/spanner-common/.agents/skills/meta-test-orchestrator in GoogleCloudPlatform/DataflowTemplates) into .agents/skills/meta-test-orchestrator in your project. Codex loads it when a task matches its description.

Can I use Meta Test Orchestrator in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add GoogleCloudPlatform/DataflowTemplates --skill meta-test-orchestrator -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/meta-test-orchestrator, .gemini/skills/meta-test-orchestrator, .github/skills/meta-test-orchestrator and .opencode/skills/meta-test-orchestrator in your project.

What does Meta Test Orchestrator need to run?

Going by SKILL.md and its folder, Meta Test Orchestrator needs the command-line tools its instructions call (ssh and mvn).

Does Meta Test Orchestrator access the network?

SKILL.md names 1 domain. In commands or code: raw.githubusercontent.com; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.

Is Meta Test Orchestrator safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Meta Test Orchestrator use?

Meta Test Orchestrator is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Meta Test Orchestrator use?

About 2.8k tokens (SKILL.md is roughly 11k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Meta Test Orchestrator?

Skills that share tags, products or a category with Meta Test Orchestrator: Google Cloud Storage Basics (google/skills, 21k stars), Io Connectors (Kilo-Org/kilo-marketplace, 189 stars), Retail Product Search Agent (google/adk-recipes, 10k stars) and Cxas Configurable Dashboards (GoogleCloudPlatform/cxas-scrapi, 106 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Meta Test Orchestrator?

GoogleCloudPlatform (a GitHub organization) maintains it in GoogleCloudPlatform/DataflowTemplates, which has 1,315 GitHub stars. The repository holds 12 skills in this directory. The repository was last updated on October 7, 2026.

Source: GoogleCloudPlatform/DataflowTemplates on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.