Agent skill

Jobs And Tests

by openshift-eng in openshift-eng/ai-helpers

A skill your agent uses when querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication, variant joins, and infrastructure failure filtering

Apache-2.0Auto-check passedDatabases

Install Jobs And Tests

skills CLI
$ npx skills add openshift-eng/ai-helpers --skill jobs-and-tests -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install openshift-eng/ai-helpers jobs-and-tests --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/openshift-eng/ai-helpers.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/bigquery-ci-data/skills/jobs-and-tests .claude/skills/jobs-and-tests && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
jobs-and-tests
GitHub stars
120
Token cost
~2.2k tokens
SKILL.md length
726 words
Files
1
Skills in repo
118
Repo updated
First seen
Licence
Apache-2.0

At a glance

A skill your agent uses when querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication, variant joins, and infrastructure failure filtering

  • Querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication
  • SKILL.md covers When to Use This Skill, Tables, Variant Reference and Query Patterns, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Infrastructure failure filtering

What it does

Jobs And Tests is an agent skill from openshift-eng/ai-helpers. Use when querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication, variant joins, and infrastructure failure filtering

Its SKILL.md is about 2.2k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Databases, covering Unit testing, Data warehousing and Data cleaning. It works with JUnit and Google BigQuery. The repository describes itself as: Developer productivity tools for Claude Code & other AI assistants. The licence is Apache-2.0.

When your agent uses it

  • Querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication
  • Infrastructure failure filtering

Example prompts

  • “/jobs-and-tests”

What it can do on your machine

Read from SKILL.md and the folder at commit a627176. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are sql).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Jobs And Tests loads about 2.2k tokens when it runs. Until then it costs about 48 tokens; SKILL.md has 726 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~48
When it runs · the whole SKILL.md, loaded when a task matches
~2.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from openshift-eng/ai-helpers at commit a627176, republished under its Apache-2.0 licence (© openshift-eng). 726 words, ~2,183 tokens.

Download SKILL.mdSave it as .claude/skills/jobs-and-tests/SKILL.md (or your agent's skills folder).
name
jobs-and-tests
description
Use when querying OpenShift CI prow job runs and junit test results in BigQuery (ci_analysis_us dataset) with deduplication, variant joins, and infrastructure failure filtering

Jobs and Tests

Query and analyze prow job runs and junit test results stored in openshift-gce-devel.ci_analysis_us. This is the primary dataset for investigating test failures, flakes, regressions, and job pass rates.

Follow the foundations skill for cost safety, caching, and execution workflow.

When to Use This Skill

  • Investigating test failures, flakes, or regressions across CI jobs
  • Querying prow job pass/fail rates over time
  • Analyzing test results by variant (platform, architecture, network, upgrade, etc.)
  • Exploring CI data patterns (e.g. which jobs run a test, how often a test fails)

Tables

ci_analysis_us.junit

Junit test results. Massive table. Partitioned by DAY on modified_time. Clustered on release.

ColumnTypeNotes
prowjob_build_idSTRINGJoin key to jobs table
file_pathSTRINGArtifact path of the junit XML
test_nameSTRINGFull test name
testsuiteSTRINGTest suite name
success_valINTEGER1 = pass, 0 = fail
successBOOLEANPass/fail
skippedBOOLEANWhether test was skipped
flake_countINTEGER>0 means this row is part of a flake
modified_timeDATETIMEPartition column — always filter on this
releaseSTRINGOCP release (e.g. "4.22", "5.0"). Clustering column — always filter for ~60-70% cost reduction
branchSTRINGLEGACY — do not use. Use release instead
prowjob_nameSTRINGName of the prow job run
duration_msINTEGERTest execution time
test_idSTRINGStable test identifier
failure_messageSTRINGFailure message from junit XML
failure_contentSTRINGFailure body from junit XML
start_timeDATETIMETest start time
end_timeDATETIMETest end time
platformSTRINGLEGACY — do not use for filtering
archSTRINGLEGACY — do not use for filtering
networkSTRINGLEGACY — do not use for filtering
upgradeSTRINGLEGACY — do not use for filtering

IMPORTANT: The platform, arch, network, upgrade columns on junit are legacy and unmaintained. Join to jobs then job_variants for accurate variant data.

ci_analysis_us.jobs

Prow job runs (invocations). Each row is a single execution. Partitioned by DAY on prowjob_start.

Terminology: "job" = a distinct prowjob_job_name. The table contains individual runs, each with a unique prowjob_build_id. Use prowjob_job_name to group/identify jobs, prowjob_build_id for specific runs.

ColumnTypeNotes
prowjob_build_idSTRINGPrimary key, join key to junit
prowjob_job_nameSTRINGCanonical job name (join key to job_variants)
prowjob_urlSTRINGLink to prow job
prowjob_stateSTRING"success", "failure", "error", "aborted"
prowjob_startDATETIMEPartition column
prowjob_completionDATETIMEWhen job finished
prowjob_typeSTRING"periodic", "presubmit", "postsubmit"
orgSTRINGGitHub org
repoSTRINGGitHub repo
pr_numberSTRINGPR number (presubmits)
base_refSTRINGBase branch
is_release_verifyBOOLEANWhether this is a release verification job
ci_analysis_us.job_variants

Maps job names to variant classifications. Not partitioned (small table).

ColumnTypeNotes
job_nameSTRINGJoin to jobs.prowjob_job_name
variant_nameSTRINGe.g. "Platform", "Architecture"
variant_valueSTRINGe.g. "aws", "amd64"
Show full SKILL.md (300 more words)Show less
ci_analysis_us.job_labels

Labels/annotations on job runs. Partitioned by DAY on prowjob_start.

ColumnTypeNotes
prowjob_build_idSTRINGJoin key to jobs/junit
prowjob_startDATETIMEPartition column
labelSTRINGe.g. "InfraFailure"
symptom_idSTRINGTriage symptom ID

Variant Reference

Each job maps to multiple variant dimensions via job_variants. Each dimension is a separate LEFT JOIN.

Release & Upgrade
VariantKey Values
Release4.18, 4.19, 4.20, 4.21, 4.22, 4.23, 5.0, 5.1
Upgradenone, micro, minor, major, multi, micro-downgrade
FromRelease4.17, 4.18, etc.
Platform & Infrastructure
VariantKey Values
Platformaws, azure, gcp, vsphere, metal, openstack, nutanix, alibaba, kubevirt, libvirt, none, ovirt, rosa, aro, external-aws, external-oci, external-vsphere, osd-gcp
Architectureamd64, arm64, multi, ppc64le, s390x
Topologyha, single, compact, external, microshift, two-node-arbiter, two-node-fencing
Installeripi, upi, agent, assisted, hypershift, aro
Network
VariantKey Values
Networkovn, sdn, cilium
NetworkStackipv4, ipv6, dual
NetworkAccessdefault, disconnected, proxy, nat-instance
Job Classification
VariantKey Values
JobTierblocking, informing, candidate, standard, rare, excluded, hidden
Ownereng, qe, aro, cnf, perfscale, etc.
Suiteparallel, serial, etcd-scaling, unknown
Configuration
VariantKey Values
Procedurenone, serial, cert-rotation-shutdown, cpu-partitioning, etcd-scaling, ipsec, on-cluster-layering, etc.
SecurityModedefault, fips
FeatureSetdefault, techpreview
CGroupModev1, v2
ContainerRuntimerunc, crun
OSrhcos9, rhcos10, rhcos9-10
Aggregationnone, aggregated

Query Patterns

Deduplicating Junit Results (CRITICAL)

A "flake" appears as two rows: one fail, one pass. Raw queries double-count unless deduplicated. Always use this pattern for aggregation:

sql
WITH deduped AS (
  SELECT
    *,
    ROW_NUMBER() OVER(
      PARTITION BY prowjob_build_id, file_path, test_name, testsuite
      ORDER BY
        CASE
          WHEN flake_count > 0 THEN 0
          WHEN success_val > 0 THEN 1
          ELSE 2
        END
    ) AS row_num,
    CASE WHEN flake_count > 0 THEN 0 ELSE success_val END AS adjusted_success_val,
    CASE WHEN flake_count > 0 THEN 1 ELSE 0 END AS adjusted_flake_count
  FROM `openshift-gce-devel.ci_analysis_us.junit`
  WHERE modified_time >= DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 7 DAY)
    AND release = '4.22'
    AND skipped = false
    AND test_name LIKE '%your test pattern%'
)
SELECT * FROM deduped WHERE row_num = 1

Priority: flakes (0) > passes (1) > failures (2). Skip deduplication only when debugging a specific flake's failure message.

Variant Joins

Each dimension is a separate LEFT JOIN with a unique alias:

sql
LEFT JOIN `openshift-gce-devel.ci_analysis_us.job_variants` jv_release
  ON jobs.prowjob_job_name = jv_release.job_name AND jv_release.variant_name = 'Release'
LEFT JOIN `openshift-gce-devel.ci_analysis_us.job_variants` jv_platform
  ON jobs.prowjob_job_name = jv_platform.job_name AND jv_platform.variant_name = 'Platform'
WHERE jv_release.variant_value = '4.19'
  AND jv_platform.variant_value = 'aws'

Tip: Exclude aggregated results with Aggregation != 'aggregated' or prowjob_name NOT LIKE '%aggregated%'.

Filtering Out Infrastructure Failures
sql
LEFT JOIN `openshift-gce-devel.ci_analysis_us.job_labels` jl
  ON junit.prowjob_build_id = jl.prowjob_build_id
  AND jl.prowjob_start >= DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 7 DAY)
  AND jl.label = 'InfraFailure'
WHERE jl.label IS NULL
Job Pass Rate Analysis
sql
SELECT
  jobs.prowjob_job_name,
  COUNT(DISTINCT jobs.prowjob_build_id) AS total_runs,
  COUNT(DISTINCT IF(jobs.prowjob_state = 'success', jobs.prowjob_build_id, NULL)) AS successful_runs
FROM `openshift-gce-devel.ci_analysis_us.jobs` jobs
WHERE jobs.prowjob_start >= DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 7 DAY)
  AND jobs.prowjob_type = 'periodic'
GROUP BY jobs.prowjob_job_name
ORDER BY total_runs DESC

QE Dataset: ci_analysis_qe

Same table structure as ci_analysis_us. Smaller. QE jobs are slowly migrating to the engineering system. Default to ci_analysis_us unless the user explicitly asks about QE data.

© openshift-eng, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in plugins/bigquery-ci-data/skills/jobs-and-tests of openshift-eng/ai-helpers.

Open the folder on GitHubat commit a627176

Compare with similar skills

Jobs And Tests next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Jobs And Tests compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Jobs And Tests this skillopenshift-eng/ai-helpers120—~2.2kAutomated safety check: PassApache-2.0
Datalineage Summarygoogle/skills21k—~1.7kAutomated safety check: PassApache-2.0
Ga4 Auditcognyai/claude-code-marketing-skills104—~1.6kAutomated safety check: PassNone
Io ConnectorsKilo-Org/kilo-marketplace190—~1.3kAutomated safety check: PassApache-2.0
Clickhouse Logs Queriessupabase/supabase111k—~2.4kAutomated safety check: PassApache-2.0
Neocarta Add Source Connectorneo4j-labs/neocarta147—~1.9kAutomated safety check: PassApache-2.0

Similar skills

  • Datalineage Summary

    google/skills

    Official

    Summarizes data lineage graphs on Google Cloud to help users debug data quality issues and understand data provenance for BigQuery and Cloud Storage.

    21k GitHub stars~1.7k tokensUpdated yesterday
    Data & AnalyticsAuto-check passed
  • Ga4 Audit

    cognyai/claude-code-marketing-skills

    Google Analytics 4 configuration and data-quality audit — key events, data streams, custom dimensions, attribution, retention, PII, Ads link, BigQuery export

    104 GitHub stars~1.6k tokensUpdated 3 mo ago
    Data & AnalyticsAuto-check passed
  • Io Connectors

    Kilo-Org/kilo-marketplace

    Guides development and usage of I/O connectors in Apache Beam.

    190 GitHub stars~1.3k tokensUpdated 12 days ago
    DatabasesAuto-check passed
  • Clickhouse Logs Queries

    supabase/supabase

    Official

    Write, review, and migrate Supabase logs queries against the ClickHouse-backed logs table (the logs.all.otel analytics endpoint).

    111k GitHub stars~2.4k tokensUpdated yesterday
    DatabasesAuto-check passed
  • Scaffold, build, and verify a neocarta source or format connector against the connector contract.

    147 GitHub stars~1.9k tokensUpdated yesterday
    DatabasesAuto-check passed
  • Mfs Find

    zilliztech/mfs

    Search, grep, browse, and read across registered MFS data sources via the mfs CLI — codebases, docs, PDFs, web crawls, databases (postgres/mysql/mongo/snowflake/bigquery), issue trackers…

    154 GitHub stars~4k tokensUpdated 2 mo ago
    DatabasesAuto-check passed

More from openshift-eng/ai-helpers

All 118 skills in this repo
  • Investigate CI Reliability

    openshift-eng/ai-helpers

    Find and independently validate actionable reliability defects across OpenShift release jobs and presubmits, then export portable issue handoffs.

    120 GitHub stars~1.9k tokensUpdated 4 days ago
    Auto-check passed
  • Address Review PR

    openshift-eng/ai-helpers

    Fetch and address all PR review comments — categorize by priority, make code changes, post replies, and push.

    120 GitHub stars~2.9k tokensUpdated 4 days ago
    Auto-check passed
  • Categorize Activity Types

    openshift-eng/ai-helpers

    Categorize Jira issues into Red Hat Sankey Activity Type categories using MCP Jira tools.

    120 GitHub stars~2.4k tokensUpdated 4 days ago
    Auto-check passed
  • Has Review Work

    openshift-eng/ai-helpers

    Decide whether a GitHub PR has unanswered authorized review comments or new required CI failures worth a follow-up agent.

    120 GitHub stars~1.9k tokensUpdated 4 days ago
    Auto-check passed
  • Must Gather Analyzer

    openshift-eng/ai-helpers

    Analyze OpenShift must-gather diagnostic data including cluster operators, pods, nodes, and network components.

    120 GitHub stars~2.3k tokensUpdated 4 days ago
    Auto-check passed
  • Payload Autodl JSON

    openshift-eng/ai-helpers

    Schema for the autodl JSON data file produced by payload-analysis for database ingestion — you must use this skill whenever generating the autodl JSON file

    120 GitHub stars~2.6k tokensUpdated 4 days ago
    Auto-check passed

Questions about Jobs And Tests

What does Jobs And Tests do?

A skill your agent uses when querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication, variant joins, and infrastructure failure filtering. Jobs And Tests is an agent skill from openshift-eng/ai-helpers.

When should I use Jobs And Tests?

Jobs And Tests fits situations like: querying OpenShift CI prow job runs and junit test results in BigQuery (cianalysisus dataset) with deduplication; infrastructure failure filtering.

How do I install Jobs And Tests in Claude Code?

Run `npx skills add openshift-eng/ai-helpers --skill jobs-and-tests -a claude-code`. Or copy the skill folder (plugins/bigquery-ci-data/skills/jobs-and-tests in openshift-eng/ai-helpers) into .claude/skills/jobs-and-tests in your project. Claude Code loads it when a task matches its description.

How do I install Jobs And Tests in Codex?

Run `npx skills add openshift-eng/ai-helpers --skill jobs-and-tests -a codex`. Or copy the skill folder (plugins/bigquery-ci-data/skills/jobs-and-tests in openshift-eng/ai-helpers) into .agents/skills/jobs-and-tests in your project. Codex loads it when a task matches its description.

Can I use Jobs And Tests in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add openshift-eng/ai-helpers --skill jobs-and-tests -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/jobs-and-tests, .gemini/skills/jobs-and-tests, .github/skills/jobs-and-tests and .opencode/skills/jobs-and-tests in your project.

What does Jobs And Tests need to run?

SKILL.md names no scripts, command-line tools or credentials: Jobs And Tests is instructions for the agent only.

Does Jobs And Tests access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Jobs And Tests safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Jobs And Tests use?

Jobs And Tests is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Jobs And Tests use?

About 2.2k tokens (SKILL.md is roughly 8.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Jobs And Tests?

Skills that share tags, products or a category with Jobs And Tests: Datalineage Summary (google/skills, 21k stars), Ga4 Audit (cognyai/claude-code-marketing-skills, 104 stars), Io Connectors (Kilo-Org/kilo-marketplace, 190 stars) and Clickhouse Logs Queries (supabase/supabase, 111k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Jobs And Tests?

openshift-eng (a GitHub organization) maintains it in openshift-eng/ai-helpers, which has 120 GitHub stars. The repository holds 118 skills in this directory. The repository was last updated on October 6, 2026.

Source: openshift-eng/ai-helpers on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.