Agent skill

Ab Testing

by gtmagents in gtmagents/gtm-agents

A skill your agent uses when designing experiments for subject lines, offers, cadences, or journeys.

Apache-2.0Auto-check passedMarketing & SEO

Install Ab Testing

skills CLI
$ npx skills add gtmagents/gtm-agents --skill ab-testing -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install gtmagents/gtm-agents ab-testing --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/gtmagents/gtm-agents.git skills-src && mkdir -p .claude/skills && cp -r skills-src/plugins/email-marketing/skills/ab-testing .claude/skills/ab-testing && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
ab-testing
GitHub stars
413
Used in
1 other repo
Token cost
~343 tokens
SKILL.md length
153 words
Files
1
Skills in repo
121
Repo updated
First seen
Licence
Apache-2.0

At a glance

A skill your agent uses when designing experiments for subject lines, offers, cadences, or journeys.

  • Works in 5 steps: Hypothesis – define expected uplift +… → Metric Selection – primary… → Sample Sizing – ensure stat significance… → …
  • Designing experiments for subject lines
  • SKILL.md covers When to Use, Framework, Templates and Experiment Ideas, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Ab Testing is an agent skill from gtmagents/gtm-agents. Use when designing experiments for subject lines, offers, cadences, or journeys.

Its SKILL.md is about 340 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Marketing & SEO, covering A/B testing. The repository describes itself as: Production-ready collection of GTM agents and specialized skills for claude code. Covers sales, marketing, customer success, and revenue operations workflows. The licence is Apache-2.0.

When your agent uses it

  • Designing experiments for subject lines
  • Tasks that involve A/B testing

Example prompts

  • “/ab-testing”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Hypothesis – define expected uplift + rationale.
  2. Metric Selection – primary (open/click/conv) + guardrails (unsubs, spam).
  3. Sample Sizing – ensure stat significance (min 500 recipients per variant or use power calculator).
  4. Execution – randomize, keep variants isolated, limit simultaneous tests.
  5. Analysis – use z-test or Bayesian uplift; document learnings.

What it can do on your machine

Read from SKILL.md and the folder at commit 78e0419. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Ab Testing loads about 343 tokens when it runs. Until then it costs about 23 tokens; SKILL.md has 153 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~23
When it runs · the whole SKILL.md, loaded when a task matches
~343

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from gtmagents/gtm-agents at commit 78e0419, republished under its Apache-2.0 licence (© gtmagents). 153 words, ~343 tokens.

Download SKILL.mdSave it as .claude/skills/ab-testing/SKILL.md (or your agent's skills folder).
name
ab-testing
description
Use when designing experiments for subject lines, offers, cadences, or journeys.

Experimentation & A/B Testing Skill

When to Use

  • Validating new subject lines or creative.
  • Testing segmentation hypotheses (persona vs behavior).
  • Optimizing cadence, timing, or automation triggers.

Framework

  1. Hypothesis – define expected uplift + rationale.
  2. Metric Selection – primary (open/click/conv) + guardrails (unsubs, spam).
  3. Sample Sizing – ensure stat significance (min 500 recipients per variant or use power calculator).
  4. Execution – randomize, keep variants isolated, limit simultaneous tests.
  5. Analysis – use z-test or Bayesian uplift; document learnings.

Templates

  • Experiment brief (hypothesis, segments, KPI, risk guardrails).
  • Variant table (control vs test inputs, creative asset links, owner).
  • Calculator sheet for minimum detectable effect + sample size.
  • Post-test debrief doc capturing learnings + rollout plan.

Experiment Ideas

  • Subject line vs preview text combos.
  • CTA placement (hero vs footer).
  • Personalization depth (basic vs dynamic modules).
  • Wait times between touches.

Tips

  • Run no more than two tests per journey simultaneously.
  • Recycle learnings into playbooks + automation templates.
  • Segment results by persona to catch hidden signals.

© gtmagents, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in plugins/email-marketing/skills/ab-testing of gtmagents/gtm-agents.

Open the folder on GitHubat commit 78e0419

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in gtmagents/gtm-agents, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Ab Testing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Ab Testing compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Ab Testing this skillgtmagents/gtm-agents4131 repos~343Automated safety check: PassApache-2.0
Ab Testingcoreyhaines31/marketingskills54k3 repos~3.1kAutomated safety check: PassMIT
AnalyticsNexus-JPF/note-companion8707 repos~2.2kAutomated safety check: PassMIT
Ad Test Designeraaron-he-zhu/aaron-marketing-skills2.9k2 repos~2.8kAutomated safety check: PassApache-2.0
Ab Test Analyzeririnabuht12-oss/marketing-skills4k—~1.4kAutomated safety check: PassNone
Ab Test Store Listingappeeky/aso-skills2.2k—~1.8kAutomated safety check: PassMIT

Similar skills

  • Ab Testing

    coreyhaines31/marketingskills

    When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.

    54k GitHub starsUsed in 3 repos~3.1k tokens
    Marketing & SEOAuto-check passed
  • Analytics

    Nexus-JPF/note-companion

    When the user wants to set up, improve, or audit analytics tracking and measurement.

    870 GitHub starsUsed in 7 repos~2.2k tokens
    Marketing & SEOAuto-check passed
  • Ad Test Designer

    aaron-he-zhu/aaron-marketing-skills

    A skill your agent uses when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"…

    2.9k GitHub starsUsed in 2 repos~2.8k tokens
    Marketing & SEOAuto-check passed
  • Ab Test Analyzer

    irinabuht12-oss/marketing-skills

    Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.

    4k GitHub stars~1.4k tokensUpdated 15 days ago
    Marketing & SEOAuto-check passed
  • Ab Test Store Listing

    appeeky/aso-skills

    When the user wants to A/B test App Store product page elements to improve conversion rate.

    2.2k GitHub stars~1.8k tokensUpdated 2 days ago
    Marketing & SEOAuto-check passed
  • Ab Test Setup

    freekmurze/dotfiles

    When the user wants to plan, design, or implement an A/B test or experiment.

    1k GitHub starsUsed in 14 repos~1.8k tokens
    Marketing & SEOAuto-check passed

More from gtmagents/gtm-agents

All 121 skills in this repo
  • Enrichment Data Sourcing

    gtmagents/gtm-agents

    Chooses and orders data providers for email, phone, company and intent enrichment, with waterfall sequences and credit-saving tactics across 150+ sources.

    413 GitHub starsUsed in 2 repos~2.4k tokens
    Auto-check passed
  • Cold Email Personalization

    gtmagents/gtm-agents

    Writes personalized B2B cold emails from prospect research, using a gated workflow, a quality rubric and follow-up sequences.

    413 GitHub starsUsed in 1 repo~853 tokens
    Auto-check passed
  • Discovery Call Playbook

    gtmagents/gtm-agents

    Structures sales discovery calls with a PREP routine, a five-part call flow, a question bank, a qualification scorecard and a follow-up recap email.

    413 GitHub starsUsed in 1 repo~368 tokens
    Auto-check passed
  • Frames marketing automation around lifecycle stages, signals, touches and SLAs, with worksheets for onboarding, expansion, renewal and churn-prevention journeys.

    413 GitHub starsUsed in 1 repo~927 tokens
    Auto-check passed
  • Social Selling

    gtmagents/gtm-agents

    A skill your agent uses when engaging prospects through LinkedIn, communities, and social channels to spark warm conversations and meetings.

    413 GitHub starsUsed in 1 repo~431 tokens
    Auto-check passed
  • Drip Campaigns

    gtmagents/gtm-agents

    A skill your agent uses when you need to map sequenced nurture flows with pacing, storytelling arcs, and value ladders.

    413 GitHub starsUsed in 1 repo~310 tokens
    Auto-check passed

Categories

Questions about Ab Testing

What does Ab Testing do?

A skill your agent uses when designing experiments for subject lines, offers, cadences, or journeys. Ab Testing is an agent skill from gtmagents/gtm-agents. Use when designing experiments for subject lines, offers, cadences, or journeys.

When should I use Ab Testing?

Ab Testing fits situations like: designing experiments for subject lines; tasks that involve A/B testing.

How do I install Ab Testing in Claude Code?

Run `npx skills add gtmagents/gtm-agents --skill ab-testing -a claude-code`. Or copy the skill folder (plugins/email-marketing/skills/ab-testing in gtmagents/gtm-agents) into .claude/skills/ab-testing in your project. Claude Code loads it when a task matches its description.

How do I install Ab Testing in Codex?

Run `npx skills add gtmagents/gtm-agents --skill ab-testing -a codex`. Or copy the skill folder (plugins/email-marketing/skills/ab-testing in gtmagents/gtm-agents) into .agents/skills/ab-testing in your project. Codex loads it when a task matches its description.

Can I use Ab Testing in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add gtmagents/gtm-agents --skill ab-testing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ab-testing, .gemini/skills/ab-testing, .github/skills/ab-testing and .opencode/skills/ab-testing in your project.

What does Ab Testing need to run?

SKILL.md names no scripts, command-line tools or credentials: Ab Testing is instructions for the agent only.

Does Ab Testing access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Ab Testing safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Ab Testing use?

Ab Testing is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Ab Testing use?

About 343 tokens (SKILL.md is roughly 1.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Ab Testing?

Skills that share tags, products or a category with Ab Testing: Ab Testing (coreyhaines31/marketingskills, 54k stars), Analytics (Nexus-JPF/note-companion, 870 stars), Ad Test Designer (aaron-he-zhu/aaron-marketing-skills, 2.9k stars) and Ab Test Analyzer (irinabuht12-oss/marketing-skills, 4k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Ab Testing?

gtmagents (a GitHub user) maintains it in gtmagents/gtm-agents, which has 413 GitHub stars. The repository holds 121 skills in this directory. The repository was last updated on April 3, 2026.

Source: gtmagents/gtm-agents on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.