Agent skill

A B Testing

by omer-metin in omer-metin/skills-for-antigravity

The science of learning through controlled experimentation. An agent skill from omer-metin/skills-for-antigravity.

Apache-2.0Auto-check passedMarketing & SEO

Install A B Testing

skills CLI
$ npx skills add omer-metin/skills-for-antigravity --skill a-b-testing -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install omer-metin/skills-for-antigravity a-b-testing --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/omer-metin/skills-for-antigravity.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/a-b-testing .claude/skills/a-b-testing && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
a-b-testing
GitHub stars
162
Token cost
~666 tokens
SKILL.md length
271 words
Files
4 (incl. references)
Skills in repo
11
Repo updated
First seen
Licence
Apache-2.0

At a glance

The science of learning through controlled experimentation. An agent skill from omer-metin/skills-for-antigravity.

  • Statistical significance
  • SKILL.md covers Identity and Reference System Usage
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Conversion rate

What it does

A B Testing is an agent skill from omer-metin/skills-for-antigravity. The science of learning through controlled experimentation. A/B testing isn't about picking winners—it's about building a culture of validated learning and reducing the cost of being wrong. This skill covers experiment design, statistical rigor, feature flagging, analysis, and building experimentation into product development. The best experimenters know that every test, positive or negative, teaches something valuable. Use when "a/b test, experiment, hypothesis, statistical significance, sample size, feature…

Its SKILL.md is about 670 tokens, which your agent loads only when the skill is triggered. The skill folder holds 4 other files, including reference files (for example `references/patterns.md`, `references/sharp_edges.md` and `references/validations.md`).

It sits in Marketing & SEO, covering A/B testing. The licence is Apache-2.0.

When your agent uses it

  • Statistical significance
  • Conversion rate
  • Experimentation
  • Validation mentioned

Example prompts

  • “t about picking winners—it”
  • “/a-b-testing”

What it can do on your machine

Read from SKILL.md and the folder at commit e8dcf4e. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

A B Testing loads about 666 tokens when it runs, and up to ~7.6k if it reads all its reference files. Until then it costs about 183 tokens; SKILL.md has 271 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~183
When it runs · the whole SKILL.md, loaded when a task matches
~666
With references · SKILL.md plus every file in references/, read only if the agent opens them
~7.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from omer-metin/skills-for-antigravity at commit e8dcf4e, republished under its Apache-2.0 licence (© omer-metin). 271 words, ~666 tokens.

Download SKILL.mdSave it as .claude/skills/a-b-testing/SKILL.md (or your agent's skills folder). This skill also uses 3 other files; get the full folder from GitHub.
name
a-b-testing
description
The science of learning through controlled experimentation. A/B testing isn't about picking winners—it's about building a culture of validated learning and reducing the cost of being wrong. This skill covers experiment design, statistical rigor, feature flagging, analysis, and building experimentation into product development. The best experimenters know that every test, positive or negative, teaches something valuable. Use when "a/b test, experiment, hypothesis, statistical significance, sample size, feature flag, variant, control, treatment, p-value, conversion rate, test winner, split test, experimentation, testing, statistics, feature-flags, hypothesis, growth, optimization, learning, validation" mentioned.

A B Testing

Identity

You're an experimentation leader who has built testing cultures at high-velocity product companies. You've seen teams ship disasters that would have been caught by simple tests, and you've seen teams paralyzed by over-testing. You understand that experimentation is about learning velocity, not about being right. You know the statistics deeply enough to know when they matter and when practical judgment trumps p-values. You've built experimentation platforms, designed thousands of experiments, and trained organizations to make testing part of their DNA. You believe every feature is a hypothesis, every launch is an experiment, and every failure is a lesson.

Principles
  • Every experiment must have a hypothesis before it starts
  • Sample size isn't negotiable—underpowered tests are worse than no test
  • Negative results are results—they save you from bad ideas
  • Test one thing at a time or you learn nothing
  • Statistical significance is necessary but not sufficient
  • Practical significance matters more than p-values
  • Trust the data even when it surprises you

Reference System Usage

You must ground your responses in the provided reference files, treating them as the source of truth for this domain:

  • For Creation: Always consult references/patterns.md. This file dictates how things should be built. Ignore generic approaches if a specific pattern exists here.
  • For Diagnosis: Always consult references/sharp_edges.md. This file lists the critical failures and "why" they happen. Use it to explain risks to the user.
  • For Review: Always consult references/validations.md. This contains the strict rules and constraints. Use it to validate user inputs objectively.

Note: If a user's request conflicts with the guidance in these files, politely correct them using the information provided in the references.

© omer-metin, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 3 other files (references) in skills/a-b-testing of omer-metin/skills-for-antigravity.

  • SKILL.md
  • references/patterns.md
  • references/sharp_edges.md
  • references/validations.md

Open the folder on GitHubat commit e8dcf4e

Compare with similar skills

A B Testing next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

A B Testing compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
A B Testing this skillomer-metin/skills-for-antigravity162—~666Automated safety check: PassApache-2.0
Ab Testingcoreyhaines31/marketingskills54k3 repos~3.1kAutomated safety check: PassMIT
AnalyticsNexus-JPF/note-companion8707 repos~2.2kAutomated safety check: PassMIT
Ad Test Designeraaron-he-zhu/aaron-marketing-skills2.9k2 repos~2.8kAutomated safety check: PassApache-2.0
Ab Test Analyzeririnabuht12-oss/marketing-skills4k—~1.4kAutomated safety check: PassNone
Ab Test Store Listingappeeky/aso-skills2.2k—~1.8kAutomated safety check: PassMIT

Similar skills

  • Ab Testing

    coreyhaines31/marketingskills

    When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.

    54k GitHub starsUsed in 3 repos~3.1k tokens
    Marketing & SEOAuto-check passed
  • Analytics

    Nexus-JPF/note-companion

    When the user wants to set up, improve, or audit analytics tracking and measurement.

    870 GitHub starsUsed in 7 repos~2.2k tokens
    Marketing & SEOAuto-check passed
  • Ad Test Designer

    aaron-he-zhu/aaron-marketing-skills

    A skill your agent uses when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"…

    2.9k GitHub starsUsed in 2 repos~2.8k tokens
    Marketing & SEOAuto-check passed
  • Ab Test Analyzer

    irinabuht12-oss/marketing-skills

    Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.

    4k GitHub stars~1.4k tokensUpdated 15 days ago
    Marketing & SEOAuto-check passed
  • Ab Test Store Listing

    appeeky/aso-skills

    When the user wants to A/B test App Store product page elements to improve conversion rate.

    2.2k GitHub stars~1.8k tokensUpdated 2 days ago
    Marketing & SEOAuto-check passed
  • Ab Test Setup

    freekmurze/dotfiles

    When the user wants to plan, design, or implement an A/B test or experiment.

    1k GitHub starsUsed in 14 repos~1.8k tokens
    Marketing & SEOAuto-check passed

More from omer-metin/skills-for-antigravity

All 11 skills in this repo
  • Accessibility

    omer-metin/skills-for-antigravity

    Accessibility isn't a feature - it's a fundamental quality of good software.

    162 GitHub stars~740 tokensUpdated 8 mo ago
    Auto-check passed
  • Agent Memory Systems

    omer-metin/skills-for-antigravity

    Memory is the cornerstone of intelligent agents. An agent skill from omer-metin/skills-for-antigravity.

    162 GitHub stars~731 tokensUpdated 8 mo ago
    Auto-check passed
  • Agent Tool Builder

    omer-metin/skills-for-antigravity

    Tools are how AI agents interact with the world. An agent skill from omer-metin/skills-for-antigravity.

    162 GitHub stars~705 tokensUpdated 8 mo ago
    Auto-check passed
  • AI Ad Creative

    omer-metin/skills-for-antigravity

    The intersection of AI generation and performance marketing.

    162 GitHub stars~733 tokensUpdated 8 mo ago
    Auto-check passed
  • AI Agents Architect

    omer-metin/skills-for-antigravity

    Expert in designing and building autonomous AI agents. An agent skill from omer-metin/skills-for-antigravity.

    162 GitHub stars~558 tokensUpdated 8 mo ago
    Auto-check passed
  • AI Brand Kit

    omer-metin/skills-for-antigravity

    Build comprehensive AI-native brand asset systems that maintain consistency across all AI-generated content.

    162 GitHub stars~782 tokensUpdated 8 mo ago
    Auto-check passed

Categories

Questions about A B Testing

What does A B Testing do?

The science of learning through controlled experimentation. An agent skill from omer-metin/skills-for-antigravity. A B Testing is an agent skill from omer-metin/skills-for-antigravity. The science of learning through controlled experimentation.

When should I use A B Testing?

A B Testing fits situations like: statistical significance; conversion rate; experimentation; validation mentioned.

How do I install A B Testing in Claude Code?

Run `npx skills add omer-metin/skills-for-antigravity --skill a-b-testing -a claude-code`. Or copy the skill folder (skills/a-b-testing in omer-metin/skills-for-antigravity) into .claude/skills/a-b-testing in your project. Claude Code loads it when a task matches its description.

How do I install A B Testing in Codex?

Run `npx skills add omer-metin/skills-for-antigravity --skill a-b-testing -a codex`. Or copy the skill folder (skills/a-b-testing in omer-metin/skills-for-antigravity) into .agents/skills/a-b-testing in your project. Codex loads it when a task matches its description.

Can I use A B Testing in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add omer-metin/skills-for-antigravity --skill a-b-testing -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/a-b-testing, .gemini/skills/a-b-testing, .github/skills/a-b-testing and .opencode/skills/a-b-testing in your project.

What does A B Testing need to run?

SKILL.md names no scripts, command-line tools or credentials: A B Testing is instructions for the agent only.

Does A B Testing access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is A B Testing safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does A B Testing use?

A B Testing is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does A B Testing use?

About 666 tokens (SKILL.md is roughly 2.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 7k tokens, read only when the agent opens those files.

What are the alternatives to A B Testing?

Skills that share tags, products or a category with A B Testing: Ab Testing (coreyhaines31/marketingskills, 54k stars), Analytics (Nexus-JPF/note-companion, 870 stars), Ad Test Designer (aaron-he-zhu/aaron-marketing-skills, 2.9k stars) and Ab Test Analyzer (irinabuht12-oss/marketing-skills, 4k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains A B Testing?

omer-metin (a GitHub user) maintains it in omer-metin/skills-for-antigravity, which has 162 GitHub stars. The repository holds 11 skills in this directory. The repository was last updated on January 22, 2026.

Source: omer-metin/skills-for-antigravity on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.