New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Ab Test Setup

by freekmurze in freekmurze/dotfiles

When the user wants to plan, design, or implement an A/B test or experiment.

No licenceAuto-check passedMarketing & SEO

Install Ab Test Setup

skills CLI
$ npx skills add freekmurze/dotfiles --skill ab-test-setup -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install freekmurze/dotfiles ab-test-setup --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/freekmurze/dotfiles.git skills-src && mkdir -p .claude/skills && cp -r skills-src/config/claude/skills/marketing/skills/ab-test-setup .claude/skills/ab-test-setup && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
ab-test-setup
GitHub stars
1k
Used in
15 other repos
Token cost
~1.8k tokens
SKILL.md length
770 words
Files
3 (incl. references)
Skills in repo
51
Repo updated
First seen
Licence
None found

At a glance

When the user wants to plan, design, or implement an A/B test or experiment.

  • Works in 4 steps: Start with a Hypothesis → Test One Thing → Statistical Rigor → …
  • Implement an A/B test
  • SKILL.md covers Initial Assessment, Core Principles, Hypothesis Framework and Test Types, plus 7 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Ab Test Setup is an agent skill from freekmurze/dotfiles. When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," or "hypothesis." For tracking implementation, see analytics-tracking.

Its SKILL.md is about 1.8k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files, including reference files (for example `references/sample-size-guide.md` and `references/test-templates.md`).

It sits in Marketing & SEO, covering A/B testing.

When your agent uses it

  • Implement an A/B test
  • The user mentions A/B test
  • Test this change
  • Multivariate test

Example prompts

  • “A/B test,”
  • “split test,”
  • “experiment,”
  • “/ab-test-setup”

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Start with a Hypothesis
  2. Test One Thing
  3. Statistical Rigor
  4. Measure What Matters

What it can do on your machine

Read from SKILL.md and the folder at commit 296be1a. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • evanmiller.org
    • optimizely.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Ab Test Setup loads about 1.8k tokens when it runs, and up to ~5.1k if it reads all its reference files. Until then it costs about 72 tokens; SKILL.md has 770 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~72
When it runs · the whole SKILL.md, loaded when a task matches
~1.8k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~5.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 770 words (~1,768 tokens).

“You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.”

— opening of SKILL.md by freekmurze
name
ab-test-setup
version
1.0.0

Read the full SKILL.md on GitHub

Files

SKILL.md and 2 other files (references) in config/claude/skills/marketing/skills/ab-test-setup of freekmurze/dotfiles.

  • SKILL.md
  • references/sample-size-guide.md
  • references/test-templates.md

Open the folder on GitHubat commit 296be1a

Used in 16 other repositories

We found 37 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 15 other GitHub owners. This page covers the copy in freekmurze/dotfiles, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Ab Test Setup next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Ab Test Setup compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Ab Test Setup this skillfreekmurze/dotfiles1k15 repos~1.8kAutomated safety check: PassNone
Ab Testingcoreyhaines31/marketingskills54k3 repos~2.8kAutomated safety check: PassMIT
AnalyticsNexus-JPF/note-companion8707 repos~2.2kAutomated safety check: PassMIT
Ad Test Designeraaron-he-zhu/aaron-marketing-skills2.9k2 repos~2.8kAutomated safety check: PassApache-2.0
Meta Tags Optimizernowork-studio/notfair-plugin3.9k1 repos~2.7kAutomated safety check: PassMIT
Ab Test Analyzeririnabuht12-oss/marketing-skills3.9k—~1.4kAutomated safety check: PassNone

Similar skills

  • Ab Testing

    coreyhaines31/marketingskills

    When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program.

    54k GitHub starsUsed in 3 repos~2.8k tokens
    Marketing & SEOAuto-check passed

  • Analytics

    Nexus-JPF/note-companion

    When the user wants to set up, improve, or audit analytics tracking and measurement.

    870 GitHub starsUsed in 7 repos~2.2k tokens
    Marketing & SEOAuto-check passed

  • Ad Test Designer

    aaron-he-zhu/aaron-marketing-skills

    A skill your agent uses when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this result statistically and practically material?"…

    2.9k GitHub starsUsed in 2 repos~2.8k tokens
    Marketing & SEOAuto-check passed

  • Meta Tags Optimizer

    nowork-studio/notfair-plugin

    Writes and improves title tags, meta descriptions, Open Graph and Twitter card tags for click-through, with character counts and A/B test variants.

    3.9k GitHub starsUsed in 1 repo~2.7k tokens
    Marketing & SEOAuto-check passed

  • Ab Test Analyzer

    irinabuht12-oss/marketing-skills

    Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.

    3.9k GitHub stars~1.4k tokensUpdated 14 days ago
    Marketing & SEOAuto-check passed

  • Ab Test Store Listing

    appeeky/aso-skills

    When the user wants to A/B test App Store product page elements to improve conversion rate.

    2.2k GitHub stars~1.8k tokensUpdated yesterday
    Marketing & SEOAuto-check passed

More from freekmurze/dotfiles

All 51 skills in this repo

  • Social Content

    freekmurze/dotfiles

    When the user wants help creating, scheduling, or optimizing social media content for LinkedIn, Twitter/X, Instagram, TikTok, Facebook, or other platforms.

    1k GitHub starsUsed in 23 repos~2.1k tokens
    Auto-check passed

  • Email Sequence

    freekmurze/dotfiles

    When the user wants to create or optimize an email sequence, drip campaign, automated email flow, or lifecycle email program.

    1k GitHub starsUsed in 19 repos~2k tokens
    Auto-check passed

  • Referral Program

    freekmurze/dotfiles

    When the user wants to create, optimize, or analyze a referral program, affiliate program, or word-of-mouth strategy.

    1k GitHub starsUsed in 17 repos~1.8k tokens
    Auto-check passed

  • Typefully

    freekmurze/dotfiles

    Create, schedule, and manage social media posts via Typefully.

    1k GitHub starsUsed in 2 repos~3.4k tokens
    Auto-check: notes

  • Onboarding Cro

    freekmurze/dotfiles

    When the user wants to optimize post-signup onboarding, user activation, first-run experience, or time-to-value.

    1k GitHub starsUsed in 16 repos~1.6k tokens
    Auto-check passed

  • Paywall Upgrade Cro

    freekmurze/dotfiles

    When the user wants to create or optimize in-app paywalls, upgrade screens, upsell modals, or feature gates.

    1k GitHub starsUsed in 15 repos~1.4k tokens
    Auto-check passed

Categories

Questions about Ab Test Setup

What does Ab Test Setup do?

When the user wants to plan, design, or implement an A/B test or experiment. Ab Test Setup is an agent skill from freekmurze/dotfiles. When the user wants to plan, design, or implement an A/B test or experiment.

When should I use Ab Test Setup?

Ab Test Setup fits situations like: implement an A/B test; the user mentions A/B test; test this change; multivariate test.

How do I install Ab Test Setup in Claude Code?

Run `npx skills add freekmurze/dotfiles --skill ab-test-setup -a claude-code`. Or copy the skill folder (config/claude/skills/marketing/skills/ab-test-setup in freekmurze/dotfiles) into .claude/skills/ab-test-setup in your project. Claude Code loads it when a task matches its description.

How do I install Ab Test Setup in Codex?

Run `npx skills add freekmurze/dotfiles --skill ab-test-setup -a codex`. Or copy the skill folder (config/claude/skills/marketing/skills/ab-test-setup in freekmurze/dotfiles) into .agents/skills/ab-test-setup in your project. Codex loads it when a task matches its description.

Can I use Ab Test Setup in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add freekmurze/dotfiles --skill ab-test-setup -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ab-test-setup, .gemini/skills/ab-test-setup, .github/skills/ab-test-setup and .opencode/skills/ab-test-setup in your project.

What does Ab Test Setup need to run?

SKILL.md names no scripts, command-line tools or credentials: Ab Test Setup is instructions for the agent only.

Does Ab Test Setup access the network?

SKILL.md names 2 domains. As links in the text: evanmiller.org and optimizely.com. This is read from the text; nothing was executed.

Is Ab Test Setup safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Ab Test Setup use?

No licence was found for Ab Test Setup or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Ab Test Setup use?

About 1.8k tokens (SKILL.md is roughly 7.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 3.3k tokens, read only when the agent opens those files.

What are the alternatives to Ab Test Setup?

Skills that share tags, products or a category with Ab Test Setup: Ab Testing (coreyhaines31/marketingskills, 54k stars), Analytics (Nexus-JPF/note-companion, 870 stars), Ad Test Designer (aaron-he-zhu/aaron-marketing-skills, 2.9k stars) and Meta Tags Optimizer (nowork-studio/notfair-plugin, 3.9k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Ab Test Setup?

freekmurze (a GitHub user) maintains it in freekmurze/dotfiles, which has 1,012 GitHub stars. The repository holds 51 skills in this directory. The repository was last updated on October 5, 2026.

Source: freekmurze/dotfiles on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.