Define Hypothesis
product-on-purpose/pm-skills
Defines a testable hypothesis with clear success metrics and a validation approach.
Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.
Install Ab Test Analyzer
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzer --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/ab-test-analyzer .claude/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .claude/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzerType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzer --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/ab-test-analyzer .agents/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .agents/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzer --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/ab-test-analyzer .cursor/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .cursor/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/irinabuht12-oss/marketing-skills.git --path skills/ab-test-analyzer--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzer --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/ab-test-analyzer .gemini/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .gemini/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzerInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/ab-test-analyzer .github/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .github/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install irinabuht12-oss/marketing-skills ab-test-analyzer --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/irinabuht12-oss/marketing-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/ab-test-analyzer .opencode/skills/ab-test-analyzer && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "ab-test-analyzer" agent skill from https://github.com/irinabuht12-oss/marketing-skills/tree/main/skills/ab-test-analyzer into .opencode/skills/ab-test-analyzer/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "ab-test-analyzer", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
ab-test-analyzer- GitHub stars
- 4k
- Token cost
- ~1.4k tokens
- SKILL.md length
- 281 words
- Files
- 1
- Skills in repo
- 48
- Repo updated
- First seen
- Licence
- None found
At a glance
Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.
- Works in 6 steps: Collect test data - Variations, sample… → Check validity - Runtime, sample size,… → Calculate significance - Z-score,… → …
- Feeding test results
- SKILL.md covers Process, Sample Size Calculator, Significance Calculation and Validity Checklist, plus 5 more sections
- Calls claude; reaches connector.get-ryze.ai
What it does
Ab Test Analyzer is an agent skill from irinabuht12-oss/marketing-skills. Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation. Use when feeding test results, checking statistical significance, calculating sample sizes, analyzing experiment outcomes, or generating next test ideas based on results. Platform: Google and Meta.
Its SKILL.md is about 1.4k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in Marketing & SEO, covering A/B testing and Experimental design. It works with Model Context Protocol. The repository describes itself as: Claude skills for marketing: 49 free marketing skills for Claude Code and claude.ai (Google Ads, Meta Ads, SEO, AI visibility) + the Ryze Google Ads MCP / Meta Ads MCP: claude….
When your agent uses it
- Feeding test results
- Checking statistical significance
- Calculating sample sizes
- Analyzing experiment outcomes
Example prompts
- “/ab-test-analyzer”
Workflow steps
6 steps, taken from the first numbered list in SKILL.md.
- Collect test data - Variations, sample sizes, conversions, time period
- Check validity - Runtime, sample size, peeking issues
- Calculate significance - Z-score, p-value, confidence interval
- Segment analysis - Device, source, new vs returning
- Interpret results - Statistical vs practical significance
- Generate hypotheses - "Why it worked" and next test ideas
What it can do on your machine
Read from SKILL.md and the folder at commit 1bb135e. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
claude
From the folder's file list and the shell code blocks in SKILL.md.
Network
Hosts in commands or code, which the agent is likely to contact:
connector.get-ryze.ai
Also links to:
get-ryze.ai
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Ab Test Analyzer loads about 1.4k tokens when it runs. Until then it costs about 87 tokens; SKILL.md has 281 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
Without a licence we can't republish the file, so here is its outline and opening line. It has 281 words (~1,394 tokens).
“Evaluate A/B test results with statistical rigor and generate actionable next steps.”
- name
- ab-test-analyzer
- metadata
- platform: Google and Meta
Files
Just SKILL.md in skills/ab-test-analyzer of irinabuht12-oss/marketing-skills.
Open the folder on GitHubat commit 1bb135e
Compare with similar skills
Ab Test Analyzer next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Ab Test Analyzer this skillirinabuht12-oss/marketing-skills | 4k | — | ~1.4k | Automated safety check: Pass | None | |
| Define Hypothesisproduct-on-purpose/pm-skills | 715 | — | ~966 | Automated safety check: Pass | Apache-2.0 | |
| A B Test DesignOwl-Listener/designer-skills | 2.9k | 1 repos | ~472 | Automated safety check: Pass | MIT | |
| Send Experiment Designeraaron-he-zhu/aaron-marketing-skills | 2.9k | 2 repos | ~4.1k | Automated safety check: Pass | Apache-2.0 | |
| Content Experimentation Best Practicessanity-io/agent-toolkit | 188 | 1 repos | ~469 | Automated safety check: Pass | MIT | |
| Ads TestAgriciDaniel/claude-ads | 9.8k | — | ~312 | Automated safety check: Pass | MIT |
Similar skills
A B Test Design
Owl-Listener/designer-skills
Design an A/B experiment — hypothesis, variants, primary metric, and sample size.
Send Experiment Designer
aaron-he-zhu/aaron-marketing-skills
A skill your agent uses when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email result…
- Official
Content Experimentation Best Practices
sanity-io/agent-toolkit
Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls.
Ads Test
AgriciDaniel/claude-ads
Design and evaluate paid-ad experiments with hypotheses, randomization units, sample-size and duration assumptions, guardrails, platform experiment tools, analysis, and decision rules.
Ab Test Setup
sickn33/agentic-awesome-skills
A skill your agent uses when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.
More from irinabuht12-oss/marketing-skills
All 48 skills in this repoAd Spend Allocator
irinabuht12-oss/marketing-skills
Multi-channel budget optimization using MER, marginal ROAS, and diminishing returns analysis.
Competitor Teardown
irinabuht12-oss/marketing-skills
Systematic competitive analysis covering positioning, messaging hierarchy, objection handling, and CTA strategy from landing page URLs or screenshots.
Content Repurposer
irinabuht12-oss/marketing-skills
Transform one long-form piece into multiple platform-specific content derivatives including LinkedIn posts, tweet threads, email snippets, ad hooks, and video scripts while maintaining voice…
E2E SEO Assistant
irinabuht12-oss/marketing-skills
Full SEO workflow covering technical audits, content gaps, backlink opportunities, on-page fixes, and content briefs.
Email Sequence Writer
irinabuht12-oss/marketing-skills
Write complete nurture email sequences with subject lines, preview text, and body copy using proven copywriting formulas.
Google Ads Audit
irinabuht12-oss/marketing-skills
Comprehensive Google Ads account health analysis detecting wasted spend, search term leaks, negative keyword gaps, bid strategy issues, and Quality Score problems.
Related
Works with
Categories
Questions about Ab Test Analyzer
What does Ab Test Analyzer do?
Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation. Ab Test Analyzer is an agent skill from irinabuht12-oss/marketing-skills. Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.
When should I use Ab Test Analyzer?
Ab Test Analyzer fits situations like: feeding test results; checking statistical significance; calculating sample sizes; analyzing experiment outcomes.
How do I install Ab Test Analyzer in Claude Code?
Run `npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a claude-code`. Or copy the skill folder (skills/ab-test-analyzer in irinabuht12-oss/marketing-skills) into .claude/skills/ab-test-analyzer in your project. Claude Code loads it when a task matches its description.
How do I install Ab Test Analyzer in Codex?
Run `npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a codex`. Or copy the skill folder (skills/ab-test-analyzer in irinabuht12-oss/marketing-skills) into .agents/skills/ab-test-analyzer in your project. Codex loads it when a task matches its description.
Can I use Ab Test Analyzer in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add irinabuht12-oss/marketing-skills --skill ab-test-analyzer -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/ab-test-analyzer, .gemini/skills/ab-test-analyzer, .github/skills/ab-test-analyzer and .opencode/skills/ab-test-analyzer in your project.
What does Ab Test Analyzer need to run?
Going by SKILL.md and its folder, Ab Test Analyzer needs the command-line tools its instructions call (claude).
Does Ab Test Analyzer access the network?
SKILL.md names 2 domains. In commands or code: connector.get-ryze.ai; the agent is likely to contact it when it follows the instructions. As links in the text: get-ryze.ai. This is read from the text; nothing was executed.
Is Ab Test Analyzer safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Ab Test Analyzer use?
No licence was found for Ab Test Analyzer or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.
How many tokens does Ab Test Analyzer use?
About 1.4k tokens (SKILL.md is roughly 5.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Ab Test Analyzer?
Skills that share tags, products or a category with Ab Test Analyzer: Define Hypothesis (product-on-purpose/pm-skills, 715 stars), A B Test Design (Owl-Listener/designer-skills, 2.9k stars), Send Experiment Designer (aaron-he-zhu/aaron-marketing-skills, 2.9k stars) and Content Experimentation Best Practices (sanity-io/agent-toolkit, 188 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Ab Test Analyzer?
irinabuht12-oss (a GitHub user) maintains it in irinabuht12-oss/marketing-skills, which has 3,982 GitHub stars. The repository holds 48 skills in this directory. The repository was last updated on September 24, 2026.
Source: irinabuht12-oss/marketing-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.