Ab Test Analyzer
irinabuht12-oss/marketing-skills
Statistical significance calculator for A/B test results with sample size requirements, segment breakdowns, and hypothesis generation.
Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls.
Install Content Experimentation Best Practices
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practices --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/content-experimentation-best-practices .claude/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .claude/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practicesType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practices --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/content-experimentation-best-practices .agents/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .agents/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practices --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/content-experimentation-best-practices .cursor/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .cursor/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/sanity-io/agent-toolkit.git --path skills/content-experimentation-best-practices--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practices --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/content-experimentation-best-practices .gemini/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .gemini/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practicesInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/content-experimentation-best-practices .github/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .github/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install sanity-io/agent-toolkit content-experimentation-best-practices --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/sanity-io/agent-toolkit.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/content-experimentation-best-practices .opencode/skills/content-experimentation-best-practices && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "content-experimentation-best-practices" agent skill from https://github.com/sanity-io/agent-toolkit/tree/main/skills/content-experimentation-best-practices into .opencode/skills/content-experimentation-best-practices/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "content-experimentation-best-practices", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
content-experimentation-best-practices- GitHub stars
- 188
- Used in
- 1 other repo
- Token cost
- ~469 tokens
- SKILL.md length
- 162 words
- Files
- 5 (incl. references)
- Skills in repo
- 8
- Repo updated
- First seen
- Licence
- MIT
At a glance
Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls.
- Planning experiments
- SKILL.md covers When to Apply, Core Concepts and References
- Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
- Setting up variants
What it does
Content Experimentation Best Practices is an agent skill from sanity-io/agent-toolkit, published by the product's own GitHub organization. Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls. Use this skill when planning experiments, setting up variants, choosing success metrics, interpreting statistical results, or building experimentation workflows in a CMS or frontend stack.
Its SKILL.md is about 470 tokens, which your agent loads only when the skill is triggered. The skill folder holds 5 other files, including reference files (for example `references/cms-integration.md`, `references/common-pitfalls.md` and `references/experiment-design.md`).
It sits in Marketing & SEO, covering A/B testing and Experimental design. The repository describes itself as: Collection of resources to help AI agents build better with Sanity. The licence is MIT.
When your agent uses it
- Planning experiments
- Setting up variants
- Choosing success metrics
- Interpreting statistical results
Example prompts
- “/content-experimentation-best-practices”
What it can do on your machine
Read from SKILL.md and the folder at commit 3fe6c8a. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
No scripts in the folder and no shell commands in SKILL.md.
From the folder's file list and the shell code blocks in SKILL.md.
Network
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Content Experimentation Best Practices loads about 469 tokens when it runs, and up to ~6k if it reads all its reference files. Until then it costs about 104 tokens; SKILL.md has 162 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
The full file from sanity-io/agent-toolkit at commit 3fe6c8a, republished under its MIT licence (© sanity-io). 162 words, ~469 tokens.
Download SKILL.mdSave it as
.claude/skills/content-experimentation-best-practices/SKILL.md (or your agent's skills folder). This skill also uses 4 other files; get the full folder from GitHub.- name
- content-experimentation-best-practices
- description
- Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls. Use this skill when planning experiments, setting up variants, choosing success metrics, interpreting statistical results, or building experimentation workflows in a CMS or frontend stack.
Content Experimentation Best Practices
Principles and patterns for running effective content experiments to improve conversion rates, engagement, and user experience.
When to Apply
Reference these guidelines when:
- Setting up A/B or multivariate testing infrastructure
- Designing experiments for content changes
- Analyzing and interpreting test results
- Building CMS integrations for experimentation
- Deciding what to test and how
Core Concepts
A/B Testing
Comparing two variants (A vs B) to determine which performs better.
Multivariate Testing
Testing multiple variables simultaneously to find optimal combinations.
Statistical Significance
The confidence level that results aren't due to random chance.
Experimentation Culture
Making decisions based on data rather than opinions (HiPPO avoidance).
References
Start with the reference that matches the current problem, such as design, statistics, CMS integration, or pitfalls. See references/ for detailed guidance:
references/experiment-design.md— Hypothesis framework, metrics, sample size, and what to testreferences/statistical-foundations.md— p-values, confidence intervals, power analysis, Bayesian methodsreferences/cms-integration.md— CMS-managed variants, field-level variants, external platformsreferences/common-pitfalls.md— 17 common mistakes across statistics, design, execution, and interpretation
© sanity-io, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Files
SKILL.md and 4 other files (references) in skills/content-experimentation-best-practices of sanity-io/agent-toolkit.
- SKILL.md
- references/cms-integration.md
- references/common-pitfalls.md
- references/experiment-design.md
- references/statistical-foundations.md
Open the folder on GitHubat commit 3fe6c8a
Used in 1 other repository
We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in sanity-io/agent-toolkit, which our catalogue first saw on October 7, 2026.
Compare with similar skills
Content Experimentation Best Practices next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Content Experimentation Best Practices this skillsanity-io/agent-toolkit | 188 | 1 repos | ~469 | Automated safety check: Pass | MIT | |
| Ab Test Analyzeririnabuht12-oss/marketing-skills | 4.1k | — | ~1.4k | Automated safety check: Pass | None | |
| Define Hypothesisproduct-on-purpose/pm-skills | 716 | — | ~966 | Automated safety check: Pass | Apache-2.0 | |
| A B Test DesignOwl-Listener/designer-skills | 2.9k | 1 repos | ~472 | Automated safety check: Pass | MIT | |
| Send Experiment Designeraaron-he-zhu/aaron-marketing-skills | 2.9k | 2 repos | ~4.1k | Automated safety check: Pass | Apache-2.0 | |
| Ads TestAgriciDaniel/claude-ads | 9.9k | — | ~312 | Automated safety check: Pass | MIT |
Similar skills
Define Hypothesis
product-on-purpose/pm-skills
Defines a testable hypothesis with clear success metrics and a validation approach.
A B Test Design
Owl-Listener/designer-skills
Design an A/B experiment — hypothesis, variants, primary metric, and sample size.
Send Experiment Designer
aaron-he-zhu/aaron-marketing-skills
A skill your agent uses when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email result…
Ads Test
AgriciDaniel/claude-ads
Design and evaluate paid-ad experiments with hypotheses, randomization units, sample-size and duration assumptions, guardrails, platform experiment tools, analysis, and decision rules.
Ab Test Setup
sickn33/agentic-awesome-skills
A skill your agent uses when designing an A/B or split test: define the hypothesis, control and variants, estimate sample size, verify tracking, and predeclare metrics and stopping rules.
More from sanity-io/agent-toolkit
All 8 skills in this repo- Official
Sanity Best Practices
sanity-io/agent-toolkit
Sanity development best practices for schema design, GROQ queries, TypeGen, Visual Editing, images, Portable Text, Studio structure, localization, migrations, Sanity Functions, webhooks, Blueprints…
- Official
Portable Text Conversion
sanity-io/agent-toolkit
Convert HTML and Markdown content into Portable Text blocks for Sanity.
- Official
Sanity Migration
sanity-io/agent-toolkit
Plans, implements, and reviews migrations from other CMSes and content systems into Sanity.
- Official
Portable Text Serialization
sanity-io/agent-toolkit
Render and serialize Portable Text to React, Svelte, Vue, Astro, HTML, Markdown, and plain text.
- Official
SEO Aeo Best Practices
sanity-io/agent-toolkit
SEO and AEO best practices for metadata, Open Graph, sitemaps, robots.txt, hreflang, JSON-LD structured data, EEAT, and content optimized for search engines and AI answer surfaces.
- Official
Sanity Studio Upgrade
sanity-io/agent-toolkit
Produces a tailored Sanity Studio upgrade plan by inspecting the repository's installed versions, config, and source, then reporting only the breaking changes that actually apply.
Related
Categories
Questions about Content Experimentation Best Practices
What does Content Experimentation Best Practices do?
Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls. Content Experimentation Best Practices is an agent skill from sanity-io/agent-toolkit, published by the product's own GitHub organization. Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls.
When should I use Content Experimentation Best Practices?
Content Experimentation Best Practices fits situations like: planning experiments; setting up variants; choosing success metrics; interpreting statistical results.
How do I install Content Experimentation Best Practices in Claude Code?
Run `npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a claude-code`. Or copy the skill folder (skills/content-experimentation-best-practices in sanity-io/agent-toolkit) into .claude/skills/content-experimentation-best-practices in your project. Claude Code loads it when a task matches its description.
How do I install Content Experimentation Best Practices in Codex?
Run `npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a codex`. Or copy the skill folder (skills/content-experimentation-best-practices in sanity-io/agent-toolkit) into .agents/skills/content-experimentation-best-practices in your project. Codex loads it when a task matches its description.
Can I use Content Experimentation Best Practices in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add sanity-io/agent-toolkit --skill content-experimentation-best-practices -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/content-experimentation-best-practices, .gemini/skills/content-experimentation-best-practices, .github/skills/content-experimentation-best-practices and .opencode/skills/content-experimentation-best-practices in your project.
What does Content Experimentation Best Practices need to run?
SKILL.md names no scripts, command-line tools or credentials: Content Experimentation Best Practices is instructions for the agent only.
Does Content Experimentation Best Practices access the network?
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Is Content Experimentation Best Practices safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Content Experimentation Best Practices use?
Content Experimentation Best Practices is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
How many tokens does Content Experimentation Best Practices use?
About 469 tokens (SKILL.md is roughly 1.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 5.5k tokens, read only when the agent opens those files.
What are the alternatives to Content Experimentation Best Practices?
Skills that share tags, products or a category with Content Experimentation Best Practices: Ab Test Analyzer (irinabuht12-oss/marketing-skills, 4.1k stars), Define Hypothesis (product-on-purpose/pm-skills, 716 stars), A B Test Design (Owl-Listener/designer-skills, 2.9k stars) and Send Experiment Designer (aaron-he-zhu/aaron-marketing-skills, 2.9k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Content Experimentation Best Practices?
sanity-io (a GitHub organization, an official publisher) maintains it in sanity-io/agent-toolkit, which has 188 GitHub stars. The repository holds 8 skills in this directory. The repository was last updated on October 9, 2026.
Source: sanity-io/agent-toolkit on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.