Agent skill

Autoresearch

by ericosiu in ericosiu/ai-marketing-skills

Run Karpathy-style autoresearch optimization on any content.

MITAuto-check passedMarketing & SEO

Install Autoresearch

skills CLI
$ npx skills add ericosiu/ai-marketing-skills --skill autoresearch -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install ericosiu/ai-marketing-skills autoresearch --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/ericosiu/ai-marketing-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/autoresearch .claude/skills/autoresearch && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
autoresearch
GitHub stars
3.6k
Used in
2 other repos
Token cost
~2.2k tokens
SKILL.md length
837 words
Files
4
Skills in repo
21
Repo updated
First seen
Licence
MIT

At a glance

Run Karpathy-style autoresearch optimization on any content.

  • Works in 6 steps: Intake & Parse → Get API Key → Run Optimization Rounds → …
  • Optimizing landing pages
  • SKILL.md covers What You'll Produce, Expert Panel (5 Personas), Round Structure (Per Content… and Content Types & Score Dimensions, plus 4 more sections
  • Runs Python scripts from its folder; needs ANTHROPIC_API_KEY

What it does

Autoresearch is an agent skill from ericosiu/ai-marketing-skills. Run Karpathy-style autoresearch optimization on any content. Generates 50+ variants, scores with a 5-expert simulated panel, evolves winners through multiple rounds, outputs optimized version + full experiment log. Use when optimizing landing pages, email sequences, ad copy, headlines, form pages, CTA text, or any conversion-focused content. Triggers on "optimize this page", "run autoresearch", "score these variants", "A/B test this copy".

Its SKILL.md is about 2.2k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files (for example `README.md` and `autoresearch.py`).

It sits in Marketing & SEO, covering Autonomous loops, Copywriting and Landing pages. The repository describes itself as: Open-source AI marketing skills — growth experiments, sales pipeline, content ops, outbound, SEO, and finance automation. The licence is MIT.

When your agent uses it

  • Optimizing landing pages
  • Email sequences
  • Any conversion-focused content
  • Optimize this page

Example prompts

  • “optimize this page”
  • “run autoresearch”
  • “score these variants”
  • “/autoresearch”

Requirements

  • Python 3
  • A credential in ANTHROPIC_API_KEY

Workflow steps

6 steps, taken from the step headings in SKILL.md.

  1. Intake & Parse
  2. Get API Key
  3. Run Optimization Rounds
  4. Cross-Breed (Multi-Element)
  5. Write Output Files
  6. Report Back

What it can do on your machine

Read from SKILL.md and the folder at commit 8088e1a. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Ships script files (Python), which the agent can run.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • ANTHROPIC_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Autoresearch loads about 2.2k tokens when it runs. Until then it costs about 114 tokens; SKILL.md has 837 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~114
When it runs · the whole SKILL.md, loaded when a task matches
~2.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from ericosiu/ai-marketing-skills at commit 8088e1a, republished under its MIT licence (© ericosiu). 837 words, ~2,178 tokens.

Download SKILL.mdSave it as .claude/skills/autoresearch/SKILL.md (or your agent's skills folder). This skill also uses 3 other files; get the full folder from GitHub.
name
autoresearch
description
Run Karpathy-style autoresearch optimization on any content. Generates 50+ variants, scores with a 5-expert simulated panel, evolves winners through multiple rounds, outputs optimized version + full experiment log. Use when optimizing landing pages, email sequences, ad copy, headlines, form pages, CTA text, or any conversion-focused content. Triggers on "optimize this page", "run autoresearch", "score these variants", "A/B test this copy".

Autoresearch Skill

Karpathy-style optimization loops for any conversion-focused content. No traffic needed. Simulated expert panel. Minutes, not weeks.

When to use this: Pre-launch content optimization. Generate 50+ variants, score with 5 simulated experts, evolve winners, output the best version + full experiment log.

When NOT to use this: Post-launch real-traffic A/B testing — that requires real analytics, not simulated scoring.

The sequence: Run autoresearch FIRST to hit 85+ simulated score. Then deploy. Then validate with real traffic.


What You'll Produce

Every run outputs 3 files:

FilePurpose
{name}-optimized.{ext}The winning optimized content
data/{name}-experiments.jsonFull experiment log — all variants + all scores
data/{name}-optimization-report.mdHuman-readable summary with winner rationale

Expert Panel (5 Personas)

Score every variant against all 5. Batch all variants into a single API call per round.

#PersonaScoring Lens
1CMO at a mid-market B2B company (50M+ revenue)"Would this make me stop and engage?"
2Skeptical founder"Do I believe this? Would I trust this company?"
3Conversion rate optimizer"Is this clear, specific, and action-driving?"
4Senior copywriter"Is this compelling, differentiated, and well-crafted?"
5Your CEO/founder"Direct, ROI-obsessed, no BS. Would I put this on my site?"

Customization: Replace persona #5 with your own CEO/founder voice. Define their priorities and communication style in a references/founder-voice.md file.

Each judge scores 0–100. Final score = average across all 5 judges.


Round Structure (Per Content Element)

Round 1:
  → Generate 10 variants of the element
  → Batch-score all 10 with the 5-expert panel (1 API call)
  → Rank by average score
  → Keep top 3

Round 2 (Evolution):
  → Analyze what the top 3 did right
  → Generate 10 new variants that push those winning patterns further
  → Batch-score all 10 (1 API call)
  → Keep top 3

Round 3 (If score < threshold):
  → Identify weakest scoring dimension
  → Generate 10 variants optimized for that dimension
  → Batch-score → keep top 1

Multi-element cross-breeding:
  → Take top 1 winner from each element
  → Generate 5 combinations that mix winning elements
  → Score holistically as complete units
  → Output the single best combination

Stop condition: Top variant hits minimum score threshold (default: 80) OR 3 rounds complete.


Content Types & Score Dimensions

Landing Pages

Elements to optimize: Hero headline, subheadline, CTA text, problem section, social proof

Score dimensions:

  • first_impression — Does it grab immediately?
  • clarity — Is the offer instantly understood?
  • trust — Does it feel credible?
  • urgency — Is there a reason to act now?
  • would_convert — Would the judge actually click?
Email Sequences

Elements to optimize: Subject line, opening line, body copy, CTA, PS line

Score dimensions:

  • would_open — Subject line pass rate
  • would_read — Does the opening hook?
  • would_click — Is the CTA compelling?
  • would_reply — Does it feel personal enough to respond to?
  • spam_risk — Does it feel spammy? (lower = better; invert for final score)
Ad Copy

Elements to optimize: Headline, description, CTA

Score dimensions:

  • scroll_stopping — Does it interrupt the scroll?
  • clarity — Is the value prop clear in 3 seconds?
  • click_worthiness — Does the judge want to click?
  • relevance — Does it match likely audience intent?
  • differentiation — Does it stand out from competitors?
Form Pages

Elements to optimize: Headline, subtext, value prop bullets, button text, field order, thank-you copy

Score dimensions:

  • first_impression — Does it feel worth filling out?
  • trust — Do they believe their info is safe and the offer is real?
  • completion_likelihood — Would the judge start filling it out?
  • lead_quality — Would this attract serious prospects (not tire-kickers)?
  • would_fill_out — Final gut check: would they submit?

Step-by-Step Execution Protocol

Step 1: Intake & Parse

Read the source content. Identify content type automatically or confirm with user:

  • HTML file → landing page or form page
  • Markdown / plain text → email or ad copy
  • If ambiguous, ask: "Is this a landing page, email sequence, ad copy, or form page?"

Extract all optimizable elements. List them back to user:

Found 5 elements to optimize:
1. Hero headline: "We help B2B companies grow"
2. Subheadline: "Full-service digital marketing..."
3. CTA: "Get Started"
4. Problem statement: [excerpt]
5. Social proof: [excerpt]

Optimizing: all | Variants per round: 10 | Min score: 80
Show full SKILL.md (335 more words)Show less
Step 2: Get API Key

Check for Anthropic API key: $ANTHROPIC_API_KEY environment variable.

bash
export ANTHROPIC_API_KEY="your-api-key-here"
Step 3: Run Optimization Rounds

For each element, run the round structure above.

Critical API efficiency rule: ALWAYS batch all variants into a single prompt. Never call the API once per variant. A round with 10 variants = 1 API call.

Model preference (in order):

  1. claude-sonnet-4-5 (preferred — fast + smart)
  2. claude-opus-4 (if highest quality needed)
  3. Any claude-3.5+ model if the above aren't available
Step 4: Cross-Breed (Multi-Element)

After all elements have winners:

  1. Assemble the top winner from each element into a complete unit
  2. Generate 5 holistic variants that naturally combine the winning elements
  3. Score the complete units (not just individual parts)
  4. Pick the winner with the highest holistic score
Step 5: Write Output Files
bash
# Create output directory
mkdir -p data

# Write optimized content
# Write experiments JSON
# Write optimization report

Experiments JSON structure:

json
{
  "run_id": "autoresearch-{name}-{timestamp}",
  "content_type": "landing_page",
  "source_file": "path/to/original",
  "min_score_threshold": 80,
  "rounds": [
    {
      "round": 1,
      "element": "hero_headline",
      "variants": [
        {
          "id": 1,
          "text": "...",
          "scores": {
            "cmo": 72,
            "skeptical_founder": 68,
            "cro": 75,
            "copywriter": 70,
            "founder": 65
          },
          "avg_score": 70
        }
      ],
      "top_3": [1, 4, 7],
      "winner_score": 82
    }
  ],
  "final_winner": {
    "hero_headline": "...",
    "subheadline": "...",
    "cta": "...",
    "holistic_score": 87
  }
}
Step 6: Report Back

Summarize results to user:

  • Final winning score
  • Biggest score jump (which element improved most)
  • Top 2 runner-up alternatives (in case winner doesn't feel right)
  • Path to all 3 output files
  • Clear next step

User Options

OptionDefaultDescription
elementsallWhich elements to optimize
variants_per_round10How many variants to generate per round
min_score80Stop when this score is hit
rounds3Max rounds before stopping
auto_applyfalseWhether to overwrite the source file with winners
content_typeauto-detectForce a content type if auto-detect is wrong

Quality Gates

  • < 70: Don't ship. Something fundamental is broken.
  • 70-79: Marginal. One more round targeting the lowest-scoring dimension.
  • 80-84: Good. Shippable. Validate with real traffic.
  • 85-89: Strong. Ship with confidence.
  • 90+: Rare. Ship immediately.

Anti-Patterns to Avoid

  • Never call the API once per variant. Always batch. A 10-variant round = 1 call.
  • Don't over-optimize for one dimension. If you're hitting 95 on clarity but 45 on trust, the overall score is misleading.
  • Don't run more than 5 rounds. If you're not hitting 80 after 3 rounds, the problem is strategic (wrong positioning), not tactical (wrong words).
  • Don't cross-breed until each element has its own winner. Premature cross-breeding creates incoherent combinations.

© ericosiu, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 3 other files in autoresearch of ericosiu/ai-marketing-skills.

  • SKILL.md
  • README.md
  • autoresearch.py
  • requirements.txt

Open the folder on GitHubat commit 8088e1a

Used in 2 other repositories

We found 2 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 2 other GitHub owners. This page covers the copy in ericosiu/ai-marketing-skills, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Autoresearch next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Autoresearch compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Autoresearch this skillericosiu/ai-marketing-skills3.6k2 repos~2.2kAutomated safety check: PassMIT
Sales MasteryaAAaqwq/AGI-Super-Team1051 repos~4.5kAutomated safety check: PassMIT
Ad Creativeindranilbanerjee/digital-marketing-pro8551 repos~1.7kAutomated safety check: PassMIT
Marketing OsYuzzyuk/marketing-os536—~2.5kAutomated safety check: PassMIT
Hormozi Ad Factorypedronauck/skills634—~2.1kAutomated safety check: PassNone
Marketing Campaignaffaan-m/ECC275k1 repos~1.3kAutomated safety check: PassMIT

Similar skills

  • Sales Mastery

    aAAaqwq/AGI-Super-Team

    World-class autonomous sales and revenue skill system. An agent skill from aAAaqwq/AGI-Super-Team.

    105 GitHub starsUsed in 1 repo~4.5k tokens
    Marketing & SEOAuto-check passed
  • Ad Creative

    indranilbanerjee/digital-marketing-pro

    Generate 3-5 ad copy variations per platform — headlines, descriptions, and CTAs formatted to Google, Meta, LinkedIn, TikTok, X, and Pinterest specs — each scored 1-10 with policy-compliance flags…

    855 GitHub starsUsed in 1 repo~1.7k tokens
    Marketing & SEOAuto-check passed
  • Marketing Os

    Yuzzyuk/marketing-os

    A complete marketing department in one skill. An agent skill from Yuzzyuk/marketing-os.

    536 GitHub stars~2.5k tokensUpdated 1 mo ago
    Marketing & SEOAuto-check passed
  • Hormozi Ad Factory

    pedronauck/skills

    Generates 150-750+ ad variations using Alex Hormozi's combinatorial Hook x Meat x CTA framework.

    634 GitHub stars~2.1k tokensUpdated 24 days ago
    Writing & ContentAuto-check passed
  • Marketing Campaign

    affaan-m/ECC

    End-to-end marketing campaign planning and execution. An agent skill from affaan-m/ECC.

    275k GitHub starsUsed in 1 repo~1.3k tokens
    Marketing & SEOAuto-check passed
  • Conversion Rate Optimization

    manojbajaj95/claude-gtm-plugin

    Conversion rate optimization for marketing pages and lead-capture forms.

    105 GitHub stars~1.2k tokensUpdated 20 days ago
    Marketing & SEOAuto-check passed

More from ericosiu/ai-marketing-skills

All 21 skills in this repo
  • Expert Panel

    ericosiu/ai-marketing-skills

    Score, evaluate, and iteratively improve any content or strategy using an auto-assembled panel of domain experts.

    3.6k GitHub starsUsed in 2 repos~2.1k tokens
    Auto-check passed
  • Cold Outbound Optimizer

    ericosiu/ai-marketing-skills

    Design, analyze, and optimize cold outbound email campaigns for Instantly.

    3.6k GitHub starsUsed in 1 repo~1.7k tokens
    Auto-check passed
  • Finance Ops

    ericosiu/ai-marketing-skills

    AI-powered financial analysis suite. An agent skill from ericosiu/ai-marketing-skills.

    3.6k GitHub starsUsed in 1 repo~1.4k tokens
    Auto-check passed
  • Leveling Up Content Engine

    ericosiu/ai-marketing-skills

    Diagnose and transform any authorized video URL, upload, recording, transcript, podcast, interview, presentation, screen recording, webinar, ad, or published video into the strongest justified…

    3.6k GitHub stars~2.3k tokensUpdated 16 days ago
    Auto-check passed
  • Net New Video Editor

    ericosiu/ai-marketing-skills

    Turn newly recorded talking-head footage into review-ready vertical video drafts with an explicit edit plan, deterministic FFmpeg rendering, captions, hook cards, audio normalization, and visual QA.

    3.6k GitHub stars~1.1k tokensUpdated 16 days ago
    Auto-check passed
  • Packaging Youtube Thumbnails

    ericosiu/ai-marketing-skills

    A skill your agent uses when a user supplies new video content or a channel and wants on-brand YouTube titles, thumbnail concepts, rendered variants, A/B packaging, identity profiling, precise…

    3.6k GitHub stars~3.8k tokensUpdated 16 days ago
    Auto-check passed

Questions about Autoresearch

What does Autoresearch do?

Run Karpathy-style autoresearch optimization on any content. Autoresearch is an agent skill from ericosiu/ai-marketing-skills. Run Karpathy-style autoresearch optimization on any content.

When should I use Autoresearch?

Autoresearch fits situations like: optimizing landing pages; email sequences; any conversion-focused content; optimize this page.

How do I install Autoresearch in Claude Code?

Run `npx skills add ericosiu/ai-marketing-skills --skill autoresearch -a claude-code`. Or copy the skill folder (autoresearch in ericosiu/ai-marketing-skills) into .claude/skills/autoresearch in your project. Claude Code loads it when a task matches its description.

How do I install Autoresearch in Codex?

Run `npx skills add ericosiu/ai-marketing-skills --skill autoresearch -a codex`. Or copy the skill folder (autoresearch in ericosiu/ai-marketing-skills) into .agents/skills/autoresearch in your project. Codex loads it when a task matches its description.

Can I use Autoresearch in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add ericosiu/ai-marketing-skills --skill autoresearch -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/autoresearch, .gemini/skills/autoresearch, .github/skills/autoresearch and .opencode/skills/autoresearch in your project.

What does Autoresearch need to run?

Going by SKILL.md and its folder, Autoresearch needs Python for the scripts in its folder and credentials named ANTHROPIC_API_KEY. Our summary lists: Python 3; A credential in ANTHROPIC_API_KEY.

Does Autoresearch access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Autoresearch safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Autoresearch use?

Autoresearch is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Autoresearch use?

About 2.2k tokens (SKILL.md is roughly 8.7k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Autoresearch?

Skills that share tags, products or a category with Autoresearch: Sales Mastery (aAAaqwq/AGI-Super-Team, 105 stars), Ad Creative (indranilbanerjee/digital-marketing-pro, 855 stars), Marketing Os (Yuzzyuk/marketing-os, 536 stars) and Hormozi Ad Factory (pedronauck/skills, 634 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Autoresearch?

ericosiu (a GitHub user) maintains it in ericosiu/ai-marketing-skills, which has 3,615 GitHub stars. The repository holds 21 skills in this directory. The repository was last updated on September 22, 2026.

Source: ericosiu/ai-marketing-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.