Agent skill

Autoresearch

by byungjunjang in byungjunjang/jangpm-meta-skills

Autonomously optimize a Claude Code skill or agent system by running it repeatedly, scoring outputs against evals, mutating owned artifacts (prompt, references, scripts, agent definitions), and…

No licenceAuto-check: warningsAgent Workflows

Install Autoresearch

The automated check flagged lines worth reading first. See the safety section below.

skills CLI
$ npx skills add byungjunjang/jangpm-meta-skills --skill autoresearch -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install byungjunjang/jangpm-meta-skills autoresearch --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/byungjunjang/jangpm-meta-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/autoresearch .claude/skills/autoresearch && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
autoresearch
GitHub stars
120
Token cost
~6k tokens
SKILL.md length
3,254 words
Files
8 (incl. references)
Skills in repo
7
Repo updated
First seen
Licence
None found

At a glance

Autonomously optimize a Claude Code skill or agent system by running it repeatedly, scoring outputs against evals, mutating owned artifacts (prompt, references, scripts, agent definitions), and…

  • Works in 10 steps: gather context → read the skill → build the eval suite → …
  • The user asks to run autoresearch
  • SKILL.md covers When NOT to use this skill, the core job, project setup (required) and step 0: gather context, plus 13 more sections
  • Calls git and python

What it does

Autoresearch is an agent skill from byungjunjang/jangpm-meta-skills. Autonomously optimize a Claude Code skill or agent system by running it repeatedly, scoring outputs against evals, mutating owned artifacts (prompt, references, scripts, agent definitions), and keeping improvements. Karpathy's autoresearch methodology. Trigger when the user asks to run autoresearch, or to optimize, benchmark, or run evals on a skill or agent. Also trigger on 스킬 개선, 스킬 최적화, 스킬 벤치마크, 스킬 평가, 에이전트 개선, 에이전트 최적화.

Its SKILL.md is about 6k tokens, which your agent loads only when the skill is triggered. The skill folder holds 8 other files, including reference files (for example `references/dashboard-guide.md`, `references/eval-guide.md` and `references/execution-guide.md`).

It sits in Agent Workflows, covering Autonomous loops and LLM evaluation. The repository describes itself as: AI에게 일을 시키는 프롬프트가 아닌, AI가 일하는 방식을 설계하는 메타 스킬 4종 — 설계(blueprint) · 인터뷰(deep-dive) · 개선(reflect) · 자기 검증개선(autoresearch).

When your agent uses it

  • The user asks to run autoresearch
  • Run evals on a skill

Example prompts

  • “/autoresearch”

Requirements

  • Python 3

Workflow steps

10 steps, taken from the step headings in SKILL.md.

  1. gather context
  2. read the skill
  3. build the eval suite
  4. define the live dashboard
  5. define the run harness
  6. establish baseline (or resume)
  7. human review phase (optional)
  8. run the autonomous experiment loop
  9. maintain the logs
  10. deliver results

What it can do on your machine

Read from SKILL.md and the folder at commit 41af514. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • git
    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use git, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Autoresearch loads about 6k tokens when it runs, and up to ~16k if it reads all its reference files. Until then it costs about 110 tokens; SKILL.md has 3,254 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~110
When it runs · the whole SKILL.md, loaded when a task matches
~6k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~16k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: warnings

The automated check found patterns that need a careful read before installing.

  • WarningTells the agent its actions are pre-authorized / not to stop for confirmationSKILL.md:233
    **NEVER STOP.** Once the loop starts, never pause to ask for confirmation. The user may be away. Keep running until the

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Without a licence we can't republish the file, so here is its outline and opening line. It has 3,254 words (~6,028 tokens).

“One-off skill edits — fixing a typo, tweaking a sentence, adding a description or a small rule — do not need an experiment loop. Just edit the skill file directly. Use autoresearch only when iterative run-score-mutate evaluation is actually wanted.”

— opening of SKILL.md by byungjunjang
name
autoresearch

Read the full SKILL.md on GitHub

Files

SKILL.md and 7 other files (references) in .claude/skills/autoresearch of byungjunjang/jangpm-meta-skills.

  • SKILL.md
  • references/dashboard-guide.md
  • references/eval-guide.md
  • references/execution-guide.md
  • references/logging-guide.md
  • references/mutation-guide.md
  • references/pipeline-guide.md
  • references/worked-example.md

Open the folder on GitHubat commit 41af514

Compare with similar skills

Autoresearch next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Autoresearch compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Autoresearch this skillbyungjunjang/jangpm-meta-skills120—~6kAutomated safety check: WarnNone
Loop Architectfabricioctelles/skills106—~2.1kAutomated safety check: NotesMIT
Improving MCP ToolsPostHog/posthog40k—~1.5kAutomated safety check: PassCustom licence
Inngest AgentsAsymmetric-al/core381—~2.6kAutomated safety check: PassAGPL-3.0
Author Skillericrisco/rsc-harness180—~4.3kAutomated safety check: PassMIT
Agents Best PracticesDenisSergeevitch/agents-best-practices2.4k—~7.4kAutomated safety check: PassMIT

Similar skills

  • Loop Architect

    fabricioctelles/skills

    Design well-structured agent loops with best-practice coaching and cross-model review gates before you run them.

    106 GitHub stars~2.1k tokensUpdated 6 days ago
    Agent WorkflowsAuto-check: notes
  • Improving MCP Tools

    PostHog/posthog

    Official

    Run an improve-my-MCP campaign: an autoresearch-style loop that measures the MCP agent experience with the eval harness, picks the highest-impact tool problem from production data, makes one bounded…

    40k GitHub stars~1.5k tokensUpdated yesterday
    Agent WorkflowsAuto-check passed
  • Inngest Agents

    Asymmetric-al/core

    A skill your agent uses when building durable AI agents or agentic workflows with Inngest and AgentKit, including model calls, tool calls, multi-agent networks, human approval, realtime progress…

    381 GitHub stars~2.6k tokensUpdated yesterday
    Agent WorkflowsAuto-check passed
  • Author Skill

    ericrisco/rsc-harness

    A skill your agent uses when authoring a NEW rsc skill or editing an existing one — scoping it to one job, writing the description that decides whether it ever loads, splitting the body into…

    180 GitHub stars~4.3k tokensUpdated yesterday
    Agent WorkflowsAuto-check passed
  • Agents Best Practices

    DenisSergeevitch/agents-best-practices

    A skill your agent uses when designing, generating an MVP blueprint for, auditing, troubleshooting, refactoring, or explaining an agentic harness for any domain.

    2.4k GitHub stars~7.4k tokensUpdated 6 days ago
    AI & LLM EngineeringAuto-check passed
  • Autocontext Knowledge Creator

    greyhaven-ai/autocontext

    Runs the `autoctx` CLI to improve an approach to a task over several generations, score or refine a single output and inspect what a run produced.

    1.3k GitHub stars~964 tokensUpdated 4 days ago
    AI & LLM EngineeringAuto-check passed

More from byungjunjang/jangpm-meta-skills

  • Blueprint

    byungjunjang/jangpm-meta-skills

    Agentic system design blueprint generator. An agent skill from byungjunjang/jangpm-meta-skills.

    120 GitHub stars~2k tokensUpdated 2 mo ago
    Auto-check passed
  • Blueprint

    byungjunjang/jangpm-meta-skills

    Codex용 자동화 에이전트 시스템 설계서 생성 스킬. An agent skill from byungjunjang/jangpm-meta-skills.

    120 GitHub stars~1.8k tokensUpdated 2 mo ago
    Auto-check passed
  • Deep Dive

    byungjunjang/jangpm-meta-skills

    Socratic interview skill to deepen a spec or refine an existing agent blueprint.

    120 GitHub stars~2.5k tokensUpdated 2 mo ago
    Auto-check passed
  • Deep Dive

    byungjunjang/jangpm-meta-skills

    A Codex skill for Socratic interviews that deepen a spec or refine an existing agent blueprint.

    120 GitHub stars~2.7k tokensUpdated 2 mo ago
    Auto-check passed
  • Reflect

    byungjunjang/jangpm-meta-skills

    Session wrap-up and fix-learning capture skill. An agent skill from byungjunjang/jangpm-meta-skills.

    120 GitHub stars~1.9k tokensUpdated 2 mo ago
    Auto-check passed
  • Reflect

    byungjunjang/jangpm-meta-skills

    Session wrap-up and fix-learning capture skill for Codex. An agent skill from byungjunjang/jangpm-meta-skills.

    120 GitHub stars~1.9k tokensUpdated 2 mo ago
    Auto-check passed

Questions about Autoresearch

What does Autoresearch do?

Autonomously optimize a Claude Code skill or agent system by running it repeatedly, scoring outputs against evals, mutating owned artifacts (prompt, references, scripts, agent definitions), and…. Autoresearch is an agent skill from byungjunjang/jangpm-meta-skills. Autonomously optimize a Claude Code skill or agent system by running it repeatedly, scoring outputs against evals, mutating owned artifacts (prompt, references, scripts, agent definitions), and keeping improvements.

When should I use Autoresearch?

Autoresearch fits situations like: the user asks to run autoresearch; run evals on a skill.

How do I install Autoresearch in Claude Code?

Run `npx skills add byungjunjang/jangpm-meta-skills --skill autoresearch -a claude-code`. Or copy the skill folder (.claude/skills/autoresearch in byungjunjang/jangpm-meta-skills) into .claude/skills/autoresearch in your project. Claude Code loads it when a task matches its description.

How do I install Autoresearch in Codex?

Run `npx skills add byungjunjang/jangpm-meta-skills --skill autoresearch -a codex`. Or copy the skill folder (.claude/skills/autoresearch in byungjunjang/jangpm-meta-skills) into .agents/skills/autoresearch in your project. Codex loads it when a task matches its description.

Can I use Autoresearch in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add byungjunjang/jangpm-meta-skills --skill autoresearch -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/autoresearch, .gemini/skills/autoresearch, .github/skills/autoresearch and .opencode/skills/autoresearch in your project.

What does Autoresearch need to run?

Going by SKILL.md and its folder, Autoresearch needs the command-line tools its instructions call (git and python). Our summary lists: Python 3.

Does Autoresearch access the network?

SKILL.md contains no URLs. Its commands use git, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Autoresearch safe to install?

Our automated static check of SKILL.md flagged 1 warning(s): tells the agent its actions are pre-authorized / not to stop for confirmation. Read the flagged lines before installing; the check is not a guarantee either way.

What licence does Autoresearch use?

No licence was found for Autoresearch or its repository. Without one, default copyright applies: ask the author before reusing or redistributing it.

How many tokens does Autoresearch use?

About 6k tokens (SKILL.md is roughly 24k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 9.7k tokens, read only when the agent opens those files.

What are the alternatives to Autoresearch?

Skills that share tags, products or a category with Autoresearch: Loop Architect (fabricioctelles/skills, 106 stars), Improving MCP Tools (PostHog/posthog, 40k stars), Inngest Agents (Asymmetric-al/core, 381 stars) and Author Skill (ericrisco/rsc-harness, 180 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Autoresearch?

byungjunjang (a GitHub user) maintains it in byungjunjang/jangpm-meta-skills, which has 120 GitHub stars. The repository holds 7 skills in this directory. The repository was last updated on August 5, 2026.

Source: byungjunjang/jangpm-meta-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.