Improvement Loop

The Improvement Loop

Overview

Improve the .claude/ pipeline after resolving the issue at hand — never during. When a skill, agent, hook, or script produces bad output, work through to the correct solution first, then update the pipeline with what you learned.

Core principle: Fix first, understand fully, improve last. Premature edits encode partial understanding.

When to Use

digraph when_to_use {
    "Issue resolved successfully?" [shape=diamond];
    "Root cause in pipeline file?" [shape=diamond];
    "Worth encoding permanently?" [shape=diamond];
    "Run improvement cycle" [shape=box style=filled fillcolor=lightgreen];
    "Keep working on the issue" [shape=box];
    "Skip - not a pipeline problem" [shape=box];
    "Skip - one-off or too specific" [shape=box];

    "Issue resolved successfully?" -> "Root cause in pipeline file?" [label="yes"];
    "Issue resolved successfully?" -> "Keep working on the issue" [label="no - finish first"];
    "Root cause in pipeline file?" -> "Worth encoding permanently?" [label="yes"];
    "Root cause in pipeline file?" -> "Skip - not a pipeline problem" [label="no"];
    "Worth encoding permanently?" -> "Run improvement cycle" [label="yes"];
    "Worth encoding permanently?" -> "Skip - one-off or too specific" [label="no"];
}

Trigger conditions (suggest to user):

• An agent produced incorrect output that required manual correction
• A skill was missing guidance that caused a wrong approach
• The same mistake has occurred more than once across sessions
• A hook failed to catch something it should have
• An orchestration script hit an unhandled edge case
• A subagent asked questions that the agent definition should have answered
• Review feedback repeatedly flags the same class of issue

Do NOT trigger:

• While still debugging or iterating on the original issue
• For one-off problems unlikely to recur
• For issues outside the pipeline (user error, external service failures)
• When the fix is a code change, not a pipeline change

The Gate: Is the Issue Resolved?

This check is mandatory before any improvement work.

digraph gate_check {
    "Original task/issue complete?" [shape=diamond];
    "Tests passing?" [shape=diamond];
    "User confirmed resolution?" [shape=diamond];
    "GATE PASSED - proceed to improvement" [shape=box style=filled fillcolor=lightgreen];
    "STOP - return to the issue" [shape=box style=filled fillcolor=salmon];

    "Original task/issue complete?" -> "Tests passing?" [label="yes"];
    "Original task/issue complete?" -> "STOP - return to the issue" [label="no"];
    "Tests passing?" -> "User confirmed resolution?" [label="yes"];
    "Tests passing?" -> "STOP - return to the issue" [label="no"];
    "User confirmed resolution?" -> "GATE PASSED - proceed to improvement" [label="yes"];
    "User confirmed resolution?" -> "STOP - return to the issue" [label="no/unclear"];
}

Verify ALL of these before proceeding:

1. The original task or issue is functionally complete
2. All tests pass (or the fix is committed and verified)
3. The user considers the issue resolved (ask if unclear)

If ANY check fails, stop. Return to the issue. Do not start improvement work.

Proactive Detection

When you observe improvement opportunities during normal work, do not act immediately. Instead:

1. Note the opportunity — mentally flag what went wrong and which pipeline file is involved
2. Finish the current task — complete whatever you're working on
3. Ask the user — suggest the improvement explicitly:

I noticed [specific problem] while working on [task]. The root cause appears to be
[skill/agent/hook/script name] which [lacks guidance on X / has an anti-pattern gap /
doesn't handle Y].

Would you like me to run an improvement cycle to update it? This would involve:
- [Specific change: e.g., "adding an anti-pattern entry for Model::all()"]
- [Estimated scope: e.g., "a one-line addition to the agent's anti-patterns section"]

Always ask before starting. The user may want to defer, batch improvements, or handle it differently.

The Five-Step Cycle

Step 1: Capture the Problem

Document what happened before details fade:

• What went wrong: The specific incorrect output or behavior
• Which pipeline file: The skill, agent, hook, or script involved
• Root cause: Why the pipeline file led to the wrong outcome
• Correct solution: What the right approach turned out to be
• How you discovered it: The debugging path (helps write better guidance)

Step 2: Classify the Improvement

Step 3: Make the Minimal Change

Write the smallest change that prevents the problem from recurring.

• Anti-pattern? Add one entry to the agent's anti-patterns section
• Missing guidance? Add one paragraph or code example to the skill
• Hook gap? Add one condition to the hook script
• Script edge case? Add one error handler to the orchestration script

Do NOT:

• Rewrite entire files while you're "in there"
• Add speculative guidance for problems that haven't occurred
• Refactor surrounding code that isn't related to the issue

Step 4: Verify the Change

Depending on the type of change: