Long Term Impact Evaluation

What it does

When your agent uses it

• Comparing long-term holdbacks
• Post-period analysis
• Continuous monitoring
• Delayed effects

Example prompts

• “/long-term-impact-evaluation”

Requirements

• Compatibility (from SKILL.md): Codex, Claude Code, and other Agent Skills-compatible clients.

Workflow steps

6 steps, taken from the first numbered list in SKILL.md.

1. 1State why short-term experiment metrics are insufficient.
2. 2Identify the expected time horizon and delayed mechanisms.
3. 3Compare holdback, post-period analysis, continuous monitoring, and CLV model
4. 4Weigh accuracy against user cost, business cost, complexity, and confounding.
5. 5Choose the simplest method that answers the long-term question.
6. 6Define metric cadence, interpretation limits, and follow-up decisions.

What it can do on your machine

Read from SKILL.md and the folder at commit 9e7b281. It shows what the files ask for, not the result of running them.

• Tool permissions

  Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

  From allowed-tools in the SKILL.md frontmatter.

• Runs code

  No scripts in the folder and no shell commands in SKILL.md (its code samples are markdown).

  From the folder's file list and the shell code blocks in SKILL.md.

• Network

  No URLs in SKILL.md.

  From URLs in SKILL.md, links to its own repository left out.

• Credentials

  Names no API keys, tokens, secrets or passwords.

  From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

• Compatibility

  Codex, Claude Code, and other Agent Skills-compatible clients.

  From compatibility in the SKILL.md frontmatter.

Context cost

Long Term Impact Evaluation loads about 770 tokens when it runs, and up to ~2.7k if it reads all its reference files. Until then it costs about 80 tokens; SKILL.md has 225 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it

~80

When it runs · the whole SKILL.md, loaded when a task matches

~770

With references · SKILL.md plus every file in references/, read only if the agent opens them

~2.7k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from hashgraph-online/awesome-codex-plugins at commit 9e7b281, republished under its MIT licence (© hashgraph-online). 225 words, ~770 tokens.

name

long-term-impact-evaluation

description

Choose methods for measuring long-term product impact after or beyond an A/B test. Use when comparing long-term holdbacks, post-period analysis, continuous monitoring, CLV models, delayed effects, short-term versus long-term metric tradeoffs, or lower-cost alternatives to long-term holdbacks.

compatibility

Codex, Claude Code, and other Agent Skills-compatible clients.

license

MIT

metadata.version

0.1.0

metadata.displayName

Long-Term Impact Evaluation

metadata.category

Product Management

metadata.tags

practical-ab-testing,next-level-ab-testing,ab-testing,experimentation,holdbacks

# Long-Term Impact Evaluation Plan

## Long-Term Question
[What delayed or sustained effect must be measured.]

## Recommended Method
[Holdback | Post-period analysis | Continuous monitoring | CLV model | Hybrid]

## Tradeoffs
| Method | Benefit | Cost/Risk | Fit |
|--------|---------|-----------|-----|

## Measurement Plan
- Short-term metric:
- Long-term metric:
- Time horizon:
- Confounders:

## Decision Rules
- Continue measuring if:
- End or revise if:
- Escalate if:

© hashgraph-online, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 5 other files (references) in plugins/LVTD-LLC/skills/skills/long-term-impact-evaluation of hashgraph-online/awesome-codex-plugins.

• SKILL.md
• guidelines.md
• references/core/examples.md
• references/core/knowledge.md
• references/core/rules.md
• workflows/choose-long-term-evaluation.md

Open the folder on GitHubat commit 9e7b281