tmux Real User Testing
QwenLM/qwen-code
Drives Qwen Code in a real tmux session the way a user would and saves a readable step-by-step transcript of each screen for maintainers to review.
Runs one manual QA scenario for the todo continuation feature in the real ./pi-test.sh CLI inside tmux, captures scrollback and checks a deterministic count marker.
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install code-yeongyu/senpi tmux-manual-qa --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .claude/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .claude/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qaType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install code-yeongyu/senpi tmux-manual-qa --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .agents/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .agents/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .agents/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install code-yeongyu/senpi tmux-manual-qa --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .cursor/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .cursor/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/code-yeongyu/senpi.git --path .factory/skills/tmux-manual-qa--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install code-yeongyu/senpi tmux-manual-qa --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .gemini/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .gemini/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install code-yeongyu/senpi tmux-manual-qaInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .github/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .github/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .github/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install code-yeongyu/senpi tmux-manual-qa --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/code-yeongyu/senpi.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/.factory/skills/tmux-manual-qa .opencode/skills/tmux-manual-qa && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "tmux-manual-qa" agent skill from https://github.com/code-yeongyu/senpi/tree/main/.factory/skills/tmux-manual-qa into .opencode/skills/tmux-manual-qa/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "tmux-manual-qa", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
tmux-manual-qaRuns one manual QA scenario for the todo continuation feature in the real ./pi-test.sh CLI inside tmux, captures scrollback and checks a deterministic count marker.
This is a worker skill for a single manual QA feature listed in features.json. It drives the real ./pi-test.sh TUI in a tmux session, saves the scrollback to a log in the gitignored local-ignore folder, and treats a count of the SYSTEM DIRECTIVE: SENPI marker, written to a .count file beside the log, as the pass or fail signal instead of how the screen looks.
Before starting, the agent reads the feature spec, the mission document, the validation contract and the library notes on architecture and user testing, then confirms that pi-test.sh runs, the project has been built, and tmux and rg are installed. Scenarios include default-enabled, settings-disable, flag-override and re-entry-guard. Temporary .pi/settings.json fixtures are deleted after capture, real LLM calls are allowed, the auth file is never touched, and source files stay unchanged: bugs go back to the orchestrator.
8 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit ee6ece1. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
rgnpmFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md. Its commands use npm, which can reach the network depending on how they are called.
From URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Tmux Manual QA Worker loads about 1.6k tokens when it runs. Until then it costs about 74 tokens; SKILL.md has 662 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from code-yeongyu/senpi at commit ee6ece1, republished under its MIT licence (© code-yeongyu). 662 words, ~1,561 tokens.
.claude/skills/tmux-manual-qa/SKILL.md (or your agent's skills folder).You are executing ONE manual QA feature from features.json that drives the real ./pi-test.sh CLI inside a tmux session, captures scrollback, and asserts deterministic pass/fail markers.
features.json — your assigned feature.mission.md.fulfills IDs for your feature in validation-contract.md..factory/library/architecture.md..factory/library/user-testing.md — especially the Manual tmux TUI section.~/.pi/agent/auth.json is presumed configured. Do NOT touch that file.local-ignore/ — never commit QA evidence. The local-ignore/ directory is gitignored..pi/settings.json for a scenario, delete it after capture so subsequent tests start from a clean slate.rg -c "SYSTEM DIRECTIVE: SENPI" count check. Always save the count to a .count file alongside the .log file. The count is the canonical pass/fail marker, not the visual scrollback.Before running any scenario, confirm:
./pi-test.sh is executable and runs (check ls -la pi-test.sh).npm run build has been run at least once after the continuation feature was merged (check packages/coding-agent/dist/cli.js exists and contains the continuation code).tmux is installed (command -v tmux).rg is installed (command -v rg).local-ignore/ directory exists at repo root (create if needed).If any prerequisite is missing, return to orchestrator.
Read your feature's description carefully. Identify:
rg -c count (0 or ≥1).local-ignore/qa-cross-XXX-*.log).If your scenario requires a test .pi/settings.json:
mkdir -p .pi
echo '{ "todotools": { "continuation": { "enabled": false } } }' > .pi/settings.json.qa-backup-test
# (Back up any existing .pi/settings.json first so we can restore.)Always back up the existing file before writing the test fixture, and restore it after capture.
Start a new tmux session for the scenario:
TMUX_SESSION="pi-qa-${FEATURE_ID}"
tmux kill-session -t "$TMUX_SESSION" 2>/dev/null || true
tmux new-session -d -s "$TMUX_SESSION" "./pi-test.sh${EXTRA_FLAGS}"Wait for the CLI to initialize (use sleep 3 or poll for the prompt).
Send the scripted prompts that drive the agent to create todos and end its turn. Example:
tmux send-keys -t "$TMUX_SESSION" 'create a 2-item todo list about testing this feature, mark one as in_progress, then pause' Enter
sleep 10 # wait for the agent to respondUse sleep generously between interactions — real model calls take time. A 10-20 second pause between prompts is reasonable.
tmux capture-pane -p -t "$TMUX_SESSION" -S -10000 > local-ignore/qa-cross-XXX-tmux.logrg -c 'SYSTEM DIRECTIVE: SENPI' local-ignore/qa-cross-XXX-tmux.log > local-ignore/qa-cross-XXX-tmux.count || true
COUNT=$(cat local-ignore/qa-cross-XXX-tmux.count)
echo "Continuation directive count: $COUNT"Compare against the expected count in your feature's expectedBehavior:
manual-tmux-qa-default-enabled: expect ≥1manual-tmux-qa-settings-disable: expect 0manual-tmux-qa-flag-override: flag-on expect 0, flag-off expect ≥1manual-tmux-qa-reentry-guard: expect per-turn count ≤1 (check manually because it needs per-turn framing)tmux kill-session -t "$TMUX_SESSION" 2>/dev/null || trueRestore any backup settings files. Remove any temporary fixtures you created.
ls -l local-ignore/qa-cross-XXX-*.log local-ignore/qa-cross-XXX-*.countConfirm both files exist.
Report:
successState: "success" if the count matches expected; "failure" if not.evidenceFiles: paths to the captured log and count files.observedCount: the actual number.expectedCount: the expected range.scrollbackSummary: 3-5 lines describing what you saw (agent behavior, any error messages, any unexpected output).discoveredIssues: anything buggy or surprising observed during the run (surface it — do not silently ignore).Return to orchestrator immediately if:
./pi-test.sh fails to start.tmux is not available.local-ignore/.rg -c count file.© code-yeongyu, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in .factory/skills/tmux-manual-qa of code-yeongyu/senpi.
Open the folder on GitHubat commit ee6ece1
Tmux Manual QA Worker next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Tmux Manual QA Worker this skillcode-yeongyu/senpi | 472 | — | ~1.6k | Automated safety check: Pass | MIT | |
| tmux Real User TestingQwenLM/qwen-code | 28k | — | ~2.3k | Automated safety check: Pass | Apache-2.0 | |
| CodexBar Live QAsteipete/CodexBar | 22k | — | ~1.2k | Automated safety check: Pass | MIT | |
| Verify Omnigent End-to-Endomnigent-ai/omnigent | 11k | — | ~1.6k | Automated safety check: Pass | Apache-2.0 | |
| OpenHarness End-to-End EvalsHKUDS/OpenHarness | 16k | 1 repos | ~2.1k | Automated safety check: Notes | MIT | |
| Acceptance Evidence for Deliverieslobehub/lobehub | 83k | — | ~9.7k | Automated safety check: Pass | Apache-2.0 |
QwenLM/qwen-code
Drives Qwen Code in a real tmux session the way a user would and saves a readable step-by-step transcript of each screen for maintainers to review.
steipete/CodexBar
Runs live QA for the CodexBar app: provider usage matrix checks through its packaged CLI, config validation and menu checks, with 1Password-backed credentials handled safely.
omnigent-ai/omnigent
Spins up an isolated Omnigent server, runner and mock model to prove a user-facing behavior or bug fix with recorded evidence instead of reasoning from code.
HKUDS/OpenHarness
Validates OpenHarness features by running real multi-turn agent loops with live LLM calls against an unfamiliar codebase, checking actual tool execution.
lobehub/lobehub
Verifies a delivery end to end by driving the real product on a CLI, web, desktop or iOS Simulator surface, capturing evidence and publishing a round with the lh CLI.
code-yeongyu/oh-my-openagent
Tests the omo Codex plugin in an isolated CODEX_HOME with a local mock model, proving hooks fired through app-server notifications without touching ~/.codex.
code-yeongyu/senpi
Checks changes to the senpi coding agent by driving the real CLI from source in an isolated sandbox, over RPC, terminal UI, mock model and CLI smoke channels.
code-yeongyu/senpi
Syncs a fork branch with its upstream remote using a history-preserving merge commit, with no rebase and no force push.
code-yeongyu/senpi
Points the agent at Bun 1.4 built-in APIs before it installs an npm package, so image, browser, markdown, cron, PTY and test work uses what Bun already ships.
code-yeongyu/senpi
Worker brief for implementing one pre-assigned feature in the senpi todotools built-in extension, with strict scope, typing, testing and git-safety rules.
code-yeongyu/senpi
Prompt-crafting guide for gpt-image-2.5: which image tool to call, which model to pick, and how to write prompts, edit with references and refine over turns.
code-yeongyu/senpi
Walks the canonical CalVer release flow for senpi, from a clean main checkout through changelog audit, checks, tag push, GitHub Release and npm publishing.
Categories
Runs one manual QA scenario for the todo continuation feature in the real ./pi-test.sh CLI inside tmux, captures scrollback and checks a deterministic count marker. json.count file beside the log, as the pass or fail signal instead of how the screen looks.
Tmux Manual QA Worker fits situations like: verifying the todo continuation behavior by hand in an interactive TUI; capturing scrollback evidence for a manual-qa milestone feature; testing a settings or flag override scenario and cleaning up its fixture afterwards.
Run `npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a claude-code`. Or copy the skill folder (.factory/skills/tmux-manual-qa in code-yeongyu/senpi) into .claude/skills/tmux-manual-qa in your project. Claude Code loads it when a task matches its description.
Run `npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a codex`. Or copy the skill folder (.factory/skills/tmux-manual-qa in code-yeongyu/senpi) into .agents/skills/tmux-manual-qa in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add code-yeongyu/senpi --skill tmux-manual-qa -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/tmux-manual-qa, .gemini/skills/tmux-manual-qa, .github/skills/tmux-manual-qa and .opencode/skills/tmux-manual-qa in your project.
Going by SKILL.md and its folder, Tmux Manual QA Worker needs the command-line tools its instructions call (rg and npm). Our summary lists: The repository's ./pi-test.sh CLI and a completed npm run build; tmux and ripgrep (rg) installed; Configured LLM credentials for real model calls.
SKILL.md contains no URLs. Its commands use npm, which can reach the network depending on how they are called. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Tmux Manual QA Worker is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.6k tokens (SKILL.md is roughly 6.2k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Tmux Manual QA Worker: tmux Real User Testing (QwenLM/qwen-code, 28k stars), CodexBar Live QA (steipete/CodexBar, 22k stars), Verify Omnigent End-to-End (omnigent-ai/omnigent, 11k stars) and OpenHarness End-to-End Evals (HKUDS/OpenHarness, 16k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
code-yeongyu (a GitHub user) maintains it in code-yeongyu/senpi, which has 472 GitHub stars. The repository holds 7 skills in this directory. The repository was last updated on October 9, 2026.
Source: code-yeongyu/senpi on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.