Agent skill

Unity UI Automation

by akiojin in akiojin/unity-cli

Automate Unity UI inspection and interaction with unity-cli.

MITAuto-check passedGame Development

Install Unity UI Automation

skills CLI
$ npx skills add akiojin/unity-cli --skill unity-ui-automation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install akiojin/unity-cli unity-ui-automation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/akiojin/unity-cli.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude-plugin/plugins/unity-cli/skills/unity-ui-automation .claude/skills/unity-ui-automation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
unity-ui-automation
GitHub stars
107
Token cost
~735 tokens
SKILL.md length
239 words
Files
3 (incl. references)
Skills in repo
28
Repo updated
First seen
Licence
MIT

At a glance

Automate Unity UI inspection and interaction with unity-cli.

  • Works in 4 steps: Find the target with namePattern or… → Inspect current state before acting… → Perform one interaction at a time and… → …
  • The user asks to find a UI element by name
  • SKILL.md covers Use When, Do Not Use When, Preferred Flow and Examples, plus 1 more section
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Unity UI Automation is an agent skill from akiojin/unity-cli. Automate Unity UI inspection and interaction with unity-cli. Use when the user asks to find a UI element by name or type, inspect button or input state, click a UI element, set a UI value, or run a short UI interaction sequence during testing. Do not use for scene authoring or general play-mode control without UI targeting; use unity-scene-create or unity-playmode-testing instead.

Its SKILL.md is about 740 tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files, including reference files (for example `references/runtime-checklist.md` and `references/ui-test-flow.md`).

It sits in Game Development. The repository describes itself as: Rust CLI for Unity Editor automation over Unity TCP protocol. The licence is MIT.

When your agent uses it

  • The user asks to find a UI element by name
  • Click a UI element
  • Run a short UI interaction sequence during testing
  • Scene authoring

Example prompts

  • “/unity-ui-automation”

Requirements

  • Pre-approved tools (allowed-tools): Bash(unity-cli:*), Read, Grep, Glob

Workflow steps

4 steps, taken from the first numbered list in SKILL.md.

  1. Find the target with namePattern or elementType.
  2. Inspect current state before acting (visibility, interactability).
  3. Perform one interaction at a time and re-check state when sequence matters.
  4. Combine with unity-playmode-testing only when the UI depends on runtime state.

What it can do on your machine

Read from SKILL.md and the folder at commit 7f45d7a. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Bash(unity-cli:*)
    • Read
    • Grep
    • Glob

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md (its code samples are bash).

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Unity UI Automation loads about 735 tokens when it runs, and up to ~1.2k if it reads all its reference files. Until then it costs about 102 tokens; SKILL.md has 239 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~102
When it runs · the whole SKILL.md, loaded when a task matches
~735
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.2k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from akiojin/unity-cli at commit 7f45d7a, republished under its MIT licence (© akiojin). 239 words, ~735 tokens.

Download SKILL.mdSave it as .claude/skills/unity-ui-automation/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.
name
unity-ui-automation
description
Automate Unity UI inspection and interaction with unity-cli. Use when the user asks to find a UI element by name or type, inspect button or input state, click a UI element, set a UI value, or run a short UI interaction sequence during testing. Do not use for scene authoring or general play-mode control without UI targeting; use `unity-scene-create` or `unity-playmode-testing` instead.
allowed-tools
Bash(unity-cli:*), Read, Grep, Glob
metadata.author
akiojin
metadata.version
0.3.1
metadata.category
ui
metadata.triggers
ui, canvas, button, click, input-field
metadata.siblings
unity-localization, unity-ui-toolkit-build, unity-playmode-testing, unity-scene-create

UI Automation

With --output json, results use {success, command, data, errors, warnings}. Check the exit status and envelope success first; tool-result fields in this skill are relative to data. Read failure codes from errors[0].code; see unity-cli-usage for exit-code recovery.

Find, inspect, and interact with uGUI / UI Toolkit elements via unity-cli. This skill is the UI-focused complement to unity-playmode-testing (full runtime control).

Use When

  • The user wants to locate UI elements by name or type.
  • The task requires inspecting UI state before or after interaction.
  • The user wants to click UI elements, set values, or run a short UI input sequence.

Do Not Use When

  • Configure Locale/String Table assets and verify localized UI text: unity-localization.

  • Build a complete UXML/USS UI Toolkit screen and verify its interactions: use unity-ui-toolkit-build.

  • The task is general Play Mode setup with no UI targeting requirement; use unity-playmode-testing.

  • The request authors UI prefabs or scene hierarchy; use unity-scene-create or unity-prefab-workflow.

Preferred Flow

  1. Find the target with namePattern or elementType.
  2. Inspect current state before acting (visibility, interactability).
  3. Perform one interaction at a time and re-check state when sequence matters.
  4. Combine with unity-playmode-testing only when the UI depends on runtime state.
bash
unity-cli raw find_ui_elements --json '{"namePattern":"Start","includeInactive":true}'
unity-cli raw get_ui_element_state --json '{"elementPath":"/Canvas/StartButton"}'
unity-cli raw click_ui_element --json '{"elementPath":"/Canvas/StartButton"}'
unity-cli raw set_ui_element_value --json '{"elementPath":"/Canvas/NameInput","value":"Player1"}'

Examples

  • "Find the start button and click it."
  • "Read the current value of /Canvas/NameInput and then set it to Player1."
  • "Run a short slider interaction sequence in the active UI."

References

© akiojin, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 2 other files (references) in .claude-plugin/plugins/unity-cli/skills/unity-ui-automation of akiojin/unity-cli.

  • SKILL.md
  • references/runtime-checklist.md
  • references/ui-test-flow.md

Open the folder on GitHubat commit 7f45d7a

Compare with similar skills

Unity UI Automation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Unity UI Automation compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Unity UI Automation this skillakiojin/unity-cli107—~735Automated safety check: PassMIT
Image to Three.js Modelimg2threejs/img2threejs18k1 repos~8.2kAutomated safety check: PassApache-2.0
Web CloneJane-xiaoer/claude-skill-web-clone1k1 repos~2.7kAutomated safety check: PassMIT
Threejs Game Directormajidmanzarpour/threejs-game-skills2.5k—~2.2kAutomated safety check: PassMIT
Game Asset Generatorhtdt/godogen7.1k—~2.8kAutomated safety check: PassMIT
Threejs Gameplay Systemsvalkor-ai/loom1.2k1 repos~1.4kAutomated safety check: PassApache-2.0

Similar skills

  • Image to Three.js Model

    img2threejs/img2threejs

    Rebuilds the object in a reference image as a procedural, animation-ready Three.js model written entirely in code, using staged sculpting with quality checks.

    18k GitHub starsUsed in 1 repo~8.2k tokens
    Game DevelopmentAuto-check passed
  • Web Clone

    Jane-xiaoer/claude-skill-web-clone

    网站复刻 / 克隆方法论。USE WHEN 用户说 复刻网站、克隆网站、clone website、抄个站、仿站、 照着这个站做一个、reproduce site、还原某个网页效果、把这个站搬下来改成我的、 复刻某个交互/WebGL/Canvas/Three.js 效果。提供「先拿真源码 → 判路径 → 逆向拆解 → 搭工程 → 替换内容」的可移植决策树,覆盖静态站 /…

    1k GitHub starsUsed in 1 repo~2.7k tokens
    Game DevelopmentAuto-check passed
  • Threejs Game Director

    majidmanzarpour/threejs-game-skills

    Entrypoint for building, upgrading, and finishing Three.js browser games.

    2.5k GitHub stars~2.2k tokensUpdated 11 days ago
    Game DevelopmentAuto-check passed
  • Generates game art from text prompts: PNG images, GLB 3D models, rigged characters, animations and sprites, with background removal.

    7.1k GitHub stars~2.8k tokensUpdated 8 days ago
    Game DevelopmentAuto-check passed
  • Build and iterate playable Three.js game systems: starter scaffold, architecture, design briefs, core loops, level and encounter design, entities, input, camera, collision and physics, scoring…

    1.2k GitHub starsUsed in 1 repo~1.4k tokens
    Game DevelopmentAuto-check passed
  • Uloop Execute Dynamic Code

    CyberAgentGameEntertainment/NovaShader

    Execute C with Unity APIs when existing uloop tools cannot inspect or edit enough.

    1.6k GitHub starsUsed in 1 repo~1.9k tokens
    Game DevelopmentAuto-check passed

More from akiojin/unity-cli

All 28 skills in this repo
  • Gh PR

    akiojin/unity-cli

    Create or update GitHub Pull Requests with the gh CLI, including deciding whether to create a new PR or only push based on existing PR merge status.

    107 GitHub stars~2.7k tokensUpdated 4 days ago
    Auto-check passed
  • Gh Skills Sync

    akiojin/unity-cli

    Sync the gh- automation skills from the upstream skills repository into Codex and project skill directories.

    107 GitHub stars~680 tokensUpdated 4 days ago
    Auto-check: notes
  • Unity 2D Sprite Tilemap

    akiojin/unity-cli

    Build and verify a 2D sprite and Tilemap scene with unity-cli.

    107 GitHub stars~1.6k tokensUpdated 4 days ago
    Auto-check passed
  • Unity Addressables

    akiojin/unity-cli

    Manage Unity Addressables groups and content with unity-cli.

    107 GitHub stars~700 tokensUpdated 4 days ago
    Auto-check passed
  • Unity Asset Management

    akiojin/unity-cli

    Manage Unity assets and import metadata with unity-cli. An agent skill from akiojin/unity-cli.

    107 GitHub stars~1.8k tokensUpdated 4 days ago
    Auto-check passed
  • Unity Audio Setup

    akiojin/unity-cli

    Configure Unity audio with unity-cli. An agent skill from akiojin/unity-cli.

    107 GitHub stars~1.4k tokensUpdated 4 days ago
    Auto-check passed

Questions about Unity UI Automation

What does Unity UI Automation do?

Automate Unity UI inspection and interaction with unity-cli. Unity UI Automation is an agent skill from akiojin/unity-cli. Automate Unity UI inspection and interaction with unity-cli.

When should I use Unity UI Automation?

Unity UI Automation fits situations like: the user asks to find a UI element by name; click a UI element; run a short UI interaction sequence during testing; scene authoring.

How do I install Unity UI Automation in Claude Code?

Run `npx skills add akiojin/unity-cli --skill unity-ui-automation -a claude-code`. Or copy the skill folder (.claude-plugin/plugins/unity-cli/skills/unity-ui-automation in akiojin/unity-cli) into .claude/skills/unity-ui-automation in your project. Claude Code loads it when a task matches its description.

How do I install Unity UI Automation in Codex?

Run `npx skills add akiojin/unity-cli --skill unity-ui-automation -a codex`. Or copy the skill folder (.claude-plugin/plugins/unity-cli/skills/unity-ui-automation in akiojin/unity-cli) into .agents/skills/unity-ui-automation in your project. Codex loads it when a task matches its description.

Can I use Unity UI Automation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add akiojin/unity-cli --skill unity-ui-automation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/unity-ui-automation, .gemini/skills/unity-ui-automation, .github/skills/unity-ui-automation and .opencode/skills/unity-ui-automation in your project.

What does Unity UI Automation need to run?

SKILL.md names no scripts, command-line tools or credentials: Unity UI Automation is instructions for the agent only. Its frontmatter pre-approves these tools: Bash(unity-cli:*), Read, Grep, Glob.

Does Unity UI Automation access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Unity UI Automation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Unity UI Automation use?

Unity UI Automation is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Unity UI Automation use?

About 735 tokens (SKILL.md is roughly 2.9k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 434 tokens, read only when the agent opens those files.

What are the alternatives to Unity UI Automation?

Skills that share tags, products or a category with Unity UI Automation: Image to Three.js Model (img2threejs/img2threejs, 18k stars), Web Clone (Jane-xiaoer/claude-skill-web-clone, 1k stars), Threejs Game Director (majidmanzarpour/threejs-game-skills, 2.5k stars) and Game Asset Generator (htdt/godogen, 7.1k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Unity UI Automation?

akiojin (a GitHub user) maintains it in akiojin/unity-cli, which has 107 GitHub stars. The repository holds 28 skills in this directory. The repository was last updated on October 5, 2026.

Source: akiojin/unity-cli on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.