Agent skill

Computer Automation

by qualcomm in qualcomm/qai-appbuilder

A skill your agent uses when working with the computer tool — driving the Windows desktop, clicking or dragging anything on screen, opening or focusing an app, or locating a UI element — and…

Custom licenceAuto-check passed

Install Computer Automation

skills CLI
$ npx skills add qualcomm/qai-appbuilder --skill computer-automation -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install qualcomm/qai-appbuilder computer-automation --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/qualcomm/qai-appbuilder.git skills-src && mkdir -p .claude/skills && cp -r skills-src/tools/qaiappbuilder/skills/computer-automation .claude/skills/computer-automation && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
computer-automation
GitHub stars
246
Token cost
~2.1k tokens
SKILL.md length
1,113 words
Files
1
Skills in repo
13
Repo updated
First seen
Licence
Custom licence

At a glance

A skill your agent uses when working with the computer tool — driving the Windows desktop, clicking or dragging anything on screen, opening or focusing an app, or locating a UI element — and…

  • Working with the computer tool — driving the Windows desktop
  • SKILL.md covers When to Use, Targeting: Use the Strongest…, Not Every Control Appears in… and Sending Input Without…, plus 4 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md
  • Dragging anything on screen

What it does

Computer Automation is an agent skill from qualcomm/qai-appbuilder. Use when working with the computer tool — driving the Windows desktop, clicking or dragging anything on screen, opening or focusing an app, or locating a UI element — and especially when a computer action did not do what was expected — a click or drag missed a target that looked right, a drag turned into a selection box, typing went to the wrong place, a shortcut had no effect, or the target cannot be pinpointed from the screenshot.

Its SKILL.md is about 2.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

The repository describes itself as: QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified…

When your agent uses it

  • Working with the computer tool — driving the Windows desktop
  • Dragging anything on screen
  • Focusing an app
  • Locating a UI element — and especially when a computer action did not do what was expected — a click

Example prompts

  • “/computer-automation”

What it can do on your machine

Read from SKILL.md and the folder at commit 700121f. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Computer Automation loads about 2.1k tokens when it runs. Until then it costs about 115 tokens; SKILL.md has 1,113 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~115
When it runs · the whole SKILL.md, loaded when a task matches
~2.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,113 words (~2,119 tokens).

“Companion reference for the computer tool. The tool does the acting (screenshot, ui_snapshot, click, drag, type, keypress); this skill covers what the tool cannot tell you by itself — which targeting mechanism to reach for, and what to do when…”

— opening of SKILL.md by qualcomm, Custom licence
name
computer-automation
tags
computer, computer-tool, desktop, automation, windows, coordinates, click, drag, taskbar, ui_snapshot, refs, background-delivery
use_for
Companion reference for the `computer` tool — locating a UI element precisely with ui_snapshot refs, clicking/dragging on the Windows desktop or inside an app…

Read the full SKILL.md on GitHub

Files

Just SKILL.md in tools/qaiappbuilder/skills/computer-automation of qualcomm/qai-appbuilder.

Open the folder on GitHubat commit 700121f

Compare with similar skills

Computer Automation next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Computer Automation compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Computer Automation this skillqualcomm/qai-appbuilder246—~2.1kAutomated safety check: PassCustom licence
Ito Computeaffaan-m/ECC275k1 repos~1.7kAutomated safety check: PassMIT
Windows Desktop E2Eaffaan-m/ECC275k1 repos~7.6kAutomated safety check: PassMIT
Windows Desktop E2Eaffaan-m/ECC275k—~5.5kAutomated safety check: PassMIT
Senior Computer Visiondavila7/claude-code-templates32k3 repos~1.4kAutomated safety check: PassMIT
Senior Computer Visionalirezarezvani/claude-skills28k2 repos~3.2kAutomated safety check: PassMIT

Similar skills

  • Ito Compute

    affaan-m/ECC

    Query live GPU inventory, submit an authenticated Itô fixed-rate RFQ, inspect RFQ or procurement status, revoke device credentials, and run explicitly gated node qualification through the separately…

    275k GitHub starsUsed in 1 repo~1.7k tokens
    Business, Finance & HRAuto-check passed
  • E2E testing for Windows native desktop apps (WPF, WinForms, Win32/MFC, Qt) using pywinauto and Windows UI Automation.

    275k GitHub starsUsed in 1 repo~7.6k tokens
    Testing & QAAuto-check passed
  • E2E testing for Windows native desktop apps (WPF, WinForms, Win32/MFC, Qt) using pywinauto and Windows UI Automation.

    275k GitHub stars~5.5k tokensUpdated 3 days ago
    Testing & QAAuto-check passed
  • Senior Computer Vision

    davila7/claude-code-templates

    World-class computer vision skill for image/video processing, object detection, segmentation, and visual AI systems.

    32k GitHub starsUsed in 3 repos~1.4k tokens
    AI & LLM EngineeringAuto-check passed
  • Senior Computer Vision

    alirezarezvani/claude-skills

    Computer vision engineering skill for object detection, image segmentation, and visual AI systems.

    28k GitHub starsUsed in 2 repos~3.2k tokens
    AI & LLM EngineeringAuto-check passed
  • Codewhale Computer Use Controller

    codewhale-hq/Codewhale

    Operates desktop apps and isolated or disposable browsers on registered computers through an observe, act, verify loop, separate from driving the user's own signed-in Chrome.

    41k GitHub stars~1.4k tokensUpdated today
    Productivity & AutomationAuto-check passed

More from qualcomm/qai-appbuilder

All 13 skills in this repo
  • Model Hub

    qualcomm/qai-appbuilder

    Model Hub — download pre-exported models from Qualcomm AI Hub, run inference on-device, and export them to App Builder as ready-to-import Packs.

    246 GitHub stars~3.3k tokensUpdated today
    Auto-check passed
  • Aipc Toolkit

    qualcomm/qai-appbuilder

    AIPC, AI Porting Conversion. An agent skill from qualcomm/qai-appbuilder.

    246 GitHub stars~5.7k tokensUpdated today
    Auto-check: notes
  • Model Builder

    qualcomm/qai-appbuilder

    QAI ModelBuilder. An agent skill from qualcomm/qai-appbuilder.

    246 GitHub stars~4.1k tokensUpdated today
    Auto-check passed
  • App Builder

    qualcomm/qai-appbuilder

    App Builder — generate complete, runnable fullstack WebUI applications (FastAPI backend + pure HTML/CSS/JS frontend) around on-device AI Model Packs (OCR, TTS, ASR, Super-Resolution, etc.).

    246 GitHub stars~2.6k tokensUpdated today
    Auto-check passed
  • Ppt Gen

    qualcomm/qai-appbuilder

    Generate fully editable, high-quality PPTX with python-pptx based on the user's topic, materials, or business goals; defaults to a general-purpose "dark gilded elegant" visual system, with adaptive…

    246 GitHub stars~2k tokensUpdated today
    Auto-check passed
  • Read Arxiv Paper

    qualcomm/qai-appbuilder

    Fetch and summarize academic papers from arxiv.org. An agent skill from qualcomm/qai-appbuilder.

    246 GitHub stars~308 tokensUpdated today
    Auto-check passed

Questions about Computer Automation

What does Computer Automation do?

A skill your agent uses when working with the computer tool — driving the Windows desktop, clicking or dragging anything on screen, opening or focusing an app, or locating a UI element — and…. Computer Automation is an agent skill from qualcomm/qai-appbuilder. Use when working with the computer tool — driving the Windows desktop, clicking or dragging anything on screen, opening or focusing an app, or locating a UI element — and especially when a computer action did not do what was expected — a click or drag missed a target that looked right, a drag turned into a selection box, typing went to the wrong place, a shortcut had no effect, or the target cannot be pinpointed from the screenshot.

When should I use Computer Automation?

Computer Automation fits situations like: working with the computer tool — driving the Windows desktop; dragging anything on screen; focusing an app; locating a UI element — and especially when a computer action did not do what was expected — a click.

How do I install Computer Automation in Claude Code?

Run `npx skills add qualcomm/qai-appbuilder --skill computer-automation -a claude-code`. Or copy the skill folder (tools/qaiappbuilder/skills/computer-automation in qualcomm/qai-appbuilder) into .claude/skills/computer-automation in your project. Claude Code loads it when a task matches its description.

How do I install Computer Automation in Codex?

Run `npx skills add qualcomm/qai-appbuilder --skill computer-automation -a codex`. Or copy the skill folder (tools/qaiappbuilder/skills/computer-automation in qualcomm/qai-appbuilder) into .agents/skills/computer-automation in your project. Codex loads it when a task matches its description.

Can I use Computer Automation in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add qualcomm/qai-appbuilder --skill computer-automation -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/computer-automation, .gemini/skills/computer-automation, .github/skills/computer-automation and .opencode/skills/computer-automation in your project.

What does Computer Automation need to run?

SKILL.md names no scripts, command-line tools or credentials: Computer Automation is instructions for the agent only.

Does Computer Automation access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Computer Automation safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Computer Automation use?

Computer Automation has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Computer Automation use?

About 2.1k tokens (SKILL.md is roughly 8.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Computer Automation?

Skills that share tags, products or a category with Computer Automation: Ito Compute (affaan-m/ECC, 275k stars), Windows Desktop E2E (affaan-m/ECC, 275k stars), Windows Desktop E2E (affaan-m/ECC, 275k stars) and Senior Computer Vision (davila7/claude-code-templates, 32k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Computer Automation?

qualcomm (a GitHub organization) maintains it in qualcomm/qai-appbuilder, which has 246 GitHub stars. The repository holds 13 skills in this directory. The repository was last updated on October 8, 2026.

Source: qualcomm/qai-appbuilder on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.