New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Agent skill

Hz Unity Passthrough Camera Access

by meta-quest in meta-quest/agentic-tools

Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines.

Apache-2.0Auto-check passedGame Development

Install Hz Unity Passthrough Camera Access

skills CLI
$ npx skills add meta-quest/agentic-tools --skill hz-unity-passthrough-camera-access -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install meta-quest/agentic-tools hz-unity-passthrough-camera-access --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/meta-quest/agentic-tools.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/hz-unity-passthrough-camera-access .claude/skills/hz-unity-passthrough-camera-access && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
hz-unity-passthrough-camera-access
GitHub stars
215
Token cost
~1.6k tokens
SKILL.md length
730 words
Files
3 (incl. references)
Skills in repo
34
Repo updated
First seen
Licence
Apache-2.0

At a glance

Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines.

  • Works in 4 steps: Specially-trained ML/CV models that… → ML/CV assistants or guides for… → Feedback for training or… → …
  • Capturing the passthrough camera image/texture
  • SKILL.md covers Use Cases, General Prerequisites, Passthrough Camera Using… and Known Issues, plus 2 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Hz Unity Passthrough Camera Access is an agent skill from meta-quest/agentic-tools. Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines. Use when capturing the passthrough camera image/texture, reading the camera pose and intrinsics, projecting camera pixels into world space via PassthroughCameraAccess.ViewportPointToRay, wiring camera frames into ML/CV models, or reasoning about resolution, permissions, vendor tags, and the pinhole/principal-point model. For projecting the image…

Its SKILL.md is about 1.6k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files, including reference files (for example `references/detection-bounding-boxes.md` and `references/principal-point-offset.md`).

It sits in Game Development, covering Computer vision and Machine learning. It works with Android. The repository describes itself as: Agent Skills for Meta Quest/Horizon OS VR Development. The licence is Apache-2.0.

When your agent uses it

  • Capturing the passthrough camera image/texture
  • Reading the camera pose and intrinsics
  • Projecting camera pixels into world space via PassthroughCameraAccess.ViewportPointToRay
  • Wiring camera frames into ML/CV models

Example prompts

  • “/hz-unity-passthrough-camera-access”

Workflow steps

4 steps, taken from the first numbered list in SKILL.md.

  1. Specially-trained ML/CV models that identify specific objects the
  2. ML/CV assistants or guides for experiences. For instance, a museum tour
  3. Feedback for training or special-interest applications — after asking the
  4. Design improvements. By interpreting the lighting or using the camera image

What it can do on your machine

Read from SKILL.md and the folder at commit 3a8553d. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • developer.android.com
    • developers.meta.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Hz Unity Passthrough Camera Access loads about 1.6k tokens when it runs, and up to ~6.7k if it reads all its reference files. Until then it costs about 227 tokens; SKILL.md has 730 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~227
When it runs · the whole SKILL.md, loaded when a task matches
~1.6k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~6.7k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from meta-quest/agentic-tools at commit 3a8553d, republished under its Apache-2.0 licence (© meta-quest). 730 words, ~1,581 tokens.

Download SKILL.mdSave it as .claude/skills/hz-unity-passthrough-camera-access/SKILL.md (or your agent's skills folder). This skill also uses 2 other files; get the full folder from GitHub.
name
hz-unity-passthrough-camera-access
description
Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines. Use when capturing the passthrough camera image/texture, reading the camera pose and intrinsics, projecting camera pixels into world space via `PassthroughCameraAccess.ViewportPointToRay`, wiring camera frames into ML/CV models, or reasoning about resolution, permissions, vendor tags, and the pinhole/principal-point model. For projecting the image onto a flat world-space surface (frustum-slice quad / image-plane overlay) see references/principal-point-offset.md; for placing 2D ML detections as world-space 3D bounding boxes see references/detection-bounding-boxes.md. Skip if the user only wants to cast the user's POV (use the Media Projection API instead) or is doing screen-space-only overlays.
license
Apache-2.0

Meta Quest Passthrough Camera Access (PCA)

Building on top of the Android Camera2 API, Passthrough Camera Access provides access to the forward-facing RGB cameras on Quest 3 and Quest 3S for the purpose of supporting Computer Vision and Machine Learning. This API is distinct from the Media Projection API, which supports casting from the user's POV (including the UI) and should be used if your purpose is to represent what the user is seeing. Use the Passthrough Camera API to add application-specific computer-vision capabilities that extend the understanding of the user's environment and actions beyond what is provided by the Scene API.

Use Cases

This API provides an unobstructed view using the forward-facing RGB cameras and can be integrated with ML/CV pipelines. Common use cases:

  1. Specially-trained ML/CV models that identify specific objects the application can interact with (e.g. fitness equipment like dumbbells, industrial equipment like audio mixers).
  2. ML/CV assistants or guides for experiences. For instance, a museum tour where looking at a painting surfaces information about its history, artist, and style using off-device LLMs.
  3. Feedback for training or special-interest applications — after asking the user to perform a task, the app can detect whether it was done correctly by interpreting changes to the environment (e.g. writing on a whiteboard).
  4. Design improvements. By interpreting the lighting or using the camera image to modify a texture, much more realistic design effects can be achieved.

General Prerequisites

  1. Horizon OS v74 or later.
  2. Quest 3 or Quest 3S (Quest Pro and earlier are not supported).
  3. Either permission android.permission.CAMERA or horizonos.permission.HEADSET_CAMERA. CAMERA grants access to both the passthrough and avatar cameras; HEADSET_CAMERA grants access only to the passthrough camera.
  4. The Passthrough feature must be enabled to access the Passthrough Camera API.

Passthrough Camera Using Android Camera2

Camera Access on Meta VR devices is implemented on top of Android's Camera2 API within Horizon OS. Starting from Horizon OS v74, Camera2 and its Unity extension are available on Meta VR headsets (Horizon OS v83 added an Unreal extension). On Quest 3 and Quest 3S developers have access to the left and right cameras on the face of the HMD.

The Android Camera2 API provides:

  • Image capture: capture camera data for advanced processing.
  • Camera metadata: query the API for hardware capabilities and configuration information.
  • Multi-camera support: access and control multiple cameras.
Show full SKILL.md (340 more words)Show less

Known Issues

  1. After the first install of an app using the Camera API in v74 after flashing a new OS, the RGB channels might flip causing color distortion (e.g. flesh tones appear bluish). Reboot the device to fix.
  2. Passthrough Camera API is not supported in XR Simulator.
  3. The passthrough camera texture captures a rectangular area (1280×960) smaller than what the user sees. The 1280×1280 resolution added in v83 expands the vertical field of view, but still does not cover the entire passthrough view.
  4. Restrictions applied by a parent to restrict Teen and Youth accounts (e.g. accessing the Passthrough Camera API) are not applied if the application is installed through the Meta Quest Developer Hub.

Best Practices

  1. Ensure user privacy. Camera image data is considered Device User Data and is covered by the Developer Data Use Policy. Adhere to this policy fully.
  2. Avoid costly processing on device. On-device processing of camera images can enable compelling use cases, but keep experiences comfortable by maintaining a high framerate.
  3. Validate the feed on device. After deploying, stream metavr adb logcat --follow --tag Unity while the pipeline runs to confirm frames flow, and check PCA API changes with metavr docs search "passthrough camera access Unity" before integrating — this surface moves fast.

References

Detailed, task-specific guidance for projecting and placing PCA imagery in world space lives under references/:

  • references/principal-point-offset.md — Correctly project the camera image onto a flat world-space surface (frustum-slice quad, FOV visualizer, image-plane overlay) using the optical axis as the plane normal. Read this when corner rays from ViewportPointToRay produce a non-rectangular quad, a camera-aligned quad drifts off-center, or 2 * d * tan(fov / 2) gives the wrong size on a device whose camera principal point is offset even though it worked on Quest 3.
  • references/detection-bounding-boxes.md — Draw precise 3D bounding boxes around real-world objects detected by an ML model. Read this when placing 2D ML detections (YOLO, SSD, DETR, custom CNN) into world space, building a camera-facing billboard quad from a 2D detection, or wiring PassthroughCameraAccess + EnvironmentRaycastManager for object localization.

© meta-quest, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 2 other files (references) in skills/hz-unity-passthrough-camera-access of meta-quest/agentic-tools.

  • SKILL.md
  • references/detection-bounding-boxes.md
  • references/principal-point-offset.md

Open the folder on GitHubat commit 3a8553d

Compare with similar skills

Hz Unity Passthrough Camera Access next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Hz Unity Passthrough Camera Access compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Hz Unity Passthrough Camera Access this skillmeta-quest/agentic-tools215—~1.6kAutomated safety check: PassApache-2.0
ML Cv Specialistalirezarezvani/claude-cto-team117—~3.1kAutomated safety check: PassMIT
RuView Model Trainingruvnet/RuView97k—~1.3kAutomated safety check: NotesMIT
Adapting Transfer Learning Modelsjeremylongshore/tons-of-skills-marketplace2.8k—~1.1kAutomated safety check: PassMIT
Ieee Transactions On Pattern Analysis And Machine Intelligencefranklee16/academic-research-skills2231 repos~2kAutomated safety check: PassNone
Transformers.jshuggingface/skills11k1 repos~6.2kAutomated safety check: PassApache-2.0

Similar skills

  • ML Cv Specialist

    alirezarezvani/claude-cto-team

    Deep expertise in ML/CV model selection, training pipelines, and inference architecture.

    117 GitHub stars~3.1k tokensUpdated 9 mo ago
    AI & LLM EngineeringAuto-check passed

  • RuView Model Training

    ruvnet/RuView

    Trains and evaluates several WiFi-signal-based pose and sensing models, from unsupervised pose estimation to domain adaptation and publishing.

    97k GitHub stars~1.3k tokensUpdated today
    AI & LLM EngineeringAuto-check: notes

  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed

  • Ieee Transactions On Pattern Analysis And Machine Intelligence

    franklee16/academic-research-skills

    A skill your agent uses when targeting IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) or deciding whether a computer vision or machine learning manuscript fits this archival…

    223 GitHub starsUsed in 1 repo~2k tokens
    AI & LLM EngineeringAuto-check passed

  • Transformers.js

    huggingface/skills

    Official

    Runs pre-trained Hugging Face models in JavaScript or TypeScript with Transformers.js, in browsers or Node.js, Bun and Deno, for text, vision, audio and multimodal tasks.

    11k GitHub starsUsed in 1 repo~6.2k tokens
    AI & LLM EngineeringAuto-check passed

  • Vision Sft

    wshobson/agents

    Fine-tune vision-language models (VLMs) with supervised learning on image+text data.

    40k GitHub stars~2k tokensUpdated 5 days ago
    AI & LLM EngineeringAuto-check passed

More from meta-quest/agentic-tools

All 34 skills in this repo

  • Hz Android 2D Porting

    meta-quest/agentic-tools

    Guides porting existing Android 2D apps to Meta VR and Horizon OS — input adaptation, panel layout, and design requirements.

    215 GitHub stars~2.1k tokensUpdated 15 days ago
    Auto-check passed

  • Hz API Upgrade

    meta-quest/agentic-tools

    Upgrades Meta VR apps to newer Horizon OS SDK versions — migration guides, deprecated API replacements, changelog.

    215 GitHub stars~1.8k tokensUpdated 15 days ago
    Auto-check passed

  • Hz Iwsdk Webxr

    meta-quest/agentic-tools

    Builds WebXR experiences for Meta VR and Horizon OS using the Immersive Web SDK (IWSDK) — ECS architecture, Three.js integration, spatial UI.

    215 GitHub stars~3k tokensUpdated 15 days ago
    Auto-check passed

  • Hz Metavrx Layout SDK

    meta-quest/agentic-tools

    Build multi-window Meta Horizon OS experiences with the MetaVrx Layout SDK in Jetpack Compose or React Native.

    215 GitHub stars~855 tokensUpdated 15 days ago
    Auto-check passed

  • Hz New Project Creation

    meta-quest/agentic-tools

    Scaffolds new Meta VR and Horizon OS projects after the build path is selected — Standard Android, Meta Spatial SDK, Unity, Unreal, or WebXR.

    215 GitHub stars~2.3k tokensUpdated 15 days ago
    Auto-check passed

  • Hz Perfetto Debug

    meta-quest/agentic-tools

    Analyzes Meta VR and Horizon OS VR performance using Perfetto traces — frame timing, CPU/GPU bottlenecks, render pass analysis.

    215 GitHub stars~2.8k tokensUpdated 15 days ago
    Auto-check passed

Works with

Categories

Questions about Hz Unity Passthrough Camera Access

What does Hz Unity Passthrough Camera Access do?

Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines. Hz Unity Passthrough Camera Access is an agent skill from meta-quest/agentic-tools. Meta Quest Passthrough Camera Access (PCA) for Unity — access the forward-facing RGB cameras on Quest 3 / Quest 3S to feed Computer Vision and Machine Learning pipelines.

When should I use Hz Unity Passthrough Camera Access?

Hz Unity Passthrough Camera Access fits situations like: capturing the passthrough camera image/texture; reading the camera pose and intrinsics; projecting camera pixels into world space via PassthroughCameraAccess.ViewportPointToRay; wiring camera frames into ML/CV models.

How do I install Hz Unity Passthrough Camera Access in Claude Code?

Run `npx skills add meta-quest/agentic-tools --skill hz-unity-passthrough-camera-access -a claude-code`. Or copy the skill folder (skills/hz-unity-passthrough-camera-access in meta-quest/agentic-tools) into .claude/skills/hz-unity-passthrough-camera-access in your project. Claude Code loads it when a task matches its description.

How do I install Hz Unity Passthrough Camera Access in Codex?

Run `npx skills add meta-quest/agentic-tools --skill hz-unity-passthrough-camera-access -a codex`. Or copy the skill folder (skills/hz-unity-passthrough-camera-access in meta-quest/agentic-tools) into .agents/skills/hz-unity-passthrough-camera-access in your project. Codex loads it when a task matches its description.

Can I use Hz Unity Passthrough Camera Access in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add meta-quest/agentic-tools --skill hz-unity-passthrough-camera-access -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/hz-unity-passthrough-camera-access, .gemini/skills/hz-unity-passthrough-camera-access, .github/skills/hz-unity-passthrough-camera-access and .opencode/skills/hz-unity-passthrough-camera-access in your project.

What does Hz Unity Passthrough Camera Access need to run?

SKILL.md names no scripts, command-line tools or credentials: Hz Unity Passthrough Camera Access is instructions for the agent only.

Does Hz Unity Passthrough Camera Access access the network?

SKILL.md names 2 domains. As links in the text: developer.android.com and developers.meta.com. This is read from the text; nothing was executed.

Is Hz Unity Passthrough Camera Access safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Hz Unity Passthrough Camera Access use?

Hz Unity Passthrough Camera Access is published under the Apache-2.0 licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Hz Unity Passthrough Camera Access use?

About 1.6k tokens (SKILL.md is roughly 6.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 5.1k tokens, read only when the agent opens those files.

What are the alternatives to Hz Unity Passthrough Camera Access?

Skills that share tags, products or a category with Hz Unity Passthrough Camera Access: ML Cv Specialist (alirezarezvani/claude-cto-team, 117 stars), RuView Model Training (ruvnet/RuView, 97k stars), Adapting Transfer Learning Models (jeremylongshore/tons-of-skills-marketplace, 2.8k stars) and Ieee Transactions On Pattern Analysis And Machine Intelligence (franklee16/academic-research-skills, 223 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Hz Unity Passthrough Camera Access?

meta-quest (a GitHub organization) maintains it in meta-quest/agentic-tools, which has 215 GitHub stars. The repository holds 34 skills in this directory. The repository was last updated on September 24, 2026.

Source: meta-quest/agentic-tools on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.