Agent skill

Sharpa Datagen

by nvidia-isaac in nvidia-isaac/video_to_data

Guide for generating robot-behaviour datasets from trained Sharpa (floating-hand) V2D policies — rolling out checkpoints in Isaac Lab with cameras and exporting to LeRobot.

Custom licenceAuto-check passed

Install Sharpa Datagen

skills CLI
$ npx skills add nvidia-isaac/video_to_data --skill sharpa-datagen -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install nvidia-isaac/video_to_data sharpa-datagen --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/nvidia-isaac/video_to_data.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/sharpa-datagen .claude/skills/sharpa-datagen && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
sharpa-datagen
GitHub stars
850
Token cost
~4.1k tokens
SKILL.md length
1,766 words
Files
1
Skills in repo
13
Repo updated
First seen
Licence
Custom licence

At a glance

Guide for generating robot-behaviour datasets from trained Sharpa (floating-hand) V2D policies — rolling out checkpoints in Isaac Lab with cameras and exporting to LeRobot.

  • Works in 11 steps: TL;DR happy path (one sequence) → Prerequisites (check FIRST) → Data requirements per record run (the #1… → …
  • The user wants to generate/record a dataset from a trained policy
  • SKILL.md covers 0. TL;DR happy path (one…, 1. Prerequisites (check FIRST), 2. Data requirements per… and 3. Running a record…, plus 10 more sections
  • Calls docker and python; needs CSS_ACCESS_KEY and CSS_SECRET_KEY

What it does

Sharpa Datagen is an agent skill from nvidia-isaac/video_to_data. Guide for generating robot-behaviour datasets from trained Sharpa (floating-hand) V2D policies — rolling out checkpoints in Isaac Lab with cameras and exporting to LeRobot. Use this skill whenever the user wants to generate/record a dataset from a trained policy, run recorddataset.py / the Sharpa-V2D-Record-v0 task, batch-generate data across a dataset's checkpoints, visualize recorded rollouts, pull retargeted motion + support surfaces from CSS for a record run, or debug why recorded episodes fail (objects…

Its SKILL.md is about 4.1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

The repository describes itself as: Nvidia Isaac Video to Data Pipeline.

When your agent uses it

  • The user wants to generate/record a dataset from a trained policy
  • Run recorddataset.py / the Sharpa-V2D-Record-v0 task
  • Batch-generate data across a datasets checkpoints
  • Visualize recorded rollouts

Example prompts

  • “data generation”
  • “datagen”
  • “record rollouts”
  • “/sharpa-datagen”

Requirements

  • Python 3
  • Docker
  • A credential in CSS_ACCESS_KEY
  • A credential in CSS_SECRET_KEY

Workflow steps

11 steps, taken from the step headings in SKILL.md.

  1. TL;DR happy path (one sequence)
  2. Prerequisites (check FIRST)
  3. Data requirements per record run (the #1 failure class)
  4. Running a record (record_dataset.py)
  5. VOC (virtual object control) semantics — READ THIS
  6. Replay mode (validate trajectories without a policy)
  7. Metrics + the success-flag caveat
  8. Batch generation
  9. Visualization
  10. Operational gotchas
  11. Troubleshooting (symptom → cause)

What it can do on your machine

Read from SKILL.md and the folder at commit 12c36fb. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • docker
    • python

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use docker, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • CSS_ACCESS_KEY
    • CSS_SECRET_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Sharpa Datagen loads about 4.1k tokens when it runs. Until then it costs about 193 tokens; SKILL.md has 1,766 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~193
When it runs · the whole SKILL.md, loaded when a task matches
~4.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,766 words (~4,085 tokens).

“Roll out a trained per-sequence Sharpa policy in Isaac Lab, record camera + state/action observations, and export a LeRobot v3 dataset. All work runs inside the container, from /workspace/video_to_data/robotic_grounding.”

— opening of SKILL.md by nvidia-isaac, Custom licence
name
sharpa-datagen

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .claude/skills/sharpa-datagen of nvidia-isaac/video_to_data.

Open the folder on GitHubat commit 12c36fb

Compare with similar skills

Sharpa Datagen next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Sharpa Datagen compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Sharpa Datagen this skillnvidia-isaac/video_to_data850—~4.1kAutomated safety check: PassCustom licence
Dummy Dataset Generatorphuryn/pm-skills27k—~983Automated safety check: PassMIT
Fal Trainnexu-io/open-design100k—~293Automated safety check: PassApache-2.0
Generatealirezarezvani/claude-skills28k1 repos~1.1kAutomated safety check: PassMIT
Fal Generatenexu-io/open-design100k—~306Automated safety check: PassApache-2.0
Video Generationbytedance/deer-flow83k4 repos~1.4kAutomated safety check: PassMIT

Similar skills

  • Dummy Dataset Generator

    phuryn/pm-skills

    Generates realistic test datasets with custom columns, row counts and business constraints, output as CSV, JSON, SQL inserts or a runnable Python script.

    27k GitHub stars~983 tokensUpdated 24 days ago
    Testing & QAAuto-check passed
  • Fal Train

    nexu-io/open-design

    Train custom AI models (LoRA) on fal.ai for personalized image generation tailored to a brand, character, or style.

    100k GitHub stars~293 tokensUpdated today
    AI & LLM EngineeringAuto-check passed
  • Generate

    alirezarezvani/claude-skills

    Generate Playwright tests. An agent skill from alirezarezvani/claude-skills.

    28k GitHub starsUsed in 1 repo~1.1k tokens
    Testing & QAAuto-check passed
  • Fal Generate

    nexu-io/open-design

    Generate images and videos using fal.ai AI models. An agent skill from nexu-io/open-design.

    100k GitHub stars~306 tokensUpdated today
    Media & CreativeAuto-check passed
  • Video Generation

    bytedance/deer-flow

    Generates short videos from a structured JSON prompt, optionally guided by a reference image used as the first or last frame.

    83k GitHub starsUsed in 4 repos~1.4k tokens
    Media & CreativeAuto-check passed
  • Robot Framework Skill

    sickn33/agentic-awesome-skills

    Generates Robot Framework tests in keyword-driven syntax with Python.

    47k GitHub starsUsed in 1 repo~1.4k tokens
    Testing & QAAuto-check passed

More from nvidia-isaac/video_to_data

All 13 skills in this repo
  • Hoi Object Reconstruction Setup

    nvidia-isaac/video_to_data

    Prepare this repository's HOI object reconstruction environment for BundleSDF or SAM3D.

    850 GitHub stars~1.4k tokensUpdated today
    Auto-check passed
  • Run Mv Hoi Reconstruction

    nvidia-isaac/video_to_data

    Run and validate the repository-local multi-view camera calibration and human-object reconstruction pipelines.

    850 GitHub stars~1.5k tokensUpdated today
    Auto-check passed
  • Ego Reconstruction Setup

    nvidia-isaac/video_to_data

    Prepare the repository-local egocentric reconstruction pipeline for Codex-driven work.

    850 GitHub stars~826 tokensUpdated today
    Auto-check passed
  • Groot Finetune

    nvidia-isaac/video_to_data

    Run and extend embodiment-aware GR00T N1.7 post-training workflows from successful robot-policy collection through semantic recording, LeRobot conversion, statistics, fine-tuning, open-loop…

    850 GitHub stars~2.6k tokensUpdated today
    Auto-check passed
  • Run Ego Reconstruction Video

    nvidia-isaac/video_to_data

    Run the egocentric reconstruction pipeline on an input video.

    850 GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Hoi Object Reconstruction Doctor

    nvidia-isaac/video_to_data

    Diagnose and repair failures in this repository's BundleSDF or SAM3D HOI object reconstruction workflow.

    850 GitHub stars~1k tokensUpdated today
    Auto-check passed

Questions about Sharpa Datagen

What does Sharpa Datagen do?

Guide for generating robot-behaviour datasets from trained Sharpa (floating-hand) V2D policies — rolling out checkpoints in Isaac Lab with cameras and exporting to LeRobot. Sharpa Datagen is an agent skill from nvidia-isaac/video_to_data. Guide for generating robot-behaviour datasets from trained Sharpa (floating-hand) V2D policies — rolling out checkpoints in Isaac Lab with cameras and exporting to LeRobot.

When should I use Sharpa Datagen?

Sharpa Datagen fits situations like: the user wants to generate/record a dataset from a trained policy; run recorddataset.py / the Sharpa-V2D-Record-v0 task; batch-generate data across a datasets checkpoints; visualize recorded rollouts.

How do I install Sharpa Datagen in Claude Code?

Run `npx skills add nvidia-isaac/video_to_data --skill sharpa-datagen -a claude-code`. Or copy the skill folder (.claude/skills/sharpa-datagen in nvidia-isaac/video_to_data) into .claude/skills/sharpa-datagen in your project. Claude Code loads it when a task matches its description.

How do I install Sharpa Datagen in Codex?

Run `npx skills add nvidia-isaac/video_to_data --skill sharpa-datagen -a codex`. Or copy the skill folder (.claude/skills/sharpa-datagen in nvidia-isaac/video_to_data) into .agents/skills/sharpa-datagen in your project. Codex loads it when a task matches its description.

Can I use Sharpa Datagen in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add nvidia-isaac/video_to_data --skill sharpa-datagen -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/sharpa-datagen, .gemini/skills/sharpa-datagen, .github/skills/sharpa-datagen and .opencode/skills/sharpa-datagen in your project.

What does Sharpa Datagen need to run?

Going by SKILL.md and its folder, Sharpa Datagen needs the command-line tools its instructions call (docker and python) and credentials named CSS_ACCESS_KEY and CSS_SECRET_KEY. Our summary lists: Python 3; Docker; A credential in CSS_ACCESS_KEY; A credential in CSS_SECRET_KEY.

Does Sharpa Datagen access the network?

SKILL.md contains no URLs. Its commands use docker, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Sharpa Datagen safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Sharpa Datagen use?

Sharpa Datagen has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Sharpa Datagen use?

About 4.1k tokens (SKILL.md is roughly 16k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Sharpa Datagen?

Skills that share tags, products or a category with Sharpa Datagen: Dummy Dataset Generator (phuryn/pm-skills, 27k stars), Fal Train (nexu-io/open-design, 100k stars), Generate (alirezarezvani/claude-skills, 28k stars) and Fal Generate (nexu-io/open-design, 100k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Sharpa Datagen?

nvidia-isaac (a GitHub organization) maintains it in nvidia-isaac/video_to_data, which has 850 GitHub stars. The repository holds 13 skills in this directory. The repository was last updated on October 8, 2026.

Source: nvidia-isaac/video_to_data on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.