Agent skill

Hand Tracking Toolkit

by wu-yc in wu-yc/LabClaw

Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking.

Apache-2.0Auto-check passedData & Analytics

Install Hand Tracking Toolkit

skills CLI
$ npx skills add wu-yc/LabClaw --skill hand-tracking-toolkit -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install wu-yc/LabClaw hand-tracking-toolkit --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/wu-yc/LabClaw.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/vision/hand-tracking-toolkit .claude/skills/hand-tracking-toolkit && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
hand-tracking-toolkit
GitHub stars
1.1k
Used in
1 other repo
Token cost
~1.3k tokens
SKILL.md length
304 words
Files
1
Skills in repo
68
Repo updated
First seen
Licence
Apache-2.0

At a glance

Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking.

  • Works in 3 steps: Standard Metrics → Visualization Tools → Data Loaders
  • Data & Analytics work in your project
  • SKILL.md covers Overview, When to Use This Skill, Core Capabilities and Quick Start, plus 8 more sections
  • Calls python, git and pip; reaches github.com

What it does

Hand Tracking Toolkit is an agent skill from wu-yc/LabClaw. Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking. Supports loading HOT3D data, computing metrics (PA-MPJPE, AUC, etc.), visualizing 3D pose projections, and generating tracking evaluation reports. Essential for benchmarking hand tracking algorithms.

Its SKILL.md is about 1.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Data & Analytics. The repository describes itself as: LabClaw – Operating Layer for LabOS (Stanford-Princeton AI Co-Scientists). The licence is Apache-2.0.

When your agent uses it

  • Data & Analytics work in your project

Example prompts

  • “/hand-tracking-toolkit”

Requirements

  • Python 3

Workflow steps

3 steps, taken from the step headings in SKILL.md.

  1. Standard Metrics
  2. Visualization Tools
  3. Data Loaders

What it can do on your machine

Read from SKILL.md and the folder at commit df37802. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • python
    • git
    • pip

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Hosts in commands or code, which the agent is likely to contact:

    • github.com

    Also links to:

    • facebookresearch.github.io
    • eval.ai

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Hand Tracking Toolkit loads about 1.3k tokens when it runs. Until then it costs about 83 tokens; SKILL.md has 304 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~83
When it runs · the whole SKILL.md, loaded when a task matches
~1.3k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from wu-yc/LabClaw at commit df37802, republished under its Apache-2.0 licence (© wu-yc). 304 words, ~1,333 tokens.

Download SKILL.mdSave it as .claude/skills/hand-tracking-toolkit/SKILL.md (or your agent's skills folder).
name
hand-tracking-toolkit
description
Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking. Supports loading HOT3D data, computing metrics (PA-MPJPE, AUC, etc.), visualizing 3D pose projections, and generating tracking evaluation reports. Essential for benchmarking hand tracking algorithms.
license
Apache 2.0
metadata.skill-author
K-Dense Inc.
metadata.original-repo
https://github.com/facebookresearch/hand_tracking_toolkit
metadata.organization
Meta Facebook Research
metadata.skill-category
Computer Vision / Evaluation
metadata.tags
hand-tracking, evaluation, metrics, visualization, benchmarking, hot3d

Hand Tracking Toolkit - Evaluation & Visualization

Overview

Comprehensive toolkit from Meta Facebook Research for evaluating and visualizing 3D hand tracking systems. Provides standardized metrics, visualization tools, and data loaders for the HOT3D dataset. Essential for researchers developing and benchmarking hand tracking algorithms on multi-view egocentric data.

Use this for: Evaluating hand tracking performance, generating evaluation reports, visualizing 3D predictions vs ground truth.

When to Use This Skill

Use when you need to:

  • Evaluate hand tracking algorithms with standard metrics
  • Visualize 3D hand pose predictions and ground truth
  • Benchmark on HOT3D dataset
  • Generate evaluation reports and leaderboards
  • Compare different tracking methods
  • Debug hand tracking predictions

Core Capabilities

1. Standard Metrics

Compute widely-used hand tracking metrics:

  • PA-MPJPE: Per-vertex Mean Per Joint Position Error (aligned)
  • MPJPE: Mean Per Joint Position Error
  • AUC: Area Under Curve for error thresholds
  • PCK: Percentage of Correct Keypoints
  • Mesh error: Surface-to-surface distance
2. Visualization Tools

Rich visualization options:

  • 3D skeleton plots
  • Multi-view projections
  • Error heatmaps
  • Trajectory visualizations
  • Side-by-side comparisons
3. Data Loaders

Easy data loading:

  • HOT3D dataset sequences
  • Ground truth annotations
  • Prediction format standardization
  • Batch processing support

Quick Start

bash
# Clone repository
git clone https://github.com/facebookresearch/hand_tracking_toolkit.git
cd hand_tracking_toolkit

# Install
pip install -r requirements.txt

# Run evaluation
python evaluate.py \
    --predictions path/to/predictions.pkl \
    --ground_truth path/to/hot3d/sequence \
    --output_dir ./results

# Generate visualizations
python visualize.py \
    --predictions path/to/predictions.pkl \
    --ground_truth path/to/hot3d/sequence \
    --output visualizations.png

Usage Examples

Example 1: Evaluate Predictions
python
from toolkit import Evaluator
import pickle

# Load predictions
with open('predictions.pkl', 'rb') as f:
    predictions = pickle.load(f)

# Load ground truth
evaluator = Evaluator()
evaluator.load_ground_truth('path/to/hot3d_sequence')

# Compute metrics
metrics = evaluator.evaluate(predictions)

print(f"PA-MPJPE: {metrics['pa_mpjpe']:.2f} mm")
print(f"AUC: {metrics['auc']:.3f}")
print(f"PCK@0.1: {metrics['pck_01']*100:.1f}%")
Example 2: Visualize Results
python
from toolkit import Visualizer

viz = Visualizer()

# Load data
viz.load_predictions('predictions.pkl')
viz.load_ground_truth('ground_truth_path')

# Create visualization
fig = viz.plot_3d_skeleton(
    frame_id=100,
    show_pred=True,
    show_gt=True,
    show_errors=True
)

fig.savefig('comparison_3d.png')
Example 3: Generate Report
python
from toolkit import ReportGenerator

report = ReportGenerator()
report.load_evaluation_results('results.json')

# Generate PDF report
report.generate_pdf(
    output_path='evaluation_report.pdf',
    include_plots=True,
    include_per_joint_errors=True
)

Supported Formats

Prediction format:

python
predictions = {
    'sequence_id': 'seq001',
    'frames': [
        {
            'frame_id': 0,
            'left_hand': np.array((21, 3)),  # 21 joints x 3 coords
            'right_hand': np.array((21, 3)),
            'confidence': np.array(21),
        },
        # ... more frames
    ]
}

Metrics Reference

MetricDescriptionLower is Better
MPJPEMean per-joint position error (mm)✓
PA-MPJPEAligned MPJPE (procrustes)✓
AUCArea under error threshold curve✗
PCK% keypoints within threshold✗

Integration

Works with:

  • hot3d: Primary dataset
  • Custom trackers: Convert predictions to supported format
  • Visualization tools: Matplotlib, Plotly, Open3D

Best Practices

  1. Standardize predictions to required format
  2. Use multiple metrics for comprehensive evaluation
  3. Visualize errors to understand failure modes
  4. Report per-joint errors for detailed analysis
  5. Cross-validate on multiple sequences

Requirements

  • Python 3.8+
  • NumPy, SciPy
  • Matplotlib (for plotting)
  • Open3D (for 3D visualization)
  • PyTorch (optional, for loading models)

References

License

Apache 2.0

© wu-yc, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/vision/hand-tracking-toolkit of wu-yc/LabClaw.

Open the folder on GitHubat commit df37802

Used in 1 other repository

We found 1 copy of this SKILL.md (exact, near-identical or edited) in other folders, from 1 other GitHub owner. This page covers the copy in wu-yc/LabClaw, which our catalogue first saw on October 7, 2026.

Compare with similar skills

Hand Tracking Toolkit next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Hand Tracking Toolkit compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Hand Tracking Toolkit this skillwu-yc/LabClaw1.1k1 repos~1.3kAutomated safety check: PassApache-2.0
MatplotlibzLanqing/codex-claude-academic-skills4.7k17 repos~2.9kAutomated safety check: PassMIT
Exploratory Data Analysisspacering-net/codeg3.9k14 repos~3.6kAutomated safety check: PassMIT
Scikit LearnzLanqing/codex-claude-academic-skills4.7k16 repos~3.9kAutomated safety check: PassBSD-3-Clause
Chart Visualizationbytedance/deer-flow84k1 repos~840Automated safety check: PassMIT
TimesFM Forecastinggoogle-research/timesfm34k—~4.7kAutomated safety check: PassApache-2.0

Similar skills

  • Matplotlib

    zLanqing/codex-claude-academic-skills

    Low-level plotting library for full customization. An agent skill from zLanqing/codex-claude-academic-skills.

    4.7k GitHub starsUsed in 17 repos~2.9k tokens
    Data & AnalyticsAuto-check passed
  • Exploratory Data Analysis

    spacering-net/codeg

    Perform comprehensive exploratory data analysis on scientific data files across 200+ file formats.

    3.9k GitHub starsUsed in 14 repos~3.6k tokens
    Data & AnalyticsAuto-check passed
  • Scikit Learn

    zLanqing/codex-claude-academic-skills

    Machine learning in Python with scikit-learn. An agent skill from zLanqing/codex-claude-academic-skills.

    4.7k GitHub starsUsed in 16 repos~3.9k tokens
    Data & AnalyticsAuto-check passed
  • Chart Visualization

    bytedance/deer-flow

    Picks a suitable chart type from 26 options for your data, maps the data to that chart's parameters and generates a chart image through a JavaScript script.

    84k GitHub starsUsed in 1 repo~840 tokens
    Data & AnalyticsAuto-check passed
  • TimesFM Forecasting

    google-research/timesfm

    Forecasts any univariate time series zero-shot with Google's TimesFM model, returning point forecasts and calibrated prediction intervals without training.

    34k GitHub stars~4.7k tokensUpdated 10 days ago
    Data & AnalyticsAuto-check passed
  • Sandbox Bench

    vercel/next.js

    Official

    Benchmark React or Next.js changes on Vercel Sandbox VMs with paired A/B statistics: react PR/commit vs base, or Next.js PR/commit vs base, measured end-to-end through the bench/render-pipeline app…

    143k GitHub stars~4.1k tokensUpdated today
    Data & AnalyticsAuto-check passed

More from wu-yc/LabClaw

All 68 skills in this repo
  • Retrieves chemical compound information from PubChem and ChEMBL with disambiguation, cross-referencing, and quality assessment.

    1.1k GitHub starsUsed in 2 repos~2.3k tokens
    Auto-check passed
  • Search and retrieve clinical practice guidelines across 12+ authoritative sources including NICE, WHO, ADA, AHA/ACC, NCCN, SIGN, CPIC, CMA, CTFPHC, GIN, MAGICapp, PubMed, EuropePMC, TRIP, and…

    1.1k GitHub starsUsed in 2 repos~4.9k tokens
    Auto-check passed
  • Generate comprehensive disease research reports using 100+ ToolUniverse tools.

    1.1k GitHub starsUsed in 2 repos~4.7k tokens
    Auto-check passed
  • Identify drug repurposing candidates using ToolUniverse for target-based, compound-based, and disease-driven strategies.

    1.1k GitHub starsUsed in 2 repos~4.4k tokens
    Auto-check passed
  • Retrieves gene expression and omics datasets from ArrayExpress and BioStudies with gene disambiguation, experiment quality assessment, and structured reports.

    1.1k GitHub starsUsed in 2 repos~2.6k tokens
    Auto-check passed
  • Perform comprehensive gene enrichment and pathway analysis using gseapy (ORA and GSEA), PANTHER, STRING, Reactome, and 40+ ToolUniverse tools.

    1.1k GitHub starsUsed in 2 repos~4k tokens
    Auto-check passed

Questions about Hand Tracking Toolkit

What does Hand Tracking Toolkit do?

Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking. Hand Tracking Toolkit is an agent skill from wu-yc/LabClaw. Facebook Research Hand Tracking Challenge Toolkit - evaluation and visualization tools for 3D hand tracking.

When should I use Hand Tracking Toolkit?

Hand Tracking Toolkit fits situations like: data & Analytics work in your project.

How do I install Hand Tracking Toolkit in Claude Code?

Run `npx skills add wu-yc/LabClaw --skill hand-tracking-toolkit -a claude-code`. Or copy the skill folder (skills/vision/hand-tracking-toolkit in wu-yc/LabClaw) into .claude/skills/hand-tracking-toolkit in your project. Claude Code loads it when a task matches its description.

How do I install Hand Tracking Toolkit in Codex?

Run `npx skills add wu-yc/LabClaw --skill hand-tracking-toolkit -a codex`. Or copy the skill folder (skills/vision/hand-tracking-toolkit in wu-yc/LabClaw) into .agents/skills/hand-tracking-toolkit in your project. Codex loads it when a task matches its description.

Can I use Hand Tracking Toolkit in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add wu-yc/LabClaw --skill hand-tracking-toolkit -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/hand-tracking-toolkit, .gemini/skills/hand-tracking-toolkit, .github/skills/hand-tracking-toolkit and .opencode/skills/hand-tracking-toolkit in your project.

What does Hand Tracking Toolkit need to run?

Going by SKILL.md and its folder, Hand Tracking Toolkit needs the command-line tools its instructions call (python, git and pip). Our summary lists: Python 3.

Does Hand Tracking Toolkit access the network?

SKILL.md names 3 domains. In commands or code: github.com; the agent is likely to contact it when it follows the instructions. As links in the text: facebookresearch.github.io and eval.ai. This is read from the text; nothing was executed.

Is Hand Tracking Toolkit safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Hand Tracking Toolkit use?

Hand Tracking Toolkit is published under the Apache-2.0 licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Hand Tracking Toolkit use?

About 1.3k tokens (SKILL.md is roughly 5.3k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Hand Tracking Toolkit?

Skills that share tags, products or a category with Hand Tracking Toolkit: Matplotlib (zLanqing/codex-claude-academic-skills, 4.7k stars), Exploratory Data Analysis (spacering-net/codeg, 3.9k stars), Scikit Learn (zLanqing/codex-claude-academic-skills, 4.7k stars) and Chart Visualization (bytedance/deer-flow, 84k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Hand Tracking Toolkit?

wu-yc (a GitHub user) maintains it in wu-yc/LabClaw, which has 1,055 GitHub stars. The repository holds 68 skills in this directory. The repository was last updated on March 19, 2026.

Source: wu-yc/LabClaw on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.