HyperFrames Media Use
heygen-com/hyperframes
Finds, generates and edits media for HyperFrames video projects: music, sound effects, images, icons, logos, voiceovers, captions and color grades.
Watch local TV shows and movies with the user in real time. An agent skill from vellum-ai/vellum-assistant.
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install vellum-ai/vellum-assistant watch-together --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/watch-together .claude/skills/watch-together && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .claude/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-togetherType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install vellum-ai/vellum-assistant watch-together --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/watch-together .agents/skills/watch-together && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .agents/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install vellum-ai/vellum-assistant watch-together --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/watch-together .cursor/skills/watch-together && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .cursor/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/vellum-ai/vellum-assistant.git --path skills/watch-together--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install vellum-ai/vellum-assistant watch-together --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/watch-together .gemini/skills/watch-together && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .gemini/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install vellum-ai/vellum-assistant watch-togetherInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/watch-together .github/skills/watch-together && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .github/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add vellum-ai/vellum-assistant --skill watch-together -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install vellum-ai/vellum-assistant watch-together --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/watch-together .opencode/skills/watch-together && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "watch-together" agent skill from https://github.com/vellum-ai/vellum-assistant/tree/main/skills/watch-together into .opencode/skills/watch-together/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "watch-together", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
watch-togetherWatch local TV shows and movies with the user in real time. An agent skill from vellum-ai/vellum-assistant.
Watch Together is an agent skill from vellum-ai/vellum-assistant. Watch local TV shows and movies with the user in real time. An editor model watches each playback window, transcribes dialogue, and picks story-critical frames. Source mode plays local media in mpv; screen mode captures supported desktops as a fallback.
Its SKILL.md is about 2.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 7 other files, including scripts (for example `scripts/capture-live.sh`, `scripts/capture_live.py` and `scripts/editor.py`).
It sits in Media & Creative, covering Transcription. The repository describes itself as: An AI Assistant that’s easy to setup, does your work 24/7, knows your preferences and gets better over time. The licence is MIT.
4 steps, taken from the first numbered list in SKILL.md.
Read from SKILL.md and the folder at commit 33cc983. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Ships 6 files in scripts/ (Python and Shell), which the agent can run.
Shell commands in SKILL.md call:
python3ffmpegbrewffprobeaptdnfpythonFrom the folder's file list and the shell code blocks in SKILL.md.
No URLs in SKILL.md.
From URLs in SKILL.md, links to its own repository left out.
Names these keys or tokens, usually read from environment variables:
GEMINI_API_KEYFrom names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Watch Together loads about 2.1k tokens when it runs. Until then it costs about 67 tokens; SKILL.md has 829 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check noted patterns worth knowing about, such as sudo or a known installer.
sudo apt install python3 ffmpeg mpvsudo dnf install python3 ffmpeg mpvAutomated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); the scripts in this folder are not scanned.
The full file from vellum-ai/vellum-assistant at commit 33cc983, republished under its MIT licence (© vellum-ai). 829 words, ~2,113 tokens.
.claude/skills/watch-together/SKILL.md (or your agent's skills folder). This skill also uses 6 other files; get the full folder from GitHub.Real-time co-watching. An editor model watches playback continuously and wakes the assistant only at moments worth reacting to. Each wake includes dialogue and story-critical frames. Wakes arrive through signal files, so do not poll.
watch-file.py plays a local media file in mpv and reads that file directly.
It does not capture the screen or require a loopback audio driver. Frames come
from the source at full quality. Sidecar .srt subtitles or the first embedded
text subtitle track provide exact dialogue. Without subtitles, the editor
transcribes audio. Pause stops the flow and seeks resynchronize it.
Use source mode whenever the user has a local media file. The bundled script does not accept stream URLs.
capture_live.py records supported desktops through ffmpeg and feeds completed
segments to the same editor pipeline.
gdigrab. It records video only by default. System
audio requires an existing DirectShow playback source such as Stereo Mix or
a configured virtual audio cable, passed explicitly as the audio device.$DISPLAY. It records video only by default.
System audio requires an existing PulseAudio or PipeWire-Pulse monitor source
passed explicitly. Native Wayland screen capture is not supported by this
script.Screen capture cannot bypass DRM or protected-video blanking. If browser video is black in the recording, explain that screen mode is unsupported for that content. Do not claim the fallback works around content protection.
editor.py reviews each window, selects story-critical frames, collects
dialogue, and decides whether to wake now or hold a developing moment.[WATCH] message to
the active conversation.The editor chooses when the assistant looks and what evidence it receives. The
assistant decides whether to speak and how to react. A hard cap controlled by
WATCH_MAX_HOLD prevents indefinite holds.
[WATCH] message arrivesIf a moment needs closer inspection, extract dense 720p frames from the source named in the wake.
macOS or Linux:
python3 "$VELLUM_WORKSPACE_DIR/watch-together/scripts/rewind.py" \
<source-file> <output-dir> <start-seconds> <end-seconds>The existing rewind.sh command remains a POSIX compatibility wrapper.
Windows PowerShell:
py -3 "$env:VELLUM_WORKSPACE_DIR\watch-together\scripts\rewind.py" `
<source-file> <output-dir> <start-seconds> <end-seconds>If the Python launcher is unavailable but python --version reports Python 3,
replace py -3 with python.
Choose a stable lowercase session ID such as example-show-s1e1. Do not include
personal data in it.
Create the session directory:
SESSION_ID="example-show-s1e1"
mkdir -p "$VELLUM_WORKSPACE_DIR/watch-together/sessions/$SESSION_ID"Source mode:
python3 "$VELLUM_WORKSPACE_DIR/watch-together/scripts/watch-file.py" \
<local-media-file> \
"$VELLUM_WORKSPACE_DIR/watch-together/sessions/$SESSION_ID" \
<conversation-id>Screen mode:
python3 "$VELLUM_WORKSPACE_DIR/watch-together/scripts/capture_live.py" \
"$VELLUM_WORKSPACE_DIR/watch-together/sessions/$SESSION_ID" \
<conversation-id>On macOS, the optional positional arguments are chunk seconds, AVFoundation
screen index, and AVFoundation audio index. The default screen index remains
2, and BlackHole is auto-detected when no audio index is supplied.
On Linux, $DISPLAY is used by default. To add system audio, pass chunk seconds,
the X11 display, and a Pulse monitor source:
python3 "$VELLUM_WORKSPACE_DIR/watch-together/scripts/capture_live.py" \
"$VELLUM_WORKSPACE_DIR/watch-together/sessions/$SESSION_ID" \
<conversation-id> 60 "$DISPLAY" <pulse-monitor-source>Create the session directory:
$SessionId = "example-show-s1e1"
$SessionDir = Join-Path $env:VELLUM_WORKSPACE_DIR "watch-together\sessions\$SessionId"
New-Item -ItemType Directory -Force $SessionDir | Out-NullSource mode:
py -3 "$env:VELLUM_WORKSPACE_DIR\watch-together\scripts\watch-file.py" `
<local-media-file> $SessionDir <conversation-id>Screen mode, video only:
py -3 "$env:VELLUM_WORKSPACE_DIR\watch-together\scripts\capture_live.py" `
$SessionDir <conversation-id>Screen mode with a configured DirectShow playback source:
ffmpeg -list_devices true -f dshow -i dummy
py -3 "$env:VELLUM_WORKSPACE_DIR\watch-together\scripts\capture_live.py" `
$SessionDir <conversation-id> 60 desktop "<DirectShow-audio-device>"Do not describe the optional Windows audio path as automatic loopback. The user must already have a playback capture source exposed through DirectShow.
After giving the matching command, tell the user to start the show. When mpv exits or screen capture stops, the final window is flushed.
The conversation ID is the bare UUID from the conversation database record, not the timestamped conversation folder name. Using the folder name routes the wake incorrectly.
Watching produces many small turns. Recommend normal inference mode and an inference profile with a reduced context ceiling so the conversation compacts regularly. Example:
"llm": {
"profiles": {
"watch-mode": {
"contextWindow": { "maxInputTokens": 200000 }
}
}
}GEMINI_API_KEY: Enables editor verdicts and transcription. Without it,
fixed-cadence wakes use evenly spaced frames and no editor transcription.GEMINI_MODEL: Editor model. Defaults to gemini-3.7-flash.WATCH_MAX_HOLD: Maximum seconds between wakes. Defaults to 240.WATCH_MAX_FRAMES: Maximum frames attached per wake. Defaults to 8.WATCH_MPV_ARGS: Extra mpv arguments for source mode. Quoted arguments use
the current platform's command-line rules.All modes require Python 3 and ffmpeg. Source mode also requires mpv. Confirm
each command is on PATH before starting.
macOS:
brew install ffmpeg mpv
brew install blackhole-2ch # optional screen-mode system audioConfigure a Multi-Output Device in Audio MIDI Setup when using BlackHole.
Windows: Install current Python 3, ffmpeg, and mpv builds, add them to
PATH, then verify:
py -3 --version
ffmpeg -version
ffprobe -version
mpv --versionLinux: Install the distro packages. For Debian or Ubuntu:
sudo apt install python3 ffmpeg mpvFor Fedora:
sudo dnf install python3 ffmpeg mpv$VELLUM_WORKSPACE_DIR/watch-together/scripts/$VELLUM_WORKSPACE_DIR/watch-together/sessions/<session-id>/chunks/: Recorded segments from screen modeeditor/verdicts/: Per-window editor outputwakes/wake-NNN/: Frames attached to each wakeeditor-state.json: Held-window statesubs.srt: Extracted source-mode subtitlesmpv.sock: POSIX source-mode IPC socket; Windows uses a named pipe$VELLUM_WORKSPACE_DIR/signals/user-message.<requestId> with optional image
attachments© vellum-ai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
SKILL.md and 6 other files (scripts) in skills/watch-together of vellum-ai/vellum-assistant.
Open the folder on GitHubat commit 33cc983
Watch Together next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Watch Together this skillvellum-ai/vellum-assistant | 1.4k | — | ~2.1k | Automated safety check: Notes | MIT | |
| HyperFrames Media Useheygen-com/hyperframes | 60k | — | ~2.4k | Automated safety check: Pass | Apache-2.0 | |
| Native Subtitle Quote Imagechengyi-ai/native-subtitle-quote-image | 2.6k | — | ~2.4k | Automated safety check: Pass | MIT | |
| Edu Chem Videowy51ai/edulab | 1.4k | — | ~2.1k | Automated safety check: Notes | Apache-2.0 | |
| Transcription Memory ReconstructionNxcoreAI/EverRoom | 3k | — | ~714 | Automated safety check: Pass | Custom licence | |
| Edu Math Videowy51ai/edulab | 1.4k | — | ~2.5k | Automated safety check: Notes | Apache-2.0 |
heygen-com/hyperframes
Finds, generates and edits media for HyperFrames video projects: music, sound effects, images, icons, logos, voiceovers, captions and color grades.
chengyi-ai/native-subtitle-quote-image
将本地视频或用户有权处理的在线视频,经过来源获取、文字稿定位、选题选句、精确取帧、紧凑裁切、拼图和逐张质检,制作成 3:4 或保留画面原比例的视频字幕长图。支持两种明确分开的输出:保留画面内已烧录字幕的原生字幕模式,以及把已审核的时间点与台词绘制到真实视频帧上的脚本字幕模式。用户要求原生字幕截图、字幕帧拼图、YouTube…
wy51ai/edulab
A skill your agent uses when asked to make an explainer / walkthrough video (讲解视频、解题视频、例题精讲、微课) for a chemistry problem (化学题: 氧化还原配平 双线桥 电子守恒, 物质的量计算, 化学平衡 三段式 平衡常数 转化率 反应速率, 离子反应, 电化学, 溶液 滴定…
NxcoreAI/EverRoom
Reconstruct a complete, searchable memory from an untrusted meeting or conversation transcript.
wy51ai/edulab
A skill your agent uses when asked to make an explainer / walkthrough video (讲解视频、解题视频、例题精讲、微课) for a math problem (数学题, geometry, algebra, functions, motion/行程 problems), from a problem screenshot…
JetBrains/skills
Transcribe audio files to text with optional diarization and known-speaker hints.
vellum-ai/vellum-assistant
Create and configure a GitHub App so the assistant can push commits, open PRs, and comment under its own bot identity.
vellum-ai/vellum-assistant
Connect a Discord bot to the assistant via the Discord Gateway with guided application creation and intent configuration
vellum-ai/vellum-assistant
Create and configure a Sentry internal integration so the assistant can manage issues, alerts, and releases under its own identity
vellum-ai/vellum-assistant
Ingest a large dataset into memory as a skimmed map. An agent skill from vellum-ai/vellum-assistant.
vellum-ai/vellum-assistant
A skill your agent uses when the user wants to build, scaffold, ship, or edit a Vellum plugin that bundles multiple surfaces (hooks, tools, skills, and more) into one installable package.
vellum-ai/vellum-assistant
Connect a Slack app to the Vellum Assistant via Socket Mode.
Categories
Watch local TV shows and movies with the user in real time. An agent skill from vellum-ai/vellum-assistant. Watch Together is an agent skill from vellum-ai/vellum-assistant. Watch local TV shows and movies with the user in real time.
Watch Together fits situations like: tasks that involve Transcription.
Run `npx skills add vellum-ai/vellum-assistant --skill watch-together -a claude-code`. Or copy the skill folder (skills/watch-together in vellum-ai/vellum-assistant) into .claude/skills/watch-together in your project. Claude Code loads it when a task matches its description.
Run `npx skills add vellum-ai/vellum-assistant --skill watch-together -a codex`. Or copy the skill folder (skills/watch-together in vellum-ai/vellum-assistant) into .agents/skills/watch-together in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add vellum-ai/vellum-assistant --skill watch-together -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/watch-together, .gemini/skills/watch-together, .github/skills/watch-together and .opencode/skills/watch-together in your project.
Going by SKILL.md and its folder, Watch Together needs Python and a shell for the scripts in its folder, the command-line tools its instructions call (python3, ffmpeg, brew, ffprobe, apt and dnf) and credentials named GEMINI_API_KEY. Our summary lists: Python 3; A Bash shell; A credential in GEMINI_API_KEY.
SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found notes only (runs commands with sudo), nothing it rates as a warning. It is not a guarantee. The check reads SKILL.md only: the scripts in the folder are not scanned, so read them before running anything.
Watch Together is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 2.1k tokens (SKILL.md is roughly 8.5k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Watch Together: HyperFrames Media Use (heygen-com/hyperframes, 60k stars), Native Subtitle Quote Image (chengyi-ai/native-subtitle-quote-image, 2.6k stars), Edu Chem Video (wy51ai/edulab, 1.4k stars) and Transcription Memory Reconstruction (NxcoreAI/EverRoom, 3k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
vellum-ai (a GitHub organization) maintains it in vellum-ai/vellum-assistant, which has 1,408 GitHub stars. The repository holds 108 skills in this directory. The repository was last updated on October 9, 2026.
Source: vellum-ai/vellum-assistant on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.