Agent skill

Music Video

by guaardvark in guaardvark/guaardvark

Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat.

MITAuto-check passedMedia & Creative

Install Music Video

skills CLI
$ npx skills add guaardvark/guaardvark --skill music-video -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install guaardvark/guaardvark music-video --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/guaardvark/guaardvark.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/music-video .claude/skills/music-video && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
music-video
GitHub stars
257
Token cost
~774 tokens
SKILL.md length
356 words
Files
1
Skills in repo
15
Repo updated
First seen
Licence
MIT

At a glance

Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat.

  • Works in 5 steps: Start the project, show the cut list and… → Offer storyboards before approval: they… → Ask for approval in plain words with the… → …
  • The user says music video
  • SKILL.md covers Start: MCP generate_music_video, The gate and the rest of the… and How to run it well
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Music Video is an agent skill from guaardvark/guaardvark. Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.

Its SKILL.md is about 770 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Media & Creative, covering Comics and storyboards, AI video generation and Diffusion and image models. It works with Model Context Protocol and ComfyUI. The repository describes itself as: Self-hosted AI studio on your own GPU: chat with your files (RAG), screen and browser agents, coding swarms, LoRA training, an MCP server for Claude Code and Cursor, and local… The licence is MIT.

When your agent uses it

  • The user says music video
  • Video for this track
  • Wants visuals timed to a song

Example prompts

  • “music video”
  • “video for this track”
  • “/music-video”

Workflow steps

5 steps, taken from the first numbered list in SKILL.md.

  1. Start the project, show the cut list and the beat count.
  2. Offer storyboards before approval: they are cheap and catch a wrong style early.
  3. Ask for approval in plain words with the cost: number of cuts times the clip time for the
  4. Character in the video: create a Cast subject and train a LoRA first (the cast skill) so the
  5. The finished cut is assembled to the detected beat grid. The Video Editor page can trim or

What it can do on your machine

Read from SKILL.md and the folder at commit 0299024. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Music Video loads about 774 tokens when it runs. Until then it costs about 80 tokens; SKILL.md has 356 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~80
When it runs · the whole SKILL.md, loaded when a task matches
~774

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from guaardvark/guaardvark at commit 0299024, republished under its MIT licence (© guaardvark). 356 words, ~774 tokens.

Download SKILL.mdSave it as .claude/skills/music-video/SKILL.md (or your agent's skills folder).
name
music-video
description
Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Use when the user says "music video", "video for this track", or wants visuals timed to a song. Has an approval gate before GPU spend.

Music video with Guaardvark

Read setup first. Needs the comfyui plugin and an installed i2v model (wan22-5b by default; minimax-h3-int8 for frame-matched continuity).

Start: MCP generate_music_video

  • song: document id or a filesystem path to mp3/wav/flac/ogg. A path is uploaded for the user.
  • style_prompt: mood, palette, movement, era ("grainy 16 mm, neon rain, slow dolly, 1984").
  • name (defaults to the song file name), i2v_model (defaults to the active i2v model).
  • The tool analyses the song (tempo, beats, sections), writes one unique prompt per cut and stops at the approval gate. It does not spend GPU rendering clips. Tell the user that.

The gate and the rest of the pipeline (REST)

B=${GUAARDVARK_URL:-http://localhost:5000}, ID = the project id the tool returned.

stepcallwhat it does
read the planGET $B/api/music-video/$IDcuts, prompts, status, storyboard state
edit promptsPOST $B/api/music-video/$ID/plan with the edited cut prompts (and optional global style)operator edits before render
regenerate the planPOST $B/api/music-video/$ID/regenerate-plan or /replannew prompts from the Director
storyboards firstPOST $B/api/music-video/$ID/generate-storyboardsone keyframe still per cut, thumbnails-first review
redo one keyframePOST $B/api/music-video/$ID/regen-storyboard/<idx>keeps the others
approvePOST $B/api/music-video/$ID/approvereleases per-clip generation. Only on the user's explicit yes
re-analysePOST $B/api/music-video/$ID/analyzerestart song analysis
cancelPOST $B/api/music-video/$ID/cancel
list allGET $B/api/music-video

Creating a project without the MCP tool: POST $B/api/music-video with {"name", "song_document_id", "style_prompt", "settings": {"i2v_model": "..."}, "user_treatment": "optional short story"}. user_treatment becomes the creative source the Director writes cuts from.

Show full SKILL.md (122 more words)Show less

How to run it well

  1. Start the project, show the cut list and the beat count.
  2. Offer storyboards before approval: they are cheap and catch a wrong style early.
  3. Ask for approval in plain words with the cost: number of cuts times the clip time for the chosen model. Approve only after a clear yes, and only once GET $B/api/music-video/$ID shows current_stage awaiting_approval with cuts: before analysis finishes the approve route answers 409.
  4. Character in the video: create a Cast subject and train a LoRA first (the cast skill) so the Director can lock identity across cuts.
  5. The finished cut is assembled to the detected beat grid. The Video Editor page can trim or overlay text afterwards.

© guaardvark, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in .agents/skills/music-video of guaardvark/guaardvark.

Open the folder on GitHubat commit 0299024

Compare with similar skills

Music Video next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Music Video compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Music Video this skillguaardvark/guaardvark257—~774Automated safety check: PassMIT
ComfyUI Local DriverSlavaSexton/ComfyUI-Agent-Kit105—~12kAutomated safety check: PassApache-2.0
Higgsfield CanvasOSideMedia/higgsfield-ai-prompt-skill713—~2.2kAutomated safety check: PassMIT
H3 Videoagent-next/video-agent120—~2.9kAutomated safety check: PassApache-2.0
Anima Baseartokun/comfyui-mcp803—~4kAutomated safety check: PassMIT
Open Videoagent-next/video-agent120—~3.2kAutomated safety check: PassApache-2.0

Similar skills

  • ComfyUI Local Driver

    SlavaSexton/ComfyUI-Agent-Kit

    Drives a local ComfyUI install over its HTTP API to generate and edit images, video and audio, with per-model prompt recipes and workflow guidance.

    105 GitHub stars~12k tokensUpdated 1 mo ago
    Media & CreativeAuto-check passed
  • Higgsfield Canvas

    OSideMedia/higgsfield-ai-prompt-skill

    A skill your agent uses when the user mentions Higgsfield Canvas, a node-based or node graph workspace, an infinite board/canvas, chaining generations into a pipeline, or wants to wire prompts →…

    713 GitHub stars~2.2k tokensUpdated 14 days ago
    Media & CreativeAuto-check passed
  • H3 Video

    agent-next/video-agent

    OpenVideo skill (v0.1.0): generate high-quality local video with the OpenVideo product (MiniMax H3 backend).

    120 GitHub stars~2.9k tokensUpdated yesterday
    Media & CreativeAuto-check passed
  • Anima Base

    artokun/comfyui-mcp

    Anime/illustration text-to-image (ANIMA 1.0, ~2B Cosmos DiT).

    803 GitHub stars~4k tokensUpdated 6 days ago
    Media & CreativeAuto-check passed
  • Open Video

    agent-next/video-agent

    Generate, edit, or direct videos via open-source models (MiniMax H3 baseline; Wan2.2 / LTX future).

    120 GitHub stars~3.2k tokensUpdated yesterday
    Media & CreativeAuto-check passed
  • Seedance 2 5

    calesthio/OpenMontage

    Generate 4-30 second cinematic video with ByteDance Seedance 2.5 through fal.ai, Volcengine Ark, Runway, or ComfyUI Partner Nodes.

    66k GitHub stars~3.2k tokensUpdated 7 days ago
    Media & CreativeAuto-check passed

More from guaardvark/guaardvark

All 15 skills in this repo
  • Cast

    guaardvark/guaardvark

    Build consistent characters, environments and props in Guaardvark's Cast Library and train LoRAs for them locally (reference photos → vision bible → sample plan → approved samples → training).

    258 GitHub stars~673 tokensUpdated today
    Auto-check passed
  • Image

    guaardvark/guaardvark

    Generate or edit images on the user's own GPU through Guaardvark: single images, instruction edits, background cut-outs, inpaint and outpaint, consistent characters from the Cast Library, and batch…

    258 GitHub stars~1.8k tokensUpdated today
    Auto-check passed
  • Music

    guaardvark/guaardvark

    Generate full songs with vocals or instrumentals (ACE-Step) and sound effects or ambience (Stable Audio Open) on the user's GPU through Guaardvark's Audio Foundry.

    258 GitHub stars~710 tokensUpdated today
    Auto-check passed
  • Ops

    guaardvark/guaardvark

    Operate a running Guaardvark: GPU and VRAM state, plugin start/stop, logs, Celery tasks, the Interconnector sync to other machines, overnight RAG autoresearch, and infographics.

    258 GitHub stars~779 tokensUpdated today
    Auto-check passed
  • Setup

    guaardvark/guaardvark

    Connect this agent to a running Guaardvark (self-hosted AI studio) and check what it can do right now.

    258 GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Swarm

    guaardvark/guaardvark

    Launch and watch Guaardvark's Swarm Orchestrator: parallel coding agents, each in its own git worktree, working a markdown plan and merging back deterministically.

    258 GitHub stars~746 tokensUpdated today
    Auto-check passed

Questions about Music Video

What does Music Video do?

Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat. Music Video is an agent skill from guaardvark/guaardvark. Turn a song into a beat-synced music video with Guaardvark's Director: song analysis, per-cut shot prompts, storyboard keyframes, image-to-video renders, cuts on the beat.

When should I use Music Video?

Music Video fits situations like: the user says music video; video for this track; wants visuals timed to a song.

How do I install Music Video in Claude Code?

Run `npx skills add guaardvark/guaardvark --skill music-video -a claude-code`. Or copy the skill folder (.agents/skills/music-video in guaardvark/guaardvark) into .claude/skills/music-video in your project. Claude Code loads it when a task matches its description.

How do I install Music Video in Codex?

Run `npx skills add guaardvark/guaardvark --skill music-video -a codex`. Or copy the skill folder (.agents/skills/music-video in guaardvark/guaardvark) into .agents/skills/music-video in your project. Codex loads it when a task matches its description.

Can I use Music Video in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add guaardvark/guaardvark --skill music-video -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/music-video, .gemini/skills/music-video, .github/skills/music-video and .opencode/skills/music-video in your project.

What does Music Video need to run?

SKILL.md names no scripts, command-line tools or credentials: Music Video is instructions for the agent only.

Does Music Video access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Music Video safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Music Video use?

Music Video is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Music Video use?

About 774 tokens (SKILL.md is roughly 3.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Music Video?

Skills that share tags, products or a category with Music Video: ComfyUI Local Driver (SlavaSexton/ComfyUI-Agent-Kit, 105 stars), Higgsfield Canvas (OSideMedia/higgsfield-ai-prompt-skill, 713 stars), H3 Video (agent-next/video-agent, 120 stars) and Anima Base (artokun/comfyui-mcp, 803 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Music Video?

guaardvark (a GitHub user) maintains it in guaardvark/guaardvark, which has 257 GitHub stars. The repository holds 15 skills in this directory. The repository was last updated on October 9, 2026.

Source: guaardvark/guaardvark on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.