Agent skill

Mlx Serve

by ddalcu in ddalcu/mlx-serve

Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions.

Custom licenceAuto-check passedAI & LLM Engineering

Install Mlx Serve

skills CLI
$ npx skills add ddalcu/mlx-serve --skill mlx-serve -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install ddalcu/mlx-serve mlx-serve --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/ddalcu/mlx-serve.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/mlx-serve .claude/skills/mlx-serve && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
mlx-serve
GitHub stars
1.8k
Token cost
~1k tokens
SKILL.md length
462 words
Files
4
Skills in repo
4
Repo updated
First seen
Licence
Custom licence

At a glance

Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions.

  • Code should call mlx-serve
  • SKILL.md covers Connect, Pick models from /v1/models,…, Loading and memory and Rules for apps and games, plus 1 more section
  • Calls curl and jq
  • Tasks that involve Music and audio generation

What it does

Mlx Serve is an agent skill from ddalcu/mlx-serve. Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions. Use when code should call mlx-serve.

Its SKILL.md is about 1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 3 other files (for example `chat.md`, `decisions.md` and `media.md`).

It sits in AI & LLM Engineering, covering Music and audio generation and Embeddings. It works with OpenAI and macOS. The repository describes itself as: Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

When your agent uses it

  • Code should call mlx-serve
  • Tasks that involve Music and audio generation
  • Tasks that involve Embeddings

Example prompts

  • “/mlx-serve”

What it can do on your machine

Read from SKILL.md and the folder at commit a21784b. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • curl
    • jq

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use curl, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Mlx Serve loads about 1k tokens when it runs. Until then it costs about 57 tokens; SKILL.md has 462 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~57
When it runs · the whole SKILL.md, loaded when a task matches
~1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 462 words (~1,033 tokens).

“mlx-serve runs MLX models on this Mac behind one HTTP port: OpenAI, Anthropic and Ollama compatible chat, plus native endpoints for images, speech, music, sound effects, video, 3D and decisions. Everything below is plain HTTP + JSON, so any language…”

— opening of SKILL.md by ddalcu, Custom licence
name
mlx-serve

Read the full SKILL.md on GitHub

Files

SKILL.md and 3 other files in skills/mlx-serve of ddalcu/mlx-serve.

  • SKILL.md
  • chat.md
  • decisions.md
  • media.md

Open the folder on GitHubat commit a21784b

Compare with similar skills

Mlx Serve next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Mlx Serve compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Mlx Serve this skillddalcu/mlx-serve1.8k—~1kAutomated safety check: PassCustom licence
Local RAGnigo81/nigo-skills133—~1.4kAutomated safety check: PassMIT
Persona Character Scenesmiuuyy/persona-voice132—~953Automated safety check: PassMIT
Ax AIdosco/aithy107—~8.2kAutomated safety check: PassApache-2.0
AI SDKvercel-labs/ai-facts16820 repos~1.2kAutomated safety check: PassNone
Chroma Vector DatabaseOrchestra-Research/AI-Research-SKILLs13k7 repos~2.3kAutomated safety check: PassMIT

Similar skills

  • Local RAG

    nigo81/nigo-skills

    本地向量知识库,支持按项目管理文档(docx/doc/pdf/md),语义检索。默认用硅基流动免费 API,零模型安装即可使用。支持多项目隔离、中文制度文档专用切片、Embedding+Rerank 两阶段检索。触发词:知识库、向量检索、RAG、制度检索、文档入库、语义搜索、local…

    133 GitHub stars~1.4k tokensUpdated 1 mo ago
    AI & LLM EngineeringAuto-check passed
  • Persona Character Scenes

    miuuyy/persona-voice

    Generate, review, and integrate consistent 2D or stylized 3D character background scenes for Codex Persona Voice session cards.

    132 GitHub stars~953 tokensUpdated 17 days ago
    Media & CreativeAuto-check passed
  • Ax AI

    dosco/aithy

    This skill helps an LLM generate correct AI provider setup and configuration code using @ax-llm/ax.

    107 GitHub stars~8.2k tokensUpdated 1 mo ago
    AI & LLM EngineeringAuto-check passed
  • AI SDK

    vercel-labs/ai-facts

    Official

    Answer questions about the AI SDK and help build AI-powered features.

    168 GitHub starsUsed in 20 repos~1.2k tokens
    AI & LLM EngineeringAuto-check passed
  • Chroma Vector Database

    Orchestra-Research/AI-Research-SKILLs

    Shows how to store documents and embeddings in Chroma, query them by similarity with metadata filters, and persist them to disk for RAG and semantic search projects.

    13k GitHub starsUsed in 7 repos~2.3k tokens
    AI & LLM EngineeringAuto-check passed
  • Codebase Management

    giancarloerra/SocratiCode

    Set up, index, and manage SocratiCode codebase indexing. An agent skill from giancarloerra/SocratiCode.

    3.3k GitHub starsUsed in 1 repo~1.8k tokens
    AI & LLM EngineeringAuto-check passed

More from ddalcu/mlx-serve

  • Release

    ddalcu/mlx-serve

    mlx-serve pre-release validation checklist, CalVer versioning, release steps, and CHANGELOG style.

    1.8k GitHub stars~1.8k tokensUpdated today
    Auto-check passed
  • Bench

    ddalcu/mlx-serve

    mlx-serve benchmarking methodology — bench.sh/llmprobe usage, comparison-trap rules (same-methodology cells only, spec-decode variance, thermal lies, engine naming), perf-claim etiquette.

    1.8k GitHub starsUsed in 1 repo~1.1k tokens
    Auto-check passed
  • PR Charts

    ddalcu/mlx-serve

    Turn llmprobe reports into the charts a perf PR embeds (one line per arm across context size, every point labelled, machine and model in the caption) and host them so the PR body renders them.

    1.8k GitHub stars~594 tokensUpdated today
    Auto-check passed

Works with

Questions about Mlx Serve

What does Mlx Serve do?

Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions. Mlx Serve is an agent skill from ddalcu/mlx-serve. Hook an app, game or script up to the local mlx-serve server for LLM chat, embeddings, image, speech, music, sound effect, video and 3D generation, and Laya/Kev/Clef typed decisions.

When should I use Mlx Serve?

Mlx Serve fits situations like: code should call mlx-serve; tasks that involve Music and audio generation; tasks that involve Embeddings.

How do I install Mlx Serve in Claude Code?

Run `npx skills add ddalcu/mlx-serve --skill mlx-serve -a claude-code`. Or copy the skill folder (skills/mlx-serve in ddalcu/mlx-serve) into .claude/skills/mlx-serve in your project. Claude Code loads it when a task matches its description.

How do I install Mlx Serve in Codex?

Run `npx skills add ddalcu/mlx-serve --skill mlx-serve -a codex`. Or copy the skill folder (skills/mlx-serve in ddalcu/mlx-serve) into .agents/skills/mlx-serve in your project. Codex loads it when a task matches its description.

Can I use Mlx Serve in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add ddalcu/mlx-serve --skill mlx-serve -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/mlx-serve, .gemini/skills/mlx-serve, .github/skills/mlx-serve and .opencode/skills/mlx-serve in your project.

What does Mlx Serve need to run?

Going by SKILL.md and its folder, Mlx Serve needs the command-line tools its instructions call (curl and jq).

Does Mlx Serve access the network?

SKILL.md contains no URLs. Its commands use curl, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Mlx Serve safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Mlx Serve use?

Mlx Serve has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Mlx Serve use?

About 1k tokens (SKILL.md is roughly 4.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Mlx Serve?

Skills that share tags, products or a category with Mlx Serve: Local RAG (nigo81/nigo-skills, 133 stars), Persona Character Scenes (miuuyy/persona-voice, 132 stars), Ax AI (dosco/aithy, 107 stars) and AI SDK (vercel-labs/ai-facts, 168 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Mlx Serve?

ddalcu (a GitHub user) maintains it in ddalcu/mlx-serve, which has 1,806 GitHub stars. The repository holds 4 skills in this directory. The repository was last updated on October 9, 2026.

Source: ddalcu/mlx-serve on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.