Agent skill

Vastai Core Workflow B

by jeremylongshore in jeremylongshore/tons-of-skills-marketplace

Build and roll out a Vast.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update.

MITAuto-check passedBackend & APIs

Install Vastai Core Workflow B

skills CLI
$ npx skills add jeremylongshore/tons-of-skills-marketplace --skill vastai-core-workflow-b -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install jeremylongshore/tons-of-skills-marketplace vastai-core-workflow-b --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/jeremylongshore/tons-of-skills-marketplace.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/.curated/vastai-core-workflow-b .claude/skills/vastai-core-workflow-b && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
vastai-core-workflow-b
GitHub stars
2.8k
Token cost
~1.1k tokens
SKILL.md length
439 words
Files
2 (incl. references)
Skills in repo
3,342
Repo updated
First seen
Licence
MIT

At a glance

Build and roll out a Vast.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update.

  • Works in 6 steps: Prove the candidate template → Define scaling bounds → Exercise convergence → …
  • Production inference capacity
  • SKILL.md covers Overview, Prerequisites, Instructions and Authentication, plus 5 more sections
  • Instructions only: no scripts, shell commands, URLs or credentials in SKILL.md

What it does

Vastai Core Workflow B is an agent skill from jeremylongshore/tons-of-skills-marketplace. Build and roll out a Vast.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update. Use when production inference capacity or model bytes change. Trigger with: "deploy Vast.ai Serverless", "tune a Vast.ai worker group", "roll a model without downtime".

Its SKILL.md is about 1.1k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/official-docs.md`). Compatibility notes: Requires Vast.ai Serverless access, a tested template, a scoped API key, representative load, and endpoint observability.

It sits in Backend & APIs, covering Serverless and Deployment. The repository describes itself as: Model-agnostic agent-skills platform with a harness-free canonical layer, verified adapters, and the ccpi package manager. Explore at tonsofskills.com. The licence is MIT.

When your agent uses it

  • Production inference capacity
  • Model bytes change
  • With: deploy Vast.ai Serverless
  • Tune a Vast.ai worker group

Example prompts

  • “deploy Vast.ai Serverless”
  • “tune a Vast.ai worker group”
  • “roll a model without downtime”
  • “/vastai-core-workflow-b”

Requirements

  • Compatibility (from SKILL.md): Requires Vast.ai Serverless access, a tested template, a scoped API key, representative load, and endpoint observability.
  • Pre-approved tools (allowed-tools): Read, Grep, Write, Edit

Workflow steps

6 steps, taken from the step headings in SKILL.md.

  1. Prove the candidate template
  2. Define scaling bounds
  3. Exercise convergence
  4. Establish the pre-update baseline
  5. Trigger the rolling update
  6. Accept or roll back

What it can do on your machine

Read from SKILL.md and the folder at commit cfae287. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Read
    • Grep
    • Write
    • Edit

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    No scripts in the folder and no shell commands in SKILL.md.

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • docs.vast.ai

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Requires Vast.ai Serverless access, a tested template, a scoped API key, representative load, and endpoint observability.

    From compatibility in the SKILL.md frontmatter.

Context cost

Vastai Core Workflow B loads about 1.1k tokens when it runs, and up to ~1.4k if it reads all its reference files. Until then it costs about 80 tokens; SKILL.md has 439 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~80
When it runs · the whole SKILL.md, loaded when a task matches
~1.1k
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.4k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from jeremylongshore/tons-of-skills-marketplace at commit cfae287, republished under its MIT licence (© jeremylongshore). 439 words, ~1,088 tokens.

Download SKILL.mdSave it as .claude/skills/vastai-core-workflow-b/SKILL.md (or your agent's skills folder). This skill also uses 1 other file; get the full folder from GitHub.
name
vastai-core-workflow-b
description
Build and roll out a Vast.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update. Use when production inference capacity or model bytes change. Trigger with: "deploy Vast.ai Serverless", "tune a Vast.ai worker group", "roll a model without downtime".
allowed-tools
Read, Grep, Write, Edit
compatibility
Requires Vast.ai Serverless access, a tested template, a scoped API key, representative load, and endpoint observability.
version
2.0.0
argument-hint
[endpoint-slo-template-and-load-profile]
model
inherit
effort
high
license
MIT
author
Jeremy Longshore <jeremy@intentsolutions.io>
tags
saas, vastai, serverless, autoscaling, rollout

Vast.ai Serverless Endpoint Rollout

Overview

Replace ad hoc multi-instance orchestration with the provider Serverless control plane. Prove a template independently, establish worker and queue bounds from load evidence, then let the workergroup perform a graceful rolling update.

Prerequisites

  • Latency, error-rate, queue-time, concurrency, and cost objectives
  • Immutable model/template candidate and a separate canary endpoint
  • Initial, minimum, maximum, cold-worker, and inactivity policy

Instructions

Step 1: Prove the candidate template

Launch the new model or environment on a non-production endpoint and verify load, readiness, response schema, and representative outputs.

Step 2: Define scaling bounds

Set min_load, min_workers, max_workers, cold_workers, inactivity_timeout, target_queue_time, and max_queue_time from explicit SLO and budget assumptions.

Step 3: Exercise convergence

During initial rollout, drive representative load up to roughly twice expected capacity and back down three times so the engine can learn GPU cost/performance.

Step 4: Establish the pre-update baseline

Record endpoint latency, queue time, error rate, active/inactive workers, model identity, and spend before changing production.

Step 5: Trigger the rolling update

Save the new template, update the workergroup reference, and monitor inactive workers updating first while active workers drain in-flight requests.

Step 6: Accept or roll back

Verify every worker is on the candidate and compare SLOs. If it fails, point the workergroup back to the last verified template and observe the reverse rollout.

Authentication

Use a scoped key with the documented misc Serverless permissions and no billing-write authority. Keep model registry credentials in approved environment variables, separate from the Vast.ai key.

Show full SKILL.md (196 more words)Show less

Tool Discipline

Use Read and Grep to inspect manifests, configuration, provider output, and existing tests before proposing a mutation. Use Write or Edit only for the approved plan, implementation, test, or redacted receipt; do not create, update, destroy, or fund Vast.ai resources without explicit operator approval.

Output

  • Canary and production template identities
  • Scaling policy plus load-test and rollout timeline
  • SLO comparison, worker convergence, and rollback decision

Return endpoint/workergroup IDs, old and new template identities, scaling bounds, load profile, SLO delta, and final rollout state.

Examples

A vLLM endpoint validates a new model on a canary, applies bounded queue targets, then updates its workergroup; active requests drain while new requests move to updated workers, with the old template retained for rollback.

Error Handling

FailureResponse
Canary cannot load the modelDo not update production; fix image, model, or environment configuration.
Queue time breaches during rolloutPause acceptance, increase safe capacity within budget, or roll back the template.
Workers do not convergeInspect workergroup logs and configuration; do not claim zero-downtime completion.
New output contract regressesRoll back to the last verified template and preserve comparison evidence.

Resources

© jeremylongshore, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

SKILL.md and 1 other file (references) in skills/.curated/vastai-core-workflow-b of jeremylongshore/tons-of-skills-marketplace.

  • SKILL.md
  • references/official-docs.md

Open the folder on GitHubat commit cfae287

Compare with similar skills

Vastai Core Workflow B next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Vastai Core Workflow B compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Vastai Core Workflow B this skilljeremylongshore/tons-of-skills-marketplace2.8k—~1.1kAutomated safety check: PassMIT
Tianji Worker Operationsmsgbyte/tianji3.1k—~1.1kAutomated safety check: PassApache-2.0
Deploy Verceljohnku2011/boilerplates-with-ai-skills240—~660Automated safety check: NotesMIT
Vercel Deploymentdavila7/claude-code-templates33k5 repos~534Automated safety check: PassMIT
Frontmcp Deploymentagentfront/frontmcp146—~9.2kAutomated safety check: NotesApache-2.0
Deployserithemage/serverless-openclaw196—~898Automated safety check: NotesNone

Similar skills

  • Operates Tianji Workers: create, test, deploy, invoke, schedule, pause and roll back them, plus manage their environment variables and shared modules.

    3.1k GitHub stars~1.1k tokensUpdated 2 days ago
    Backend & APIsAuto-check passed
  • Deploy Vercel

    johnku2011/boilerplates-with-ai-skills

    A skill your agent uses when deploying or configuring this project on Vercel — env vars, build settings, serverless limits, and production checks for Next.js or Express.

    240 GitHub stars~660 tokensUpdated 1 mo ago
    Backend & APIsAuto-check: notes
  • Vercel Deployment

    davila7/claude-code-templates

    Expert knowledge for deploying to Vercel with Next.js Use when: vercel, deploy, deployment, hosting, production.

    33k GitHub starsUsed in 5 repos~534 tokens
    DevOps & CloudAuto-check passed
  • Frontmcp Deployment

    agentfront/frontmcp

    A skill your agent uses when deploying, building for production, packaging, or shipping a FrontMCP server.

    146 GitHub stars~9.2k tokensUpdated today
    DevOps & CloudAuto-check: notes
  • Deploy

    serithemage/serverless-openclaw

    Deploys Serverless OpenClaw CDK stacks to AWS. An agent skill from serithemage/serverless-openclaw.

    196 GitHub stars~898 tokensUpdated 6 mo ago
    DevOps & CloudAuto-check: notes
  • Model Deployment

    awslabs/agent-plugins

    Official

    Generates code that deploys fine-tuned models from SageMaker Serverless Model Customization to SageMaker endpoints or Bedrock.

    916 GitHub stars~1.5k tokensUpdated yesterday
    Backend & APIsAuto-check passed

More from jeremylongshore/tons-of-skills-marketplace

All 3,342 skills in this repo
  • Performing Security Code Review

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to conduct a security-focused code review using the security-agent plugin.

    2.8k GitHub starsUsed in 2 repos~1.3k tokens
    Auto-check: notes
  • Adapting Transfer Learning Models

    jeremylongshore/tons-of-skills-marketplace

    Build this skill automates the adaptation of pre-trained machine learning models using transfer learning techniques.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Agent Context Loader

    jeremylongshore/tons-of-skills-marketplace

    Execute proactive auto-loading: automatically detects and loads agents.md files.

    2.8k GitHub stars~1.1k tokensUpdated today
    Auto-check passed
  • Aggregating Performance Metrics

    jeremylongshore/tons-of-skills-marketplace

    Aggregate and centralize performance metrics from applications, systems, databases, caches, and services.

    2.8k GitHub stars~1.2k tokensUpdated today
    Auto-check passed
  • Analyzing Capacity Planning

    jeremylongshore/tons-of-skills-marketplace

    Execute this skill enables AI assistant to analyze capacity requirements and plan for future growth.

    2.8k GitHub stars~947 tokensUpdated today
    Auto-check passed
  • Analyzing Database Indexes

    jeremylongshore/tons-of-skills-marketplace

    Process use when you need to work with database indexing. An agent skill from jeremylongshore/tons-of-skills-marketplace.

    2.8k GitHub stars~2k tokensUpdated today
    Auto-check passed

Questions about Vastai Core Workflow B

What does Vastai Core Workflow B do?

Build and roll out a Vast.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update. Vastai Core Workflow B is an agent skill from jeremylongshore/tons-of-skills-marketplace.ai Serverless endpoint with measured autoscaling, a canary template, and a zero-downtime worker update.

When should I use Vastai Core Workflow B?

Vastai Core Workflow B fits situations like: production inference capacity; model bytes change; with: deploy Vast.ai Serverless; tune a Vast.ai worker group.

How do I install Vastai Core Workflow B in Claude Code?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill vastai-core-workflow-b -a claude-code`. Or copy the skill folder (skills/.curated/vastai-core-workflow-b in jeremylongshore/tons-of-skills-marketplace) into .claude/skills/vastai-core-workflow-b in your project. Claude Code loads it when a task matches its description.

How do I install Vastai Core Workflow B in Codex?

Run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill vastai-core-workflow-b -a codex`. Or copy the skill folder (skills/.curated/vastai-core-workflow-b in jeremylongshore/tons-of-skills-marketplace) into .agents/skills/vastai-core-workflow-b in your project. Codex loads it when a task matches its description.

Can I use Vastai Core Workflow B in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add jeremylongshore/tons-of-skills-marketplace --skill vastai-core-workflow-b -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/vastai-core-workflow-b, .gemini/skills/vastai-core-workflow-b, .github/skills/vastai-core-workflow-b and .opencode/skills/vastai-core-workflow-b in your project.

What does Vastai Core Workflow B need to run?

SKILL.md names no scripts, command-line tools or credentials: Vastai Core Workflow B is instructions for the agent only. Its frontmatter pre-approves these tools: Read, Grep, Write, Edit. Compatibility (from SKILL.md): Requires Vast.ai Serverless access, a tested template, a scoped API key, representative load, and endpoint observability..

Does Vastai Core Workflow B access the network?

SKILL.md names 1 domain. As links in the text: docs.vast.ai. This is read from the text; nothing was executed.

Is Vastai Core Workflow B safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Vastai Core Workflow B use?

Vastai Core Workflow B is published under the MIT licence (declared in SKILL.md). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Vastai Core Workflow B use?

About 1.1k tokens (SKILL.md is roughly 4.4k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 342 tokens, read only when the agent opens those files.

What are the alternatives to Vastai Core Workflow B?

Skills that share tags, products or a category with Vastai Core Workflow B: Tianji Worker Operations (msgbyte/tianji, 3.1k stars), Deploy Vercel (johnku2011/boilerplates-with-ai-skills, 240 stars), Vercel Deployment (davila7/claude-code-templates, 33k stars) and Frontmcp Deployment (agentfront/frontmcp, 146 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Vastai Core Workflow B?

jeremylongshore (a GitHub user) maintains it in jeremylongshore/tons-of-skills-marketplace, which has 2,827 GitHub stars. The repository holds 3,342 skills in this directory. The repository was last updated on October 10, 2026.

Source: jeremylongshore/tons-of-skills-marketplace on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.