Agent skill

Typescript Eval

by vellum-ai in vellum-ai/vellum-assistant

Test TypeScript code snippets before persisting as skills. An agent skill from vellum-ai/vellum-assistant.

MITAuto-check passed

Install Typescript Eval

skills CLI
$ npx skills add vellum-ai/vellum-assistant --skill typescript-eval -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install vellum-ai/vellum-assistant typescript-eval --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/vellum-ai/vellum-assistant.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/typescript-eval .claude/skills/typescript-eval && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
typescript-eval
GitHub stars
1.4k
Token cost
~397 tokens
SKILL.md length
100 words
Files
1
Skills in repo
108
Repo updated
First seen
Licence
MIT

At a glance

Test TypeScript code snippets before persisting as skills. An agent skill from vellum-ai/vellum-assistant.

  • Works in 4 steps: Write the snippet to a temp file → Run it with bun → For function-based testing → …
  • SKILL.md covers Workflow and Guidelines
  • Calls bash

What it does

Typescript Eval is an agent skill from vellum-ai/vellum-assistant. Test TypeScript code snippets before persisting as skills

Its SKILL.md is about 400 tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts. Compatibility notes: Designed for Vellum personal assistants

It works with TypeScript. The repository describes itself as: An AI Assistant that’s easy to setup, does your work 24/7, knows your preferences and gets better over time. The licence is MIT.

Example prompts

  • “/typescript-eval”

Requirements

  • Compatibility (from SKILL.md): Designed for Vellum personal assistants

Workflow steps

4 steps, taken from the step headings in SKILL.md.

  1. Write the snippet to a temp file
  2. Run it with bun
  3. For function-based testing
  4. Clean up

What it can do on your machine

Read from SKILL.md and the folder at commit c92ead1. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • bash

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

  • Compatibility

    Designed for Vellum personal assistants

    From compatibility in the SKILL.md frontmatter.

Context cost

Typescript Eval loads about 397 tokens when it runs. Until then it costs about 18 tokens; SKILL.md has 100 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~18
When it runs · the whole SKILL.md, loaded when a task matches
~397

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

The full file from vellum-ai/vellum-assistant at commit c92ead1, republished under its MIT licence (© vellum-ai). 100 words, ~397 tokens.

Download SKILL.mdSave it as .claude/skills/typescript-eval/SKILL.md (or your agent's skills folder).
name
typescript-eval
description
Test TypeScript code snippets before persisting as skills
compatibility
Designed for Vellum personal assistants
metadata.emoji
🧪

TypeScript Evaluation

When you need to test a TypeScript snippet before persisting it as a managed skill, use bash directly.

Workflow

1. Write the snippet to a temp file
bash command="mkdir -p /tmp/vellum-eval && cat > /tmp/vellum-eval/snippet.ts << 'SNIPPET_EOF'
<your code here>
SNIPPET_EOF"
2. Run it with bun
bash command="bun run /tmp/vellum-eval/snippet.ts" timeout_seconds=10
3. For function-based testing

If the snippet exports a default or run function, write a runner script:

bash command="cat > /tmp/vellum-eval/runner.ts << 'RUNNER_EOF'
import * as mod from './snippet.ts';
const fn = (mod as any).default ?? (mod as any).run;
const input = {}; // mock input
const result = await fn(input);
console.log(JSON.stringify(result, null, 2));
RUNNER_EOF"

Then run the runner:

bash command="bun run /tmp/vellum-eval/runner.ts" timeout_seconds=10
4. Clean up
bash command="rm -rf /tmp/vellum-eval/"

Guidelines

  • Iteration limit: Max 3 attempts before asking the user for guidance.
  • After successful test: Persist with scaffold_managed_skill only after explicit user consent.
  • Timeout: Use timeout_seconds=10 (or up to 20 for complex snippets).
  • Never persist or delete skills without explicit user confirmation.

© vellum-ai, MIT. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file

Files

Just SKILL.md in skills/typescript-eval of vellum-ai/vellum-assistant.

Open the folder on GitHubat commit c92ead1

Compare with similar skills

Typescript Eval next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Typescript Eval compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Typescript Eval this skillvellum-ai/vellum-assistant1.4k—~397Automated safety check: PassMIT
MCP Server Builderanthropics/skills180k64 repos~2.3kAutomated safety check: PassApache-2.0
Web Artifacts Builderanthropics/skills180k41 repos~769Automated safety check: PassApache-2.0
Typescript Advanced Typesrolling-scopes/rsschool-app10k25 repos~4.2kAutomated safety check: PassMPL-2.0
Code Review ChecklistshareAI-lab/learn-claude-code78k5 repos~1.1kAutomated safety check: PassMIT
MCP Server BuildershareAI-lab/learn-claude-code78k5 repos~1.2kAutomated safety check: PassMIT

Similar skills

  • MCP Server Builder

    anthropics/skills

    Official

    Guides the design and implementation of Model Context Protocol servers in TypeScript or Python, from tool naming and error messages to evaluation.

    180k GitHub starsUsed in 64 repos~2.3k tokens
    Agent WorkflowsAuto-check passed
  • Web Artifacts Builder

    anthropics/skills

    Official

    Builds multi-component claude.ai HTML artifacts as a small React, TypeScript and Tailwind project, then bundles it into one shareable HTML file.

    180k GitHub starsUsed in 41 repos~769 tokens
    Frontend & DesignAuto-check passed
  • Typescript Advanced Types

    rolling-scopes/rsschool-app

    Master TypeScript's advanced type system including generics, conditional types, mapped types, template literals, and utility types for building type-safe applications.

    10k GitHub starsUsed in 25 repos~4.2k tokens
    DevelopmentAuto-check passed
  • Code Review Checklist

    shareAI-lab/learn-claude-code

    Reviews code against a five-part checklist covering security, correctness, performance, maintainability and testing, and reports findings in a fixed format.

    78k GitHub starsUsed in 5 repos~1.1k tokens
    DevelopmentAuto-check passed
  • MCP Server Builder

    shareAI-lab/learn-claude-code

    Walks through building MCP servers in Python or TypeScript that expose tools, resources and prompts to Claude, with templates, registration and testing.

    78k GitHub starsUsed in 5 repos~1.2k tokens
    Agent WorkflowsAuto-check passed
  • Nx Import

    nrwl/nx

    Import, merge, or combine repositories into an Nx workspace using nx import.

    29k GitHub starsUsed in 6 repos~3.5k tokens
    DevelopmentAuto-check passed

More from vellum-ai/vellum-assistant

All 108 skills in this repo
  • Vellum GitHub App Setup

    vellum-ai/vellum-assistant

    Create and configure a GitHub App so the assistant can push commits, open PRs, and comment under its own bot identity.

    1.4k GitHub stars~3.1k tokensUpdated today
    Auto-check passed
  • Discord App Setup

    vellum-ai/vellum-assistant

    Connect a Discord bot to the assistant via the Discord Gateway with guided application creation and intent configuration

    1.4k GitHub stars~4.2k tokensUpdated today
    Auto-check passed
  • Sentry App Setup

    vellum-ai/vellum-assistant

    Create and configure a Sentry internal integration so the assistant can manage issues, alerts, and releases under its own identity

    1.4k GitHub stars~1.3k tokensUpdated today
    Auto-check passed
  • Memory Corpus Ingest

    vellum-ai/vellum-assistant

    Ingest a large dataset into memory as a skimmed map. An agent skill from vellum-ai/vellum-assistant.

    1.4k GitHub stars~3k tokensUpdated today
    Auto-check: notes
  • Plugin Builder

    vellum-ai/vellum-assistant

    A skill your agent uses when the user wants to build, scaffold, ship, or edit a Vellum plugin that bundles multiple surfaces (hooks, tools, skills, and more) into one installable package.

    1.4k GitHub stars~3.1k tokensUpdated today
    Auto-check passed
  • Slack App Setup

    vellum-ai/vellum-assistant

    Connect a Slack app to the Vellum Assistant via Socket Mode.

    1.4k GitHub stars~2.5k tokensUpdated today
    Auto-check: warnings

Works with

Questions about Typescript Eval

What does Typescript Eval do?

Test TypeScript code snippets before persisting as skills. An agent skill from vellum-ai/vellum-assistant. Typescript Eval is an agent skill from vellum-ai/vellum-assistant.

How do I install Typescript Eval in Claude Code?

Run `npx skills add vellum-ai/vellum-assistant --skill typescript-eval -a claude-code`. Or copy the skill folder (skills/typescript-eval in vellum-ai/vellum-assistant) into .claude/skills/typescript-eval in your project. Claude Code loads it when a task matches its description.

How do I install Typescript Eval in Codex?

Run `npx skills add vellum-ai/vellum-assistant --skill typescript-eval -a codex`. Or copy the skill folder (skills/typescript-eval in vellum-ai/vellum-assistant) into .agents/skills/typescript-eval in your project. Codex loads it when a task matches its description.

Can I use Typescript Eval in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add vellum-ai/vellum-assistant --skill typescript-eval -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/typescript-eval, .gemini/skills/typescript-eval, .github/skills/typescript-eval and .opencode/skills/typescript-eval in your project.

What does Typescript Eval need to run?

Going by SKILL.md and its folder, Typescript Eval needs the command-line tools its instructions call (bash). Compatibility (from SKILL.md): Designed for Vellum personal assistants.

Does Typescript Eval access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Typescript Eval safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Typescript Eval use?

Typescript Eval is published under the MIT licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.

How many tokens does Typescript Eval use?

About 397 tokens (SKILL.md is roughly 1.6k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Typescript Eval?

Skills that share tags, products or a category with Typescript Eval: MCP Server Builder (anthropics/skills, 180k stars), Web Artifacts Builder (anthropics/skills, 180k stars), Typescript Advanced Types (rolling-scopes/rsschool-app, 10k stars) and Code Review Checklist (shareAI-lab/learn-claude-code, 78k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Typescript Eval?

vellum-ai (a GitHub organization) maintains it in vellum-ai/vellum-assistant, which has 1,397 GitHub stars. The repository holds 108 skills in this directory. The repository was last updated on October 7, 2026.

Source: vellum-ai/vellum-assistant on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.