Official agent skill

Rubydex MCP Benchmark

by Shopify in Shopify/rubydex

A skill your agent uses when benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks.

OfficialCustom licenceAuto-check passedAgent Workflows

Install Rubydex MCP Benchmark

skills CLI
$ npx skills add Shopify/rubydex --skill rubydex-mcp-benchmark -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install Shopify/rubydex rubydex-mcp-benchmark --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/Shopify/rubydex.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.claude/skills/rubydex-mcp-benchmark .claude/skills/rubydex-mcp-benchmark && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
rubydex-mcp-benchmark
GitHub stars
364
Token cost
~1k tokens
SKILL.md length
389 words
Files
1
Skills in repo
4
Repo updated
First seen
Licence
Custom licence

At a glance

A skill your agent uses when benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks.

  • Works in 5 steps: Find a Good Benchmark Candidate → Set Up the Experiment → Generate Commands for the Developer → …
  • Benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks
  • SKILL.md covers Prerequisites, Step 1: Find a Good Benchmark…, Step 2: Set Up the Experiment and Step 3: Generate Commands for…, plus 3 more sections
  • Calls git, claude and cargo

What it does

Rubydex MCP Benchmark is an agent skill from Shopify/rubydex, published by the product's own GitHub organization. Use when benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks. Guides A/B comparison setup, candidate selection, and metrics collection.

Its SKILL.md is about 1k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.

It sits in Agent Workflows, covering MCP servers. It works with Model Context Protocol and Ruby. The repository describes itself as: A high-performance static analysis toolkit for Ruby.

When your agent uses it

  • Benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks
  • Tasks that involve MCP servers

Example prompts

  • “/rubydex-mcp-benchmark”

Workflow steps

5 steps, taken from the step headings in SKILL.md.

  1. Find a Good Benchmark Candidate
  2. Set Up the Experiment
  3. Generate Commands for the Developer
  4. Compare Results
  5. Cleanup

What it can do on your machine

Read from SKILL.md and the folder at commit aa87702. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • git
    • claude
    • cargo

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md. Its commands use git, which can reach the network depending on how they are called.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Rubydex MCP Benchmark loads about 1k tokens when it runs. Until then it costs about 44 tokens; SKILL.md has 389 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~44
When it runs · the whole SKILL.md, loaded when a task matches
~1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 389 words (~1,024 tokens).

“Compare rubydex MCP-assisted development vs standard Grep/Glob for Ruby code tasks.”

— opening of SKILL.md by Shopify, Custom licence
name
rubydex-mcp-benchmark

Read the full SKILL.md on GitHub

Files

Just SKILL.md in .claude/skills/rubydex-mcp-benchmark of Shopify/rubydex.

Open the folder on GitHubat commit aa87702

Compare with similar skills

Rubydex MCP Benchmark next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Rubydex MCP Benchmark compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Rubydex MCP Benchmark this skillShopify/rubydex364—~1kAutomated safety check: PassCustom licence
Ruby MCP Server Generatorgithub/awesome-copilot40k1 repos~3.6kAutomated safety check: PassMIT
MCP SDK Tier Auditmodelcontextprotocol/conformance129—~4.4kAutomated safety check: PassCustom licence
MCP Server Builderanthropics/skills180k63 repos~2.3kAutomated safety check: PassApache-2.0
MCP Server BuildershareAI-lab/learn-claude-code78k5 repos~1.2kAutomated safety check: PassMIT
MCP Integration for Pluginsanthropics/claude-plugins-official38k11 repos~3.1kAutomated safety check: PassApache-2.0

Similar skills

  • Ruby MCP Server Generator

    github/awesome-copilot

    Official

    Generate a complete Model Context Protocol server project in Ruby using the official MCP Ruby SDK gem.

    40k GitHub starsUsed in 1 repo~3.6k tokens
    Agent WorkflowsAuto-check passed
  • MCP SDK Tier Audit

    modelcontextprotocol/conformance

    Official

    Comprehensive tier assessment for an MCP SDK repository against SEP-1730.

    129 GitHub stars~4.4k tokensUpdated 4 days ago
    MobileAuto-check passed
  • MCP Server Builder

    anthropics/skills

    Official

    Guides the design and implementation of Model Context Protocol servers in TypeScript or Python, from tool naming and error messages to evaluation.

    180k GitHub starsUsed in 63 repos~2.3k tokens
    Agent WorkflowsAuto-check passed
  • MCP Server Builder

    shareAI-lab/learn-claude-code

    Walks through building MCP servers in Python or TypeScript that expose tools, resources and prompts to Claude, with templates, registration and testing.

    78k GitHub starsUsed in 5 repos~1.2k tokens
    Agent WorkflowsAuto-check passed
  • MCP Integration for Plugins

    anthropics/claude-plugins-official

    Official

    Explains how to bundle Model Context Protocol servers in a Claude Code plugin, covering config files, stdio, SSE, HTTP and WebSocket server types, and authentication.

    38k GitHub starsUsed in 11 repos~3.1k tokens
    Agent WorkflowsAuto-check passed
  • Crush Configuration

    charmbracelet/crush

    Explains how to configure the Crush coding agent with crushrc or crush.json, covering providers, models, LSPs, MCP servers, hooks, permissions and config precedence.

    29k GitHub stars~3.7k tokensUpdated today
    Agent WorkflowsAuto-check passed

More from Shopify/rubydex

  • Profiling

    Shopify/rubydex

    Official

    Profile Rubydex indexer performance — CPU flamegraphs, memory usage, phase-level timing.

    364 GitHub stars~2.3k tokensUpdated yesterday
    Auto-check: notes
  • Send Private Method

    Shopify/rubydex

    Official

    Remediate a send/send call that reaches a private method, restoring a real public seam instead of bypassing visibility.

    364 GitHub stars~1.8k tokensUpdated yesterday
    Auto-check passed
  • Benchmark Rbs

    Shopify/rubydex

    Official

    Benchmark Rubydex indexing performance on RBS core/stdlib, comparing the current branch against main.

    364 GitHub stars~723 tokensUpdated yesterday
    Auto-check passed

Categories

Questions about Rubydex MCP Benchmark

What does Rubydex MCP Benchmark do?

A skill your agent uses when benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks. Rubydex MCP Benchmark is an agent skill from Shopify/rubydex, published by the product's own GitHub organization. Use when benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks.

When should I use Rubydex MCP Benchmark?

Rubydex MCP Benchmark fits situations like: benchmarking rubydex MCP against plain Grep/Glob for Ruby code tasks; tasks that involve MCP servers.

How do I install Rubydex MCP Benchmark in Claude Code?

Run `npx skills add Shopify/rubydex --skill rubydex-mcp-benchmark -a claude-code`. Or copy the skill folder (.claude/skills/rubydex-mcp-benchmark in Shopify/rubydex) into .claude/skills/rubydex-mcp-benchmark in your project. Claude Code loads it when a task matches its description.

How do I install Rubydex MCP Benchmark in Codex?

Run `npx skills add Shopify/rubydex --skill rubydex-mcp-benchmark -a codex`. Or copy the skill folder (.claude/skills/rubydex-mcp-benchmark in Shopify/rubydex) into .agents/skills/rubydex-mcp-benchmark in your project. Codex loads it when a task matches its description.

Can I use Rubydex MCP Benchmark in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add Shopify/rubydex --skill rubydex-mcp-benchmark -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/rubydex-mcp-benchmark, .gemini/skills/rubydex-mcp-benchmark, .github/skills/rubydex-mcp-benchmark and .opencode/skills/rubydex-mcp-benchmark in your project.

What does Rubydex MCP Benchmark need to run?

Going by SKILL.md and its folder, Rubydex MCP Benchmark needs the command-line tools its instructions call (git, claude and cargo).

Does Rubydex MCP Benchmark access the network?

SKILL.md contains no URLs. Its commands use git, which can reach the network depending on how they are called. This is read from the text; nothing was executed.

Is Rubydex MCP Benchmark safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Rubydex MCP Benchmark use?

Rubydex MCP Benchmark has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Rubydex MCP Benchmark use?

About 1k tokens (SKILL.md is roughly 4.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Rubydex MCP Benchmark?

Skills that share tags, products or a category with Rubydex MCP Benchmark: Ruby MCP Server Generator (github/awesome-copilot, 40k stars), MCP SDK Tier Audit (modelcontextprotocol/conformance, 129 stars), MCP Server Builder (anthropics/skills, 180k stars) and MCP Server Builder (shareAI-lab/learn-claude-code, 78k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Rubydex MCP Benchmark?

Shopify (a GitHub organization, an official publisher) maintains it in Shopify/rubydex, which has 364 GitHub stars. The repository holds 4 skills in this directory. The repository was last updated on October 8, 2026.

Source: Shopify/rubydex on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.