Evaluates whether the agent selected appropriate MCP tools instead of shell workarounds.

Custom licenceAuto-check passedAgent Workflows

Install Tool Selection

skills CLI
$ npx skills add databricks-solutions/ai-dev-kit --skill tool-selection -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install databricks-solutions/ai-dev-kit tool-selection --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/databricks-solutions/ai-dev-kit.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.test/eval-criteria/tool-selection .claude/skills/tool-selection && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
tool-selection
GitHub stars
1.9k
Token cost
~519 tokens
SKILL.md length
224 words
Files
2 (incl. references)
Skills in repo
5
Repo updated
First seen
Licence
Custom licence

At a glance

Evaluates whether the agent selected appropriate MCP tools instead of shell workarounds.

  • Works in 5 steps: MCP Over Bash → Correct Tool for Task → No Shell Workarounds → …
  • Tasks that involve MCP servers
  • Calls databricks

What it does

Tool Selection is an agent skill from databricks-solutions/ai-dev-kit. Evaluates whether the agent selected appropriate MCP tools instead of shell workarounds. Load when the trace contains Bash tool calls that could have used MCP tools, or when evaluating tool call efficiency.

Its SKILL.md is about 520 tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files, including reference files (for example `references/MCP_TOOL_GUIDE.md`).

It sits in Agent Workflows, covering MCP servers. It works with Bash, Databricks, Model Context Protocol and SQL. The repository describes itself as: Databricks Toolkit for Coding Agents provided by Field Engineering.

When your agent uses it

  • Tasks that involve MCP servers

Example prompts

  • “Use the tool-selection skill to evaluate whether the agent selected appropriate MCP tools instead of shell workarounds”
  • “/tool-selection”

Requirements

  • Python 3

Workflow steps

5 steps, taken from the step headings in SKILL.md.

  1. MCP Over Bash
  2. Correct Tool for Task
  3. No Shell Workarounds
  4. Reasonable Call Count
  5. Error Recovery

What it can do on your machine

Read from SKILL.md and the folder at commit b059fd0. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • databricks

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    No URLs in SKILL.md.

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names no API keys, tokens, secrets or passwords.

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Tool Selection loads about 519 tokens when it runs, and up to ~1.1k if it reads all its reference files. Until then it costs about 55 tokens; SKILL.md has 224 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~55
When it runs · the whole SKILL.md, loaded when a task matches
~519
With references · SKILL.md plus every file in references/, read only if the agent opens them
~1.1k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check passed

The automated check found no risky patterns in SKILL.md.

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 224 words (~519 tokens).

“When evaluating tool selection in agent traces:”

— opening of SKILL.md by databricks-solutions, Custom licence
name
tool-selection
metadata.category
evaluation
metadata.version
1.0

Read the full SKILL.md on GitHub

Files

SKILL.md and 1 other file (references) in .test/eval-criteria/tool-selection of databricks-solutions/ai-dev-kit.

  • SKILL.md
  • references/MCP_TOOL_GUIDE.md

Open the folder on GitHubat commit b059fd0

Compare with similar skills

Tool Selection next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Tool Selection compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Tool Selection this skilldatabricks-solutions/ai-dev-kit1.9k—~519Automated safety check: PassCustom licence
Crush Configurationcharmbracelet/crush29k—~3.7kAutomated safety check: PassCustom licence
Record Demoapify/mcpc981—~3.3kAutomated safety check: NotesApache-2.0
Releasejgravelle/jcodemunch-mcp2.7k—~6.5kAutomated safety check: PassCustom licence
Mcpcapify/mcpc981—~3.5kAutomated safety check: PassApache-2.0
Meridian MCPMeridiona/meridian405—~967Automated safety check: NotesCustom licence

Similar skills

  • Crush Configuration

    charmbracelet/crush

    Explains how to configure the Crush coding agent with crushrc or crush.json, covering providers, models, LSPs, MCP servers, hooks, permissions and config precedence.

    29k GitHub stars~3.7k tokensUpdated today
    Agent WorkflowsAuto-check passed
  • Record Demo

    apify/mcpc

    Official

    Record or regenerate the mcpc demo GIFs (the README hero docs/images/mcpc-demo.gif and the focused tapes in docs/vhs/) with VHS.

    981 GitHub stars~3.3k tokensUpdated today
    Agent WorkflowsAuto-check: notes
  • Release

    jgravelle/jcodemunch-mcp

    Publishing a jMunch release (jcodemunch-mcp, jdocmunch-mcp, jdatamunch-mcp, jragmunch-cli), reviewing/merging/closing PRs, and responding to the community.

    2.7k GitHub stars~6.5k tokensUpdated today
    Agent WorkflowsAuto-check passed
  • Mcpc

    apify/mcpc

    Official

    Use the mcpc CLI to work with MCP (Model Context Protocol) servers from the shell - connect to a server as a persistent session, then list and call tools, read resources, get prompts, and run async…

    981 GitHub stars~3.5k tokensUpdated today
    Agent WorkflowsAuto-check passed
  • Meridian MCP

    Meridiona/meridian

    Build, configure, and debug the Meridian MCP server. An agent skill from Meridiona/meridian.

    405 GitHub stars~967 tokensUpdated today
    Agent WorkflowsAuto-check: notes
  • Orchard

    okooo5km/Skills4U

    Use the local Orchard app to interact with macOS Apple apps and services: Calendar, Reminders, Clock, Mail, Contacts, Notes, Music, Weather, Messages, Location/Maps, and Apple Shortcuts.

    183 GitHub stars~5k tokensUpdated today
    Agent WorkflowsAuto-check: warnings

More from databricks-solutions/ai-dev-kit

  • Skill Test

    databricks-solutions/ai-dev-kit

    Testing framework for evaluating Databricks skills. An agent skill from databricks-solutions/ai-dev-kit.

    1.9k GitHub stars~1.9k tokensUpdated 1 mo ago
    Auto-check passed
  • Python Dev

    databricks-solutions/ai-dev-kit

    Python development guidance with code quality standards, error handling, testing practices, and environment management.

    1.9k GitHub stars~1.6k tokensUpdated 1 mo ago
    Auto-check passed
  • SQL Correctness

    databricks-solutions/ai-dev-kit

    SQL evaluation criteria for Databricks. An agent skill from databricks-solutions/ai-dev-kit.

    1.9k GitHub stars~438 tokensUpdated 1 mo ago
    Auto-check passed
  • General Quality

    databricks-solutions/ai-dev-kit

    General response quality evaluation. An agent skill from databricks-solutions/ai-dev-kit.

    1.9k GitHub stars~358 tokensUpdated 1 mo ago
    Auto-check passed

Categories

Questions about Tool Selection

What does Tool Selection do?

Evaluates whether the agent selected appropriate MCP tools instead of shell workarounds. Tool Selection is an agent skill from databricks-solutions/ai-dev-kit. Evaluates whether the agent selected appropriate MCP tools instead of shell workarounds.

When should I use Tool Selection?

Tool Selection fits situations like: tasks that involve MCP servers.

How do I install Tool Selection in Claude Code?

Run `npx skills add databricks-solutions/ai-dev-kit --skill tool-selection -a claude-code`. Or copy the skill folder (.test/eval-criteria/tool-selection in databricks-solutions/ai-dev-kit) into .claude/skills/tool-selection in your project. Claude Code loads it when a task matches its description.

How do I install Tool Selection in Codex?

Run `npx skills add databricks-solutions/ai-dev-kit --skill tool-selection -a codex`. Or copy the skill folder (.test/eval-criteria/tool-selection in databricks-solutions/ai-dev-kit) into .agents/skills/tool-selection in your project. Codex loads it when a task matches its description.

Can I use Tool Selection in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add databricks-solutions/ai-dev-kit --skill tool-selection -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/tool-selection, .gemini/skills/tool-selection, .github/skills/tool-selection and .opencode/skills/tool-selection in your project.

What does Tool Selection need to run?

Going by SKILL.md and its folder, Tool Selection needs the command-line tools its instructions call (databricks). Our summary lists: Python 3.

Does Tool Selection access the network?

SKILL.md contains no URLs. Any network use would come from the scripts or tools the agent runs. This is read from the text; nothing was executed.

Is Tool Selection safe to install?

Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.

What licence does Tool Selection use?

Tool Selection has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Tool Selection use?

About 519 tokens (SKILL.md is roughly 2.1k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full. Its references folder adds about 567 tokens, read only when the agent opens those files.

What are the alternatives to Tool Selection?

Skills that share tags, products or a category with Tool Selection: Crush Configuration (charmbracelet/crush, 29k stars), Record Demo (apify/mcpc, 981 stars), Release (jgravelle/jcodemunch-mcp, 2.7k stars) and Mcpc (apify/mcpc, 981 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Tool Selection?

databricks-solutions (a GitHub organization) maintains it in databricks-solutions/ai-dev-kit, which has 1,938 GitHub stars. The repository holds 5 skills in this directory. The repository was last updated on August 13, 2026.

Source: databricks-solutions/ai-dev-kit on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.