New: 98,000+ skills indexed from GitHub repos with 100+ stars · every skill safety-checkedBrowse top skillsTop skills
Esc to closeBrowse all skills
Submit a skillBrowse skills
Submit a skillBrowse skills

Official agent skill

Evals Run On Demand

by elastic in elastic/kibana

Trigger an on-demand @kbn/evals Buildkite run by describing what you want in plain English.

OfficialCustom licenceAuto-check: notesAI & LLM Engineering

Install Evals Run On Demand

skills CLI
$ npx skills add elastic/kibana --skill evals-run-on-demand -a claude-code

Project install by default; add -g for ~/.claude/skills/.

GitHub CLI
$ gh skill install elastic/kibana evals-run-on-demand --agent claude-code

Project scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).

Manual copy
$ git clone --depth 1 https://github.com/elastic/kibana.git skills-src && mkdir -p .claude/skills && cp -r skills-src/.agents/skills/evals-run-on-demand .claude/skills/evals-run-on-demand && rm -rf skills-src

Use ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.

Claude Code skills documentation · loads skills from .claude/skills/

Facts

Skill name
evals-run-on-demand
GitHub stars
21k
Token cost
~2.6k tokens
SKILL.md length
973 words
Files
2
Skills in repo
40
Repo updated
First seen
Licence
Custom licence

At a glance

Trigger an on-demand @kbn/evals Buildkite run by describing what you want in plain English.

  • Works in 8 steps: Parse intent → Check bk authentication → Resolve suite(s) → …
  • An on-demand @kbn/evals Buildkite run by describing what you want in plain English
  • SKILL.md covers Prerequisites, Step 0: Parse intent, Step 1: Check bk authentication and Step 2: Resolve suite(s), plus 6 more sections
  • Calls gh and git; needs KIBANA_EIS_CCM_API_KEY

What it does

Evals Run On Demand is an agent skill from elastic/kibana, published by the product's own GitHub organization. Trigger an on-demand @kbn/evals Buildkite run by describing what you want in plain English. Use when asked to run evals, trigger a Buildkite eval build, test a suite against a model, or any phrasing that implies kicking off LLM evaluation. Accepts suite names, model names (EIS or OpenRouter), judge model, branch, and grep filter as natural language.

Its SKILL.md is about 2.6k tokens, which your agent loads only when the skill is triggered. The skill folder holds 2 other files (for example `agents/openai.yaml`).

It sits in AI & LLM Engineering, covering LLM evaluation and Model routing and gateways. It works with OpenRouter and Elasticsearch. The repository describes itself as: Your window into all of your data.

When your agent uses it

  • An on-demand @kbn/evals Buildkite run by describing what you want in plain English
  • Asked to run evals
  • Trigger a Buildkite eval build
  • Test a suite against a model

Example prompts

  • “/evals-run-on-demand”

Requirements

  • A credential in KIBANA_EIS_CCM_API_KEY
  • Pre-approved tools (allowed-tools): Bash, Read

Workflow steps

8 steps, taken from the step headings in SKILL.md.

  1. Parse intent
  2. Check bk authentication
  3. Resolve suite(s)
  4. Resolve branch
  5. Resolve models
  6. Build the command
  7. Confirm
  8. Execute and report

What it can do on your machine

Read from SKILL.md and the folder at commit 452e025. It shows what the files ask for, not the result of running them.

  • Tool permissions

    Pre-approves these tools, so the agent can use them without asking each time:

    • Bash
    • Read

    From allowed-tools in the SKILL.md frontmatter.

  • Runs code

    Shell commands in SKILL.md call:

    • gh
    • git

    From the folder's file list and the shell code blocks in SKILL.md.

  • Network

    Links to these hosts (documentation or services it may open):

    • github.com
    • buildkite.com

    From URLs in SKILL.md, links to its own repository left out.

  • Credentials

    Names these keys or tokens, usually read from environment variables:

    • KIBANA_EIS_CCM_API_KEY

    From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.

Context cost

Evals Run On Demand loads about 2.6k tokens when it runs. Until then it costs about 93 tokens; SKILL.md has 973 words of instructions outside code blocks.

Always · name and description, kept in context so the agent knows when to use it
~93
When it runs · the whole SKILL.md, loaded when a task matches
~2.6k

Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.

Safety

Auto-check: notes

The automated check noted patterns worth knowing about, such as sudo or a known installer.

  • NotePre-approves every shell command (allowed-tools: Bash)SKILL.md
    allowed-tools: Bash, Read

Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.

SKILL.md

Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 973 words (~2,606 tokens).

“Translate a plain-English request into a bk build create call against the kibana-evals-on-demand-llm-evals pipeline. The user wants to run: $ARGUMENTS”

— opening of SKILL.md by elastic, Custom licence
name
evals-run-on-demand
allowed-tools
Bash, Read
disable-model-invocation
true
argument-hint
[suite-name] [with <model>] [judged-by <model>] [on <branch>] [grep <pattern>]

Read the full SKILL.md on GitHub

Files

SKILL.md and 1 other file in .agents/skills/evals-run-on-demand of elastic/kibana.

  • SKILL.md
  • agents/openai.yaml

Open the folder on GitHubat commit 452e025

Compare with similar skills

Evals Run On Demand next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.

Evals Run On Demand compared with similar skills
SkillStarsUsed inTokensAuto-checkLicenceRepo updated
Evals Run On Demand this skillelastic/kibana21k—~2.6kAutomated safety check: NotesCustom licence
Add Modelget-convex/convex-evals130—~1.5kAutomated safety check: NotesApache-2.0
Legal AI Model Router Stephane Boghossianlawve-ai/awesome-legal-skills842—~1.5kAutomated safety check: PassAGPL-3.0-or-later
Embeddings via 9Routerdecolua/9router30k—~604Automated safety check: PassMIT
FreeRide Free Model ManagerShaivpidadi/FreeRide2372 repos~1.1kAutomated safety check: PassNone
Using Ccproxy Inspectorstarbaser/ccproxy350—~2.7kAutomated safety check: PassCustom licence

Similar skills

  • Add Model

    get-convex/convex-evals

    Add a new model to the convex-evals coding leaderboard, and optionally the decision benchmark, through a PR, then dispatch its baseline runs.

    130 GitHub stars~1.5k tokensUpdated today
    AI & LLM EngineeringAuto-check: notes

  • Legal AI Model Router Stephane Boghossian

    lawve-ai/awesome-legal-skills

    Routes any legal task to the right LLM, like OpenRouter but for legal work and grounded in benchmarks instead of brand loyalty.

    842 GitHub stars~1.5k tokensUpdated 7 days ago
    Legal & ComplianceAuto-check passed

  • Embeddings via 9Router

    decolua/9router

    Generates vector embeddings through the 9Router /v1/embeddings endpoint, using models from providers such as OpenAI, Gemini, Mistral and Voyage for RAG and semantic search.

    30k GitHub stars~604 tokensUpdated yesterday
    AI & LLM EngineeringAuto-check passed

  • FreeRide Free Model Manager

    Shaivpidadi/FreeRide

    Configures OpenClaw to use free OpenRouter models, setting the best one as primary and adding ranked fallbacks so rate limits do not interrupt work.

    237 GitHub starsUsed in 2 repos~1.1k tokens
    AI & LLM EngineeringAuto-check passed

  • Using Ccproxy Inspector

    starbaser/ccproxy

    Operates the ccproxy inspector MITM system for intercepting, inspecting, and transforming LLM API traffic.

    350 GitHub stars~2.7k tokensUpdated 2 mo ago
    AI & LLM EngineeringAuto-check passed

  • Outsourcerer

    alexgreensh/outsourcerer

    Cross-harness orchestrator for AI coding work. An agent skill from alexgreensh/outsourcerer.

    170 GitHub stars~5.5k tokensUpdated 20 days ago
    AI & LLM EngineeringAuto-check: notes

More from elastic/kibana

All 40 skills in this repo

  • Cypress To Scout Migration

    elastic/kibana

    Official

    Migrate Kibana Cypress E2E tests (.cy.ts) to Scout (Playwright).

    21k GitHub stars~3.8k tokensUpdated today
    Auto-check passed

  • Activate Connector

    elastic/kibana

    Official

    Creates a connector instance in a running Kibana. An agent skill from elastic/kibana.

    21k GitHub stars~1.9k tokensUpdated today
    Auto-check: notes

  • Codeql

    elastic/kibana

    Official

    Work with CodeQL in Kibana — write, test, and debug custom queries locally, fetch scan results from GitHub, and validate inline suppression comments.

    21k GitHub stars~1.7k tokensUpdated today
    Auto-check passed

  • Debug Oas

    elastic/kibana

    Official

    A skill your agent uses when debugging OpenAPI (OAS) issues for a specific API area in Kibana by scoping validation output with one or more --path filters, then separating structural invalid-OAS…

    21k GitHub stars~1.4k tokensUpdated today
    Auto-check passed

  • Evals Write Spec

    elastic/kibana

    Official

    Write LLM evaluation spec files with datasets, tasks, and evaluators using the @kbn/evals Playwright fixture.

    21k GitHub stars~2.3k tokensUpdated today
    Auto-check passed

  • Kbn GitHub

    elastic/kibana

    Official

    GitHub interactions via gh CLI for the Kibana repo. An agent skill from elastic/kibana.

    21k GitHub stars~1.3k tokensUpdated today
    Auto-check passed

Works with

Categories

Questions about Evals Run On Demand

What does Evals Run On Demand do?

Trigger an on-demand @kbn/evals Buildkite run by describing what you want in plain English. Evals Run On Demand is an agent skill from elastic/kibana, published by the product's own GitHub organization. Trigger an on-demand @kbn/evals Buildkite run by describing what you want in plain English.

When should I use Evals Run On Demand?

Evals Run On Demand fits situations like: an on-demand @kbn/evals Buildkite run by describing what you want in plain English; asked to run evals; trigger a Buildkite eval build; test a suite against a model.

How do I install Evals Run On Demand in Claude Code?

Run `npx skills add elastic/kibana --skill evals-run-on-demand -a claude-code`. Or copy the skill folder (.agents/skills/evals-run-on-demand in elastic/kibana) into .claude/skills/evals-run-on-demand in your project. Claude Code loads it when a task matches its description.

How do I install Evals Run On Demand in Codex?

Run `npx skills add elastic/kibana --skill evals-run-on-demand -a codex`. Or copy the skill folder (.agents/skills/evals-run-on-demand in elastic/kibana) into .agents/skills/evals-run-on-demand in your project. Codex loads it when a task matches its description.

Can I use Evals Run On Demand in Cursor, Gemini CLI or GitHub Copilot?

Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add elastic/kibana --skill evals-run-on-demand -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/evals-run-on-demand, .gemini/skills/evals-run-on-demand, .github/skills/evals-run-on-demand and .opencode/skills/evals-run-on-demand in your project.

What does Evals Run On Demand need to run?

Going by SKILL.md and its folder, Evals Run On Demand needs the command-line tools its instructions call (gh and git) and credentials named KIBANA_EIS_CCM_API_KEY. Our summary lists: A credential in KIBANA_EIS_CCM_API_KEY. Its frontmatter pre-approves these tools: Bash, Read.

Does Evals Run On Demand access the network?

SKILL.md names 2 domains. As links in the text: github.com and buildkite.com. This is read from the text; nothing was executed.

Is Evals Run On Demand safe to install?

Our automated static check of SKILL.md found notes only (pre-approves every shell command (allowed-tools: bash)), nothing it rates as a warning. It is not a guarantee. Review the folder before installing.

What licence does Evals Run On Demand use?

Evals Run On Demand has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.

How many tokens does Evals Run On Demand use?

About 2.6k tokens (SKILL.md is roughly 10k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.

What are the alternatives to Evals Run On Demand?

Skills that share tags, products or a category with Evals Run On Demand: Add Model (get-convex/convex-evals, 130 stars), Legal AI Model Router Stephane Boghossian (lawve-ai/awesome-legal-skills, 842 stars), Embeddings via 9Router (decolua/9router, 30k stars) and FreeRide Free Model Manager (Shaivpidadi/FreeRide, 237 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.

Who maintains Evals Run On Demand?

elastic (a GitHub organization, an official publisher) maintains it in elastic/kibana, which has 21,307 GitHub stars. The repository holds 40 skills in this directory. The repository was last updated on October 9, 2026.

Source: elastic/kibana on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.