Inngest Agents
Asymmetric-al/core
A skill your agent uses when building durable AI agents or agentic workflows with Inngest and AgentKit, including model calls, tool calls, multi-agent networks, human approval, realtime progress…
The step-by-step procedure for running this repo's Promptfoo evals with a generator and a judge over provider APIs.
Install Maplibre Running Evals
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evals --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/maplibre-running-evals .claude/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .claude/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evalsType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evals --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/maplibre-running-evals .agents/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .agents/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evals --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/maplibre-running-evals .cursor/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .cursor/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/maplibre/maplibre-agent-skills.git --path skills/maplibre-running-evals--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evals --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/maplibre-running-evals .gemini/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .gemini/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evalsInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/maplibre-running-evals .github/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .github/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install maplibre/maplibre-agent-skills maplibre-running-evals --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/maplibre/maplibre-agent-skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/maplibre-running-evals .opencode/skills/maplibre-running-evals && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "maplibre-running-evals" agent skill from https://github.com/maplibre/maplibre-agent-skills/tree/main/skills/maplibre-running-evals into .opencode/skills/maplibre-running-evals/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "maplibre-running-evals", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
Facts
- Skill name
maplibre-running-evals- GitHub stars
- 151
- Token cost
- ~3.3k tokens
- SKILL.md length
- 1,734 words
- Files
- 1
- Skills in repo
- 10
- Repo updated
- First seen
- Licence
- Custom licence
At a glance
The step-by-step procedure for running this repo's Promptfoo evals with a generator and a judge over provider APIs.
- Works in 8 steps: Set up and budget the run → Write the tests before the content → Run the baseline, with the skill withheld → …
- Starting a new skill and needing a baseline before writing content
- SKILL.md covers 1. Set up and budget the run, 2. Write the tests before the…, 3. Run the baseline, with the… and 4. Write content only for what…, plus 6 more sections
- Calls npm, curl and npx; reaches api.groq.com; needs GROQ_API_KEY and GOOGLE_API_KEY
What it does
Maplibre Running Evals is an agent skill from maplibre/maplibre-agent-skills. The step-by-step procedure for running this repo's Promptfoo evals with a generator and a judge over provider APIs. Use when starting a new skill and needing a baseline before writing content, when a run stalls or returns no data, when a provider rate-limits, or when deciding whether an edit needs a retest.
Its SKILL.md is about 3.3k tokens, which your agent loads only when the skill is triggered. It is a single SKILL.md file with no bundled scripts.
It sits in AI & LLM Engineering, covering LLM evaluation and Rate limiting. The repository describes itself as: Community-maintained agent skills for MapLibre GL JS — helping AI coding assistants write better mapping code.
When your agent uses it
- Starting a new skill and needing a baseline before writing content
- Returns no data
- A provider rate-limits
- Deciding whether an edit needs a retest
Example prompts
- “/maplibre-running-evals”
Requirements
- Node.js
- A credential in GROQ_API_KEY
- A credential in GOOGLE_API_KEY
Workflow steps
8 steps, taken from the step headings in SKILL.md.
- Set up and budget the run
- Write the tests before the content
- Run the baseline, with the skill withheld
- Write content only for what failed at baseline
- Run with the skill injected
- Diagnose before retrying
- When a retest is needed, and when it is not
- Record the result concisely
What it can do on your machine
Read from SKILL.md and the folder at commit 99f8774. It shows what the files ask for, not the result of running them.
Tool permissions
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Runs code
Shell commands in SKILL.md call:
npmcurlnpx
From the folder's file list and the shell code blocks in SKILL.md.
Network
Hosts in commands or code, which the agent is likely to contact:
api.groq.com
Also links to:
console.groq.com
From URLs in SKILL.md, links to its own repository left out.
Credentials
Names these keys or tokens, usually read from environment variables:
GROQ_API_KEYGOOGLE_API_KEY
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Context cost
Maplibre Running Evals loads about 3.3k tokens when it runs. Until then it costs about 83 tokens; SKILL.md has 1,734 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
Safety
Auto-check passed
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
SKILL.md
Its licence (Custom licence) doesn't allow us to republish the file, so here is its outline and opening line. It has 1,734 words (~3,266 tokens).
“Every eval here runs two roles over provider APIs: a generator, the model under test, and a judge, the model that grades each llm-rubric assertion. evals/README.md covers what to test and how to write prompts and rubrics; this is the…”
- name
- maplibre-running-evals
- status
- process
Files
Just SKILL.md in skills/maplibre-running-evals of maplibre/maplibre-agent-skills.
Open the folder on GitHubat commit 99f8774
Compare with similar skills
Maplibre Running Evals next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Maplibre Running Evals this skillmaplibre/maplibre-agent-skills | 151 | — | ~3.3k | Automated safety check: Pass | Custom licence | |
| Inngest AgentsAsymmetric-al/core | 381 | — | ~2.6k | Automated safety check: Pass | AGPL-3.0 | |
| LLM Benchmarking with lm-evaluation-harnessOrchestra-Research/AI-Research-SKILLs | 13k | 8 repos | ~3k | Automated safety check: Pass | MIT | |
| Hugging Face Local Model Evalshuggingface/skills | 11k | 2 repos | ~1.6k | Automated safety check: Pass | Apache-2.0 | |
| Looperksimback/looper | 710 | — | ~2.7k | Automated safety check: Notes | MIT | |
| Agent Eval Engineeringlangchain-ai/langchain-skills | 1.3k | — | ~4k | Automated safety check: Pass | MIT |
Similar skills
LLM Benchmarking with lm-evaluation-harness
Orchestra-Research/AI-Research-SKILLs
Runs lm-evaluation-harness to benchmark language models on academic suites such as MMLU, GSM8K and HumanEval, compare models and track training checkpoints.
- Official
Hugging Face Local Model Evals
huggingface/skills
Runs evaluations of Hugging Face Hub models on local hardware with inspect-ai or lighteval, and helps choose between vLLM, Transformers and accelerate backends.
Looper
ksimback/looper
Scaffold a well-designed agent loop with best-practice coaching and a cross-model review council.
- Official
Agent Eval Engineering
langchain-ai/langchain-skills
Builds agent evaluations in stages: inspect the repository and traces, agree a Task Spec with you, then build, audit and run a Harbor task with an independent verifier.
Quality Flywheel
GoogleCloudPlatform/vertex-ai-samples
Evaluate and improve GenAI models and agents using the Google GenAI Evaluation SDK.
More from maplibre/maplibre-agent-skills
All 10 skills in this repoMaplibre Cartography
maplibre/maplibre-agent-skills
Cartographic principles for MapLibre GL JS — label and symbol legibility on imagery vs.
Maplibre Fonts Glyphs
maplibre/maplibre-agent-skills
Configuring fonts and glyphs for MapLibre GL JS and MapLibre Native — the style's glyphs URL, self-hosting or generating font PBFs, the GL JS local-font fallback (omitted glyphs or a failed glyph…
Maplibre Mapbox Migration
maplibre/maplibre-agent-skills
Migrating from Mapbox GL JS to MapLibre GL JS — package and import changes, removing the access token, choosing tile sources, plugin equivalents, and what you gain or give up.
Maplibre Pmtiles Patterns
maplibre/maplibre-agent-skills
Serverless vector and raster tiles with PMTiles for MapLibre GL JS — single-file format, HTTP range requests, hosting on S3/R2/GitHub Pages, generating with Planetiler or tippecanoe, and the pmtiles…
Maplibre Source Wiring
maplibre/maplibre-agent-skills
Getting a MapLibre GL JS source to actually render — TileJSON url versus hand-wired tiles templates, matching source-layer names to the tile schema, layer order and inserting below labels, promoteId…
Maplibre Terrain Rendering
maplibre/maplibre-agent-skills
Drawing elevation in MapLibre GL JS once a raster-dem source works — hillshade and hillshade-method, the color-relief layer and the ["elevation"] expression, runtime contours with maplibre-contour…
Related
Categories
Questions about Maplibre Running Evals
What does Maplibre Running Evals do?
The step-by-step procedure for running this repo's Promptfoo evals with a generator and a judge over provider APIs. Maplibre Running Evals is an agent skill from maplibre/maplibre-agent-skills. The step-by-step procedure for running this repo's Promptfoo evals with a generator and a judge over provider APIs.
When should I use Maplibre Running Evals?
Maplibre Running Evals fits situations like: starting a new skill and needing a baseline before writing content; returns no data; A provider rate-limits; deciding whether an edit needs a retest.
How do I install Maplibre Running Evals in Claude Code?
Run `npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a claude-code`. Or copy the skill folder (skills/maplibre-running-evals in maplibre/maplibre-agent-skills) into .claude/skills/maplibre-running-evals in your project. Claude Code loads it when a task matches its description.
How do I install Maplibre Running Evals in Codex?
Run `npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a codex`. Or copy the skill folder (skills/maplibre-running-evals in maplibre/maplibre-agent-skills) into .agents/skills/maplibre-running-evals in your project. Codex loads it when a task matches its description.
Can I use Maplibre Running Evals in Cursor, Gemini CLI or GitHub Copilot?
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add maplibre/maplibre-agent-skills --skill maplibre-running-evals -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/maplibre-running-evals, .gemini/skills/maplibre-running-evals, .github/skills/maplibre-running-evals and .opencode/skills/maplibre-running-evals in your project.
What does Maplibre Running Evals need to run?
Going by SKILL.md and its folder, Maplibre Running Evals needs the command-line tools its instructions call (npm, curl and npx) and credentials named GROQ_API_KEY and GOOGLE_API_KEY. Our summary lists: Node.js; A credential in GROQ_API_KEY; A credential in GOOGLE_API_KEY.
Does Maplibre Running Evals access the network?
SKILL.md names 2 domains. In commands or code: api.groq.com; the agent is likely to contact it when it follows the instructions. As links in the text: console.groq.com. This is read from the text; nothing was executed.
Is Maplibre Running Evals safe to install?
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
What licence does Maplibre Running Evals use?
Maplibre Running Evals has a licence file (the repository's licence) that doesn't match a standard licence. Read it on GitHub before reusing the skill.
How many tokens does Maplibre Running Evals use?
About 3.3k tokens (SKILL.md is roughly 13k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
What are the alternatives to Maplibre Running Evals?
Skills that share tags, products or a category with Maplibre Running Evals: Inngest Agents (Asymmetric-al/core, 381 stars), LLM Benchmarking with lm-evaluation-harness (Orchestra-Research/AI-Research-SKILLs, 13k stars), Hugging Face Local Model Evals (huggingface/skills, 11k stars) and Looper (ksimback/looper, 710 stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
Who maintains Maplibre Running Evals?
maplibre (a GitHub organization) maintains it in maplibre/maplibre-agent-skills, which has 151 GitHub stars. The repository holds 10 skills in this directory. The repository was last updated on October 10, 2026.
Source: maplibre/maplibre-agent-skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.