LLM Benchmarking with lm-evaluation-harness
Orchestra-Research/AI-Research-SKILLs
Runs lm-evaluation-harness to benchmark language models on academic suites such as MMLU, GSM8K and HumanEval, compare models and track training checkpoints.
Finds top models for a task from official Hugging Face benchmark leaderboards, filters them to what fits your hardware, and returns a comparison table with scores.
$ npx skills add huggingface/skills --skill huggingface-best -a claude-codeProject install by default; add -g for ~/.claude/skills/.
$ gh skill install huggingface/skills huggingface-best --agent claude-codeProject scope by default; add --scope user for a personal install. Needs GitHub CLI 2.90.0 or later (public preview).
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .claude/skills && cp -r skills-src/skills/huggingface-best .claude/skills/huggingface-best && rm -rf skills-srcUse ~/.claude/skills/ instead of .claude/skills for a personal install. The folder must contain SKILL.md.
Claude Code skills documentation · loads skills from .claude/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .claude/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.Claude Code copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$skill-installer install https://github.com/huggingface/skills/tree/main/skills/huggingface-bestType this inside Codex. $skill-installer <name> installs a curated skill from openai/skills. The installer writes to $CODEX_HOME/skills (default ~/.codex/skills). Restart Codex if the skill does not show up.
$ npx skills add huggingface/skills --skill huggingface-best -a codexProject install goes to .agents/skills/; add -g for ~/.codex/skills/.
$ gh skill install huggingface/skills huggingface-best --agent codexProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .agents/skills && cp -r skills-src/skills/huggingface-best .agents/skills/huggingface-best && rm -rf skills-srcUse ~/.agents/skills/ instead of .agents/skills for a personal install.
Codex skills documentation · loads skills from .agents/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .agents/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.Codex copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add huggingface/skills --skill huggingface-best -a cursorProject install goes to .agents/skills/; add -g for ~/.cursor/skills/.
$ gh skill install huggingface/skills huggingface-best --agent cursorProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .cursor/skills && cp -r skills-src/skills/huggingface-best .cursor/skills/huggingface-best && rm -rf skills-srcUse ~/.cursor/skills/ instead of .cursor/skills for a personal install.
Cursor skills documentation · loads skills from .cursor/skills/, .agents/skills/, .claude/skills/, .codex/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .cursor/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.Cursor copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gemini skills install https://github.com/huggingface/skills.git --path skills/huggingface-best--scope user (default) or --scope workspace; --path is the subfolder of the repo that holds the skill; --consent skips the security confirmation prompt.
$ npx skills add huggingface/skills --skill huggingface-best -a gemini-cliProject install goes to .agents/skills/; add -g for ~/.gemini/skills/.
$ gh skill install huggingface/skills huggingface-best --agent gemini-cliProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .gemini/skills && cp -r skills-src/skills/huggingface-best .gemini/skills/huggingface-best && rm -rf skills-srcUse ~/.gemini/skills/ instead of .gemini/skills for a personal install, then run /skills reload.
Gemini CLI skills documentation · loads skills from .gemini/skills/, .agents/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .gemini/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.Gemini CLI copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ gh skill install huggingface/skills huggingface-bestInstalls for Copilot at project scope by default; add --scope user for a personal install. Preview a skill first with gh skill preview. Needs GitHub CLI 2.90.0 or later (public preview).
$ npx skills add huggingface/skills --skill huggingface-best -a github-copilotProject install goes to .agents/skills/; add -g for ~/.copilot/skills/.
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .github/skills && cp -r skills-src/skills/huggingface-best .github/skills/huggingface-best && rm -rf skills-srcUse ~/.copilot/skills/ instead of .github/skills for a personal install. Commit .github/skills so cloud agent and code review can use it.
GitHub Copilot skills documentation · loads skills from .github/skills/, .claude/skills/, .agents/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .github/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.GitHub Copilot copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
$ npx skills add huggingface/skills --skill huggingface-best -a opencodeOpenCode documents no install command of its own. Project install goes to .agents/skills/; add -g for ~/.config/opencode/skills/.
$ gh skill install huggingface/skills huggingface-best --agent opencodeProject scope by default (.agents/skills/); add --scope user for a personal install.
$ git clone --depth 1 https://github.com/huggingface/skills.git skills-src && mkdir -p .opencode/skills && cp -r skills-src/skills/huggingface-best .opencode/skills/huggingface-best && rm -rf skills-srcUse ~/.config/opencode/skills/ instead of .opencode/skills for a personal install.
OpenCode skills documentation · loads skills from .opencode/skills/, .claude/skills/, .agents/skills/
Install the "huggingface-best" agent skill from https://github.com/huggingface/skills/tree/main/skills/huggingface-best into .opencode/skills/huggingface-best/ in this project. Copy the whole folder (SKILL.md and every file beside it), keep the folder name "huggingface-best", then confirm the skill loads.OpenCode copies the folder itself, the same result as the manual copy. Check what it changed before you commit it.
huggingface-bestFinds top models for a task from official Hugging Face benchmark leaderboards, filters them to what fits your hardware, and returns a comparison table with scores.
The skill reads your request for a task (coding, math and reasoning, chat, OCR, retrieval, speech recognition, image classification and similar) and for any device limit. When a device is named, it works out a parameter budget from the available memory: roughly the memory in GB divided by two for fp16 models, or multiplied by two for Q4 quantized ones. With no device given, it skips filtering and ranks by performance alone.
It then lists the official benchmark datasets through the Hugging Face API, picks every one relevant to the task, and pulls the top entries from each leaderboard, skipping any that return errors and noting them in the output. The leading candidates are enriched with model metadata such as size and tags, and the result is a comparison table of benchmark scores. Requests use curl and jq with a token read from the local Hugging Face cache.
6 steps, taken from the step headings in SKILL.md.
Read from SKILL.md and the folder at commit c3ff942. It shows what the files ask for, not the result of running them.
Pre-approves nothing: there is no allowed-tools line, so your agent's usual permission prompts apply.
From allowed-tools in the SKILL.md frontmatter.
Shell commands in SKILL.md call:
jqcurlhfFrom the folder's file list and the shell code blocks in SKILL.md.
Hosts in commands or code, which the agent is likely to contact:
huggingface.coFrom URLs in SKILL.md, links to its own repository left out.
Names no API keys, tokens, secrets or passwords.
From names ending in _API_KEY, _TOKEN, _SECRET, _KEY or _PASSWORD in SKILL.md.
Hugging Face Best Model Finder loads about 1.5k tokens when it runs. Until then it costs about 161 tokens; SKILL.md has 581 words of instructions outside code blocks.
Estimates: characters ÷ 4, the usual rule of thumb; real counts depend on the model's tokenizer. Scripts and assets cost tokens only if the agent reads them.
The automated check found no risky patterns in SKILL.md.
Automated static check — not a guarantee. Review scripts before installing. It scans the text of SKILL.md for risky patterns (piping downloads into a shell, reading credential files, hidden Unicode, destructive commands); files beside SKILL.md are not scanned.
The full file from huggingface/skills at commit c3ff942, republished under its Apache-2.0 licence (© huggingface). 581 words, ~1,453 tokens.
.claude/skills/huggingface-best/SKILL.md (or your agent's skills folder).Finds the best models for a task by querying official HF benchmark leaderboards, enriching results with model size data, filtering for what fits on the user's device, and returning a comparison table with benchmark scores.
Extract from the user's message:
If device is not mentioned, skip filtering entirely and return the highest-performing models regardless of size. If the task is genuinely ambiguous, ask one clarifying question.
When a device is specified, extract its available memory (unified RAM for Apple Silicon, VRAM for discrete GPUs) and apply:
Examples: 16GB → 8B fp16 / 32B Q4 — 24GB VRAM → 12B fp16 / 48B Q4 — 8GB → 4B fp16 / 16B Q4
Fetch the full list of official HF benchmarks:
curl -s -H "Authorization: Bearer $(cat ~/.cache/huggingface/token)" \
"https://huggingface.co/api/datasets?filter=benchmark:official&limit=500" | jq '[.[] | {id, tags, description}]'Read the returned list and select the datasets most relevant to the user's task — match on dataset id, tags, and description. Use your judgment; don't limit yourself to 2-3. Aim for comprehensive coverage: if 5 benchmarks clearly cover the task, use all 5.
For each selected benchmark dataset:
curl -s -H "Authorization: Bearer $(cat ~/.cache/huggingface/token)" \
"https://huggingface.co/api/datasets/<namespace>/<repo>/leaderboard" | jq '[.[:15] | .[] | {rank, modelId, value, verified}]'Collect model IDs and scores across all benchmarks. If a leaderboard returns an error (404, 401, etc.), skip it and note it in the output.
For the top 10-15 candidate model IDs, get model infos.
# REST API
curl -s -H "Authorization: Bearer $(cat ~/.cache/huggingface/token)" \
"https://huggingface.co/api/models/org/model1" | jq '{safetensors, tags, cardData}'
# CLI (hf-cli)
hf models info org/model1 --json | jq '{safetensors, tags, cardData}'Extract from each response:
safetensors.total → convert to B (e.g., 7_241_748_480 → "7.2B")license:apache-2.0, license:mit, etc.)safetensors is absent, parse size from the model name (look for "7b", "8b", "13b", "70b", "72b", etc.)If a device was specified:
If no device was mentioned: skip all size filtering — just rank by benchmark score.
Then: rank by benchmark score (descending), keep top 5-8 models.
Include proprietary models (GPT-4, Claude, Gemini) if they appear on leaderboards, but flag them as "API only / not self-hostable". If the user explicitly asked for local/open models only, exclude them.
| # | Model | Params | [Benchmark 1] | [Benchmark 2] | License | On device |
|---|-------|--------|--------------|--------------|---------|-----------|
| ⭐1 | [org/name](https://huggingface.co/org/name) | 7B | 85.2% | — | Apache 2.0 | Yes (fp16) |
| 2 | [org/name](https://huggingface.co/org/name) | 13B | 83.1% | 71.5% | MIT | Q4 only |
| 3 | [org/name](https://huggingface.co/org/name) | 70B | 90.0% | 81.0% | Llama | Too large |https://huggingface.co/<model_id>— for benchmarks where the model wasn't evaluatedYes (fp16), Q4 only, Too large, API onlyAfter presenting the table, ask the user: "Would you like to run [top recommended model]?"
If they say yes, ask whether they'd prefer to:
hub_repo_search with filters=["<task>"] sorted by trendingScorehub_repo_search for popular models tagged with the task, note that results are by popularity rather than benchmark score© huggingface, Apache-2.0. Rendered from Markdown: HTML in the file is shown as text, images as links, and headings moved down two levels. Raw file
Just SKILL.md in skills/huggingface-best of huggingface/skills.
Open the folder on GitHubat commit c3ff942
We found 7 copies of this SKILL.md (exact, near-identical or edited) in other folders, from 2 other GitHub owners. This page covers the copy in huggingface/skills, which our catalogue first saw on October 7, 2026.
Hugging Face Best Model Finder next to the 5 skills that share the most tags, products or categories with it. Stars are the repository's; “used in” counts other GitHub owners with a copy.
| Skill | Stars | Used in | Tokens | Auto-check | Licence | Repo updated |
|---|---|---|---|---|---|---|
| Hugging Face Best Model Finder this skillhuggingface/skills | 11k | 2 repos | ~1.5k | Automated safety check: Pass | Apache-2.0 | |
| LLM Benchmarking with lm-evaluation-harnessOrchestra-Research/AI-Research-SKILLs | 13k | 8 repos | ~3k | Automated safety check: Pass | MIT | |
| Code Model Evaluation HarnessOrchestra-Research/AI-Research-SKILLs | 13k | 4 repos | ~2.9k | Automated safety check: Pass | MIT | |
| Hugging Face Community Evalshenryalouf/ruflow | 157 | — | ~1.6k | Automated safety check: Pass | MIT | |
| Hugging Face Community Evalssickn33/agentic-awesome-skills | 47k | 1 repos | ~1.9k | Automated safety check: Pass | Apache-2.0 | |
| Huggingface Community Evalssickn33/agentic-awesome-skills | 47k | 1 repos | ~1.7k | Automated safety check: Pass | MIT |
Orchestra-Research/AI-Research-SKILLs
Runs lm-evaluation-harness to benchmark language models on academic suites such as MMLU, GSM8K and HumanEval, compare models and track training checkpoints.
Orchestra-Research/AI-Research-SKILLs
Benchmarks code generation models with the BigCode Evaluation Harness across HumanEval, MBPP, MultiPL-E and other suites using pass@k metrics.
henryalouf/ruflow
Run local evaluations for Hugging Face Hub models with inspect-ai or lighteval.
sickn33/agentic-awesome-skills
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware.
sickn33/agentic-awesome-skills
Curated upstream guidance for Huggingface Community Evals; use when the workflow matches the user goal.
huggingface/blog
A skill your agent uses when adding or migrating non-thumbnail images for a Hugging Face Blog post.
huggingface/skills
Finds or validates a usable SageMaker execution role before deploying or training, so scripts do not try to create IAM roles they lack permission to create.
huggingface/skills
Chooses the right serving container and current image URI for deploying a Hugging Face model to a SageMaker endpoint, preferring Hugging Face images over generic ones.
huggingface/skills
Routes a sentence-transformers training task to the right model type and required reference docs and example scripts, covering bi-encoders, rerankers, sparse and multi-vector models.
huggingface/skills
Sets up an isolated Python environment with a supported interpreter and current boto3 before any SageMaker deployment, training or AWS automation code runs.
huggingface/skills
Runs evaluations of Hugging Face Hub models on local hardware with inspect-ai or lighteval, and helps choose between vLLM, Transformers and accelerate backends.
huggingface/skills
Deploys SageMaker endpoints with autoscaling, CloudWatch alarms and tags on by default, using scripts for real-time, scale-to-zero and async setups.
Works with
Categories
Finds top models for a task from official Hugging Face benchmark leaderboards, filters them to what fits your hardware, and returns a comparison table with scores. The skill reads your request for a task (coding, math and reasoning, chat, OCR, retrieval, speech recognition, image classification and similar) and for any device limit. When a device is named, it works out a parameter budget from the available memory: roughly the memory in GB divided by two for fp16 models, or multiplied by two for Q4 quantized ones.
Hugging Face Best Model Finder fits situations like: picking a model for a task such as OCR, coding or speech recognition; finding which models fit a laptop or GPU with limited memory; comparing candidate models by official benchmark scores.
Run `npx skills add huggingface/skills --skill huggingface-best -a claude-code`. Or copy the skill folder (skills/huggingface-best in huggingface/skills) into .claude/skills/huggingface-best in your project. Claude Code loads it when a task matches its description.
Run `npx skills add huggingface/skills --skill huggingface-best -a codex`. Or copy the skill folder (skills/huggingface-best in huggingface/skills) into .agents/skills/huggingface-best in your project. Codex loads it when a task matches its description.
Cursor, Gemini CLI, GitHub Copilot and OpenCode also load SKILL.md folders. With the skills CLI, run `npx skills add huggingface/skills --skill huggingface-best -a cursor` (or -a gemini-cli, github-copilot or opencode for the others). To copy it by hand, put the folder in .cursor/skills/huggingface-best, .gemini/skills/huggingface-best, .github/skills/huggingface-best and .opencode/skills/huggingface-best in your project.
Going by SKILL.md and its folder, Hugging Face Best Model Finder needs the command-line tools its instructions call (jq, curl and hf). Our summary lists: Network access to the Hugging Face API; A Hugging Face token at ~/.cache/huggingface/token; curl and jq.
SKILL.md names 1 domain. In commands or code: huggingface.co; the agent is likely to contact it when it follows the instructions. This is read from the text; nothing was executed.
Our automated static check of SKILL.md found no risky patterns, such as piping downloads into a shell, reading credential files or hidden Unicode. It is not a guarantee. Review the folder before installing.
Hugging Face Best Model Finder is published under the Apache-2.0 licence (the repository's licence). It allows redistribution, so the full SKILL.md is shown on this page.
About 1.5k tokens (SKILL.md is roughly 5.8k characters). Agents keep only the skill's name and description in context until a task matches; then they load SKILL.md in full.
Skills that share tags, products or a category with Hugging Face Best Model Finder: LLM Benchmarking with lm-evaluation-harness (Orchestra-Research/AI-Research-SKILLs, 13k stars), Code Model Evaluation Harness (Orchestra-Research/AI-Research-SKILLs, 13k stars), Hugging Face Community Evals (henryalouf/ruflow, 157 stars) and Hugging Face Community Evals (sickn33/agentic-awesome-skills, 47k stars). The comparison table on this page puts their stars, adoption, token cost, safety result and licence side by side.
huggingface (a GitHub organization, an official publisher) maintains it in huggingface/skills, which has 11,151 GitHub stars. The repository holds 25 skills in this directory. The repository was last updated on October 8, 2026.
Source: huggingface/skills on GitHub. Facts on this page come from the repository at the commit we read; the author's words are quoted as theirs.