Repository
azrtydxb/Fastllm-proxy agent skills
- skills
- 14
- GitHub stars
- 108
GitHub description: “The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.”
- Stars
- 108 (93 forks)
- Licence
- Apache-2.0
- Last push
- Oct 2026
- Created
- Aug 2026
- Homepage
- fastllm.azrty.com
- ai-gateway
- inference
- litellm
- llm
- llm-gateway
- load-balancing
- observability
- openai-api
- rbac
- reverse-proxy
- rust
- vllm
Install all skills
npx skills add azrtydxb/Fastllm-proxyAdd --skill <name> for a single skill and -a <agent> to choose the agent (see the agent guides).
Skills in azrtydxb/Fastllm-proxy, ranked
Ranked by score. Sort bymost stars,trending,newest,recently updated
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 1 | Manage and invoke A2A agents behind FastLLM — register, patch, delete and list agents on the control plane, list them through the gateway, fetch an agent card, and invoke an agent by name. | azrtydxb/ | 108 | — | ~512 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 2 | Run and troubleshoot the inference backends on the DGX Spark pair that FastLLM proxies to — starting or stopping models with vLLM, SGLang or sparkrun, choosing memory and speculative-decoding… | azrtydxb/ | 108 | — | ~980 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 3 | Manage FastLLM prompt classes for semantic routing — create classes and their example prompts, list or delete them, and evaluate how a given prompt would be classified. | azrtydxb/ | 108 | — | ~499 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 4 | Inspect and control the running FastLLM deployment — read effective configuration and deployment settings, force a snapshot rebuild, fetch the snapshot the proxies consume, and check liveness and… | azrtydxb/ | 108 | — | ~727 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 5 | Send inference requests through the FastLLM OpenAI-compatible gateway — chat completions, completions, embeddings, rerank, score, responses, moderations, audio speech and transcription, image… | azrtydxb/ | 108 | — | ~926 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 6 | Manage and use MCP servers behind FastLLM — register, patch, delete and list MCP servers on the control plane, and list or call their tools through the gateway. | azrtydxb/ | 108 | — | ~515 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 7 | Register and maintain the models FastLLM can serve — create, patch or delete a model, attach backends to it, remove a backend, and set the deployment-wide fallback model. | azrtydxb/ | 108 | — | ~1.8k | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 8 | Read what FastLLM has been doing — usage records, time-series aggregates, the configuration audit trail, Prometheus metrics, control-plane health, and per-replica fleet status. | azrtydxb/ | 108 | — | ~916 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 9 | Manage FastLLM principals (API clients and users) and their API keys — create or delete principals, issue and revoke keys, attach roles, and set per-principal budgets and rate limits. | azrtydxb/ | 108 | — | ~865 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 10 | Define FastLLM roles and their permissions — create or delete roles, grant and revoke individual permissions, and inspect what a role allows. | azrtydxb/ | 108 | — | ~487 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 11 | Route requests across models in FastLLM — create, inspect or change frontend models, their default targets, weighted splits, and routing rules (by caller, prompt size, streaming, headers, budget… | azrtydxb/ | 108 | — | ~2.7k | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 12 | 12.Fastllm Auth Authenticate to the FastLLM control plane and manage sessions — log in for a session cookie, log out, set or reset a principal's password, and revoke every session at once. | azrtydxb/ | 108 | — | ~464 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 13 | Inspect and reconcile FastLLM spend and rate limits — read global budgets and limits, trigger limit reconciliation across replicas, and sync provider prices. | azrtydxb/ | 108 | — | ~467 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
| 14 | Operate and diagnose the FastLLM deployment on the kw Kubernetes cluster — check whether it is running, bring it back after a shutdown, deploy manifest changes, and work out why the gateway is… | azrtydxb/ | 108 | — | ~932 | Automated safety check: Pass | Apache-2.0 | 2 days ago |
Questions, answered from the data.
What is the best skill in azrtydxb/Fastllm-proxy?
Fastllm Agents from azrtydxb/Fastllm-proxy ranks first of the 14 skills in azrtydxb/Fastllm-proxy listed here, with the highest score: its repository has 108 GitHub stars, its SKILL.md loads about 512 tokens and it passes the automated safety check with no findings. Next come Fastllm Backends and Fastllm Classifier.
Are the skills in azrtydxb/Fastllm-proxy official?
None yet. All 14 skills in azrtydxb/Fastllm-proxy listed here come from community repositories; a skill counts as official when the product's own GitHub organization publishes it.
How do I install all skills from azrtydxb/Fastllm-proxy?
Run npx skills add azrtydxb/Fastllm-proxy in your project: the open-source skills CLI installs the repository's skills into your coding agent's skills folder. To install a single skill, open its page here for the exact command.
How are these skills ranked?
By Skill Navigator score, which combines the GitHub stars of the skill's repository (shared across that repo's skills and discounted for large collections), how many other GitHub owners carry a copy of the skill, and automated SKILL.md quality checks, minus penalties for safety-check warnings and for each further skill from the same repository. Skills that fail the safety check are not listed.