Search
AI & LLM Engineering · llama.cpp · By magnus919
Skills
Sort:BestMost starsTrending todayTrending this weekTrending this monthNewestRecently updatedName
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 1 | 1.Litellm Operate, configure, secure, and troubleshoot the LiteLLM AI gateway (proxy) and Python SDK: run the proxy (litellm --config), route to 100+ providers through one OpenAI-compatible API, configure… | magnus919/ | 115 | — | ~4.2k | Automated safety check: Notes | MIT | yesterday |
| 2 | 2.Vllm Operate, configure, benchmark, and troubleshoot vLLM inference servers: Docker and Kubernetes deployment, quantization-aware model configuration (tensor parallelism, KV cache), OpenAI-compatible API… | magnus919/ | 115 | — | ~4.1k | Automated safety check: Notes | MIT | yesterday |
| 3 | Operate, configure, benchmark, and troubleshoot llama.cpp across CPU, Metal, CUDA, HIP/ROCm, Vulkan, SYCL, and hybrid or multi-GPU systems. | magnus919/ | 115 | — | ~2.3k | Automated safety check: Pass | MIT | yesterday |
| 4 | Plan and execute production ML engineering work — model training and fine-tuning (LoRA/QLoRA), evaluation and eval-set design, quantization decisions, inference deployment, lineage, feature parity… | magnus919/ | 115 | — | ~1.5k | Automated safety check: Pass | MIT | yesterday |
