Search
llama.cpp · Orchestra-Research/AI-Research-SKILLs
4 skills found.
Category:
Skills
Sort:BestMost starsTrending todayTrending this weekTrending this monthNewestRecently updatedName
| # | Skill | Repository | Stars | Used in | Tokens | Auto-check | Licence | Updated |
|---|---|---|---|---|---|---|---|---|
| 1 | Uses the Outlines library to constrain model output to a JSON schema, Pydantic model, regex or fixed set of choices when running local models. | Orchestra-Research/ | 13k | 9 repos | ~4k | Automated safety check: Pass | MIT | 3 mo ago |
| 2 | Constrains language model output with regex, selections and grammars using the Guidance library, so JSON, XML, code or formatted fields come out valid. | Orchestra-Research/ | 13k | 5 repos | ~3.6k | Automated safety check: Pass | MIT | 3 mo ago |
| 3 | GGUF format and llama.cpp quantization for efficient CPU/GPU inference. | Orchestra-Research/ | 13k | 3 repos | ~2.6k | Automated safety check: Pass | MIT | 3 mo ago |
| 4 | Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. | Orchestra-Research/ | 13k | 3 repos | ~1.5k | Automated safety check: Pass | MIT | 3 mo ago |
