CUDA · By vllm-project

4 skills found.

Category:

Skills

Search results
#	Skill	Repository	Stars	Used in	Tokens	Auto-check	Licence	Updated
1	1.Add Tts Model Integrate a new text-to-speech model into vLLM-Omni from HuggingFace reference implementation through production-ready serving with streaming and CUDA graph acceleration. vllm-project/vllm-omni	vllm-project/vllm-omni	7.1k	—	~8.7k	Automated safety check: Pass	Apache-2.0	today
2	2.Production Add Diffusion Model Productionize a vLLM-Omni diffusion model after its Day-0 vertical slice works. vllm-project/vllm-omni	vllm-project/vllm-omni	7.1k	—	~5.5k	Automated safety check: Pass	Apache-2.0	today
3	3.Vllm Deploy Simple Quick install and deploy vLLM, start serving with a simple LLM, and test OpenAI API. vllm-project/vllm-skills	vllm-project/vllm-skills	102	—	~1.6k	Automated safety check: Pass	Apache-2.0	6 mo ago
4	4.Vllm Deploy Docker Deploy vLLM using Docker (pre-built images or build-from-source) with NVIDIA GPU support and run the OpenAI-compatible server. vllm-project/vllm-skills	vllm-project/vllm-skills	102	—	~2.5k	Automated safety check: Notes	Apache-2.0	6 mo ago