Search

AI & LLM Engineering · vLLM · azrtydxb/Fastllm-proxy

1 skill found.

Skills

Search results
#SkillRepositoryStarsUsed inTokensAuto-checkLicenceUpdated
1

Run and troubleshoot the inference backends on the DGX Spark pair that FastLLM proxies to — starting or stopping models with vLLM, SGLang or sparkrun, choosing memory and speculative-decoding…

azrtydxb/Fastllm-proxy108—~980Automated safety check: PassApache-2.0today