LM/vLLM

From Fundamental Ramen

< LM

Revision as of 02:14, 14 August 2026 by Tacoball (talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Jump to navigation Jump to search

Run

vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu

Path

TODO

https://docs.vllm.ai/en/stable/getting_started/installation/gpu/#requirements

Retrieved from "https://wiki.fundamental-ramen.com/index.php?title=LM/vLLM&oldid=2869"