LM/vLLM
< LM
Jump to navigation
Jump to search
Experiment
uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate
vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu
Path
uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate
vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu