LM/vLLM

Experiment

uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate

git clone https://github.com/vllm-project/vllm.git
cd vllm
pip install --upgrade pip
pip install -v -r requirements/xpu.txt

pip uninstall -y triton triton-xpu
pip install triton-xpu==3.7.2 --extra-index-url https://download.pytorch.org/whl/xpu

vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu

Path

TODO

• https://docs.vllm.ai/en/stable/getting_started/installation/gpu/#requirements