LM/vLLM: Difference between revisions
< LM
Jump to navigation
Jump to search
No edit summary |
(→Run) |
||
| Line 1: | Line 1: | ||
== | == Experiment == | ||
<syntaxhighlight lang="bash"> | |||
uv venv --python 3.12 --seed --managed-python | |||
source .venv/bin/activate | |||
vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu | vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu | ||
</syntaxhighlight> | |||
== Path == | == Path == | ||
Revision as of 02:16, 14 August 2026
Experiment
uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate
vllm serve unsloth/gemma-4-E4B-it-qat-GGUF --device xpu
Path
