LM/Inference Engine Comparison

From Fundamental Ramen

< LM

Revision as of 09:01, 7 October 2026 by Tacoball (talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Jump to navigation Jump to search

	Model format	TP	ROCM	XPU
vLLM	Hugging Face Transformers / Safetensors	✅	✅	✅
llama.cpp	GGUF	✅	✅	✅
SGLang	Hugging Face Transformers / Safetensors	✅	✅	✅
Strata	Project-specific format / GGUF	✅	✅	❌
Ninfer	Project-specific model artifacts	✅	✅	❌

Retrieved from "http://192.168.25.90:53000/index.php?title=LM/Inference_Engine_Comparison&oldid=3847"