LM/Inference Engine Comparison

From Fundamental Ramen
< LM
Revision as of 08:59, 7 October 2026 by Tacoball (talk | contribs) (Created page with "{| class="wikitable" ! || Model format || TP || ROCM || XPU |- | vLLM || || || || |- | llama.cpp || || || || |- | SGLang || || || || |- | Strata || || || || |- | Ninfer || || || || |}")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search
Model format TP ROCM XPU
vLLM
llama.cpp
SGLang
Strata
Ninfer
Retrieved from "http://192.168.25.90:53000/index.php?title=LM/Inference_Engine_Comparison&oldid=3846"