LM

Topics

🤖 Agent / Framework	🧠 Model	🚀 Engine	⚙️ GPU & Driver	📊 Evaluation
Codex AnythingLLM axe MCP Software Development	hf (Model Management) Qwen 4 27B 🐣 Qwen 3.8 27B ⭐ Voxtral Mini 4B Realtime 🐣 Flint 40B 🐣 Gemma 4 Bonsai 2 27B Ornith 1.5 35B A3B Experience	vLLM ⭐ SGLang 🐣 llama-swap ComfyUI llama.cpp for SYCL llama.cpp for CUDA Comparison	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment NVIDIA RTX 3060 Install driver AMD Ryzen AI 7 350 Experiment Tools Install nvtop PCIe Trouble Shooting Comparison LM/GPU Comparison	Performance

News

• SWE Pro Benchmark for models < 32B
• OpenVINO 2026.3 supports Ubuntu 26 - 2026-08-04

Models management

File Path	/images/quickmmd/LM-models-handling-infra.svg
File Size	3.07 KB
Last modified	14:06:31
Time of SVG loading	0.00 second(s)
Time of SVG conversion	0.20 second(s)
Cache Detected	Yes
SVG Engine	pele
Node Path	/usr/bin/node
Mermaid syntax Reference	https://mermaid.js.org/intro/syntax-reference.html
QuickMMD Version	1.0.0 - About QuickMMD

• llama-swap can launch model, cannot manage users.
• LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70