LM

Topics

🤖 Agent / Framework	🧠 Model	🚀 Engine	⚙️ GPU & Driver	📊 Evaluation
Codex AnythingLLM axe MCP Software Development	hf (Model Management) Qwen 3.8 27B ⭐ Flint 40B 🐣 Gemma 4 Bonsai 2 27B Ornith 1.5 35B A3B Experience	vLLM ⭐ SGLang 🐣 llama-swap ComfyUI llama.cpp for SYCL llama.cpp for CUDA Comparison	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment NVIDIA RTX 3060 Install driver AMD Ryzen AI 7 350 Experiment Tools Install nvtop PCIe Trouble Shooting Comparison LM/GPU Comparison	Performance

News

• SWE Pro Benchmark for models < 32B
• OpenVINO 2026.3 supports Ubuntu 26 - 2026-08-04

Models management

File Path	/images/quickmmd/LM-models-handling-infra.svg
File Size	3.07 KB
Last modified	13:38:15
Time of SVG loading	0.21 second(s)
Time of SVG conversion	0.21 second(s)
Cache Detected	No
MD5 of incoming syntax	0770d42dd4fb46323a1d7567cb108541
MD5 of cached syntax	84bcc9c6aa8e79615db3a4e7791c22e5
SVG Engine	pele
Node Path	/usr/bin/node
Mermaid syntax Reference	https://mermaid.js.org/intro/syntax-reference.html
QuickMMD Version	1.0.0 - About QuickMMD

• llama-swap can launch model, cannot manage users.
• LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70