LM

Topics

🤖 Agent	🧠 Model	🚀 Engine	⚙️ GPU & Driver	📊 Evaluation
ZooCode axe MCP	hf (Model Management) Bonsai 2 27B Qwen 3.8 27B Gemma 4 Devstral Small 2 24B Experience	vLLM llama-swap ComfyUI llama.cpp for SYCL llama.cpp for CUDA llama.cpp for OpenVINO llama.cpp for TurboQuant SGLang Comparison	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment NVIDIA RTX 3060 Install driver AMD Ryzen AI 7 350 Experiment Tools Install nvtop PCIe Trouble Shooting Comparison LM/GPU Comparison	Performance

News

• SWE Pro Benchmark for models < 32B
• OpenVINO 2026.3 supports Ubuntu 26 - 2026-08-04

Models management

• llama-swap can launch model, cannot manage users.
• LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70