Revision as of 04:14, 21 September 2026

Topics

🤖 Agent	🧠 Model	🚀 Engine	⚙️ GPU & Driver	Evaluation
ZooCode axe MCP	hf (Model Management) Qwen 3.8 27B Gemma 4 Devstral Small 2 24B Muse Glimmer Experience	llama-swap bifrost vLLM ComfyUI llama.cpp for SYCL llama.cpp for CUDA OVMS llama.cpp for OpenVINO llama.cpp for TurboQuant lemonade for AMD NPU SGLang	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment NVIDIA RTX 3060 Install driver AMD Ryzen AI 7 350 Experiment Tools Install nvtop lact PCIe Trouble Shooting	Performance Security Hallucination

@@ Line 53: / Line 53: @@
 * [https://storage.openvinotoolkit.org/repositories/openvino/packages/2026.3/linux/ OpenVINO 2026.3 supports Ubuntu 26] - 2026-08-04
-= Test =
+= Models management =
 <quickmmd name="models-handling-infra">
@@ Line 65: / Line 65: @@
    B --> C1 & C2
 </quickmmd>
+* llama-swap can launch model, cannot manage users.
+* LiteLLM cannot launch model, can manage users.
 = Decision Tree for tinkering with Intel Arc Pro B70 =