Latest revision as of 01:58, 26 October 2026

Topics

🤖 Agent	🧠 Model	🚀 Engine	⚙️ GPU & Driver	📊 Evaluation
ZooCode axe MCP	hf (Model Management) Flint Qwen 3.8 27B Gemma 4 Bonsai 2 27B Ornith 1.5 35B A3B Experience	vLLM llama-swap ComfyUI llama.cpp for SYCL llama.cpp for CUDA SGLang Comparison	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment NVIDIA RTX 3060 Install driver AMD Ryzen AI 7 350 Experiment Tools Install nvtop PCIe Trouble Shooting Comparison LM/GPU Comparison	Performance

@@ Line 10: / Line 10: @@
 | style="width:200px;vertical-align:top" |
 : [[LM/hf|hf (Model Management)]]
-: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
+: [[LM/Flint|Flint]]
 : [[LM/Qwen 3.8 27B|Qwen 3.8 27B]]
 : [[LM/Gemma 4|Gemma 4]]
-: [[LM/Devstral Small 2 24B|Devstral Small 2 24B]]
+: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
+: [[LM/Ornith 1.5 35B A3B|Ornith 1.5 35B A3B]]
 : [[LM/Experience|Experience]]
 | style="width:200px;vertical-align:top" |
@@ Line 21: / Line 22: @@
 : [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
 : [[LM/llama.cpp for CUDA|llama.cpp for CUDA]]
-: [[LM/llama.cpp for OpenVINO|llama.cpp for OpenVINO]]
-: [[LM/llama.cpp for TurboQuant|llama.cpp for TurboQuant]]
 : [[LM/SGLang|SGLang]]
 : [[LM/Inference Engine Comparison|Comparison]]
@@ Line 53: / Line 52: @@
 <quickmmd name="models-handling-infra">
-flowchart LR
+flowchart TD
    A(LiteLLM)
    B(vLLM<br>Qwen 3.8 27B)
@@ Line 92: / Line 91: @@
      T3(Install<br>nvtop)
      T4(Install<br>tmux)
+    T5(Install<br>docker)
      T1 --> T2
      B1 --> T1
      B1 --> T3
      B1 --> T4
+    B1 --> T5
    end
@@ Line 103: / Line 104: @@
    end
-   subgraph config
+   subgraph Config
      V1(Optimize<br>.bashrc)
+    V2(docker-compose.yaml)
      T2 --> V1
      T4 ----> V1
+    T5 --> V2
+  end
+  subgraph Engine
+    E1(Docker Image<br>vllm-openai-xpu<br>0.30.0+)
+    C1 --> E1
+    T5 --> E1
+    M1 --> E1
+    V2 --> E1
    end