LM: Difference between revisions
Jump to navigation
Jump to search
| Line 54: | Line 54: | ||
<quickmmd name="tinkering-b70"> | <quickmmd name="tinkering-b70"> | ||
flowchart LR | flowchart LR | ||
subgraph | subgraph Hardware | ||
A(Got B70):::node-okay | A(Got B70):::node-okay | ||
end | end | ||
subgraph | subgraph OS | ||
B1(Install<br>Ubuntu 26.04):::node-okay | B1(Install<br>Ubuntu 26.04):::node-okay | ||
A --> B1 | A --> B1 | ||
end | end | ||
subgraph | subgraph Driver | ||
C1(Install PPA driver<br>26.27.39122.14):::node-okay | C1(Install PPA driver<br>26.27.39122.14):::node-okay | ||
C2(Install oneAPI<br>2026.1.1.20260724):::node-okay | C2(Install oneAPI<br>2026.1.1.20260724):::node-okay | ||
| Line 71: | Line 71: | ||
end | end | ||
subgraph | subgraph Runtime | ||
D1[Build llama.cpp for<br>SYCL]:::node-okay | D1[Build llama.cpp for<br>SYCL]:::node-okay | ||
D2[Build llama.cpp for<br>OpenVINO<br>not stable yet]:::node-warn | D2[Build llama.cpp for<br>OpenVINO<br>not stable yet]:::node-warn | ||
| Line 82: | Line 82: | ||
end | end | ||
subgraph | subgraph Tools | ||
T1(Install<br>pipx) | T1(Install<br>pipx) | ||
T2(Install<br>hf) | T2(Install<br>hf) | ||
| Line 95: | Line 95: | ||
end | end | ||
subgraph | subgraph Models | ||
M1(Qwen3.8-27B) | M1(Qwen3.8-27B) | ||
M2(Devstral-Small-2) | M2(Devstral-Small-2) | ||
| Line 112: | Line 112: | ||
end | end | ||
subgraph | subgraph Service | ||
Z(service<br>llama-swap \<br> -config lmsw.yaml \<br> -listen 0.0.0.0:9876) | Z(service<br>llama-swap \<br> -config lmsw.yaml \<br> -listen 0.0.0.0:9876) | ||
M1 --> Z | M1 --> Z | ||
Revision as of 07:48, 27 August 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Runner | ⚙️ GPU & Driver | Evaluation |
|---|---|---|---|---|
|
|
News
Decision Tree for tinkering with Intel Arc Pro B70