LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
 
Line 42: Line 42:
flowchart LR
flowchart LR
   subgraph hardware
   subgraph hardware
     A[Got B70]
     A(Got B70)
   end
   end


   subgraph os
   subgraph os
     B1[Install<br>Ubuntu 24.04]:::node-okay
     B1(Install<br>Ubuntu 24.04):::node-okay
     B2[Install<br>Ubuntu 26.04]:::node-warn
     B2(Install<br>Ubuntu 26.04):::node-warn
     A --> B1
     A --> B1
     A --> B2
     A --> B2
Line 53: Line 53:


   subgraph drvier
   subgraph drvier
     C1[Install<br>PPA driver]:::node-okay
     C1(Install<br>PPA driver):::node-okay
     C2[Install<br>oneAPI]:::node-okay
     C2(Install<br>oneAPI):::node-okay
     C3[Install<br>OpenVINO]:::node-okay
     C3(Install<br>OpenVINO):::node-okay
     C4[Install<br>PPA driver]:::node-warn
     C4(Install<br>PPA driver):::node-warn
     C5[Client GPU not listed in<br>oneAPI 2026.1.0]:::node-fail
     C5(Client GPU not listed in<br>oneAPI 2026.1.0):::node-fail
     C6[Cannot install<br>OpenVINO 2026.2.1]:::node-fail
     C6(Cannot install<br>OpenVINO 2026.2.1):::node-fail
     C1 --> C2 & C3
     C1 --> C2 & C3
     C4 --> C5 & C6
     C4 --> C5 & C6
Line 77: Line 77:


   subgraph tools
   subgraph tools
     T1[Install<br>pipx]
     T1(Install<br>pipx)
     T2[Install<br>hf]
     T2(Install<br>hf)
     T3[Install<br>nvtop]
     T3(Install<br>nvtop)
     T4[Install<br>screen]
     T4(Install<br>tmux)
     T5[Install<br>llama-swap]
     T5(Install<br>llama-swap)
     T1 --> T2
     T1 --> T2
     B1 --> T1
     B1 --> T1
Line 90: Line 90:


   subgraph models
   subgraph models
     M1[Muse-Glimmer-30B]
     M1(Muse-Glimmer-30B)
     M2[Devstral-Small-2]
     M2(Devstral-Small-2)
     M3[Qwen3-Coder-30B]
     M3(Qwen3-Coder-30B)
     M4[Gemma-4-E4B]
     M4(Gemma-4-E4B)
     T2 --> M1 & M2 & M3 & M4
     T2 --> M1 & M2 & M3 & M4
   end
   end


   subgraph env
   subgraph env
     V1[Optimize<br>.bashrc]
     V1(Optimize<br>.bashrc)
     V2[Optimize<br>llama-swap.yaml]
     V2(Optimize<br>llama-swap.yaml)
     C2 --> V1
     C2 --> V1
     C3 --> V1
     C3 --> V1
Line 108: Line 108:


   subgraph service
   subgraph service
     Z[service]
     Z(service)
     M1 --> Z
     M1 --> Z
     D1 --> Z
     D1 --> Z

Latest revision as of 17:21, 13 August 2026

Topics

🤖 Agent 🧠 Model 🚀 Runner ⚙️ GPU & Driver
axe
SKILL
MCP
hf (Model Management)
Muse Glimmer
Devstral Small 2
Qwen 3.6 27B
Gemma 4
SGLang
llama-swap
llama.cpp for SYCL
llama.cpp for OpenVINO
lemonade for AMD NPU
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
Experiment
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop

News

Decision Tree for tinkering with Intel Arc Pro B70