LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 54: Line 54:
<quickmmd name="tinkering-b70">
<quickmmd name="tinkering-b70">
flowchart LR
flowchart LR
   subgraph hardware
   subgraph Hardware
     A(Got B70):::node-okay
     A(Got B70):::node-okay
   end
   end


   subgraph os
   subgraph OS
     B1(Install<br>Ubuntu 26.04):::node-okay
     B1(Install<br>Ubuntu 26.04):::node-okay
     A --> B1
     A --> B1
   end
   end


   subgraph driver
   subgraph Driver
     C1(Install PPA driver<br>26.27.39122.14):::node-okay
     C1(Install PPA driver<br>26.27.39122.14):::node-okay
     C2(Install oneAPI<br>2026.1.1.20260724):::node-okay
     C2(Install oneAPI<br>2026.1.1.20260724):::node-okay
Line 71: Line 71:
   end
   end


   subgraph runtime
   subgraph Runtime
     D1[Build llama.cpp for<br>SYCL]:::node-okay
     D1[Build llama.cpp for<br>SYCL]:::node-okay
     D2[Build llama.cpp for<br>OpenVINO<br>not stable yet]:::node-warn
     D2[Build llama.cpp for<br>OpenVINO<br>not stable yet]:::node-warn
Line 82: Line 82:
   end
   end


   subgraph tools
   subgraph Tools
     T1(Install<br>pipx)
     T1(Install<br>pipx)
     T2(Install<br>hf)
     T2(Install<br>hf)
Line 95: Line 95:
   end
   end


   subgraph models
   subgraph Models
     M1(Qwen3.8-27B)
     M1(Qwen3.8-27B)
     M2(Devstral-Small-2)
     M2(Devstral-Small-2)
Line 112: Line 112:
   end
   end


   subgraph service
   subgraph Service
     Z(service<br>llama-swap \<br>  -config lmsw.yaml \<br>  -listen 0.0.0.0:9876)
     Z(service<br>llama-swap \<br>  -config lmsw.yaml \<br>  -listen 0.0.0.0:9876)
     M1 --> Z
     M1 --> Z

Revision as of 07:48, 27 August 2026