LM: Difference between revisions
Jump to navigation
Jump to search
| Line 69: | Line 69: | ||
= Investigating vLLM on Intel Arc Pro B70 = | = Investigating vLLM on Intel Arc Pro B70 = | ||
<quickmmd name="tinkering-b70"> | <quickmmd name="tinkering-b70-vllm"> | ||
flowchart TD | flowchart TD | ||
subgraph Hardware | subgraph Hardware | ||
| Line 84: | Line 84: | ||
subgraph Driver | subgraph Driver | ||
C1(Install PPA driver<br>26.27.39122.14):::node-okay | C1(Install PPA driver<br>26.27.39122.14):::node-okay | ||
B1 --> C1 | B1 --> C1 | ||
end | end | ||
| Line 99: | Line 92: | ||
T3(Install<br>nvtop) | T3(Install<br>nvtop) | ||
T4(Install<br>tmux) | T4(Install<br>tmux) | ||
T1 --> T2 | T1 --> T2 | ||
B1 --> T1 | B1 --> T1 | ||
B1 --> T3 | B1 --> T3 | ||
B1 --> T4 | B1 --> T4 | ||
end | end | ||
| Line 120: | Line 109: | ||
T2 --> V1 | T2 --> V1 | ||
T4 ----> V1 | T4 ----> V1 | ||
end | end | ||
| Line 135: | Line 123: | ||
classDef node-todo fill:#eee,stroke:#777 | classDef node-todo fill:#eee,stroke:#777 | ||
</quickmmd> | </quickmmd> | ||
= Investigating llama.cpp on Intel Arc Pro B70 = | = Investigating llama.cpp on Intel Arc Pro B70 = | ||
Revision as of 07:33, 22 October 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | 📊 Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Investigating vLLM on Intel Arc Pro B70
Investigating llama.cpp on Intel Arc Pro B70
