LM: Difference between revisions
Jump to navigation
Jump to search
(→Topics) |
|||
| (16 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
{| class="wikitable" | {| class="wikitable" | ||
! 🤖 Agent || 🧠 Model || 🚀 | ! 🤖 Agent || 🧠 Model || 🚀 Engine || ⚙️ GPU & Driver || Evaluation | ||
|- | |- | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
| Line 8: | Line 8: | ||
: [[LM/jrswab_axe|axe]] | : [[LM/jrswab_axe|axe]] | ||
: [[LM/MCP|MCP]] | : [[LM/MCP|MCP]] | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/hf|hf (Model Management)]] | : [[LM/hf|hf (Model Management)]] | ||
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]] | : [[LM/Qwen 3.8 27B|Qwen 3.8 27B]] | ||
: [[LM/ | : [[LM/Gemma 4|Gemma 4]] | ||
: [[LM/Devstral Small 2 24B|Devstral Small 2 24B]] | : [[LM/Devstral Small 2 24B|Devstral Small 2 24B]] | ||
: [[LM/Muse Glimmer|Muse Glimmer]] | : [[LM/Muse Glimmer|Muse Glimmer]] | ||
: [[LM/Experience|Experience]] | : [[LM/Experience|Experience]] | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/llama-swap|llama-swap]] | : [[LM/llama-swap|llama-swap]] | ||
: [[LM/lact|lact]] | |||
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]] | : [[LM/llama.cpp for SYCL|llama.cpp for SYCL]] | ||
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]] | |||
: [[LM/SGLang|SGLang]] | |||
: [[LM/OVMS|OVMS]] | |||
: [[LM/llama.cpp for OpenVINO|llama.cpp for OpenVINO]] | : [[LM/llama.cpp for OpenVINO|llama.cpp for OpenVINO]] | ||
: [[LM/llama.cpp for TurboQuant|llama.cpp for TurboQuant]] | : [[LM/llama.cpp for TurboQuant|llama.cpp for TurboQuant]] | ||
: [[LM/lemonade for AMD NPU|lemonade for AMD NPU]] | : [[LM/lemonade for AMD NPU|lemonade for AMD NPU]] | ||
: [[LM/vLLM|vLLM]] | : [[LM/vLLM|vLLM]] | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: Intel Arc Pro B70 | : Intel Arc Pro B70 | ||
| Line 35: | Line 33: | ||
:: [[LM/.bashrc for B70|.bashrc for B70]] | :: [[LM/.bashrc for B70|.bashrc for B70]] | ||
:: [[LM/Intel Pro Arc B70|Experiment]] | :: [[LM/Intel Pro Arc B70|Experiment]] | ||
: NVIDIA RTX 3060 | |||
:: [[LM/Install NVIDIA driver|Install driver]] | |||
: AMD Ryzen AI 7 350 | : AMD Ryzen AI 7 350 | ||
:: [[LM/Ryzen AI 7 350|Experiment]] | :: [[LM/Ryzen AI 7 350|Experiment]] | ||
: Tools | : Tools | ||
:: [[LM/Install nvtop|Install nvtop]] | :: [[LM/Install nvtop|Install nvtop]] | ||
:: [[LM/PCIe Trouble Shooting|PCIe Trouble Shooting]] | |||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/Performance|Performance]] | : [[LM/Performance|Performance]] | ||
| Line 53: | Line 54: | ||
<quickmmd name="tinkering-b70"> | <quickmmd name="tinkering-b70"> | ||
flowchart | flowchart TD | ||
subgraph Hardware | subgraph Hardware | ||
A1(Intel Arc Pro B70):::node-okay | A1(Intel Arc Pro B70):::node-okay | ||
| Line 68: | Line 69: | ||
C1(Install PPA driver<br>26.27.39122.14):::node-okay | C1(Install PPA driver<br>26.27.39122.14):::node-okay | ||
C2(Install oneAPI<br>2026.1.1.20260724):::node-okay | C2(Install oneAPI<br>2026.1.1.20260724):::node-okay | ||
C3(Install OpenVINO):::node- | C3(Install OpenVINO<br>2026.3.0<br>hard to install):::node-warn | ||
C1 --> C2 & C3 | C1 --> C2 & C3 | ||
B1 --> C1 | B1 --> C1 | ||
| Line 89: | Line 90: | ||
T3(Install<br>nvtop) | T3(Install<br>nvtop) | ||
T4(Install<br>tmux) | T4(Install<br>tmux) | ||
T5(Install<br>llama-swap) | T5(Install<br>lact) | ||
T6(Install<br>llama-swap) | |||
T1 --> T2 | T1 --> T2 | ||
B1 --> T1 | B1 --> T1 | ||
| Line 95: | Line 97: | ||
B1 --> T4 | B1 --> T4 | ||
B1 --> T5 | B1 --> T5 | ||
T5 --> T6 | |||
end | end | ||
| Line 110: | Line 113: | ||
T2 --> V1 | T2 --> V1 | ||
T4 ---> V1 | T4 ---> V1 | ||
T6 ---> V2 | |||
end | end | ||
Latest revision as of 03:50, 9 September 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | Evaluation |
|---|---|---|---|---|
|
News
Decision Tree for tinkering with Intel Arc Pro B70
