LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
 
(25 intermediate revisions by the same user not shown)
Line 1: Line 1:
= Topics =
= Topics =
{| class="wikitable"
{| class="wikitable"
! Agent || Model || Runner || GPU & Driver
! 🤖 Agent || 🧠 Model || 🚀 Runner || ⚙️ GPU & Driver
|-
|-
| valign="top" |
| style="width:200px;vertical-align:top" |
* [[LLM/jrswab_axe|axe]]
: [[LM/jrswab_axe|axe]]
* SKILL
: SKILL
* MCP
: MCP
| valign="top" |
| style="width:200px;vertical-align:top" |
* [[LLM/hf|hf]]
: [[LM/hf|hf (Model Management)]]
| valign="top" |
: Muse Glimmer
* SGLang
: Devstral Small 2
* llama.cpp for SYCL
: Qwen 3.6 27B
* llama.cpp for OpenVINO
: Gemma 4
* lemonade for AMD NPU
| style="width:200px;vertical-align:top" |
| valign="top" |
: [[LM/SGLang|SGLang]]
* Intel Arc Pro B70
: [[LM/llama-swap|llama-swap]]
** xe driver
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
** oneAPI
: [[LM/llama.cpp for OpenVINO|llama.cpp for OpenVINO]]
** OpenVINO
: [[LM/lemonade for AMD NPU|lemonade for AMD NPU]]
** [[LLM/Intel Pro Arc B70|Experiment]]
| style="width:200px;vertical-align:top" |
* AMD Ryzen AI 7 350
: Intel Arc Pro B70
** [[LLM/Ryzen AI 7 350|Experiment]]
:: [[LM/Install driver|Install driver]]
:: [[LM/Install oneAPI|Install oneAPI (SYCL)]]
:: [[LM/Install OpenVINO|Install OpenVINO]]
:: [[LM/Intel Pro Arc B70|Experiment]]
: AMD Ryzen AI 7 350
:: [[LM/Ryzen AI 7 350|Experiment]]
: Tools
:: [[LM/Install nvtop|Install nvtop]]
|}
|}


= News =
= News =


* https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables
* [https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro?leaderboard_max_params=32B SWE Pro Benchmark for models < 32B]
* https://www.datalearner.com/en/leaderboards/category/code?benchmark=SWE-bench+Verified&modelSize=34b&licenseType=open
* [https://storage.openvinotoolkit.org/repositories/openvino/packages/2026.3/linux/ OpenVINO 2026.3 supports Ubuntu 26] - 2026-08-04
* https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro


= Decision Tree for tinkering with Intel Arc Pro B70 =
= Decision Tree for tinkering with Intel Arc Pro B70 =
Line 50: Line 57:
     C3[Install<br>OpenVINO]:::node-okay
     C3[Install<br>OpenVINO]:::node-okay
     C4[Install<br>PPA driver]:::node-warn
     C4[Install<br>PPA driver]:::node-warn
     C5[Cannot install<br>oneAPI]:::node-fail
     C5[Client GPU not listed in<br>oneAPI 2026.1.0]:::node-fail
     C6[Cannot install<br>OpenVINO]:::node-fail
     C6[Cannot install<br>OpenVINO 2026.2.1]:::node-fail
     C1 --> C2 & C3
     C1 --> C2 & C3
     C4 --> C5 & C6
     C4 --> C5 & C6

Latest revision as of 11:16, 13 August 2026

Topics

🤖 Agent 🧠 Model 🚀 Runner ⚙️ GPU & Driver
axe
SKILL
MCP
hf (Model Management)
Muse Glimmer
Devstral Small 2
Qwen 3.6 27B
Gemma 4
SGLang
llama-swap
llama.cpp for SYCL
llama.cpp for OpenVINO
lemonade for AMD NPU
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
Experiment
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop

News

Decision Tree for tinkering with Intel Arc Pro B70