LM: Difference between revisions
Jump to navigation
Jump to search
| (13 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
{| class="wikitable" | {| class="wikitable" | ||
! 🤖 | ! 🤖 Agent / Framework || 🧠 Model || 🚀 Engine || ⚙️ GPU & Driver || 📊 Evaluation | ||
|- | |- | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/ | : [[LM/Codex|Codex]] | ||
: [[LM/AnythingLLM|AnythingLLM]] | |||
: [[LM/jrswab_axe|axe]] | : [[LM/jrswab_axe|axe]] | ||
: [[LM/MCP|MCP]] | : [[LM/MCP|MCP]] | ||
: [[LM/Software Development|Software Development]] | |||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/hf|hf (Model Management)]] | : [[LM/hf|hf (Model Management)]] | ||
: [[LM/Qwen 4 27B|Qwen 4 27B]] 🐣 | |||
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]] ⭐ | |||
: [[LM/Flint 40B|Flint 40B]] 🐣 | |||
: [[LM/Gemma 4|Gemma 4]] | |||
: [[LM/Bonsai 2 27B|Bonsai 2 27B]] | : [[LM/Bonsai 2 27B|Bonsai 2 27B]] | ||
: [[LM/ | : [[LM/Ornith 1.5 35B A3B|Ornith 1.5 35B A3B]] | ||
: [[LM/Experience|Experience]] | : [[LM/Experience|Experience]] | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/vLLM|vLLM]] | : [[LM/vLLM|vLLM]] ⭐ | ||
: [[LM/SGLang|SGLang]] 🐣 | |||
: [[LM/llama-swap|llama-swap]] | : [[LM/llama-swap|llama-swap]] | ||
: [[LM/ComfyUI|ComfyUI]] | : [[LM/ComfyUI|ComfyUI]] | ||
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]] | : [[LM/llama.cpp for SYCL|llama.cpp for SYCL]] | ||
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]] | : [[LM/llama.cpp for CUDA|llama.cpp for CUDA]] | ||
: [[LM/Inference Engine Comparison|Comparison]] | : [[LM/Inference Engine Comparison|Comparison]] | ||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
| Line 50: | Line 54: | ||
= Models management = | = Models management = | ||
<quickmmd name="models-handling-infra"> | <quickmmd name="models-handling-infra" dump-env="true"> | ||
flowchart TD | flowchart TD | ||
A(LiteLLM) | A(LiteLLM 2) | ||
B(vLLM<br>Qwen 3.8 27B) | B(vLLM<br>Qwen 3.8 27B) | ||
C1(Intel Arc Pro B70) | C1(Intel Arc Pro B70) | ||
Latest revision as of 04:35, 11 November 2026
Topics
| 🤖 Agent / Framework | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | 📊 Evaluation |
|---|---|---|---|---|
|
News
Models management
| File Path | /images/quickmmd/LM-models-handling-infra.svg |
|---|---|
| File Size | 3.07 KB |
| Last modified | 07:29:34 |
| Time of SVG loading | 0.00 second(s) |
| Time of SVG conversion | 0.19 second(s) |
| Cache Detected | Yes |
| SVG Engine | pele |
| Node Path | /usr/bin/node |
| Mermaid syntax Reference | https://mermaid.js.org/intro/syntax-reference.html |
| QuickMMD Version | 1.0.0 - About QuickMMD |
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Investigating vLLM on Intel Arc Pro B70
Investigating llama.cpp on Intel Arc Pro B70
