LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
 
(2 intermediate revisions by the same user not shown)
Line 2: Line 2:


{| class="wikitable"
{| class="wikitable"
! 🤖 Agent  || 🧠 Model  || 🚀 Engine  || ⚙️ GPU & Driver || 📊 Evaluation
! 🤖 Agent / Framework  || 🧠 Model  || 🚀 Engine  || ⚙️ GPU & Driver || 📊 Evaluation
|-
|-
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |
Line 10: Line 10:
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |
: [[LM/hf|hf (Model Management)]]
: [[LM/hf|hf (Model Management)]]
: [[LM/Flint|Flint]]
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]] ⭐
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]]
: [[LM/Flint|Flint]] 🐣
: [[LM/Gemma 4|Gemma 4]]
: [[LM/Gemma 4|Gemma 4]]
: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
Line 17: Line 17:
: [[LM/Experience|Experience]]
: [[LM/Experience|Experience]]
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |
: [[LM/vLLM|vLLM]]
: [[LM/vLLM|vLLM]] ⭐
: [[LM/SGLang|SGLang]] 🐣
: [[LM/llama-swap|llama-swap]]
: [[LM/llama-swap|llama-swap]]
: [[LM/ComfyUI|ComfyUI]]
: [[LM/ComfyUI|ComfyUI]]
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]]
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]]
: [[LM/SGLang|SGLang]]
: [[LM/Inference Engine Comparison|Comparison]]
: [[LM/Inference Engine Comparison|Comparison]]
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |

Latest revision as of 06:03, 27 October 2026

Topics

🤖 Agent / Framework  🧠 Model  🚀 Engine  ⚙️ GPU & Driver  📊 Evaluation
Software Development
axe
MCP
hf (Model Management)
Qwen 3.8 27B ⭐
Flint 🐣
Gemma 4
Bonsai 2 27B
Ornith 1.5 35B A3B
Experience
vLLM ⭐
SGLang 🐣
llama-swap
ComfyUI
llama.cpp for SYCL
llama.cpp for CUDA
Comparison
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
.bashrc for B70
Experiment
NVIDIA RTX 3060
Install driver
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop
PCIe Trouble Shooting
Comparison
LM/GPU Comparison
Performance

News

Models management

  • llama-swap can launch model, cannot manage users.
  • LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70