LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 2: Line 2:


{| class="wikitable"
{| class="wikitable"
! 🤖 Agent  || 🧠 Model  || 🚀 Engine  || ⚙️ GPU & Driver || 📊 Evaluation
! 🤖 Agent / Framework  || 🧠 Model  || 🚀 Engine  || ⚙️ GPU & Driver || 📊 Evaluation
|-
|-
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |

Revision as of 06:03, 27 October 2026

Topics

🤖 Agent / Framework  🧠 Model  🚀 Engine  ⚙️ GPU & Driver  📊 Evaluation
Software Development
axe
MCP
hf (Model Management)
Qwen 3.8 27B ⭐
Flint 🐣
Gemma 4
Bonsai 2 27B
Ornith 1.5 35B A3B
Experience
vLLM ⭐
llama-swap
ComfyUI
llama.cpp for SYCL
llama.cpp for CUDA
SGLang 🐣
Comparison
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
.bashrc for B70
Experiment
NVIDIA RTX 3060
Install driver
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop
PCIe Trouble Shooting
Comparison
LM/GPU Comparison
Performance

News

Models management

  • llama-swap can launch model, cannot manage users.
  • LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70