LM

From Fundamental Ramen
Revision as of 06:01, 27 October 2026 by Tacoball (talk | contribs) (→Topics)
Jump to navigation Jump to search

Topics

🤖 Agent  🧠 Model  🚀 Engine  ⚙️ GPU & Driver  📊 Evaluation
Software Development
axe
MCP
hf (Model Management)
Qwen 3.8 27B ⭐
Flint 🐣
Gemma 4
Bonsai 2 27B
Ornith 1.5 35B A3B
Experience
vLLM ⭐
llama-swap
ComfyUI
llama.cpp for SYCL
llama.cpp for CUDA
SGLang 🐣
Comparison
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
.bashrc for B70
Experiment
NVIDIA RTX 3060
Install driver
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop
PCIe Trouble Shooting
Comparison
LM/GPU Comparison
Performance

News

Models management

  • llama-swap can launch model, cannot manage users.
  • LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70