LM: Difference between revisions

From Fundamental Ramen
Jump to navigation Jump to search
Line 10: Line 10:
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |
: [[LM/hf|hf (Model Management)]]
: [[LM/hf|hf (Model Management)]]
: [[LM/Flint|Flint]]
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]] ⭐
: [[LM/Qwen 3.8 27B|Qwen 3.8 27B]]
: [[LM/Flint|Flint]] 🐣
: [[LM/Gemma 4|Gemma 4]]
: [[LM/Gemma 4|Gemma 4]]
: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
: [[LM/Bonsai 2 27B|Bonsai 2 27B]]
Line 17: Line 17:
: [[LM/Experience|Experience]]
: [[LM/Experience|Experience]]
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |
: [[LM/vLLM|vLLM]]
: [[LM/vLLM|vLLM]] ⭐
: [[LM/llama-swap|llama-swap]]
: [[LM/llama-swap|llama-swap]]
: [[LM/ComfyUI|ComfyUI]]
: [[LM/ComfyUI|ComfyUI]]
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
: [[LM/llama.cpp for SYCL|llama.cpp for SYCL]]
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]]
: [[LM/llama.cpp for CUDA|llama.cpp for CUDA]]
: [[LM/SGLang|SGLang]]
: [[LM/SGLang|SGLang]] 🐣
: [[LM/Inference Engine Comparison|Comparison]]
: [[LM/Inference Engine Comparison|Comparison]]
| style="width:200px;vertical-align:top" |
| style="width:200px;vertical-align:top" |

Revision as of 06:01, 27 October 2026

Topics

🤖 Agent  🧠 Model  🚀 Engine  ⚙️ GPU & Driver  📊 Evaluation
Software Development
axe
MCP
hf (Model Management)
Qwen 3.8 27B ⭐
Flint 🐣
Gemma 4
Bonsai 2 27B
Ornith 1.5 35B A3B
Experience
vLLM ⭐
llama-swap
ComfyUI
llama.cpp for SYCL
llama.cpp for CUDA
SGLang 🐣
Comparison
Intel Arc Pro B70
Install driver
Install oneAPI (SYCL)
Install OpenVINO
.bashrc for B70
Experiment
NVIDIA RTX 3060
Install driver
AMD Ryzen AI 7 350
Experiment
Tools
Install nvtop
PCIe Trouble Shooting
Comparison
LM/GPU Comparison
Performance

News

Models management

  • llama-swap can launch model, cannot manage users.
  • LiteLLM cannot launch model, can manage users.

Investigating vLLM on Intel Arc Pro B70

Investigating llama.cpp on Intel Arc Pro B70