LM: Difference between revisions
Jump to navigation
Jump to search
| Line 55: | Line 55: | ||
<quickmmd name="models-handling-infra"> | <quickmmd name="models-handling-infra"> | ||
flowchart TD | flowchart TD | ||
A(LiteLLM) | A(LiteLLM 2) | ||
B(vLLM<br>Qwen 3.8 27B) | B(vLLM<br>Qwen 3.8 27B) | ||
C1(Intel Arc Pro B70) | C1(Intel Arc Pro B70) | ||
Revision as of 06:55, 9 November 2026
Topics
| 🤖 Agent / Framework | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | 📊 Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Investigating vLLM on Intel Arc Pro B70
Investigating llama.cpp on Intel Arc Pro B70
