LM: Difference between revisions
Jump to navigation
Jump to search
| Line 55: | Line 55: | ||
A(LiteLLM) | A(LiteLLM) | ||
B1(llama-swap) | B1(llama-swap) | ||
B2(vLLM) | B2(vLLM<br>Qwen 3.8 27B) | ||
C(llama.cpp) | C(llama.cpp<br>Gemma 4 E4B) | ||
A --> B1 & B2 | A --> B1 & B2 | ||
Latest revision as of 09:49, 21 September 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Decision Tree for tinkering with Intel Arc Pro B70
