LM: Difference between revisions
Jump to navigation
Jump to search
(→Topics) |
|||
| (4 intermediate revisions by the same user not shown) | |||
| Line 38: | Line 38: | ||
:: [[LM/lact|lact]] | :: [[LM/lact|lact]] | ||
:: [[LM/PCIe Trouble Shooting|PCIe Trouble Shooting]] | :: [[LM/PCIe Trouble Shooting|PCIe Trouble Shooting]] | ||
: Comparison | |||
:: [[LM/GPU Comparison]] | |||
| style="width:200px;vertical-align:top" | | | style="width:200px;vertical-align:top" | | ||
: [[LM/Performance|Performance]] | : [[LM/Performance|Performance]] | ||
|} | |} | ||
| Line 54: | Line 54: | ||
flowchart LR | flowchart LR | ||
A(LiteLLM) | A(LiteLLM) | ||
B1(llama-swap) | |||
B2(vLLM<br>Qwen 3.8 27B) | |||
C(llama.cpp<br>Gemma 4 E4B) | |||
A --> | A --> B1 & B2 | ||
B1 --> C | |||
</quickmmd> | </quickmmd> | ||
Latest revision as of 09:49, 21 September 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Decision Tree for tinkering with Intel Arc Pro B70