LM: Difference between revisions
Jump to navigation
Jump to search
Tag: Manual revert |
|||
| Line 62: | Line 62: | ||
A --> |Forward| B | A --> |Forward| B | ||
B --> |Tensor Parallelism| C1 & C2 | B --> |Tensor Parallelism| C1 & C2 | ||
C1 --- |XCCL| C2 | %% C1 --- |XCCL| C2 | ||
</quickmmd> | </quickmmd> | ||
Revision as of 07:52, 14 October 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | 📊 Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Investigating llama.cpp on Intel Arc Pro B70