LM/SGLang: Difference between revisions

From Fundamental Ramen
< LM
Jump to navigation Jump to search
No edit summary
Line 1: Line 1:
= Structure =
<quickmmd name="sgl-xpu">
flowchart TD
    %% 前端與介面層
    subgraph Frontend ["1. 前端與高階語言層 (Frontend & Program)"]
        A["使用者輸入 (SGLang DSL / OpenAI API / Python)"]
        B["SGLang Router & Radix Cache 管理 (CPU)"]
        A --> B
    End
    %% SRT 引擎層
    subgraph Engine ["2. SGLang Runtime (SRT Engine)"]
        C["Model Runner / Forward Engine"]
        D{"Platform Abstraction Layer (DeviceMixin)"}
        B --> C
        C --> D
    End
    %% 轉接層：Intel XPU 平台分支
    subgraph PyTorch_XPU ["3. PyTorch Backend Branch (Intel Focus)"]
        E["PyTorch XPU Backend (torch_xpu)"]
        F["Distributed Processing (oneCCL / OneAPI)"]
        D -- "檢測到 Intel GPU" --> E
        D --> F
    End
    %% 高效算子與編譯層
    subgraph Kernels ["4. XPU Kernel Execution (sgl-kernel-xpu)"]
        G["FlashAttention / FMHA (SYCL)"]
        H["MLA & MoE Grouped GEMM (SYCL)"]
        I["oneDNN / oneMKL (Intel Libraries)"]
        J["SYCL JIT Compiler (Intel icpx)"]
       
        E --> G
        E --> H
        E --> I
        G & H -- "AOT 或 JIT 編譯" --> J
    End
    %% 硬體實體層
    subgraph Hardware ["5. Intel Hardware Target (XPU)"]
        K["Intel Data Center GPU (Max/Flex 系列 / Gaudi)"]
        J --> K
        I --> K
        F --> K
    End
    %% 樣式設定
    classDef frontend fill:#e1f5fe,stroke:#0288d1,stroke-width:2px;
    classDef engine fill:#fff3e0,stroke:#f57c00,stroke-width:2px;
    classDef xpu fill:#e8f5e9,stroke:#388e3c,stroke-width:2px;
    classDef kernel fill:#f3e5f5,stroke:#7b1fa2,stroke-width:2px;
    classDef hw fill:#eceff1,stroke:#455a64,stroke-width:2px;
    class A,B frontend;
    class C,D engine;
    class E,F xpu;
    class G,H,I,J kernel;
    class K hw;
</quickmmd>
= TODO =
= TODO =


Revision as of 07:21, 8 September 2026

Structure

Cannot convert SVG by mmdc. (retval=1)
Shell command: '/usr/bin/mmdc' -q -i - -p '/var/www/html/extensions/QuickMMD/src/../config-puppeteer.json' -o '/var/www/html/images/quickmmd/LM_SGLang-sgl-xpu.svg'
Error: Parse error on line 48:
...l;    class K hw;
--------------------^
Expecting 'SEMI', 'NEWLINE', 'SPACE', 'EOF', 'subgraph', 'end', 'acc_title', 'acc_descr', 'acc_descr_multiline_value', 'AMP', 'COLON', 'STYLE', 'LINKSTYLE', 'CLASSDEF', 'CLASS', 'CLICK', 'DOWN', 'DEFAULT', 'NUM', 'COMMA', 'NODE_STRING', 'BRKT', 'MINUS', 'MULT', 'UNICODE_TEXT', 'direction_tb', 'direction_bt', 'direction_rl', 'direction_lr', 'direction_td', got '1'

TODO

Retrieved from "https://wiki.fundamental-ramen.com/index.php?title=LM/SGLang&oldid=3271"