minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[feature] Ascend NPU graph support (#8027)

Browse Source 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
This commit is contained in:
VDV1985
2025-08-16 17:25:17 -07:00
committed by GitHub
co-authored by ronnie_zheng yezhifeng anon189Ty Maksim ssshinigami
parent 740f063035
commit 94371dbbd6
18 changed files with 1349 additions and 878 deletions
Download Patch File Download Diff File Expand all files Collapse all files
benchmark/kernels/fused_moe_triton/benchmark_torch_compile_fused_moe.py
+1 -1
View File
@@ -9,7 +9,7 @@ from transformers import AutoConfig
from sglang.srt.layers.moe.fused_moe_triton.fused_moe import (
fused_moe as fused_moe_triton,
)
from sglang.srt.model_executor.cuda_graph_runner import set_torch_compile_config
from sglang.srt.model_executor.graph_runner import set_torch_compile_config
def get_model_config(model_name: str, tp_size: int):