minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Fix missing StandardCombineInput import in BF16 flashinfer_trtllm MoE (#19400)

Browse Source 
Co-authored-by: Alison Shao <alisonshao@MacBook-Pro-D2W773R9CD.local>
This commit is contained in:
Alison Shao
2026-02-26 18:32:08 -08:00
committed by GitHub
co-authored by Alison Shao
parent c2dce06d9f
commit 52c8a3632a
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py
+2
View File
@@ -501,6 +501,8 @@ def fused_experts_none_to_flashinfer_trtllm_bf16(
runner_config: MoeRunnerConfig, runner_config: MoeRunnerConfig,
) -> StandardCombineInput: ) -> StandardCombineInput:
# lazy import # lazy import
from sglang.srt.layers.moe.token_dispatcher.standard import StandardCombineInput
try: try:
from flashinfer.fused_moe import trtllm_bf16_moe from flashinfer.fused_moe import trtllm_bf16_moe
except ImportError as e: except ImportError as e: