minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity

Enable flashinfer::trtllm_allreduce_fusion with PDL (#23765)

Browse Source 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
This commit is contained in:
Brayden Zhong
2026-05-08 10:41:10 +08:00
committed by GitHub
co-authored by b8zhong gemini-code-assist[bot]
parent d9dddd4d7d
commit 5fa3bb2eaf
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/flashinfer_comm_fusion.py
+1
View File
@@ -676,6 +676,7 @@ def flashinfer_allreduce_residual_rmsnorm(
workspace=workspace_manager.workspace,
pattern=_flashinfer_comm.AllReduceFusionPattern.kARResidualRMSNorm,
launch_with_pdl=True,
trigger_completion_at_end=trigger_completion_at_end,
residual_out=residual_out,
norm_out=norm_out,
residual_in=residual,