minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[Intel GPU] DeepSeek V4 10/N : Add sqrtsoftplus support to fused_topk_torch_native (#28048)

Browse Source 
Signed-off-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
This commit is contained in:
Polisetty V R K Jyothendra Varma
2026-07-03 15:59:12 +08:00
committed by GitHub
co-authored by Rahul Vijayaraghavan Ma Mingfei
parent 9df16b5ba9
commit e90fec4868
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/moe/topk.py
+2
View File
@@ -652,6 +652,8 @@ def fused_topk_torch_native(
return gating_output.softmax(dim=-1) return gating_output.softmax(dim=-1)
elif scoring_func == "sigmoid": elif scoring_func == "sigmoid":
return gating_output.sigmoid() return gating_output.sigmoid()
elif scoring_func == "sqrtsoftplus":
return F.softplus(gating_output).sqrt()
else: else:
raise ValueError(f"Invalid scoring function: {scoring_func}") raise ValueError(f"Invalid scoring function: {scoring_func}")