19 Commits
Author SHA1 Message Date
Miaomiao Jiang 690428b470 [XPU] Add xpu forward in Gemma3RMSNorm & Add test and benchmark for Gemma3RMSNorm (#36278) 2026-09-11 10:32:25 +08:00
ANSHUMAN TRIPATHYandmingfeima 2adb2e8485 [XPU] Adapt device agnostic API usage (#32093)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
2026-09-11 10:03:12 +08:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
Yuan Luoandluoyuan.luo 5b04408784 [MoE] Add FlashInfer SM90 MXFP4 W4A8 CUTLASS MoE (#34967)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-08-31 20:04:41 -07:00
Jonny Kongandjonnykong 4d78d59e51 [MoE] Make simulated expert routing support DP>1, and fuse into one triton kernel (#29718)
Co-authored-by: jonnykong <jonnykong@fb.com>
2026-08-28 14:22:45 -07:00
Xiaoyu ZhangandClaude Opus 4.8 11b0e5c5ad [Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 13:47:02 +08:00
Xiaoyu ZhangandClaude Opus 4.8 977ea336cd [Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-22 17:49:51 +08:00
Xiaoyu ZhangandClaude Fable 5 ba5be86d42 [Kernel] Migrate DSA + DSV4 attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 5/7) (#30792)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 11:11:22 +08:00
Xiaoyu ZhangandClaude Fable 5 e9ef06c560 [Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 09:20:59 +08:00
Yuhao Yang aea0e30853 [4/N] Qwen3.5Opt: Overlap mamba verify update with draft extend (#26924) 2026-06-13 20:29:20 +08:00
Cheng WanandClaude Sonnet 4.6 8131641bc6 [Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 00:18:04 -07:00
a080358cac [Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-18 04:36:42 +03:00
Liangsheng Yin d89b678d69 move dead sglang.test files to test/manual (#25316) 2026-05-14 20:02:44 -07:00
BingjiaWangandabing 006bd44cf9 [deepseekv3.2] fix get_k_and_s_triton kenel for 128K seqlen case bug (#19319)
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
2026-03-11 12:56:33 -07:00
Baizhou Zhang 615a02dcd4 Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471) 2026-02-09 16:37:19 +08:00
BingjiaWangandabing 760ae933bb optimize get_topk_ragged by fusing get k and k_scale triton kernel (#16043)
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
2026-02-04 19:59:41 +08:00
Jonah Bernard 45ef834412 Add MoE Integration Tests For CUTLASS Coverage (#16280) 2026-01-05 11:26:11 -08:00
JohnsonmsandJohnsonms 043f13171f [Performance] Optimize NSA Indexer K/S Buffer Access with Fused Triton Kernels (#13812)
Co-authored-by: Johnsonms <johnson@together.ai>
2025-12-02 18:53:06 -08:00
alisonshao 6b262ac839 Test reorganization: Move tests to manual/ (#13610) 2025-11-20 13:41:58 -08:00