Commit Graph
3189 Commits
Author SHA1 Message Date
ashwini rathiandSinghal, Shubham 5134dcdcab [Intel XPU] Initially add nightly GSM8K accuracy tests for Llama-3.1-8B (TP=2) and Qwen3-32B (TP=4) (#28908)
Co-authored-by: Singhal, Shubham <shubham.singhal@intel.com>
2026-07-01 16:27:24 +08:00
Bingxu Chen 548f505cc5 [AMD] Cover DeepSeek-R1 MXFP4 TP4 MTP nightly CI (#29290) 2026-07-01 01:21:17 -07:00
Michael 69ce72020a [AMD] Register ltx2_ada_values JIT kernel test for AMD nightly CI (#29693) 2026-07-01 01:13:55 -07:00
huangtingwei 5e1ccd9320 [HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287) 2026-07-01 15:44:23 +08:00
df0dfbaa45 [Kernel] Strengthen kernel shape coverage (#29636)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-07-01 15:44:20 +08:00
YC Yen-Ching Tseng 308d89e042 [AMD] Split qwen3.5 triton DCP test into its own nightly job (#29409) 2026-07-01 00:39:39 -07:00
Jialin Ouyang 40594bd381 [passthrough] engine: zstd request-body decompression + header overrides (#29684) 2026-06-30 23:48:56 -07:00
Xiaoyu Zhang fcb9f229b3 [KDA-Pilot] Add LTX2 QKNorm split-RoPE CUDA fast path (#29708) 2026-07-01 14:42:07 +08:00
Chang Min Bark 41779d56fd fix: make write_token dynamic (#29271) 2026-06-30 22:55:57 -07:00
Lijuan Tang 3cdc2415b1 [MLX] Fix step-bounded profiling for bench tools on Apple Silicon (#29217) 2026-06-30 22:55:29 -07:00
zhangxiaolei 56f22cd520 Optimize C128 state pool allocation using request state pool (#28612) 2026-06-30 19:11:29 -07:00
53c61bd5e6 [bug2] skip swa recovery on locked full kv (#29352)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
2026-06-30 16:07:06 -07:00
Feng Yaoandispobock 1c2523b719 [bug1] keep full kv when swa skips leaf data (#29351)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-07-01 00:51:18 +08:00
cf36dca6d4 [JIT Kernel] Triton moe fused gate (#25835)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-06-30 23:26:18 +08:00
Stanley Winata a5e6dd3767 [AMD] Implement QuarkW4A8MXFp4MoE to support amd/gpt-oss-120b-w-mxfp4-a-fp8 (#27204)
Signed-off-by: Stanley Winata <stanley.winata@amd.com>
2026-06-30 01:24:22 -07:00
Mohammad Miadh Angkad b6fceaa789 [DSA] Use cos_sin_cache for DSA indexer fusion (#29613) 2026-06-29 23:49:00 -07:00
dbb51c46ac [CI] Migrate JIT tests missed by #29066 to runner_config registration (#29715)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-29 23:21:14 -07:00
Zhangheng dad0120c57 [HiSparse]: Skip flaky hisparse-nixl ci (#29710) 2026-06-30 14:04:34 +08:00
Baizhou Zhang cc238270b1 Update GLM tests to 5.2 and delete redundant tests (#29686) 2026-06-29 23:04:26 -07:00
YC Yen-Ching Tseng 7d9116d9d7 Fix test_type_based_dispatcher after TokenizedGenerateReqInput field changes (#29376) 2026-06-29 22:22:22 -07:00
Michael 7da4e30d9b [AMD] Register fused_metadata_copy JIT kernel test for AMD nightly CI (#29671) 2026-06-29 21:26:11 -07:00
Zhaoyi Liandbingxche 6bf15aa2b9 [AMD]: Enable NIXL PD disaggregation for ROCm(1/n) (#28348)
Co-authored-by: bingxche <bingxche@amd.com>
2026-06-29 21:23:09 -07:00
Mohammad Miadh Angkad 3a72d02415 [DSA] Optimize DSA CUDA graph replay metadata generation (#29499) 2026-06-29 19:53:23 -07:00
3e16be2122 [CI] Migrate JIT tests to runner config registration (#29066)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-29 19:12:14 -07:00
Ho-Ren (Jack) Chuang bc8b3ab1f5 [Kernel] Add SM90 Q8KV8 FP8 Sparse MLA Prefill JIT Kernel with Tests and Benchmark (#25751) 2026-06-30 09:00:11 +08:00
Ho-Ren (Jack) Chuang a6bc432fd8 [Perf][Kernel] Fuse SiLU+Mul into NVFP4 Expert Quantization for CUTLASS MoE (#18612) 2026-06-29 16:51:01 -07:00
eeechoandAliceChenyy f0bf96390b [SM120] Add FlashInfer sparse MLA decode for DSv4-Flash (#27455)
Co-authored-by: AliceChenyy <alicechenyy@users.noreply.github.com>
2026-06-29 16:27:16 -07:00
Trevor Morris b8c25bfaa7 [NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394) 2026-06-29 16:23:58 -07:00
Cheng Wanandlch1475369 fc96edd297 feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
2026-06-29 14:49:54 -07:00
Mohammad Miadh Angkad 6c018eb4d1 Fix bounded checkpoint prefetching and buffered drop-cache handling (#29156) 2026-06-29 21:49:16 +00:00
Feng Yao e6c15f76f3 [optimize] fix swa eviction boundary for unfinished inserts (#29350) 2026-06-30 00:19:15 +08:00
Jyothirmai KottuandXinyuan Tong 473a278dd1 model: support nvidia/LocateAnything-3B (#28958)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-06-30 00:16:42 +08:00
Shangming Cai 93926b9a95 Add Qwen3 MoE tests for PP compatibility with CP and DP (#29640)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-06-29 18:52:03 +08:00
danielafrimiandDaniel Afrimi a2b5ce2ed1 Add stochastic rounding for FP16 Mamba SSM cache (#26929)
Signed-off-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
2026-06-29 01:47:09 -07:00
SSSunzt 91cf159696 [PP] bugfix: include CP size in PP rank offset (#29571) 2026-06-29 16:01:41 +08:00
Brayden ZhongandBrayden Zhong c7b9b92d9a Fix CI caused by https://github.com/sgl-project/sglang/pull/29576 (#29596)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-28 23:46:18 -07:00
Liangsheng Yin c0d45cda29 [Spec] Add DFLASH basic sanity CI test (#29338) 2026-06-28 23:45:05 -07:00
Yueming Yuan cd91dd0757 fix test_weight_checker_comparator assertion and ue8m0 scale unpack (#29623) 2026-06-28 23:36:37 -07:00
Yueming Yuan e1ca92a7fd [weight checker] refactor: add precision branch; allow ULP quant err; used chunked compare (#28974) 2026-06-28 18:44:05 -07:00
Liangsheng Yin 909123ddb8 [misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591) 2026-06-28 18:38:28 -07:00
Ma Mingfei 3217410cf6 [CPU] enable fused_sigmoid_mul on CPU device (#29378) 2026-06-29 09:38:04 +08:00
Liangsheng Yin abaee4664e [dflash] fa3/fa4: device-side page table; drop seq_lens_cpu D2H sync (#29343) 2026-06-28 18:06:33 -07:00
Chao Shi bd2a5db987 [HiCache] Detect for double-free in HostKVCache (#29310) 2026-06-29 09:02:21 +08:00
ishandhanani aaa31eb0a1 feat: first-class session identity in SGLang (#29436) 2026-06-28 07:16:38 -07:00
Mick 643e1cc779 fix: fix prefill-aware SWA floor tracking (#29520) 2026-06-28 14:18:28 +08:00
Xinyuan Tong ddc389cf09 [minimax-m3] Split 3/4: disagg K-only index-K transfer (#28714) 2026-06-28 13:54:42 +08:00
Mohammad Miadh Angkad ae09b8302f [CI] Fix GB300 DSV4 Pro FP4 nightly (#29502) 2026-06-27 21:06:17 -07:00
sglang-botandClaude Sonnet 4.6 3d922a51fc test: remove multimodal piecewise CUDA graph gate test (#29537)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-27 19:03:32 -07:00
Khoa PhamandCursor da802ddcaf (perf): Shard Kimi-K2.5 Eagle3 draft fc + symm-mem AG (#29223)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-27 17:40:32 -07:00
073de15053 Fuse the DSA (V3.2, GLM-5.x) indexer Q/K paths into single kernels (#27705)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: Kaixi <kaiximatteoc@nvidia.com>
2026-06-27 14:29:56 -07:00