 Xiaoyu ZhangandClaude Fable 5
|
d4a0dfbc31
|
[Fix] Two root causes of the H100 deepep TBO CI break: scale-tensor use-after-free + missing non-finite quant sanitization (#32188)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-24 07:29:28 +08:00 |
|
|
Siyuan Chen
|
71fe41b6b3
|
[DSV4] Support megamoe for CP (#29569)
|
2026-07-23 14:46:32 -07:00 |
|
|
Jimmy Shong
|
410ab4fde5
|
Add return_token_ids support to completions and chat completions APIs (#30917)
|
2026-07-23 14:41:52 -07:00 |
|
|
Hongkuan Zhou
|
d0b9689805
|
[Fix] Include disagg prefill waiting queue in FPM (#32122)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
|
2026-07-23 09:30:27 -07:00 |
|
|
Jialin Ouyangandhzh0425
|
70ac0c4b0e
|
[UnifiedRadixCache][mamba] Fix mamba state corruption and slot leak when load_back aborts (#30986)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-07-23 18:48:31 +08:00 |
|
|
YAMY
|
c18919f8f3
|
[Mamba] Add a per-path cap for cached states (#31230)
|
2026-07-23 17:58:36 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
62aa85d9aa
|
[Kernel] Sweep missed dedicated kernels into kernels.ops (moe/quant siblings + dspark) (RFC #29630) (#32160)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-23 17:07:16 +08:00 |
|
|
Liangsheng Yin
|
f35411ee81
|
[Spec] Enable grammar overlap scheduling for STANDALONE speculative decoding (#32110)
|
2026-07-23 01:47:27 -07:00 |
|
|
Liangsheng Yin
|
9b853e6832
|
[Scheduler] Enable decode retraction ordering under speculative decoding (#32023)
|
2026-07-23 00:42:56 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
11b0e5c5ad
|
[Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-23 13:47:02 +08:00 |
|
|
Liangsheng Yin
|
1b63155efe
|
[Perf] Skip blocks past per-request live length in full-width Triton kernels (#32109)
|
2026-07-22 22:00:25 -07:00 |
|
|
Yuzhen Zhou
|
eb242b6c03
|
Seed the GDN CuteDSL correctness test inputs to fix flakiness (#32126)
|
2026-07-22 21:30:00 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
2d1a7be8c4
|
[Kernel] Reclassify kernel tests by ops group + move helpers out of the package (RFC #29630) (#32128)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-23 12:18:27 +08:00 |
|
|
huangtingwei
|
86e1bb584d
|
[HiCache] Add model-aware key isolation to Mooncake Store (#31920)
|
2026-07-23 10:20:13 +08:00 |
|
|
Chunyuan WU
|
60dea26077
|
[sgl-kernel][CPU] add kernel for shm_allgather_into_tensor and shm_reduce_scatter_tensor (#13397)
|
2026-07-23 09:19:38 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
99f636a86f
|
[Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels (#32072)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-23 08:35:09 +08:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
0c29c8fece
|
Bump FlashInfer to 0.6.15.post1 (#31927)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-07-22 14:21:59 -07:00 |
|
|
|
c20c48b8fd
|
Add 'anyOf' schema support for qwen3_coder tool call parser (#30832)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-22 14:14:47 -07:00 |
|
|
Cheng Wan
|
f5dcbe8f14
|
Revert RuntimeContext config-namespace reads/roles (#31813–#31817) (#32100)
|
2026-07-22 11:52:41 -07:00 |
|
|
Mohammad Miadh Angkad
|
0bdd4730af
|
[CI] Fix failures on main (#32091)
|
2026-07-23 00:11:25 +08:00 |
|
|
Ke Bao
|
e81b326e72
|
Add Inkling per-commit server test (#32095)
|
2026-07-22 23:56:18 +08:00 |
|
|
|
e8e765b9d6
|
[AMD] Add fused all-reduce RMSNorm per-group quant for Qwen3.5 FP8 (#24651)
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-07-22 07:33:03 -07:00 |
|
|
Fan Kunand范坤
|
004df6b520
|
[FIX] Prevent Lightning Attention extra-buffer mamba state corruption (#29973)
Co-authored-by: 范坤 <fankun@U-Q0542J2D-0225.local>
|
2026-07-22 22:01:29 +08:00 |
|
|
ishandhananiandConnor Carpenter
|
21065bc862
|
feat: add native gRPC sidecar module launcher (#31076)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
Signed-off-by: Connor Carpenter <connorc@nvidia.com>
Co-authored-by: Connor Carpenter <connorc@nvidia.com>
|
2026-07-22 06:39:08 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
74338e94f1
|
[Kernel] Phase 4 batch-3: migrate tangled JIT subsystems + new groups into kernels.ops (RFC #29630) (#32045)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 21:15:03 +08:00 |
|
|
Mohammad Miadh Angkad
|
d6690de961
|
[CI] Fix Marlin MoE test ServerArgs initialization (#32049)
|
2026-07-22 20:16:43 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
977ea336cd
|
[Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 17:49:51 +08:00 |
|
|
Cheng Wan
|
2e43b4de52
|
test: publish resolved config in unit fixtures for the namespace API (#31817)
|
2026-07-22 01:19:13 -07:00 |
|
|
Cheng Wan
|
1d0a6ee178
|
runtime_context: record the publishing process role (#31813)
|
2026-07-22 01:17:42 -07:00 |
|
|
Cheng Wan
|
e1479cc966
|
config: route runtime config adjustments through the namespace bags (#31812)
|
2026-07-22 01:17:22 -07:00 |
|
|
Cheng Wan
|
97e2c0c4ee
|
config: make ServerArgs read-only with a single audited mutation entry (#31811)
|
2026-07-22 01:16:55 -07:00 |
|
|
Cheng Wan
|
09688d58bc
|
runtime_context: add resolved-config namespace bags and accessors (#31810)
|
2026-07-22 01:16:24 -07:00 |
|
|
Cheng Wan
|
1a19f2b50f
|
config: annotate ServerArgs fields with their runtime-config namespace (#31809)
|
2026-07-22 01:15:11 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
ae2bc3321e
|
[KDA] Fix mixed exponent bases in Triton chunk prefill (#31904)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-07-22 16:03:29 +08:00 |
|
|
Hanming Lu
|
297f9336c8
|
[Test] Enable mamba lazy extra buffer alloc edge case kl test in CI (#31991)
|
2026-07-21 20:45:43 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
246b3c3eaf
|
[Kernel] Phase 3+4: move JIT infra + operator groups into sglang.kernels (RFC #29630) (#31666)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 11:28:27 +08:00 |
|
|
|
3217b7e3ce
|
fix(hicache): support staged write-back for asymmetric MHA (#30981)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-07-22 09:58:49 +08:00 |
|
|
Ma MingfeiandCopilot Autofix powered by AI
|
878d77929d
|
[CPU] refactor rope kernels (#31897)
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
|
2026-07-22 09:12:02 +08:00 |
|
|
ashwini rathi
|
14c0a31829
|
[Bugfix] Fix Cohere2MoeConfig import crash from huggingface_hub @strict (#31769)
|
2026-07-22 08:56:30 +08:00 |
|
|
DarkSharpnessandClaude Fable 5
|
8bb0d8d005
|
[JIT] Trait-driven per_token_group_quant: unify the quant kernel family (flat + masked) (#30924)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-22 08:46:52 +08:00 |
|
|
Liangsheng Yin
|
024639a372
|
[Perf] Stack dspark dense draft per-layer ctx KV projection into one GEMM (#31986)
|
2026-07-21 17:46:13 -07:00 |
|
|
Fardin Hoque
|
b54adced46
|
[Quant] Support NVFP4_AWQ checkpoints in ModelOpt FP4 path (#31825)
|
2026-07-22 08:46:10 +08:00 |
|
|
|
03342e7732
|
Delete sgl-kernel AOT router GEMM and fused A GEMM (#30280)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
|
2026-07-22 08:44:59 +08:00 |
|
|
Liangsheng Yin
|
08cb081ed0
|
[Perf] Skip page-table columns past kv length in DSA draft-extend metadata kernel (#31981)
|
2026-07-21 16:20:14 -07:00 |
|
|
JD
|
becf252e6c
|
AutoWeightLoader support Sglang native models 1: demo (#28671)
|
2026-07-21 14:32:13 -07:00 |
|
|
Hanming Lu
|
d03c8cee80
|
Negotiate PrefillDelayer only after KV-budget admission checks (#31835)
|
2026-07-21 12:07:30 -07:00 |
|
|
Hanming Lu
|
927979e127
|
Fix pad-row top-k masking with custom_routing_function under DP attention (#31838)
|
2026-07-21 11:49:17 -07:00 |
|
|
Ke Bao
|
604b1507d2
|
Add Inkling to nightly test (#31939)
|
2026-07-21 23:06:11 +08:00 |
|
|
Xiaoyu Zhang
|
075bd97952
|
[Benchmark] Remove obsolete auto-benchmark remnants (#31941)
|
2026-07-21 20:44:52 +08:00 |
|
|
|
e4eea7ce2f
|
Optimize LongCat-Flash router GEMM with the HPC-Ops bf16xfp32 kernel (#30247)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Halcyon <56064364+VAthree@users.noreply.github.com>
|
2026-07-21 20:05:17 +08:00 |
|