 Yuzhen ZhouandJiajun Li
|
e03dfa8182
|
[3/N][Sync sglang-miles] TITO Support (#23751)
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
|
2026-06-03 21:45:33 -04:00 |
|
|
Jonny Kong
|
084c6a7e2a
|
Refactor simulated acceptance length generation (#26768)
|
2026-06-03 18:31:32 -07:00 |
|
|
|
f6cd1a9822
|
Add num_waiting_uncached_tokens load metric (#27174)
Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-03 18:29:49 -07:00 |
|
|
ybyangandLianmin Zheng
|
687baf9471
|
fix(load-snapshot): avoid duplicate zmq bind in multi-tokenizer mode (#27145)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-03 18:24:56 -07:00 |
|
|
|
14ed9b448e
|
Add ZMQ IPv6 support, bench_serving sampling params, and reduce routed_dp_rank log noise (#27180)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Grigory Sizov <grisha.sizov@gmail.com>
|
2026-06-03 17:49:34 -07:00 |
|
|
Yinghai Lu
|
7bb5c96685
|
Trigger scheduler diagnostics on health failure (#26757)
|
2026-06-03 17:19:55 -07:00 |
|
|
Baizhou Zhang
|
d097cd2212
|
[GLM-5] Apply trtllm MHA kernel for GLM-5 on Blackwell (#21332)
|
2026-06-03 17:16:54 -07:00 |
|
|
Mick
|
3790173b3b
|
[diffusion] fix: avoid flashattention forward context lookup (#27153)
|
2026-06-04 08:11:50 +08:00 |
|
|
Clintandclintg6
|
cfb7fb4fad
|
[AMD] Fix TP2 DeepSeek-R1 nhead=64 MLA decode crash and add nightly coverage (#27188)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
|
2026-06-03 16:56:05 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
c9ca56da8c
|
Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-03 16:12:27 -07:00 |
|
|
Cheng Wan
|
61aa3293d3
|
Revert "Fix TokenizerManager crash on top_logprobs with tensor values" (#27187)
|
2026-06-03 14:53:28 -07:00 |
|
|
ishandhanani
|
978fb6ed1a
|
hicache kv events: publish split write-through fragments (#27072)
|
2026-06-03 14:52:25 -07:00 |
|
|
jacky.cheng
|
1dd9432889
|
[AMD] Fuse compress norm+rope+hadamard into single Triton kernel (#26894)
|
2026-06-03 14:20:40 -07:00 |
|
|
|
c670609ac5
|
[NPU] Diffusion CI Ground Truth Generation (NPU) (#24630)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-04 00:14:37 +03:00 |
|
|
Cheng WanandClaude Opus 4.8
|
e485ad6ac1
|
Fix hybrid linear attention dispatch by layer id with draft-worker awareness (#27120)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-03 14:11:14 -07:00 |
|
|
Kevin Flansburg
|
7716fa00e0
|
Fix TokenizerManager crash on top_logprobs with tensor values (#26825)
|
2026-06-03 13:55:02 -07:00 |
|
|
|
293816ab14
|
[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
|
2026-06-03 12:55:24 -07:00 |
|
|
Hanming LuandYAMY
|
e0b692600f
|
[Mamba] extra buffer lazy support (#27118)
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-06-03 12:42:11 -07:00 |
|
|
Liangsheng YinandAlison Shao
|
ac99794e64
|
Reland spec v2 tree drafting (eagle topk>1) with page_size==1 (#26866) (#26997)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
|
2026-06-03 15:40:05 -04:00 |
|
|
Mohammad Miadh Angkad
|
7f706f4cfb
|
[Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854)
|
2026-06-03 12:09:18 -07:00 |
|
|
Liangsheng Yin
|
578f232e5e
|
Fix trace_modules gate disabling default trace contexts (#27173)
|
2026-06-03 14:03:42 -04:00 |
|
|
Cheng WanandClaude Opus 4.8
|
45604a0f4a
|
[refactor] Unify CUDA graph runner input buffers behind CudaGraphBufferRegistry (#26742)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-03 10:54:10 -07:00 |
|
|
Mick
|
b0f78bef97
|
[diffusion] improve: improve realtime webui playback pacing (#27148)
|
2026-06-04 00:33:56 +08:00 |
|
|
Lijuan TangandXiaodong Ye
|
9d0e6a2df4
|
fix(mlx): set canary_manager and materialize overlap-loop inputs on Apple Silicon (#26882)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Signed-off-by: LijuanTang94 <tang.lij@northeastern.edu>
Co-authored-by: Xiaodong Ye <yeahdongcn@gmail.com>
|
2026-06-04 00:03:46 +08:00 |
|
|
Xinyuan Tong
|
fa5c8a3101
|
[model] support encoder-free unified Text/Vision/Audio model (#27167)
|
2026-06-03 23:58:06 +08:00 |
|
|
shuwenn
|
f65aae8493
|
[HiCache] fix: truncate prefetch key on degraded allocation (#25991)
|
2026-06-03 22:06:18 +08:00 |
|
|
Mick
|
33f943fbf5
|
[diffusion] optimize: batch usp replicated kv prefix all-to-all (#27143)
|
2026-06-03 21:22:39 +08:00 |
|
|
Ye (Charlotte) Qi
|
03c77dc33d
|
[PD] Deduplicate PD logprob normalization (#27085)
|
2026-06-03 19:08:15 +08:00 |
|
|
Ke Bao
|
44d4a25a07
|
Type hicache transfer hook kwargs in unified cache (#27071)
|
2026-06-03 18:57:25 +08:00 |
|
|
|
e67810bea7
|
[SGLang Tracing] Add pd disaggregation mooncake backend tracing (#23755)
Co-authored-by: Mu Huai <tianbowen.tbw@antgroup.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-03 16:43:29 +08:00 |
|
|
Cheng Wan
|
73b53e7a87
|
Revert "Support NextN = 2/4 in DSV32" (#27138)
|
2026-06-03 01:29:52 -07:00 |
|
|
Vladislav NosivskoyandZhangheng
|
63dc20ae6c
|
[UnifiedTree] Add CP sync (#25395)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-03 16:10:27 +08:00 |
|
|
|
93173b27e8
|
integrate flash_mla_sparse_fwd (#25418)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: laixinn <q865809639@gmail.com>
Co-authored-by: MeowGrange <276466210+MeowGrange@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-03 01:09:25 -07:00 |
|
|
ybyang
|
f790674ad8
|
fix(moe): avoid unpacking None from masked deep_gemm without overlap when sbo enabled (#26839)
|
2026-06-03 00:44:28 -07:00 |
|
|
Mick
|
9450696aa5
|
[diffusion] CI: add cosmos3 nano t2v gpu test (#26963)
|
2026-06-03 15:42:51 +08:00 |
|
|
Bingxu Chen
|
8e77af1afc
|
[AMD] fix(triton-mla): cap max_kv_splits at 256 on gfx942 (Kimi-K2.6 hang) (#24762)
|
2026-06-03 00:13:18 -07:00 |
|
|
inkcherryandAlex Nails
|
e5b8e3a66a
|
Optimize streaming detokenizer updates (#24659)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-06-02 23:44:21 -07:00 |
|
|
Kevin Flansburg
|
52f2fe456a
|
fix(disagg): correct DSA/SWA state-page transfer mismatch in PD disaggregation (#27004)
|
2026-06-03 14:33:41 +08:00 |
|
|
Mick
|
dae86f51f5
|
[diffusion] chore: polish realtime webui waiting state (#27068)
|
2026-06-03 14:29:26 +08:00 |
|
|
Khoa Pham
|
b5560ffc36
|
Fix flashinfer autotune oom glm51 (#24195)
|
2026-06-02 23:28:57 -07:00 |
|
|
Cheng Wan
|
202e618898
|
Revert "Fix hybrid linear attention misrouting plain-RadixAttention linear layers to the full backend (Ring-2.5-1T)" (#27116)
|
2026-06-02 23:27:57 -07:00 |
|
|
Jimmy Shong
|
0ef39784ef
|
[Bugfix] Gate DP-attention even-token padding to CP-enabled configs (#26911)
|
2026-06-03 02:06:52 -04:00 |
|
|
Duyi-Wang
|
ab7c4ab6bb
|
[AMD] Fix correctness for AITER MLA backend with --page-size > 1 (#25556)
|
2026-06-02 23:01:19 -07:00 |
|
|
Shaun Kotek
|
b8d7351a74
|
Feat/add w4a16 moe support to nemotron (#25655)
|
2026-06-02 22:42:26 -07:00 |
|
|
gaopengff
|
aa510bda45
|
Support specific pass of bias_grouped_topk for xpu (#26349)
|
2026-06-03 13:13:48 +08:00 |
|
|
|
f4e7a98fe5
|
[HiCache] feat: support draft offload for mooncake (#24984)
Co-authored-by: huangtingwei9988 <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: stmatengss <11641725+stmatengss@users.noreply.github.com>
|
2026-06-02 21:42:04 -07:00 |
|
|
CrazyCoder
|
c3aaafc5f2
|
[Bugfix] Clean up failed NIXL sender state (#27011)
|
2026-06-03 12:15:15 +08:00 |
|
|
zhaoshangandShangming Cai
|
3e681d7fff
|
Add per-rank staggered weight loading for improved TP I/O concurrency (#26937)
Signed-off-by: zhaoshang <zhaoshangsjtu@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-03 11:25:21 +08:00 |
|
|
zijiexiaandYihao Wang
|
1ebc7438ac
|
model: support Command A plus (#26106)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-06-03 11:23:04 +08:00 |
|
|
Mick
|
71a747cf15
|
[diffusion] fix: fix lingbot realtime consistency gt pin (#27080)
|
2026-06-03 10:29:37 +08:00 |
|