Cheng Wan
758fd4bb9a
[SWA] Cache full→SWA out_cache_loc per forward across attention backends ( #27617 )
2026-06-09 22:57:51 -07:00
Aleksi Vesanto
08ceb96ea5
[diffusion] fix: remove boolean arithmetic guard to fix compiling ( #27065 )
2026-06-10 13:55:47 +08:00
Liangsheng Yin
d1895cb60d
[Spec] Extract move_accept_tokens_to_target_kvcache into spec_utils ( #27764 )
2026-06-09 21:55:26 -07:00
2495c02c2c
[Refactor] Cuda Graph Runner/Backend Refactor ( #23906 )
...
Co-authored-by: BBuf <1182563586@qq.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com >
2026-06-09 21:36:57 -07:00
Mick
56f06278c6
[diffusion] refactor: refactor realtime control state and adapters ( #27698 )
2026-06-10 12:27:16 +08:00
Baizhou Zhang
047e5df3b1
Revert "Share BCG output buffers across capture sizes" ( #27758 )
2026-06-09 20:51:40 -07:00
Lianmin Zheng
165331a200
Share BCG output buffers across capture sizes ( #27659 )
2026-06-09 20:33:46 -07:00
fatSheep
d21c31f681
fix: forward update_mamba_state_after_mtp_verify in HybridAttnBackend ( #25883 )
2026-06-09 20:06:50 -07:00
huangtingwei
f101b287ef
[Unified Tree]fix compatibility with eagle key and l3 hicache ( #27655 )
2026-06-10 10:54:45 +08:00
sushil Dubey
5809bbe35d
Mistral3 add tensor parallel support for diffusion text encoder ( #25950 )
2026-06-10 09:43:21 +08:00
Mick
af55025644
[diffusion] refactor: refactor realtime and model-specific stage modules ( #27697 )
2026-06-10 09:39:06 +08:00
bcd9c5a903
update pytorch-xpu to 2.12 ( #27133 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com >
2026-06-10 09:25:30 +08:00
Jianhong Zhang
77c4d53f19
[PD] Fix prefill bootstrap registration failure with --host 0.0.0.0 ( #27608 )
2026-06-10 09:15:26 +08:00
iridiumine
2947781ce6
[NPU] MiMo-V2-Flash Adaptation ( #25455 )
2026-06-10 09:13:55 +08:00
Jan Bernlöhr
f3ecc3688f
Fix Gemma3 ModelOpt kv-scale loading ( #25794 )
2026-06-09 17:53:21 -07:00
Muqi Li and zqlcode
365b7dab9a
fix(schema): update tokens_after_end ( #27017 )
...
Co-authored-by: zqlcode <1309223143@qq.com >
2026-06-09 16:52:35 -07:00
Mohammad Miadh Angkad
bc82086ef8
Remove FlashInfer GB transport workaround ( #27453 )
...
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
2026-06-09 16:48:49 -07:00
Wenqi and wenqi
98fe7e326e
fix(gemma4): register image/video/audio token_regex for HF-expanded prompts ( #26320 )
...
Co-authored-by: wenqi <wenqi@convergence.ai >
2026-06-09 16:30:13 -07:00
Yueming Yuan
53a4b51f8c
Fix GLM NextN draft value head dim ( #26049 )
2026-06-09 16:13:37 -07:00
David Wang
4455abd164
dflash piecewise cuda graphs support ( #27468 )
2026-06-09 15:44:19 -07:00
decb88e0e3
Support spec v2 for Frozen-KV MTP; remove v1 worker ( #27607 )
...
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai >
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
2026-06-09 15:30:20 -07:00
7f730edfdc
fix: correct off-by-one in vocab boundary check for token validation ( #22367 )
...
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
Co-authored-by: fzyzcjy <ch271828n@outlook.com >
2026-06-09 15:24:39 -07:00
weizhoublue
fde4004429
[Fix] Reset positions tensor in CUDA graph runner when batch size differs from captured size ( #24401 )
...
Signed-off-by: weizhoublue <weizhou.lan@daocloud.io >
2026-06-09 15:03:58 -07:00
jacky.cheng
2fef951fe8
[AMD] Replace fp8 mla with fp8 mha kernel for diffusion model aiter backend ( #23927 )
2026-06-09 14:46:41 -07:00
ziang663
42322947aa
[BUG FIX]Fix DSA CPU offload mamba indices signature ( #27645 )
2026-06-09 14:03:38 -07:00
Lianmin Zheng and lmzheng
eb8dceda44
Defer DeepGEMM PDL setup to worker init ( #27671 )
...
Co-authored-by: lmzheng <lmzheng@fb.com >
2026-06-09 13:52:30 -07:00
Liangsheng Yin
186f1e300a
[CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard ( #27644 )
2026-06-09 12:37:39 -07:00
Bi Xue
8ae328e5f0
[sgl] Fix kimi-k2.5 EAGLE3 MLA draft embeds for batched MM prefill ( #27647 )
2026-06-09 11:26:48 -07:00
Michael
5babb902a9
[AMD] fix: handle per-frame 4D shift in native scale-shift kernel ( #27581 )
2026-06-09 10:31:00 -07:00
Xiaoyu Zhang and Claude Opus 4.8
aa18a68ac5
[diffusion] Run LTX-2 VAE decode in channels_last_3d (faster decode, lower peak memory) ( #27431 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-06-09 23:26:40 +08:00
fzyzcjy
1368717248
Add more testing for chunked prefill ( #27506 )
2026-06-09 20:19:30 +08:00
fzyzcjy
609f5f549c
Add mixed-prefix gsm8k eval and its CPU unit test ( #27502 )
2026-06-09 20:17:41 +08:00
fdcd28a08d
[NPU] Enable consistency checking for diffusion tests ( #27283 )
...
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com >
Co-authored-by: Elizaveta Martirosian <you@example.com >
2026-06-09 15:01:45 +03:00
McZyWu
c6be251c5b
[NPU] RL update_weights_from_disk/ tensor /distributed ( #26717 )
2026-06-09 16:52:36 +08:00
AndyLi429
cd6efcb947
[NPU][Bugfix] fix MTP accuracy regression on Qwen3 hybrid models ( #27202 )
2026-06-09 15:47:23 +08:00
2218622f50
Fix spec v2 stop output boundary ( #25980 )
...
Co-authored-by: gss <2783977641@qq.com >
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com >
2026-06-09 00:32:21 -07:00
Zaili Wang
d981b7b9c4
[Fix] Avoid applying cuda graph input-buffer registry on non-cuda devices ( #27549 )
2026-06-09 00:24:55 -07:00
Mohammad Miadh Angkad
a287ab83c0
Fix Gemma4 NVFP4 MoE default attention backend ( #26791 )
2026-06-09 14:33:08 +08:00
d145a6127a
fix: stop-string check misses early matches during speculative decoding ( #23802 )
...
Co-authored-by: xythink <xythink@users.noreply.github.com >
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com >
2026-06-08 23:25:58 -07:00
LJL36 and Zhangheng
991689fd0d
fix(hiradix): wait for extra pool IO ( #27550 )
...
Co-authored-by: Zhangheng <hzh0425@apache.org >
2026-06-09 14:17:36 +08:00
Erik Wijmans
dff695c76b
[lora] Exclude finished requests from running_loras ( #27597 )
2026-06-08 23:05:43 -07:00
Khoa Pham and Cursor
9a3e845fc1
[Spec] Add nvtx to spec regions ( #27615 )
...
Co-authored-by: Cursor <cursoragent@cursor.com >
2026-06-08 22:58:03 -07:00
5c0b2859e8
[diffusion] rl: extract post-training weight apis into mixins and add tensor update/checker paths ( #22817 )
...
Co-authored-by: dreamyang-liu <nikolaliu@icloud.com >
Co-authored-by: Xiaole Guo <vera0315@connect.hku.hk >
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com >
Co-authored-by: Xiaole Guo <119391905+gxlvera@users.noreply.github.com >
Co-authored-by: zhihengy <zhihengy@andrew.cmu.edu >
Co-authored-by: MikukuOvO <MikukuOvO@users.noreply.github.com >
2026-06-09 13:57:47 +08:00
Liangsheng Yin
cae022aa88
[JIT] Reuse JIT kernel build cache across CI runs ( #27605 )
2026-06-08 22:14:48 -07:00
Michael
a32aeb688a
[AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers ( #27580 )
2026-06-08 21:53:14 -07:00
c2eae96c56
MSCCL++ Integration ( #22734 )
...
Co-authored-by: Caio Rocha <caiorocha@microsof.com >
Co-authored-by: empyreus <rjsouza1995@gmail.com >
2026-06-08 21:13:13 -07:00
Jan Bernlöhr and XueLiang Yang
15c801f726
fix(server): clamp piecewise_cuda_graph_max_tokens to context_length ( #22516 )
...
Co-authored-by: XueLiang Yang <102161631+xueliangyang-oeuler@users.noreply.github.com >
2026-06-08 19:43:54 -07:00
jianan-gu and Ma Mingfei
db143e5212
[Intel GPU][Encoder] Add xpu_attn backend for encoder vision attention ( #26460 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-06-09 09:47:44 +08:00
ea66b2cca7
[XPU] Enable NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 on Intel XPU backend ( #24390 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Yao Matrix <matrix.yao@intel.com >
2026-06-09 09:46:12 +08:00
Cao E
71e8258783
Improve registration in cpu_graph_runner ( #26635 )
2026-06-09 09:35:33 +08:00
Cheng Wan