 Thomas WangandXinyi Song
|
f2bcdb0508
|
[AMD] Add unified kv attention support in dpsk-v4 (#27380)
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
|
2026-06-09 23:13:37 -07:00 |
|
|
Cheng Wan
|
95d8a75bc9
|
Bundle set_kv_buffer write targets into KVWriteLoc (loc + swa_loc) (#27695)
|
2026-06-09 23:09:51 -07:00 |
|
|
Cheng Wan
|
758fd4bb9a
|
[SWA] Cache full→SWA out_cache_loc per forward across attention backends (#27617)
|
2026-06-09 22:57:51 -07:00 |
|
|
Aleksi Vesanto
|
08ceb96ea5
|
[diffusion] fix: remove boolean arithmetic guard to fix compiling (#27065)
|
2026-06-10 13:55:47 +08:00 |
|
|
Liangsheng Yin
|
d1895cb60d
|
[Spec] Extract move_accept_tokens_to_target_kvcache into spec_utils (#27764)
|
2026-06-09 21:55:26 -07:00 |
|
|
|
2495c02c2c
|
[Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-09 21:36:57 -07:00 |
|
|
Mick
|
56f06278c6
|
[diffusion] refactor: refactor realtime control state and adapters (#27698)
|
2026-06-10 12:27:16 +08:00 |
|
|
Baizhou Zhang
|
047e5df3b1
|
Revert "Share BCG output buffers across capture sizes" (#27758)
|
2026-06-09 20:51:40 -07:00 |
|
|
Lianmin Zheng
|
165331a200
|
Share BCG output buffers across capture sizes (#27659)
|
2026-06-09 20:33:46 -07:00 |
|
|
fatSheep
|
d21c31f681
|
fix: forward update_mamba_state_after_mtp_verify in HybridAttnBackend (#25883)
|
2026-06-09 20:06:50 -07:00 |
|
|
huangtingwei
|
f101b287ef
|
[Unified Tree]fix compatibility with eagle key and l3 hicache (#27655)
|
2026-06-10 10:54:45 +08:00 |
|
|
sushil Dubey
|
5809bbe35d
|
Mistral3 add tensor parallel support for diffusion text encoder (#25950)
|
2026-06-10 09:43:21 +08:00 |
|
|
Mick
|
af55025644
|
[diffusion] refactor: refactor realtime and model-specific stage modules (#27697)
|
2026-06-10 09:39:06 +08:00 |
|
|
|
bcd9c5a903
|
update pytorch-xpu to 2.12 (#27133)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
|
2026-06-10 09:25:30 +08:00 |
|
|
Jianhong Zhang
|
77c4d53f19
|
[PD] Fix prefill bootstrap registration failure with --host 0.0.0.0 (#27608)
|
2026-06-10 09:15:26 +08:00 |
|
|
iridiumine
|
2947781ce6
|
[NPU] MiMo-V2-Flash Adaptation (#25455)
|
2026-06-10 09:13:55 +08:00 |
|
|
Jan Bernlöhr
|
f3ecc3688f
|
Fix Gemma3 ModelOpt kv-scale loading (#25794)
|
2026-06-09 17:53:21 -07:00 |
|
|
Muqi Liandzqlcode
|
365b7dab9a
|
fix(schema): update tokens_after_end (#27017)
Co-authored-by: zqlcode <1309223143@qq.com>
|
2026-06-09 16:52:35 -07:00 |
|
|
Mohammad Miadh Angkad
|
bc82086ef8
|
Remove FlashInfer GB transport workaround (#27453)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-09 16:48:49 -07:00 |
|
|
Wenqiandwenqi
|
98fe7e326e
|
fix(gemma4): register image/video/audio token_regex for HF-expanded prompts (#26320)
Co-authored-by: wenqi <wenqi@convergence.ai>
|
2026-06-09 16:30:13 -07:00 |
|
|
Yueming Yuan
|
53a4b51f8c
|
Fix GLM NextN draft value head dim (#26049)
|
2026-06-09 16:13:37 -07:00 |
|
|
David Wang
|
4455abd164
|
dflash piecewise cuda graphs support (#27468)
|
2026-06-09 15:44:19 -07:00 |
|
|
|
decb88e0e3
|
Support spec v2 for Frozen-KV MTP; remove v1 worker (#27607)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-09 15:30:20 -07:00 |
|
|
|
7f730edfdc
|
fix: correct off-by-one in vocab boundary check for token validation (#22367)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2026-06-09 15:24:39 -07:00 |
|
|
weizhoublue
|
fde4004429
|
[Fix] Reset positions tensor in CUDA graph runner when batch size differs from captured size (#24401)
Signed-off-by: weizhoublue <weizhou.lan@daocloud.io>
|
2026-06-09 15:03:58 -07:00 |
|
|
jacky.cheng
|
2fef951fe8
|
[AMD] Replace fp8 mla with fp8 mha kernel for diffusion model aiter backend (#23927)
|
2026-06-09 14:46:41 -07:00 |
|
|
ziang663
|
42322947aa
|
[BUG FIX]Fix DSA CPU offload mamba indices signature (#27645)
|
2026-06-09 14:03:38 -07:00 |
|
|
Lianmin Zhengandlmzheng
|
eb8dceda44
|
Defer DeepGEMM PDL setup to worker init (#27671)
Co-authored-by: lmzheng <lmzheng@fb.com>
|
2026-06-09 13:52:30 -07:00 |
|
|
Liangsheng Yin
|
186f1e300a
|
[CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard (#27644)
|
2026-06-09 12:37:39 -07:00 |
|
|
Bi Xue
|
8ae328e5f0
|
[sgl] Fix kimi-k2.5 EAGLE3 MLA draft embeds for batched MM prefill (#27647)
|
2026-06-09 11:26:48 -07:00 |
|
|
Michael
|
5babb902a9
|
[AMD] fix: handle per-frame 4D shift in native scale-shift kernel (#27581)
|
2026-06-09 10:31:00 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
aa18a68ac5
|
[diffusion] Run LTX-2 VAE decode in channels_last_3d (faster decode, lower peak memory) (#27431)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-09 23:26:40 +08:00 |
|
|
fzyzcjy
|
1368717248
|
Add more testing for chunked prefill (#27506)
|
2026-06-09 20:19:30 +08:00 |
|
|
fzyzcjy
|
609f5f549c
|
Add mixed-prefix gsm8k eval and its CPU unit test (#27502)
|
2026-06-09 20:17:41 +08:00 |
|
|
|
fdcd28a08d
|
[NPU] Enable consistency checking for diffusion tests (#27283)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: Elizaveta Martirosian <you@example.com>
|
2026-06-09 15:01:45 +03:00 |
|
|
McZyWu
|
c6be251c5b
|
[NPU] RL update_weights_from_disk/ tensor /distributed (#26717)
|
2026-06-09 16:52:36 +08:00 |
|
|
AndyLi429
|
cd6efcb947
|
[NPU][Bugfix] fix MTP accuracy regression on Qwen3 hybrid models (#27202)
|
2026-06-09 15:47:23 +08:00 |
|
|
|
2218622f50
|
Fix spec v2 stop output boundary (#25980)
Co-authored-by: gss <2783977641@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-06-09 00:32:21 -07:00 |
|
|
Zaili Wang
|
d981b7b9c4
|
[Fix] Avoid applying cuda graph input-buffer registry on non-cuda devices (#27549)
|
2026-06-09 00:24:55 -07:00 |
|
|
Mohammad Miadh Angkad
|
a287ab83c0
|
Fix Gemma4 NVFP4 MoE default attention backend (#26791)
|
2026-06-09 14:33:08 +08:00 |
|
|
|
d145a6127a
|
fix: stop-string check misses early matches during speculative decoding (#23802)
Co-authored-by: xythink <xythink@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-06-08 23:25:58 -07:00 |
|
|
LJL36andZhangheng
|
991689fd0d
|
fix(hiradix): wait for extra pool IO (#27550)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-09 14:17:36 +08:00 |
|
|
Erik Wijmans
|
dff695c76b
|
[lora] Exclude finished requests from running_loras (#27597)
|
2026-06-08 23:05:43 -07:00 |
|
|
Khoa PhamandCursor
|
9a3e845fc1
|
[Spec] Add nvtx to spec regions (#27615)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-08 22:58:03 -07:00 |
|
|
|
5c0b2859e8
|
[diffusion] rl: extract post-training weight apis into mixins and add tensor update/checker paths (#22817)
Co-authored-by: dreamyang-liu <nikolaliu@icloud.com>
Co-authored-by: Xiaole Guo <vera0315@connect.hku.hk>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: Xiaole Guo <119391905+gxlvera@users.noreply.github.com>
Co-authored-by: zhihengy <zhihengy@andrew.cmu.edu>
Co-authored-by: MikukuOvO <MikukuOvO@users.noreply.github.com>
|
2026-06-09 13:57:47 +08:00 |
|
|
Liangsheng Yin
|
cae022aa88
|
[JIT] Reuse JIT kernel build cache across CI runs (#27605)
|
2026-06-08 22:14:48 -07:00 |
|
|
Michael
|
a32aeb688a
|
[AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers (#27580)
|
2026-06-08 21:53:14 -07:00 |
|
|
|
c2eae96c56
|
MSCCL++ Integration (#22734)
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
|
2026-06-08 21:13:13 -07:00 |
|
|
Jan BernlöhrandXueLiang Yang
|
15c801f726
|
fix(server): clamp piecewise_cuda_graph_max_tokens to context_length (#22516)
Co-authored-by: XueLiang Yang <102161631+xueliangyang-oeuler@users.noreply.github.com>
|
2026-06-08 19:43:54 -07:00 |
|
|
jianan-guandMa Mingfei
|
db143e5212
|
[Intel GPU][Encoder] Add xpu_attn backend for encoder vision attention (#26460)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-06-09 09:47:44 +08:00 |
|