Commit Graph
13837 Commits
Author SHA1 Message Date
zijiexiaandClaude Fable 5 73d0989d9b docs: make playground issue template model field a free-form input (#27827)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-10 14:04:16 -07:00
Liangsheng Yin 5fefe91289 [Spec] NGRAMWorker on BaseSpecWorker; algo-owned verify-tree shape params (#27799) 2026-06-10 12:38:16 -07:00
zijiexiaandClaude Opus 4.8 99258b2f1e [Docs] Restore right-hand ToC on the DeepSeek-V4 cookbook page (#27830)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-10 11:58:02 -07:00
shuwennandQiaolin Yu 3600a9ac5f [SPEC] feat: init adaptive spec params from config (#27493)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
2026-06-10 18:55:25 +00:00
Kangyan-ZhouandClaude Opus 4.8 21647f1f5d [router] Apply chat template before cache-aware hashing (fix overlap=0 on chat traffic) (#27386)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-10 10:27:54 -07:00
Mohammad Miadh Angkad 276c98c6cf [Docs] Add Kimi-K2.6 NVFP4 and update Kimi-K2.5 cookbook guidance (#27714)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-10 10:24:09 -07:00
billishyahaoandHAI 0ae27405d0 [AMD] Support eplb for moriep (#22985)
Co-authored-by: HAI <hixiao@gmail.com>
2026-06-10 10:23:51 -07:00
Mohammad Miadh Angkad 91ff7baa28 [Docs] Add GLM-5.1 NVFP4 to cookbook (#27708)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-10 10:23:15 -07:00
Kai-Hsun Chen 8c6bbe0658 [deepseek] Enable DP attention + TBO + shared experts fusion (#27510) 2026-06-10 09:42:27 -07:00
1cf8efdd08 docs: Diffusion Gemma cookbook (#27824)
Co-authored-by: Richard Wang <wangrichard08@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-10 09:33:01 -07:00
Kangyan-ZhouandClaude Opus 4.8 0c7faf01fb test(sgl-router): cover sticky scale-up no-redistribution e2e (#27742)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-10 08:54:31 -07:00
Michael 6a16f29af6 [AMD] ci: register 8 framework / unit tests to run on AMD CI (#25939) 2026-06-10 08:41:22 -07:00
502bc89e1b [AMD] Fix DeepSeek V4 Pro c128 state tensor dtype mismatch error and c4_sparse_raw_indices attribute error in cuda graph phase (#27529)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-06-10 08:30:48 -07:00
JoyFuture 53ed34cb88 Fix MiMo-V2.5-Pro DP-attention dp size in cookbook deployment snippet (#27668) 2026-06-10 22:08:28 +08:00
Yuan Luoandluoyuan.luo 518e35fae7 [KDA] Add CuteDSL Prefill Kernel on SM100 (#27488)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-10 21:25:19 +08:00
Mohammad Miadh Angkad 4faaa9ba92 [CI] Fix stale ngram bookkeeping owner sites (#27803) 2026-06-10 04:51:46 -07:00
Thomas Wangandbingxche b0d888a195 [CI] Remove AMD DSv4 Docker publish job (#27795)
Co-authored-by: bingxche <bingxche@amd.com>
2026-06-10 17:50:28 +08:00
111009ea54 [Feature] [Ngram spec] Support ngram spec v2 (#17260)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Ratish P <114130421+Ratish1@users.noreply.github.com>
2026-06-10 02:46:00 -07:00
ChengYao-amdandgithub-actions[bot] 255843d454 Support for Zyphra zaya1 model (#26347)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-06-10 02:44:47 -07:00
DarkSharpnessandClaude b40f365732 [CI] Move misplaced mhc kernel test into test/registered/kernels (#27781)
Co-authored-by: Claude <noreply@anthropic.com>
2026-06-10 01:49:18 -07:00
Cheng Wan 70c71ba183 [NPU] Fix dead patch_model monkey-patch breaking NPU torch.compile capture (#27774) 2026-06-10 01:15:50 -07:00
Ziang Li 01f10acd06 Implement online nvfp4 quantization (#26083) 2026-06-10 00:26:51 -07:00
nbarzilie e76e4959b5 [CI][PD] Add unit tests for nixl backend (#26908) 2026-06-10 14:31:59 +08:00
zijiexiaandClaude Opus 4.8 1a5775a9df [Docs] Remove the legacy release-docs.yml deploy workflow (#27766)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-09 23:18:41 -07:00
Mick e8a437ef26 [diffusion] doc: update docs architecture (#27767) 2026-06-10 14:18:10 +08:00
Thomas WangandXinyi Song f2bcdb0508 [AMD] Add unified kv attention support in dpsk-v4 (#27380)
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
2026-06-09 23:13:37 -07:00
Cheng Wan 95d8a75bc9 Bundle set_kv_buffer write targets into KVWriteLoc (loc + swa_loc) (#27695) 2026-06-09 23:09:51 -07:00
Cheng Wan 758fd4bb9a [SWA] Cache full→SWA out_cache_loc per forward across attention backends (#27617) 2026-06-09 22:57:51 -07:00
Aleksi Vesanto 08ceb96ea5 [diffusion] fix: remove boolean arithmetic guard to fix compiling (#27065) 2026-06-10 13:55:47 +08:00
Bingxu Chen 4704b10d0d [AMD] Update MoRI to v1.2.0 (#27669) 2026-06-09 22:41:53 -07:00
Liangsheng Yin d1895cb60d [Spec] Extract move_accept_tokens_to_target_kvcache into spec_utils (#27764) 2026-06-09 21:55:26 -07:00
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
Mick 56f06278c6 [diffusion] refactor: refactor realtime control state and adapters (#27698) 2026-06-10 12:27:16 +08:00
Baizhou Zhang 047e5df3b1 Revert "Share BCG output buffers across capture sizes" (#27758) 2026-06-09 20:51:40 -07:00
Lianmin Zheng 165331a200 Share BCG output buffers across capture sizes (#27659) 2026-06-09 20:33:46 -07:00
fatSheep d21c31f681 fix: forward update_mamba_state_after_mtp_verify in HybridAttnBackend (#25883) 2026-06-09 20:06:50 -07:00
huangtingwei f101b287ef [Unified Tree]fix compatibility with eagle key and l3 hicache (#27655) 2026-06-10 10:54:45 +08:00
Michaelandmichaelzhang-ai f42a093261 [AMD] Migrate 2-GPU kernel allreduce tests into the registered system (#27722)
Co-authored-by: michaelzhang-ai <michaelzhang@example.com>
2026-06-09 19:39:03 -07:00
Mandepudi Rani Chowdary 7e3e616159 Add Arm64 INT8 MoE test coverage (#25007) 2026-06-10 10:36:57 +08:00
Ke Bao 854d232a40 Fix flaky hicache l3 mmlu nightly test (#27688) 2026-06-10 10:01:14 +08:00
zijiexia 6565b7c464 [Docs] Update MegaMoE handling and rerun benchmarks (#27726) 2026-06-09 19:00:43 -07:00
6110ed671f ci(xpu): clean build artifacts in cleanup (#27648)
Co-authored-by: Patil, Jitendra <jitendra.patil@intel.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-06-10 09:46:54 +08:00
sushil Dubey 5809bbe35d Mistral3 add tensor parallel support for diffusion text encoder (#25950) 2026-06-10 09:43:21 +08:00
Mick af55025644 [diffusion] refactor: refactor realtime and model-specific stage modules (#27697) 2026-06-10 09:39:06 +08:00
bcd9c5a903 update pytorch-xpu to 2.12 (#27133)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-06-10 09:25:30 +08:00
Jianhong Zhang 77c4d53f19 [PD] Fix prefill bootstrap registration failure with --host 0.0.0.0 (#27608) 2026-06-10 09:15:26 +08:00
iridiumine 2947781ce6 [NPU] MiMo-V2-Flash Adaptation (#25455) 2026-06-10 09:13:55 +08:00
Jan Bernlöhr f3ecc3688f Fix Gemma3 ModelOpt kv-scale loading (#25794) 2026-06-09 17:53:21 -07:00
Liangsheng Yin f332e52611 Add UT guarding per-request bookkeeping clock ownership (#27710) 2026-06-09 17:11:49 -07:00
Muqi Liandzqlcode 365b7dab9a fix(schema): update tokens_after_end (#27017)
Co-authored-by: zqlcode <1309223143@qq.com>
2026-06-09 16:52:35 -07:00