Commit Graph
14514 Commits
Author SHA1 Message Date
R0CKSTAR 38e857f423 [MUSA][diffusion] Bump torchada version to 0.1.68 (#29236)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2026-06-25 16:53:43 -07:00
Ma Mingfei 1ba7c79761 [CPU] add indices in chunk_gated_delta_rule (#29267) 2026-06-26 07:51:07 +08:00
Khoa PhamandClaude Opus 4.7 c8c6757bed test(dp-attn): drop --enable-torch-compile from TestDPAttentionDP2TP2 (#29345)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-06-25 16:41:35 -07:00
Yueming Yuan 65f31acc6c Add yueming-yuan to CI_PERMISSIONS.json (#29341) 2026-06-25 16:18:54 -07:00
Augusto Yao ea8f4e9f3f [feature] implement dcp for deepseek_v2 (#14194) 2026-06-25 15:15:04 -07:00
Liangsheng Yin e4696ed62d [test] Report token tps in fwd occupancy kit and force ignore_eos (#29332) 2026-06-25 15:08:33 -07:00
kkandwunhuang b7d3c3016d [AMD] Feat/dsv4 aiter reduce scatter decode (#29103)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-06-25 13:45:18 -07:00
Mohammad Miadh Angkad 212c30d008 [MoE Refactor] Centralize FlashInfer CUTLASS MoE runner (#28211) 2026-06-25 13:40:33 -07:00
cctry dbe9e3b706 [PD] Early-send cached-prefix KV overlapping uncached prefill forward (#29316) 2026-06-25 13:31:53 -07:00
Michael e6efe10072 [AMD] Register 5 JIT kernel unit tests for AMD nightly CI (#29197) 2026-06-25 13:12:58 -07:00
Lianmin Zheng 118d6b2e5e [Cleanup] Style and type annotation improvements extracted from #28688 (#29224) 2026-06-25 12:51:15 -07:00
Baizhou Zhang 3344b73c80 Add DeepSeek V4 Pro GB300 nightly and expand Kimi K25 nightly test (#28103) 2026-06-25 12:13:52 -07:00
weireweire f9a3720e2b Skip empty non-idle output batches (#28504) 2026-06-26 02:40:01 +08:00
Brayden ZhongandBrayden Zhong 9495737d82 Fix CI broken by #28450 (#29308)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-25 10:35:34 -07:00
Xiaoyu Zhang 4d06d4c97f Sync Gemma4 hardware table with Blackwell recipes (#29266) 2026-06-25 22:57:33 +08:00
52c32035eb [diffusion] Add Qwen-Image ModelOpt NVFP4 support (#28928)
Co-authored-by: jingyu-ml <jingyux@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-25 22:56:09 +08:00
Mick 890b38c211 [diffusion] doc: fix diffusion docs and cookbook drift (#29302) 2026-06-25 21:13:00 +08:00
YC Yen-Ching Tseng bc150173b2 [AMD] Fix stage-b-test-1-gpu-small-amd-nondeterministic timeout after VLM model swap (#29234) 2026-06-25 03:56:04 -07:00
Raiden MakotoandRaiden-Makoto 0075c8f02b [AMD] [GLM5] GLM-5.1 MXFP4 (MI355X) + enable EAGLE for gfx950 in cookbook (#29194)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-25 03:54:48 -07:00
Xiaoyu Zhang ddda4f9028 [Bugfix] Fix Ministral3 init argument forwarding (#29111) 2026-06-25 18:26:45 +08:00
Mohammad Miadh Angkad e4976683f4 [Docs] Fix broken links in cookbook (#29261) 2026-06-25 02:31:55 -07:00
Rita Brugarolas 3d3a7ec031 [AMD] fix(moe): correct fused shared-expert scaling on aiter/DeepEP path (mori all-to-all) (#28237)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
2026-06-25 01:56:30 -07:00
Michael ec12a28a87 [AMD] Register 7 JIT kernel unit tests for AMD nightly CI (#28967) 2026-06-25 01:51:30 -07:00
Michael 4ba8634780 [AMD] Register scripted-core chunked-prefill test for AMD extra-a CI (#29058) 2026-06-25 01:50:08 -07:00
Rita Brugarolas de2d01c8da [AMD] Fuse shared-expert append + DeepEP remap into one Triton kernel (#28450)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
2026-06-25 01:22:57 -07:00
Yuhao Yang 4a8200565e Fused QK GemmaRMSNorm + RoPE + gate kernel for Qwen3.5 (#28320) 2026-06-25 15:58:54 +08:00
Liangsheng Yin 2812a3c93a [Spec] Unify spec/non-spec decode result handling and overlap relay-payload gating (#29225) 2026-06-25 00:44:38 -07:00
jiayisunx 32bae911f6 Add CI permission for jiayisunx (#28899) 2026-06-25 14:49:07 +08:00
jiayisunx d717e926c1 fix(runner): prevent eager token buffer under-allocation (#28894) 2026-06-25 14:37:19 +08:00
Raiden MakotoandRaiden-Makoto 9215da2515 [AMD] [GLM5] skip redundant -inf pre-fill of HIP indexer MQA-logits (#28757)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-24 23:21:39 -07:00
AndyLi429 72cac88022 [NPU] perf: precompute mamba conv-state track indices once per batch (#29105) 2026-06-25 14:04:56 +08:00
Xiaoyu Zhang 7c9804ef21 Add MiMo V2.5 Blackwell vision FA4 recipe (#29253) 2026-06-25 13:47:32 +08:00
Yanbin JiangandYusheng Su 9fd6d0ec99 [LoRA] BF16 support + EP cuda-graph crash fix for experimental_sgl_trtllm MoE-LoRA (#28953)
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
2026-06-24 21:16:50 -07:00
wenxuewuhdandronnie_zheng a9270250c3 Dllm radix cache npu (#27144)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-25 06:44:03 +03:00
Xiaoyu Zhang efbe67d237 Tune Gemma4 26B-A4B B200 memory recipe (#29252) 2026-06-25 11:31:25 +08:00
Zhiyao JiangandXinyu Jiang d1cf09d4d4 [AMD-miles] Add a ROCm 7.0 MI35x miles nightly image (#29219)
Co-authored-by: Xinyu Jiang <xinyuj2@andrew.cmu.edu>
2026-06-25 11:27:06 +08:00
CrazyCoderandClaude Opus 4.8 c268a7edf5 [Bugfix] Fix inverted PP-disable condition for diffusion LLM inference (#27700)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-24 20:18:00 -07:00
Mohammad Miadh Angkad 8b7a1e908a Revert Gemma4 modelopt fp4 MoE backend change (#28347) 2026-06-24 19:49:09 -07:00
Mohammad Miadh Angkad 40439acd0a Sync backend docs with #29063 (#29233) 2026-06-24 19:48:34 -07:00
Liangsheng Yin 8314247d9d [Spec] Merge dflash triton kernels into a single dflash.py (#29228) 2026-06-24 18:57:15 -07:00
ae6f787637 [diffusion] rl: add sleep/wake support for diffusion engine (#22659)
Co-authored-by: klhhhhh <1412841649@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: MikukuOvO <MikukuOvO@users.noreply.github.com>
2026-06-25 09:37:27 +08:00
看海的人 67b2a9ed0c [NPU] Fix the DeepSeek-V2-Coder model accuracy issue (#29042) 2026-06-25 09:14:32 +08:00
chx96642264 4e155ecc31 [NPU] adaptation to support operator FA3 in deterministic inference on NPU. (#26724) 2026-06-25 09:12:57 +08:00
Liangsheng Yin c7734e6871 [Spec] Dissolve EagleDraftInputV2Mixin so spec-info dataclasses hold data only (#29220) 2026-06-24 18:08:30 -07:00
fzyzcjy 2b64fc7a2c Remove Req.extend_logprob_start_len field and make it pure (#27625) 2026-06-25 09:06:14 +08:00
Ma Mingfei 2c3f007a65 [CPU] optimize GDN prefill performance (#29117) 2026-06-25 09:04:34 +08:00
fzyzcjy 7002a37ea1 Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611) 2026-06-25 08:56:44 +08:00
cen121212 9305d10099 [NPU] adapt_fused_rope_qk_mqa_optimize (#28872) 2026-06-25 08:55:52 +08:00
fzyzcjy d0524d6433 Avoid scattered assignment of extend_input_len and fill_len by merging them into Req.extend_range (#27610) 2026-06-25 08:33:28 +08:00
Lianmin Zheng 6c839368e0 [Cleanup] IPC struct renames, better typing, and SenderWrapper removal (#29214) 2026-06-24 17:25:24 -07:00