Commit Graph
9247 Commits
Author SHA1 Message Date
YAMYandYuwei An ca66e6fb5e [BCG] Support breakable CUDA graph for DeepSeek V4 DP attention (#25195)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
2026-06-08 13:54:58 -07:00
Mohammad Miadh Angkad dc24a26821 Fix GPT-OSS MXFP4 hidden size reshape on SM10X (#27528)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-08 13:26:54 -07:00
Liangsheng Yin 28c1a3cb45 [Spec] Deprecate Spec V1 (#25464) 2026-06-08 13:10:27 -07:00
ea1d190ed0 [ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode (#27289)
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-06-08 11:49:34 -07:00
Lianmin Zheng fca4ef9d69 Fix SWA pool resolution for EAGLE draft workers (#27491) 2026-06-08 11:00:29 -07:00
Lianmin Zheng bcb5645629 Fix TRTLLM target verify query metadata (#27495) 2026-06-08 10:58:48 -07:00
32bedbf88e [diffusion] model: support SANA-WM with streaming support (#27531)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: sjmshsh <88866917+sjmshsh@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-09 01:10:14 +08:00
MARATRIX 61e4132bc2 [MUSA] bump torchada version to 0.1.59 and workaround PCG limitation. (#27537)
Signed-off-by: yafeng.li <yafeng.li@mthreads.com>
2026-06-08 08:45:39 -07:00
Stella-17andxinyue.fan 12de907bc2 [MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test (#27242)
Co-authored-by: xinyue.fan <xinyue.fan@mthreads.com>
2026-06-08 08:45:16 -07:00
Leon Gao eb646c7b78 [srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363) 2026-06-08 23:41:54 +08:00
40030d8af8 [NPU] Add GitHub test summary and deduplicate test code. Part 2 (#24689)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-08 18:08:45 +03:00
Vladislav Nosivskoy 62c505a196 [HiCache][Dsv4] Don't cache C128 State pool in L3 (#27293) 2026-06-08 21:23:26 +08:00
Brian Chao b0cd533a96 [diffusion] feat: progressive resolution growing for image and video models (#27524) 2026-06-08 20:44:07 +08:00
Zhangheng 1ff7c627cd [UnifiedTree]: Support hicache metrics (#27554) 2026-06-08 20:18:02 +08:00
Shangming Cai 6394a8b381 [EPD] Dynamic encoder registration cleanup (#27542) 2026-06-08 19:08:29 +08:00
Yaochen Hanandronnie_zheng 1f5dc2cdca [GPTQ] Refactor CPU quantization schemes (#26786)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-08 13:14:40 +03:00
YC Yen-Ching Tseng a26587dd4e [AMD][diffusion] Add FlyDSL fused normalization kernels for ROCm diffusion models optimization (#22786) 2026-06-08 02:42:39 -07:00
Liangsheng Yin 57ea09badb Fix NaN in triton EAGLE spec-v2 draft-extend CUDA graph at topk>1 (wrong qo_indptr stride) (#27545) 2026-06-08 02:28:48 -07:00
Shangming Cai 8ff0c9fef9 [PD] Downgrade propagated rank failure logs from error to debug (#27534)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-06-08 16:56:46 +08:00
Ke Bao d03182cd2d Fix TP deadlock in unified radix cache writing_check / loading_check (#27489) 2026-06-08 16:08:47 +08:00
siyu 13dda3b8de [EPD] Support dynamic encoder register (#22253) 2026-06-08 16:05:16 +08:00
Niko Ma 18d728967a [PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922) 2026-06-08 00:49:25 -07:00
Jan BernlöhrandClaude Opus 4.6 0d0254c9de Fix port overflow in DP attention path when base port is near 65535 (#20260)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-06-08 00:39:29 -07:00
fzyzcjy 71a0b10462 Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate (#26938) 2026-06-08 14:55:41 +08:00
fzyzcjy f746e4a608 Fix fill_len asymmetric assignment statement in ignore-eos branch (#26999) 2026-06-08 14:53:21 +08:00
fzyzcjy 9034c2f9ae Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659) 2026-06-08 14:52:48 +08:00
fzyzcjy 259a2da3e0 Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637) 2026-06-08 14:52:18 +08:00
fzyzcjy 4201de11de Extract release_req and retract_all as module-level free functions (#26548) 2026-06-08 14:51:45 +08:00
fzyzcjy 3197808283 Avoid calling filter_batch with chunked_req_to_exclude being things unrelated to chunked reqs (#26547) 2026-06-08 14:51:21 +08:00
fzyzcjy f5fdf9c5d8 Speed up dump comparator percentile computation using numpy (#26874) 2026-06-08 14:50:31 +08:00
fzyzcjy 995e649190 Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850) 2026-06-08 14:49:22 +08:00
Han Yu 3d2165a286 Fix dual-chunk sparse fallback index overflow (#27361) 2026-06-07 23:15:37 -07:00
Liangsheng Yin 6365d6faee [spec] Misc defensive guards for EAGLE draft KV indexing (#27486) 2026-06-07 21:27:46 -07:00
Xiaoyu Zhangandxiaoyu.zhang 6c2770149b [diffusion] Fix native text-encoder loading for T5/UMT5 encoder-decoder models (#27432)
Co-authored-by: xiaoyu.zhang <xiaoyu.zhang@radixark.net>
2026-06-08 12:23:16 +08:00
Xiaoyu Zhang 5bf7dd8e4a Update SGLang diffusion skills (#27496) 2026-06-08 12:22:45 +08:00
David Wang bf7fb6b925 fix dflash rope config parsing for updated transformers (#27477) 2026-06-07 20:52:07 -07:00
kkandwunhuang 1c73ff8ad3 [AMD] Optimize gpt-oss-120B performance (#27063)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-06-07 20:06:30 -07:00
Cao E 2d1856bf45 Support encoder_decoder on cpu_graph_runner (#10950) 2026-06-08 10:30:11 +08:00
Liangsheng Yin 303757ccd8 [Attn] Fix aiter MLA verify kv_indices under-alloc + shared assert_buffer_fits guard (#27485) 2026-06-07 17:06:25 -07:00
Liangsheng Yin f68c79675f Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463) 2026-06-07 17:04:09 -07:00
Liangsheng Yin 70db73afce [Spec] Clamp multimodal pad sentinels in spec-v2 draft prefill embedding (#27512) 2026-06-07 17:00:49 -07:00
Hubert Lu 10d33bd77e [AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299) 2026-06-07 16:28:20 -07:00
Mick 02be2e7189 [diffusion] support tp for ideogram4 (#27393) 2026-06-07 23:14:58 +08:00
Lianmin Zheng a07d813ec8 Revert "Fix TRTLLM target verify query metadata (#27473)" (#27494) 2026-06-07 02:48:52 -07:00
Lianmin ZhengandMing Yang db58e76c33 Add all_to_all_single to GroupCoordinator (#27492)
Co-authored-by: Ming Yang <minos.future@gmail.com>
2026-06-07 02:48:47 -07:00
Lianmin Zheng 5be0b0c8c0 Fix TRTLLM target verify query metadata (#27473) 2026-06-07 02:46:01 -07:00
fzyzcjy 0a190d1c97 Fix PP is_fully_idle missing in-flight microbatches (#27446) 2026-06-07 17:38:26 +08:00
fzyzcjy 14b8f98a21 Complete server warmup before scripted runtime scripts start (#27445) 2026-06-07 17:37:37 +08:00
Liangsheng Yin eab2e02fa0 [spec] Dedup draft kv_indices sizing into spec_utils helpers (#27475) 2026-06-07 00:42:29 -07:00
Liangsheng Yin 5e2e0d5b49 [spec] Make spec_utils module-importable: type-only imports under TYPE_CHECKING (#27484) 2026-06-07 00:01:32 -07:00