Commit Graph
19442 Commits
Author SHA1 Message Date
Po-Han Huang (NVIDIA)andClaude Opus 5.5 f2f0be731c [Docs] GLM-5.2: move GB300 AgentX recipe to the agentic HiCache section and drop no-op settings (#42167)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:40:30 +08:00
MickandMick Qian 21c9bbdf2c [diffusion] fix: fix concurrent server perf dump writes across ranks (#41541)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-06 09:29:51 +08:00
Yash AkhauriandXiaoyu Zhang 36b216e2ee [Docs] Refresh K2 Horizon checkpoint revisions (#42130)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 09:19:04 +08:00
5d385007b3 [diffusion] kernels: take the Wan VAE decoder's remaining first-decode work off the request path (#41830)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:05:29 +08:00
3120bb87a2 [diffusion] fix: fix the OOM hint's placement advice and add a 24 GB Wan2.1 recipe (#41723)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 09:01:02 +08:00
Liangsheng Yin ad7a9b53cc [mem_cache] Make release_kv_cache's final checkpoint an explicit checkpoint flag (#42270) 2026-10-05 17:32:07 -07:00
Po-Han Huang (NVIDIA) 62af5f56a5 [CI] Drop the redundant and broken tc_piecewise tests (#42571) 2026-10-05 17:29:32 -07:00
Liangsheng Yin c01d59eb90 [Session] Let a streaming session own its KV record and tree lock from the first turn (#42537) 2026-10-05 17:28:09 -07:00
Liangsheng Yin f3fe753475 [misc] Rename SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW to SGLANG_OPT_RELEASE_PREFILL_SWA (#42657) 2026-10-05 17:24:15 -07:00
Sage 4409d2fd22 [ci] add renderer automatic labeler (#40923)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-10-05 17:12:51 -07:00
Yuwei An 18ec2ecce3 [Refactor][TCPCG] Relocate shared graph tensor and DSA head-gate helpers (1/9) (#42285) 2026-10-05 17:06:52 -07:00
ADiL 968726f3ce [HiCache] Route --file-storage-path to the file storage backend (#33883)
Signed-off-by: adlashab <adlashab@amd.com>
2026-10-05 15:33:49 -07:00
61ba98443d [DSA] k-pool: 256-token logical page so index page id = logical page id (#42178)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
2026-10-05 15:02:44 -07:00
c765f8818a [DFlash2] Keep the greedy selector walk in range for all-NaN score rows (#41737)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-10-05 14:29:13 -07:00
maocheng23 57826a62ea [Speculative] Add opt-in block verification (#42297) 2026-10-05 11:49:23 -07:00
70f0b7351e [sgl-router] Improved policy balanced mode (#42545)
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
2026-10-05 09:48:37 -07:00
debanshd efb62ce269 [diffusion] fix: resolve QKV layout inference for MiniMax-H3 checkpoints (#40158)
Signed-off-by: Debanshu Das <debanshu@google.com>
2026-10-05 23:01:37 +08:00
150f568900 [diffusion] kernels: stop specializing on per-request sequence lengths (#41710)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 22:21:01 +08:00
a977e3b9d5 [diffusion] optimization: stream an oversized DiT in auto mode instead of OOMing (#41721)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:58:27 +08:00
ad3e80d4de [diffusion] chore: warm the image writer and the HTTP route models at startup (#41833)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:58:00 +08:00
c83c84b422 [diffusion] chore: keep the DiT off component offload under explicit multi-GPU fsdp (#41722)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 21:56:52 +08:00
wxy 23bf107469 [diffusion] optimization: cache LTX-2 RoPE coords to avoid per-step recompute (#22441) 2026-10-05 21:21:36 +08:00
Shiwen Cheng 91f9bf8d17 [diffusion] fix: fix scheduler host not working when ipv6 in multi modal gen (#22813) 2026-10-05 21:14:09 +08:00
liukeandMick f20f8e120d [diffusion] model: restore folded H3 GGUF patch embedding (#39523)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-05 21:10:06 +08:00
MickandMick Qian 83a6e1d39b [diffusion] docs: keep model compatibility details in cookbook recipes (#42227)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 20:02:43 +08:00
Akshat Anandandcipheraxat 860ebe720e [diffusion] fix: skip warmup preferred preload when it would OOM (#40761)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
2026-10-05 19:59:35 +08:00
aiyueqiandMick 8663e3b670 [diffusion] optimization: avoid full-video clone in VAE post-processing for MiniMax-H3 (#40095)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-05 19:56:11 +08:00
d349e672bc [diffusion] feat: recycle warmup-only entries of conditioning-cache at the first served store (#41832)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 19:55:30 +08:00
7352073ec6 [diffusion] feat: support --async-output-save to overlap output saving with the next request (#37549)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 19:53:38 +08:00
WenhaoZhangandMick Qian f048d5aa4b [diffusion] feat: add community LoRA recipes and Kohya mapping (#35857)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 18:22:56 +08:00
08fa37e48d [sgl-router] Add reorg bucket config with per-group admission (#42429)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
2026-10-05 18:17:32 +08:00
Shangming CaiandClaude Opus 5.5 ab4f8a44f4 [sgl-router] Point the design doc at the shared engine ranking (#42572)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 18:16:42 +08:00
a96b146491 [sgl-router] Move pressure and prefix signals out of legacy policies (#42428)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 18:10:29 +08:00
mrusanovskyandPo-Han Huang 26a1377c50 [Spec] LiLiCorr: named head MLPs and quantized head linears (#42057)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-05 02:43:59 -07:00
WenhaoZhangandMick Qian 284cda01fb [diffusion] optimization: fuse the video VAE decoder's RMSNorm and QK RoPE for MiniMax-H3 (#41906)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 17:30:39 +08:00
0263fdacb2 [diffusion] fix: keep generic warmup valid for step-floored models and stop reporting a failed warmup as warm (#41641)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 17:23:06 +08:00
elvischenvandClaude Opus 5.5 55dcf3254f Fix XQA draft extend with FP8 KV cache in trtllm_mha (#41656)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-05 01:37:54 -07:00
Xiaoyu Zhang abd6c374c7 [Perf] Optimize MiMo local audio attention on Hopper (#42101) 2026-10-05 16:14:56 +08:00
Michael b3f967e809 Revert "Revert "[AMD][ROCm] Keep cos_sin_cache fp32 on HIP for fused QSA indexer kernel (#41282)"" (#42558) 2026-10-05 16:12:21 +08:00
Aleksi Vesantoandjacky.cheng 9f7d38ffd3 [diffusion] attention: Allow disabling sequence masking in SP (#33855)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-05 15:22:53 +08:00
Aleksi Vesantoandjacky.cheng c41b2d26e5 [diffusion][ROCm][Perf]: Set gfx942 AITER FMHA rounding mode to rtz instead of rtna (#28650)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-05 15:21:04 +08:00
MickandMick Qian dd2ffdb680 [diffusion] nightly: keep nightly regression baselines on a comparable methodology (#42226)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 15:19:21 +08:00
438d9d2074 [Feature] DeepEP v2: expanded (do_expand=True) prefill dispatch (#37261)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-10-05 00:02:10 -07:00
cafb37a10d [JIT] Fuse FP8 KV-cache quantization into the prefix-valid commit kernel (#40785)
Co-authored-by: Jayden Yu <jaydenyu@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-05 14:47:54 +08:00
WenhaoZhangandMick Qian f218798006 [diffusion] CI: relax the load latency check and extend the 2-GPU retry deadline (#42505)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-05 14:43:27 +08:00
520d6d0229 [DSv4.1] Prefill indexer: raw selection, row-pair schedule ids, no host syncs (#41659)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-05 14:33:37 +08:00
Liangsheng Yin 503b898540 [Session] Count streaming session KV by owner in pool accounting (#42539) 2026-10-04 22:15:57 -07:00
Michael 456d533e61 Revert "[AMD][ROCm] Keep cos_sin_cache fp32 on HIP for fused QSA indexer kernel (#41282)" (#42541) 2026-10-04 21:59:12 -07:00
Liangsheng Yin 1818db4e54 [CI] Drop the echoed command from /rerun-test result replies (#42543) 2026-10-04 21:50:53 -07:00
ashwini rathi b1bbd74f28 [XPU][CI] Disable test_xpu_graph until tc_piecewise is removed (#41634) (#42524) 2026-10-05 11:09:26 +08:00