Commit Graph
11986 Commits
Author SHA1 Message Date
Yihao WangandClaude Fable 5 7088f21922 [diffusion] fix: make tail_attn_meta cuda-graph capturable (#36658)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-28 12:22:07 +08:00
Kevin MiandClaude Fable 5 ad5a105a4a [Diffusion] Fix the five unit tests failing on main (#36726)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-27 21:18:32 -07:00
2380121e9b [HiCache] Stop populating host-pool mmaps twice (-13% allocation time) (#36705)
Co-authored-by: DellCurry <30748980+DellCurry@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-28 11:54:11 +08:00
karverma-amd 2b209711d8 [AMD][DSV4] perf: MXFP8 MoRI dispatch to match the w4a8 MoE input format (#36119) 2026-08-27 20:45:40 -07:00
karverma-amd aa0a0aa3c3 [AMD][DSV4] perf: bound the MoRI receive buffer during decode (#36130) 2026-08-27 20:27:52 -07:00
YAMY 6480cce9bc perf: skip redundant scheduler metadata gather for DP1 (#36568) 2026-08-27 20:04:54 -07:00
Liangsheng Yin daf6317196 [mem_cache] Add free_full to release the full side of a tombstoned SWA node (#36637) 2026-08-27 19:34:48 -07:00
Kurt Shuster b7686e17d6 [k3] declare packed_modules_mapping on KimiK3ForConditionalGeneration (#36211) 2026-08-28 10:22:36 +08:00
Aurick Qiao 84a6f51bd6 Fix DeepSeek V4 multistream QKV buffer lifetime (#36547) 2026-08-28 10:10:36 +08:00
cbd0271574 [diffusion] model: add cosmos3 transfer capability (#34747)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Kedi Wu <31940276+kediwu0331@users.noreply.github.com>
2026-08-28 09:37:22 +08:00
billishyahao de2fb50120 [AMD] Enable aiter mla asm path through padding attn heads for Kimi K3 (#36356) 2026-08-27 18:30:29 -07:00
Xiaoyu Zhang 96b31770f9 [diffusion] fuse Helios paired transposed RoPE (#36502) 2026-08-28 08:57:37 +08:00
Aurick QiaoandYuwei An 26fd7fdaa2 [Feature] Support PP in full prefill CUDA graphs (#35451)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
2026-08-27 17:32:00 -07:00
ashwini rathi 7cbe564829 [Fix][XPU/ROCm/NPU] Defer sgl_kernel.quantization import in expert_pack (#36529) 2026-08-27 16:17:24 -07:00
Baizhou Zhang 76217f6603 Revert "[NPU] [bugfix] Fix import of ggml_moe_a8_vec and Fix NPU MLA HiCache backup accessing missing data_ptrs" (#36747) 2026-08-27 16:16:30 -07:00
chx96642264andsglang-npu-bot 5640e53cab [NPU] [bugfix] Fix import of ggml_moe_a8_vec and Fix NPU MLA HiCache backup accessing missing data_ptrs (#36640)
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-08-27 16:14:48 -07:00
Liangsheng Yin 5d52f02f22 [misc] Fold the allocator free-group flag into free_group (#36739) 2026-08-27 16:12:47 -07:00
Vedant V JhaveriandCopilot dc10483592 [Kernel] Add H200 MoE configs for Qwen3.5 and Qwen3.6 (#35374)
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-08-27 16:01:22 -07:00
skyandClaude 0132848349 Revert "[Fix] Disable --enable-symm-mem under CUDA graphs on Kimi hybrid models" (#34842)
Signed-off-by: wangfakang <fakangwang@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-27 14:19:27 -07:00
Yuwei AnandClaude Fable 5 ff5578eb4e [1/N][Mix] Mixed Chunk Prefill Base (#36288)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-27 12:59:56 -07:00
Cheng WanandClaude Opus 5 6ff2a20ccf config: the record is not an object that gets passed around (#36622)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:57:10 -07:00
Cheng WanandClaude Opus 5 fd40a331bf config: a parallel size has one spelling; a patched scope declares its own (#36621)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:56:42 -07:00
Cheng WanandClaude Opus 5 ca1d7ed8e6 config: a parallel leaf with no live counterpart is read bare (#36620)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:56:11 -07:00
Cheng WanandClaude Opus 5 7c3b5a6732 config: every handler declares its cuda-graph decisions (#36725)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:55:34 -07:00
Cheng WanandClaude Opus 5 bd4bb1781a config: resolution declares, and nothing writes a field (#36618)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 12:53:17 -07:00
Lianmin Zheng a0a2295271 Refactor server_args constants and layout (#36676) 2026-08-27 12:16:16 -07:00
Mickandjohn.xh 20a491d1d3 [Fix] Re-encode multimodal embeddings after cache mismatch (#36595)
Co-authored-by: john.xh <dengxuhuijohn@gmail.com>
2026-08-27 23:24:30 +08:00
Xiaoyu Zhang 024a7a1031 [diffusion] Fix native LingBot-Video text encoding (#36542) 2026-08-27 22:58:22 +08:00
inkcherry 8ad76415e2 [PD][mori] Align prefill transfer control plane for unified control plane (#36160) 2026-08-27 21:43:13 +08:00
Xiaoyu Zhang a7e3f590ca [Diffusion] Fuse LongCat residual gate updates (#36577) 2026-08-27 21:07:04 +08:00
Xiaoyu Zhang e061dd1b47 [Diffusion][Kernel] Fuse Wan FFN GELU epilogue (#36592) 2026-08-27 21:06:28 +08:00
Xiaoyu Zhang 1af95ffded [diffusion] Fuse Cosmos3 Nano T2I attention on Hopper (#36571) 2026-08-27 20:59:15 +08:00
Xiaoyu Zhang db4125bb56 [diffusion] Accept mesh benchmark artifacts (#36553) 2026-08-27 20:53:25 +08:00
Xiaoyu Zhang d42fa5e10a [diffusion] align video BCG warmup frame count (#36485) 2026-08-27 20:52:00 +08:00
xdtbynd b647ae82f5 [NPU][Bugfix] Fix OOB gather in decode KV allocation when free pool is tight (#35727) 2026-08-27 19:44:45 +08:00
97ba99067d Publish per-scheduler load on a dedicated socket for load-aware routers (#34608)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-08-27 19:33:18 +08:00
Lianmin Zheng 94183a8d2b Move server args config parser under utils (#36681) 2026-08-27 03:34:50 -07:00
Xiaoyu Zhang ad911a5ec0 [kernel] Tune LingBot-Video MoE TMA configs for H100 (#36543) 2026-08-27 02:47:32 -07:00
Schwinn Saereesitthipitak 08315c56df [Fix] Account resident weight memory in KV sizing (#34053)
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
2026-08-27 02:43:04 -07:00
Xia Weiwen 56fdfc3b26 XPU: remove SGLANG_USE_SGL_XPU flag (#34492) 2026-08-27 02:38:02 -07:00
Khoa Pham 78d36f5f62 fix: kill_process_tree waits for the reap by default (#36589) 2026-08-27 02:34:05 -07:00
AMD-yanfeiwang 2ded8a6aea [AMD] Enable moe_a2a_backend=mori for DeepSeek-V4 prefill context parallelism (#35611) 2026-08-27 02:31:41 -07:00
Lianmin Zheng 3402265989 [Core] Refactor server argument choices (#36586) 2026-08-27 01:56:03 -07:00
MickandClaude Opus 5 c2c3320cf0 [VLM] feat: size the multimodal preprocessing pool by where preprocessing runs (#35349)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 16:32:58 +08:00
b8a6adadfe [Bug][Spec] fix startup crash and reduce CUDA graph memory usage for speculative adaptive (#35275)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-27 00:46:13 -07:00
jacky.cheng c967cd19b5 [AMD] Optimize Qwen3.5 MTP unified attention on gfx950 (#36330) 2026-08-27 00:13:49 -07:00
72bf8c4d53 [ci] xpu: trigger pr-test-xpu on multimodal_gen changes (#36100)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-08-27 14:50:26 +08:00
Xun Sun adcf73d7f7 [Weight Cache] Enhance test and support EPLB (#36198) 2026-08-26 23:11:53 -07:00
weireweireandweireweire ea48cb04cc Pin scheduler metadata before asynchronous H2D copies (#35944)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-26 22:21:47 -07:00
jacky.cheng f775db03aa [AMD] Fix int32 seqused_k overflow in aiter draft-extend attention (#36541) 2026-08-26 22:06:39 -07:00