Commit Graph
16030 Commits
Author SHA1 Message Date
Kan WuandClaude Fable 5 17d19081d9 [mm] sglang-mm: server vision pipeline core (fetch/driver/pipeline) + Qwen VL (#32364)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-04 00:47:00 -07:00
Vladislav NosivskoyandXinyuan Tong 154f0ac662 Fix DSpark and DP/EP (#33098)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-08-04 00:35:57 -07:00
Alex NailsandClaude Opus 5 bfa4e4a57b [Nemotron] Hoist mamba track-mask host syncs out of the per-layer prefill path (#32589)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-03 23:58:28 -07:00
weireweireandweireweire 23ea7b6481 Prewarm DSV4 MHC post kernel at model load (#30741)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-03 23:41:56 -07:00
Liangsheng Yin 157401f050 [CI] Build the Rust extensions on the 5090 pool and seed the cache from main (#33460) 2026-08-03 23:33:20 -07:00
TobyMintandMick 101bb2327c [diffusion] fix: fix local-path detection for MiniMax-H3 and other non-diffusers models (#33365)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-04 14:03:35 +08:00
Rain Jiang 4494fb96b2 refactor the tcp listener binding logic (#33420) 2026-08-03 22:10:52 -07:00
Zhaoyi LiandChen 48dcadc770 [AMD][DI][CI] 5/N Add DSV4 wide-EP16 4-node 2P1D nightly recipes (#31500)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-03 22:08:00 -07:00
Liangsheng YinandMick afc868517b [Perf] Speed up the Kimi-K2.5 vision path and match PIL bicubic in the GPU resize (#33349)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-03 21:57:49 -07:00
Liangsheng Yin 7ba393dd15 [CI] Dispatch base-a-test-cpu through its own reusable stage workflow (#33461) 2026-08-03 20:49:23 -07:00
Xiaoyu ZhangandClaude Fable 5 c6f2a9c1d4 [diffusion] Restrict request-level quality to two validated tiers: lossless (default) and high (#33453)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-04 11:43:16 +08:00
Jinchen HanandMick 614825fd38 [vla] fix: pi05 models does not apply scale factor for language embeddings (#33367)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-04 11:25:54 +08:00
Mick b058dc9106 [diffusion] fix: reject ring parallelism where it would silently miscompute (#33353) 2026-08-04 11:15:23 +08:00
Mohammad Miadh Angkad 7dd8a3d5ea [CI] Fix scheduler max new tokens test fixture (#33467) 2026-08-03 20:12:21 -07:00
EchO 1e64fc1563 [Fix] Honor FlashMLA natural-log LSE in DCP reduction (#33065) 2026-08-03 19:55:52 -07:00
Khoa Pham 91fae8a72c [DCP] Bound a request by the aggregate KV pool, not one rank's share (#33448) 2026-08-03 19:36:25 -07:00
Oguz UlgenandCheng Wan c113ead98a Bump helion version to 1.4 (#32562)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-08-03 19:10:31 -07:00
Yuwei AnandClaude Opus 5 92087ef4d2 fix(mem_cache): state the MLA KV bound in the DCP index space (#33432)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-03 19:07:49 -07:00
Baizhou Zhang eb31a53338 Revert "Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120" (#33455) 2026-08-03 19:03:56 -07:00
Liangsheng Yin cdff33d738 [CI] Build the Rust extension modules once per run instead of in every CUDA job (#33384) 2026-08-03 18:56:48 -07:00
Xingyu Liu 572924634b [mem_cache] Build empty-prefix last_loc sentinel on-device to avoid per-call H2D sync (#32575)
Signed-off-by: xingyuliu <charlotteliu12x@gmail.com>
2026-08-03 18:55:03 -07:00
Zhaoyi Li a84e70eb1e [AMD][DI][CI] 6/N Add Kimi-K2.6 MXFP4 wide-EP16 2P1D nightly recipes (#33333) 2026-08-03 18:51:55 -07:00
Zhaoyi LiandChen 03f44c978a [AMD][DI][CI] Auto-mount latest host ionic/ibverbs userspace in the MI355X nightly launcher (fix ABI mismatch) (#33374)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-03 18:14:14 -07:00
Baizhou Zhang 7f6a2e2b50 [Refactor] Clean up and split DSA indexer (#33443) 2026-08-03 18:05:01 -07:00
3960983753 Add flashinfer rmsnorm + quant fusion support SM90, SM100, SM120 (#32994)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-04 08:37:42 +08:00
Xiaoyu Zhang f829fb3ff7 [diffusion] Fix component accuracy topology reuse (#33317) 2026-08-04 08:35:03 +08:00
1307968605 [JIT] Drop redundant per-kernel arch overrides (#32952)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-04 08:33:54 +08:00
Po-Han Huang (NVIDIA) 7eb27372b3 fix(server): capture legal multi-request prefill CUDA graph batches (#30206) 2026-08-03 16:56:59 -07:00
zijiexiaandClaude Opus 4.8 b819d2fb5b [Docs] Rename docs_new/ to docs/ (#32123)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-03 16:51:00 -07:00
Liangsheng Yin c949e91f18 [CI] Remove the orphaned site-packages sglang skeleton that shadows the checkout (#33441) 2026-08-03 16:31:25 -07:00
Liangsheng Yin 22c2e2bcad [CI] Persist the cargo build cache across CUDA CI jobs (#33361) 2026-08-03 16:23:09 -07:00
Liangsheng Yin b8f6181bff [CI] Build the Rust extensions with the pinned toolchain instead of the image default (#33437) 2026-08-03 16:16:34 -07:00
Hanming Lu bc7e1a07c3 Bound prefill delayer all-branch delay and decay the max_prefill_bs high-watermark (#32880) 2026-08-03 14:43:02 -07:00
Xinyuan Tong 7cd79fda56 [CI] Skip absent inline suites when loading timeouts (#33410) 2026-08-03 14:21:25 -07:00
Xiaoyu ZhangandClaude Fable 5 4ef1660cd8 [Docs] MiniMax-H3: add measured H200 Ulysses4 vs TP2+Ulysses2 topology data (#33398)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-03 12:54:29 -07:00
cctry db0fe370b7 [PD] Fix false health-503 during decode retraction re-admission (#33118) 2026-08-03 09:44:25 -07:00
cctry 6cf661117d [PD] Add a queues.prealloc_ready counter to the load snapshot (#33133) 2026-08-03 09:44:11 -07:00
Mick 0ba46c88e5 [diffusion] CI: add minimax-h3 2-gpu consistency coverage (#33281) 2026-08-03 22:40:08 +08:00
huangtingweiandjackyYang6 3953788596 [HiSparse]Fix DeepSeek V4 HiSparse PD Transfers with Separate Host and Device KV Indices (#31901)
Co-authored-by: jackyYang6 <82102811+jackyYang6@users.noreply.github.com>
2026-08-03 20:35:04 +08:00
Mohammad Miadh Angkad d48ab2d386 Fix BCG circular import during server startup (#33371) 2026-08-03 01:53:16 -07:00
Xun Sun a2d1003b18 [Mooncake] Fix ProcessGroup API imports (#32403) 2026-08-03 01:16:41 -07:00
amd-oshkarav 92999d84f4 [AMD]Qwen3.5 integration gfx950 fmha fp8 hd256 (#32046) 2026-08-03 00:25:31 -07:00
Liangsheng Yin 45c00daa1b [misc] Deep-merge nested config overrides and parse request bodies with orjson (#33351) 2026-08-02 23:55:06 -07:00
204e0fbac0 [SM120] Only split touched SWA pages in FlashMLA page-split kernel (#32320)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
Co-authored-by: David Orman <ormandj@corenode.com>
2026-08-02 23:45:07 -07:00
Wang, FangYuanandBingxu Chen 21d930aae3 [AMD] Fix JIT compile failure in sgl_kernel/warp.cuh (#33195)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-08-02 23:35:29 -07:00
e9366d7f79 Updated b200 kimi-k3 cookbook (#33038)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-08-02 23:16:39 -07:00
Chengyu LinandRain Jiang e00f32ed4f feat: rust sglang server openai apis (#33103)
Co-authored-by: Rain Jiang <rain-jiang@outlook.com>
2026-08-02 23:13:44 -07:00
Baizhou Zhang 0bf0640b9d [CP] Support breakable CUDA graphs for zigzag strategy (#33136) 2026-08-02 23:11:57 -07:00
Lianmin Zheng 85484c457d docs: refresh README news highlights (#33347) 2026-08-02 22:37:01 -07:00
Liangsheng Yin fcc4de9e5f [CI] Size the CPU stage from the live partition model (#33329) 2026-08-02 22:26:58 -07:00