Commit Graph
20367 Commits
Author SHA1 Message Date
Yuwei An 06934575b9 [Fix] DSv4.1: Fix BCG image handling and add multimodal bounded replay coverage (#44131) 2026-10-15 22:32:55 -07:00
2a08e261ec [Feat] MiniCPM-V-4.7: add model support (#41993)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-10-16 13:24:48 +08:00
a2981ab8ea [Feat] sgl-router: Serve native gRPC ChatComplete (#42674)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 13:11:36 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 fd4b75c696 [Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 12:45:07 +08:00
Kolade FajimiandXiaoyu Zhang 5117bfbaeb [Fix] compressed-tensors: Serve NVFP4 W4A4 linears via FP4 Marlin when --fp4-gemm-backend marlin is set on SM100 (#44213)
Signed-off-by: kolade fajimi <fajimikolade23@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-16 12:36:02 +08:00
HuangJi 6d70787398 [Fix] diffusion: Align Qwen-Image 2.1 resolution and handle RGBA JPEG output (#44275) 2026-10-16 12:35:04 +08:00
MickandMick Qian e5274752a8 [Doc] diffusion: align PR title conventions (#44646)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-16 11:29:20 +08:00
Mick 3420baea8c [diffusion] CI: batch performance failure-policy runner scenarios (#44508) 2026-10-16 11:04:05 +08:00
Mohammad Miadh AngkadandMohammad Angkad 6231a617d3 [Test] diffusion: Load NVFP4 block scales through the weight loader in tests (#44595)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-16 10:56:27 +08:00
ashwini rathiandClaude Opus 5.5 75e25a21bd [Fix] [XPU] nightly: Fix rerank, zimage, flux2 and EAGLE parity (#44100)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 10:27:51 +08:00
Chetan Kumar VermaandClaude Sonnet 5 75e77fca25 [Fix] wan: fix opt-in Wan2.2 progressive mode and one-step transitions (#43768)
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
2026-10-16 10:22:09 +08:00
Shuwen Wang f9df33494a [Fix] scheduler: Keep PD decode non-idle while deferred KV releases are held (#44386) 2026-10-15 19:17:51 -07:00
Chetan Kumar VermaandClaude Opus 5.5 1e33d2c4bd [Perf] [XPU] usp: Enable packed Ulysses QKV all-to-all (#39989)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-16 10:08:50 +08:00
4e85e8ed37 [Fix] imports: Bind FlashInfer lazily at four import sites so the server starts without it (#44430)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: yeqcharlotte <yeqcharlotte@users.noreply.github.com>
2026-10-15 18:52:33 -07:00
shodocoandmetamergebot 2957ff3165 [Fix] sglang-server: Keep the matched stop token in output_ids (#42637)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
2026-10-15 18:51:47 -07:00
sglang-botandsglang-bot c15edf314d [Doc] blogs: Sync LMSYS SGLang blog cards (#44616)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-10-16 00:52:14 +00:00
e3961eb6fa [Fix] utils: Allowlist torch.bcomplex32 in SafeUnpickler (#44440)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: zx3xyy <zx3xyy@users.noreply.github.com>
2026-10-15 17:50:43 -07:00
f110b2f801 [Feat] rust-server: Report cached_tokens and reasoning_tokens in meta_info (#44531)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-15 17:50:27 -07:00
d393298736 [Fix] tokenizer_manager: re-report only emitted customized_info keys on cumulative streams (#44537)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-15 17:49:49 -07:00
metamergebotandYe Qi bda6ef7e01 [Perf] [NVIDIA] scheduler: Pageable host staging and inline hidden-state/DSpark readback under Confidential Computing (#44568)
Co-authored-by: Ye (Charlotte) Qi <7269575+yeqcharlotte@users.noreply.github.com>
2026-10-15 17:48:50 -07:00
ed8c3139f1 [Fix] deepseek-v4.1: Keep the full SWA window for short bounded-replay extends (#41303)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-10-15 17:32:50 -07:00
Khoa Pham a93f16f0cf [Perf] deepseek-v4.1: Integrate FlashMLA MegaAttention with NVFP4 KV (#43922) 2026-10-15 17:21:43 -07:00
Liangsheng Yin d14fa5db9b [Perf] pd: Copy prebuilt decode batch inputs to the GPU without host syncs (#44598) 2026-10-15 17:20:02 -07:00
Khoa Pham 4cca7fcd3e chore: bump sgl-kernel version to 0.4.10 (#44590) 2026-10-15 15:50:51 -07:00
ec7ab9d0c2 [Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-15 15:50:25 -07:00
0b1a73599a [Feat] rust-server: Apply the x-override-* request headers (#44312)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-15 15:50:04 -07:00
William Hu 4e0609ea27 [Fix] moe: Preserve negative routing sentinel in EP mapping (#40498) 2026-10-15 15:05:08 -07:00
Yuwei An 91f6ef2322 [DSv4.1] Fuse request-window KV copies (#44555) 2026-10-15 14:11:51 -07:00
Xinyuan Tong 877be2974a [CI] pr-test: Let stage wait jobs reach their max-wait budget (#44410) 2026-10-15 13:34:49 -07:00
snadampal aa5c7e887c [Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
2026-10-15 13:19:22 -07:00
Ziyi XuandClaude Opus 5.5 bc76a6b819 [DSv4] Sparse prefill: build compressed lengths without a host sync (#44557)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 12:45:56 -07:00
87211088c9 perf: fix overlap scheduling for NVIDIA Confidential Computing(CC) on Blackwell (#36810)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-15 12:09:09 -07:00
02a43eeef6 [Feat] rust-server: Attach configured metadata headers to a healthy /health_generate (#44315)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
2026-10-15 12:04:23 -07:00
173e0f2e9b [Feat] hicache: Add opt-in tail-only SWA backups in buffer mode (#44173)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
2026-10-15 12:02:59 -07:00
Michael bba535ebb4 [Fix] [AMD] docker: Repair the AITER build step after the 2bb549102 pin bump (#44534) 2026-10-15 11:18:41 -07:00
c5a5bf0d0b [Fix] pp: Order output send/recv by rank parity to fix cross-node hang (#44453)
Co-authored-by: chuixue <chuixue@minimaxi.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-16 01:46:37 +08:00
Shangming Cai c7fb57d990 [Fix] sgl-router: Bump rustls to 0.23.46 for RUSTSEC-2026-0346..0349 (#44509) 2026-10-16 01:28:57 +08:00
a8aaf95b58 [Cookbook] Add cookbook for muse spark open (#44527)
Co-authored-by: thomawan <thomawan@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: zijie <zijie.chen@amd.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-10-15 10:20:38 -07:00
Aleksi Vesantoandjacky.cheng 5ef8319f16 [Perf] [AMD] attention: Enable diffusion BF16 attention and MXFP4 compilation (#27702)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-16 00:40:41 +08:00
Yihao WangandClaude Opus 5.5 5b12ec163c [Doc] cookbook: Expand the FLUX.3 Image Klein model description (#44515)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 08:56:54 -07:00
Jimmy ShongandJimmy Shong 05cbe241be [Doc] cookbook: Add Nemotron 3.5 Super VL (#44510)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
2026-10-15 08:39:14 -07:00
28b98e5d13 [Doc] cookbook: Add the FLUX.3 prompt upsampler section (#44512)
Co-authored-by: Sandro Cavallari <scavallari@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 08:38:33 -07:00
YC Yen-Ching Tseng e87e32b311 [Feat] [AMD] docker: Release ROCm 10.1 for gfx1250 in parallel with ROCm 10.0 (#42699) 2026-10-15 22:59:54 +08:00
a57707377f [Fix] sgl-router: Send disagg_prefill_dp_rank to decode under --dp-aware (#44072)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-15 22:42:33 +08:00
qiaonan02 c4870d98cf [Fix] glm5_next: Correct num_experts_per_tok default to 8 (#44093) 2026-10-15 21:53:31 +08:00
09b7383624 [diffusion] model: support FLUX.3 image (#44418)
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-15 21:50:59 +08:00
elvischenvandClaude Opus 5.5 6fe5596ebb Support EPLB for Nemotron-H (#43685)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 13:50:09 +00:00
ormandjandBenjamin Oldenburg c5bf3aafbc Fix overflow in legacy and v1 DSA top-k selectors (#37625)
Co-authored-by: Benjamin Oldenburg <benjamin.oldenburg@ordis.co.th>
2026-10-15 21:44:58 +08:00
jiaqiang-dot-liuandCursor 2f5407da28 [Fix] [AMD] qwen3: Fix KV cache write in the fused QK-norm + mRoPE decode path (#44266)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-15 21:22:46 +08:00
sogalin_codegen 2092160d42 [AMD][Diffusion] Route unquantized linears through aiter tgemm on gfx1250 (#41988) 2026-10-15 21:08:44 +08:00