Commit Graph
15905 Commits
Author SHA1 Message Date
Rain JiangandAlex Nails 9dcaf6bfdf rust server build release artifacts (#33096)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-31 12:36:25 -07:00
Xinyuan Tongandzijiexia 94743f934c [Docs] Add DeepSeek-V4 Flash Official (0731) recipe (#33083)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-07-31 19:14:53 +00:00
Po-Han Huang (NVIDIA) 5df193b4ac [Speculative Decoding] Fix GPT-OSS EAGLE3 hidden states (#32334) 2026-07-31 11:58:49 -07:00
Rain Jiang 4af8ddb576 support rust sglang server (#29799) 2026-07-31 11:56:31 -07:00
Cheng Wan 77c77a3da8 feat(inkling): migrate short convs onto the ShortConv attention backend (#33023) 2026-07-31 11:52:12 -07:00
Cheng Wan d3222bcc3a [unified-memory] Support fa3, the default MLA backend on pre-Blackwell hosts (#33046) 2026-07-31 11:46:46 -07:00
luchangli 26486a957d Fix --hicache-size allocating ~2x host memory on hybrid Mamba (#32915) 2026-08-01 02:37:57 +08:00
Nan Jiang 89f4a80c1f Support fastsafetensors no-GDS loading and page-cache release (#31859) 2026-07-31 23:12:32 +08:00
Danila ShtanandDanila Shtan 5f9b0db18c Fix async loading of RunAI-streamed tensors (#32896)
Co-authored-by: Danila Shtan <dan@nebius.com>
2026-07-31 21:46:33 +08:00
luoroger37andXinyuan Tong 690de097c4 [fix]reject media input for text-only models (#32914)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-07-31 12:43:25 +00:00
Peng Wu e3d4f48e55 [Fix] missing max_context_len on HybridAttnBackend (#32690) 2026-07-31 19:43:09 +08:00
MickandClaude Fable 5 754b692afc [diffusion] optimization: support cuda-ipc zero-staging all-to-all for 2-rank Ulysses (#31854)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-31 19:35:48 +08:00
Baizhou Zhang fd28242b68 [CI] Pin NCCL ports for GB300 PR tests (#33044) 2026-07-31 02:28:37 -07:00
Khoa PhamandYangmin Li 2573190b93 feat: support Kimi Linear PD disaggregation with DCP (#32837)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
2026-07-31 02:14:09 -07:00
Cheng Wan 33c27d8e7f [unified-memory] Let Kimi-Linear use the paged MLA attention backends (#32972) 2026-07-31 01:32:08 -07:00
Ziang Li 937c77cf50 [Fix] Clear stale FlashInfer BF16 MoE index cache (#33016) 2026-07-31 00:35:15 -07:00
Kangrui Du 585a7d05e3 [Diffusion] Return scheduler sigmas snapshot in rollout dit_trajectory (#32683) 2026-07-31 00:29:07 -07:00
amote-i 0d6bef6b6d [NPU] [DOC] renew triton-ascend installation guide location (#32986) 2026-07-31 14:46:04 +08:00
Brayden Zhong f94d2c5663 [Fix] Restore online MXFP8 quantization for linear layers (#32953) 2026-07-31 06:42:06 +00:00
Liangsheng YinandKaixi Matteo Chen 5c6635d8f3 [Spec] Compact the target-verify mask when nothing reads it (#32920)
Co-authored-by: Kaixi Matteo Chen <kaiximatteoc@nvidia.com>
2026-07-30 23:13:21 -07:00
Shijin ZhangandXinyuan Tong 09193bf36f [Fix]: render tool_reference schema regardless of tool_result part order (#32522)
Signed-off-by: Shijin Zhang <75300765+Dovis01@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-07-31 13:57:52 +08:00
Cheng Wan e23ccb15f0 [unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971) 2026-07-30 22:10:34 -07:00
Cheng Wan 06ccaef24a Fix silently wrong EPLB output with --moe-a2a-backend none (rank-invariant dispatch) (#32962) 2026-07-30 22:10:04 -07:00
Qiaolin Yu f3fd869494 [gdn] support replayssm with extra buffer (#32692) 2026-07-30 21:34:37 -07:00
DAI0818andXiaoyu Zhang afeaeccfa2 perf(hisparse): eliminate redundant swap output fill (#32483)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-07-31 12:09:44 +08:00
zky 425349b799 [Perf][DSA] Pass topk_length to flash_mla_sparse_fwd in the sparse attention path (#31128) 2026-07-30 20:25:59 -07:00
Ziang LiandParth Chadha 0aefba7283 fix(dsa): correct packed FlashInfer top-k and backend selection semantics (#32490)
Co-authored-by: Parth Chadha <parth@humansand.ai>
2026-07-30 20:20:16 -07:00
amote-i c039e1a7ee [NPU][DOC] Restructure ascend-npus docs into layered navigation (#32857) 2026-07-31 09:49:46 +08:00
DarkSharpnessandClaude Fable 5 3abbc565e4 [Docs] Add a Conventions section to the add-jit-kernel skill (#32956)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-31 09:11:49 +08:00
Mick a149717308 feat: log multimodal encoder DP tradeoffs (#30903) 2026-07-31 08:50:20 +08:00
weireweireandweireweire 55c1963df4 Remove unused draft-extend CUDA graph top-k (#31430)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-07-30 17:45:01 -07:00
Xinyuan Tong 68d442945f Flush dropped reasoning at stream end when stream_reasoning=False (#32225) 2026-07-31 08:25:54 +08:00
YAMY 48dbc24cbf [Qwen3.5][MTP] Support FlashInfer CuTe DSL for online NVFP4 draft MoE (#31382) 2026-07-30 17:19:48 -07:00
Trang DoandCheng Wan a1c30701aa Integrate pplx a2a backend (#30756)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-07-30 15:33:19 -07:00
Mohammad Miadh Angkad 3a53c26c27 [CI] Fix MoE compile and DSA indexer regressions (#32937) 2026-07-30 15:21:51 -07:00
sglang-botandsglang-bot 85f9998524 docs: sync LMSYS SGLang blog cards (#32838)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-07-30 21:56:22 +00:00
Trevor Morris a6221d776f feat: Support nvidia/MiniMax-M3-NVFP4 (#31989) 2026-07-30 14:32:03 -07:00
Henning Thieß c4af6cf263 Qwen3.5-MoE: support modelopt_fp4 checkpoints that quantize attention (+ load baked FP8 KV scales) (#31220) 2026-07-30 14:30:26 -07:00
saatwiknagpal 5339450ed4 Support SGLANG_SIMULATE_ACC_LEN for DFLASH (#32595) 2026-07-30 14:10:06 -07:00
Rain Jiang 3312645a30 wire the rust server modules into lib, runtime, and tokenizer manager (#32877) 2026-07-30 12:46:19 -07:00
Rain Jiang 047635ee35 add the rust server native api handlers and runtime threads (#32876) 2026-07-30 12:46:19 -07:00
Rain Jiang 30643f88bc add the rust server api frame codec and http server entry (#32875) 2026-07-30 12:46:19 -07:00
Rain Jiang 4facc0e18a add the rust server ingress tests, guard, and submit modules (#32874) 2026-07-30 12:46:18 -07:00
Rain Jiang e2c65af229 add the rust server ingress request validation and api server common types (#32873) 2026-07-30 12:46:17 -07:00
Rain Jiang 922d6e5542 add the rust server tokenizer, detokenizer, and egress modules (#32872) 2026-07-30 12:46:17 -07:00
Rain Jiang 35f2e6ab58 update Cargo.lock for the rust sglang-server dependencies (#32871) 2026-07-30 12:32:27 -07:00
04edadb34d Add Inkling-Small cookbook (#32951)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
2026-07-31 01:59:11 +08:00
Broduker b61cb5f9de Fix DeepSeek V4 loading with RunAI Model Streamer. (#30240) 2026-07-30 23:03:34 +08:00
Xiaoyu Zhang c5bd3d7dce [diffusion][benchmark] Add reproducible request-manifest offline benchmark (#32917) 2026-07-30 22:11:18 +08:00
Xiaoyu Zhang 7784ac8f91 [diffusion][docs] Fix Cosmos3 model sizes (#32916) 2026-07-30 22:10:23 +08:00