Commit Graph
1991 Commits
Author SHA1 Message Date
Shuwen Wang 15e8e687db [Chore] environ: Remove retired unified radix tree environment variable (#45090) 2026-10-20 07:02:43 +00:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 9e23107772 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 14:48:48 +08:00
lpdinkandZhangheng 4a651146de [Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-20 14:09:13 +08:00
Duyi-Wang 50fa3727eb [Doc] [AMD] cookbook: Fix DeepSeek-V4 PD image and c1 capacity (#45297) 2026-10-19 22:45:50 -07:00
Qiaolin Yuandzijiexia 28448a86d4 [Doc] cookbook: Default Qwen3.8-Flash-Next datacenter recipes to FP8 KV cache and QSA indexer (#45245)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-19 15:57:22 -07:00
Mingyi 9a949403f1 [Doc] tpu: Introduce SGLang-TorchTPU in README and TPU guide (#45246) 2026-10-19 15:34:47 -07:00
YAMY 722669e606 [Feat] [NVIDIA] megakernels: Add --enable-nvidia-megakernel and a layer for NVIDIA megakernel plugins (#44945) 2026-10-19 11:54:44 -07:00
AMD-yanfeiwang 678913a0f0 [Feat] sgl-model-gateway: Add --decode-dispatch-limit to pick PD decode workers near KV arrival (#44689) 2026-10-20 02:16:21 +08:00
Jan SchalkampandXiaoyu Zhang 8e7601ae4a [Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-19 23:10:04 +08:00
Thomas Wang 5d9c956f8e [Doc] [AMD] dsv4: Update amd cookbook 1016 (#45070) 2026-10-19 16:11:11 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 af9bb2a32d [Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 15:24:08 +08:00
97857f9f96 [Doc] cookbook: GB300 full-set accuracy and tool follow-up output for Ling-3.1-flash (#44307)
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-18 23:29:09 -07:00
Liangsheng Yin 82c9a8b037 [Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075) 2026-10-18 21:16:45 -07:00
Ankur SinghandClaude Opus 5.5 7b1710324c [Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.8-Flash-Next H200 (v0.5.22, TP2 points) (#45039)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

Force merge to unblock SA AgentX submission
2026-10-19 10:31:51 +08:00
Kotthagattu Meher Sai 7f96dc6874 [Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345) 2026-10-19 10:19:52 +08:00
Jimmy Shong 0dc6de2e74 [Doc] nemotron-3.5-super: update H200 and Spark wizard recipes (#44587) 2026-10-18 18:22:05 -07:00
Xiaoyu ZhangandClaude Opus 5.5 329072d99a [Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 08:55:47 +08:00
Liangsheng Yin 6708426728 [Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043) 2026-10-18 16:41:21 -07:00
Liangsheng Yin 0f4aedfecc [Perf] deepseek-v4.1: Default decoder SWA bounded replay on for both PD roles on CUDA (#45035) 2026-10-18 11:53:35 -07:00
5a930cfd88 [Fix] glm4v: Clamp request video budgets to the deployment limit (#43871)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 17:31:33 +08:00
+14 d33dd0566a [Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-10-18 01:00:24 -07:00
Bowen Wang 3671503e44 [Feat] bench: report goodput and SLO attainment in bench_serving (#43967) 2026-10-18 13:31:48 +08:00
Thomas Wang e5dc10e73b [Doc] [AMD] dsv41: Update amd cookbook 1016 (#44903) 2026-10-17 22:10:42 -07:00
Baizhou Zhang a8b939da43 Revert "[Doc] cookbook: Add Muse Spark Open SWA ratio calculator" (#44947) 2026-10-17 20:55:00 -07:00
531b426281 [Feat] diffusion/model: support Cosmos Dreams and Cosmos Multiview (#39475) (#39475)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-18 11:15:57 +08:00
zijiexia 3b0a154e60 [Doc] cookbook: Add DeepSeek V4.1 Flash 1017 variant (#44937) 2026-10-17 20:04:41 -07:00
zijiexiaandClaude Sonnet 5.5 df24bca4ba [Doc] popular-models: Replace Kimi-K3 with Muse Spark Open (#44693)
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
2026-10-17 19:54:45 -07:00
+3 d4191a4624 [Fix] diffusion: stabilize FLUX.3 serving and reuse static conditioning (#44493)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Fabio Camaiora <fcamaiora@nvidia.com>
Co-authored-by: Linda-Stadter <lstadter@nvidia.com>
2026-10-17 20:46:13 +08:00
9771e5a4f0 [Feat] diffusion: Per-task prompt enhancer config and the FLUX.3 Klein upsampler protocol (#44662)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-17 20:45:07 +08:00
a2953d7b7f [Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
2026-10-17 01:25:33 -07:00
Mohammad Miadh AngkadandMohammad Angkad 3fc08b939a [Feat] server-args: Add --enable-hicache alias for --enable-hierarchical-cache (#44849)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-17 13:22:34 +08:00
Liangsheng Yin 4cbea9d3c7 [Doc] cookbook: Allow PD with DSpark for DeepSeek-V4.1 (#44848) 2026-10-16 21:17:32 -07:00
feixiangpengandzijiexia 9590dc80cc [Doc] hicache: Explain HiCache host pool sizing with a storage backend (#44790)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-17 11:28:37 +08:00
3603824541 [Perf] DSv4.1: Enable decoder bounded replay by default (#44403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-10-16 19:52:02 -07:00
63a9b7a713 [Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
2026-10-16 10:36:35 -07:00
Duyi-Wang ed2ebad342 [Doc] [AMD] cookbook: Refresh DeepSeek V4 AgentX PD recipe optimizations (#44454) 2026-10-16 23:34:01 +08:00
Jimmy ShongandJimmy Shong 2c2986be2b docs: add Beam 1.0 deployment cookbook (#44694)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
2026-10-16 13:29:14 +00:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 5e240a200d [Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 19:31:08 +08:00
f05da43d44 [Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
2026-10-16 02:39:27 -07:00
MingyiandZijie Xia 56a3c4fa16 [Doc] cookbook: Add RTX Spark Qwen3.6 NVFP4 recipe (#44707)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-10-16 01:55:41 -07:00
Xinyuan Tongandzijiexia 9baace8456 [Doc] cookbook: refresh MiniCPM-V 4.7 DSPARK benchmarks at the final model PR head (#44310)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-16 01:48:25 -07:00
ZiruandNiu Ziru 5dd37af412 [Doc] [XPU] Cookbook: Update the XPU Docker version to 0.5.22 (#44647)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-16 16:13:24 +08:00
amote-i 9d394dfbd7 [Doc] [NPU] docs: refresh associated dependency versions in npu docs (#44695) 2026-10-16 15:48:37 +08:00
Ziang Li 7098ec387c [Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036) 2026-10-16 00:38:50 -07:00
Baizhou Zhang dfc89580f1 [Doc] cookbook: Add Muse Spark Open SWA ratio calculator (#44687) 2026-10-16 00:00:12 -07:00
amote-i 92580581da [Doc] [NPU] docs: Freeze qwen3-235b-a22b recommended image to a fixed version (#44650) 2026-10-16 14:14:05 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 fd4b75c696 [Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 12:45:07 +08:00
MickandMick Qian e5274752a8 [Doc] diffusion: align PR title conventions (#44646)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-16 11:29:20 +08:00
sglang-botandsglang-bot c15edf314d [Doc] blogs: Sync LMSYS SGLang blog cards (#44616)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-10-16 00:52:14 +00:00
ec7ab9d0c2 [Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-15 15:50:25 -07:00