 Jan SchalkampandXiaoyu Zhang
|
8e7601ae4a
|
[Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 23:10:04 +08:00 |
|
Thomas Wang
|
5d9c956f8e
|
[Doc] [AMD] dsv4: Update amd cookbook 1016 (#45070)
|
2026-10-19 16:11:11 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
af9bb2a32d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 15:24:08 +08:00 |
|
 
|
97857f9f96
|
[Doc] cookbook: GB300 full-set accuracy and tool follow-up output for Ling-3.1-flash (#44307)
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-18 23:29:09 -07:00 |
|
Liangsheng Yin
|
82c9a8b037
|
[Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075)
|
2026-10-18 21:16:45 -07:00 |
|
 Ankur SinghandClaude Opus 5.5
|
7b1710324c
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.8-Flash-Next H200 (v0.5.22, TP2 points) (#45039)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Force merge to unblock SA AgentX submission
|
2026-10-19 10:31:51 +08:00 |
|
Kotthagattu Meher Sai
|
7f96dc6874
|
[Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345)
|
2026-10-19 10:19:52 +08:00 |
|
Jimmy Shong
|
0dc6de2e74
|
[Doc] nemotron-3.5-super: update H200 and Spark wizard recipes (#44587)
|
2026-10-18 18:22:05 -07:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Liangsheng Yin
|
6708426728
|
[Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043)
|
2026-10-18 16:41:21 -07:00 |
|
Liangsheng Yin
|
0f4aedfecc
|
[Perf] deepseek-v4.1: Default decoder SWA bounded replay on for both PD roles on CUDA (#45035)
|
2026-10-18 11:53:35 -07:00 |
|
 
|
5a930cfd88
|
[Fix] glm4v: Clamp request video budgets to the deployment limit (#43871)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 17:31:33 +08:00 |
|
+14        
|
d33dd0566a
|
[Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-18 01:00:24 -07:00 |
|
Bowen Wang
|
3671503e44
|
[Feat] bench: report goodput and SLO attainment in bench_serving (#43967)
|
2026-10-18 13:31:48 +08:00 |
|
Thomas Wang
|
e5dc10e73b
|
[Doc] [AMD] dsv41: Update amd cookbook 1016 (#44903)
|
2026-10-17 22:10:42 -07:00 |
|
Baizhou Zhang
|
a8b939da43
|
Revert "[Doc] cookbook: Add Muse Spark Open SWA ratio calculator" (#44947)
|
2026-10-17 20:55:00 -07:00 |
|
 
|
531b426281
|
[Feat] diffusion/model: support Cosmos Dreams and Cosmos Multiview (#39475) (#39475)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-18 11:15:57 +08:00 |
|
zijiexia
|
3b0a154e60
|
[Doc] cookbook: Add DeepSeek V4.1 Flash 1017 variant (#44937)
|
2026-10-17 20:04:41 -07:00 |
|
 zijiexiaandClaude Sonnet 5.5
|
df24bca4ba
|
[Doc] popular-models: Replace Kimi-K3 with Muse Spark Open (#44693)
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
|
2026-10-17 19:54:45 -07:00 |
|
+3        
|
d4191a4624
|
[Fix] diffusion: stabilize FLUX.3 serving and reuse static conditioning (#44493)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Fabio Camaiora <fcamaiora@nvidia.com>
Co-authored-by: Linda-Stadter <lstadter@nvidia.com>
|
2026-10-17 20:46:13 +08:00 |
|
 
|
9771e5a4f0
|
[Feat] diffusion: Per-task prompt enhancer config and the FLUX.3 Klein upsampler protocol (#44662)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-17 20:45:07 +08:00 |
|
 
|
a2953d7b7f
|
[Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-10-17 01:25:33 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
3fc08b939a
|
[Feat] server-args: Add --enable-hicache alias for --enable-hierarchical-cache (#44849)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-17 13:22:34 +08:00 |
|
Liangsheng Yin
|
4cbea9d3c7
|
[Doc] cookbook: Allow PD with DSpark for DeepSeek-V4.1 (#44848)
|
2026-10-16 21:17:32 -07:00 |
|
 feixiangpengandzijiexia
|
9590dc80cc
|
[Doc] hicache: Explain HiCache host pool sizing with a storage backend (#44790)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-17 11:28:37 +08:00 |
|
 
|
3603824541
|
[Perf] DSv4.1: Enable decoder bounded replay by default (#44403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-16 19:52:02 -07:00 |
|
 
|
63a9b7a713
|
[Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-16 10:36:35 -07:00 |
|
Duyi-Wang
|
ed2ebad342
|
[Doc] [AMD] cookbook: Refresh DeepSeek V4 AgentX PD recipe optimizations (#44454)
|
2026-10-16 23:34:01 +08:00 |
|
 Jimmy ShongandJimmy Shong
|
2c2986be2b
|
docs: add Beam 1.0 deployment cookbook (#44694)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
|
2026-10-16 13:29:14 +00:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
5e240a200d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 19:31:08 +08:00 |
|
 
|
f05da43d44
|
[Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:39:27 -07:00 |
|
 MingyiandZijie Xia
|
56a3c4fa16
|
[Doc] cookbook: Add RTX Spark Qwen3.6 NVFP4 recipe (#44707)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-10-16 01:55:41 -07:00 |
|
 Xinyuan Tongandzijiexia
|
9baace8456
|
[Doc] cookbook: refresh MiniCPM-V 4.7 DSPARK benchmarks at the final model PR head (#44310)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-16 01:48:25 -07:00 |
|
 ZiruandNiu Ziru
|
5dd37af412
|
[Doc] [XPU] Cookbook: Update the XPU Docker version to 0.5.22 (#44647)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-16 16:13:24 +08:00 |
|
amote-i
|
9d394dfbd7
|
[Doc] [NPU] docs: refresh associated dependency versions in npu docs (#44695)
|
2026-10-16 15:48:37 +08:00 |
|
Ziang Li
|
7098ec387c
|
[Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036)
|
2026-10-16 00:38:50 -07:00 |
|
Baizhou Zhang
|
dfc89580f1
|
[Doc] cookbook: Add Muse Spark Open SWA ratio calculator (#44687)
|
2026-10-16 00:00:12 -07:00 |
|
amote-i
|
92580581da
|
[Doc] [NPU] docs: Freeze qwen3-235b-a22b recommended image to a fixed version (#44650)
|
2026-10-16 14:14:05 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
fd4b75c696
|
[Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 12:45:07 +08:00 |
|
 MickandMick Qian
|
e5274752a8
|
[Doc] diffusion: align PR title conventions (#44646)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-16 11:29:20 +08:00 |
|
 sglang-botandsglang-bot
|
c15edf314d
|
[Doc] blogs: Sync LMSYS SGLang blog cards (#44616)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-10-16 00:52:14 +00:00 |
|
 
|
ec7ab9d0c2
|
[Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-15 15:50:25 -07:00 |
|
snadampal
|
aa5c7e887c
|
[Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
|
2026-10-15 13:19:22 -07:00 |
|
     
|
a8aaf95b58
|
[Cookbook] Add cookbook for muse spark open (#44527)
Co-authored-by: thomawan <thomawan@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: zijie <zijie.chen@amd.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-15 10:20:38 -07:00 |
|
 Yihao WangandClaude Opus 5.5
|
5b12ec163c
|
[Doc] cookbook: Expand the FLUX.3 Image Klein model description (#44515)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 08:56:54 -07:00 |
|
 Jimmy ShongandJimmy Shong
|
05cbe241be
|
[Doc] cookbook: Add Nemotron 3.5 Super VL (#44510)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
|
2026-10-15 08:39:14 -07:00 |
|
 
|
28b98e5d13
|
[Doc] cookbook: Add the FLUX.3 prompt upsampler section (#44512)
Co-authored-by: Sandro Cavallari <scavallari@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 08:38:33 -07:00 |
|
        
|
09b7383624
|
[diffusion] model: support FLUX.3 image (#44418)
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 21:50:59 +08:00 |
|
amote-i
|
abf92826ee
|
[NPU] [DOC] update NPU best practices and model deployment docs to CANN 9.1.0 (#44432)
|
2026-10-15 20:22:54 +08:00 |
|
 Zhang Yiyang (SII)andMick Qian
|
23c2a026db
|
[diffusion] model: support MOSS-Image (#44325)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 19:23:56 +08:00 |
|