Commit Graph
1962 Commits
Author SHA1 Message Date
a2953d7b7f [Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
2026-10-17 01:25:33 -07:00
Mohammad Miadh AngkadandMohammad Angkad 3fc08b939a [Feat] server-args: Add --enable-hicache alias for --enable-hierarchical-cache (#44849)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-17 13:22:34 +08:00
Liangsheng Yin 4cbea9d3c7 [Doc] cookbook: Allow PD with DSpark for DeepSeek-V4.1 (#44848) 2026-10-16 21:17:32 -07:00
feixiangpengandzijiexia 9590dc80cc [Doc] hicache: Explain HiCache host pool sizing with a storage backend (#44790)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-17 11:28:37 +08:00
3603824541 [Perf] DSv4.1: Enable decoder bounded replay by default (#44403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-10-16 19:52:02 -07:00
63a9b7a713 [Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
2026-10-16 10:36:35 -07:00
Duyi-Wang ed2ebad342 [Doc] [AMD] cookbook: Refresh DeepSeek V4 AgentX PD recipe optimizations (#44454) 2026-10-16 23:34:01 +08:00
Jimmy ShongandJimmy Shong 2c2986be2b docs: add Beam 1.0 deployment cookbook (#44694)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
2026-10-16 13:29:14 +00:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 5e240a200d [Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 19:31:08 +08:00
f05da43d44 [Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
2026-10-16 02:39:27 -07:00
MingyiandZijie Xia 56a3c4fa16 [Doc] cookbook: Add RTX Spark Qwen3.6 NVFP4 recipe (#44707)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-10-16 01:55:41 -07:00
Xinyuan Tongandzijiexia 9baace8456 [Doc] cookbook: refresh MiniCPM-V 4.7 DSPARK benchmarks at the final model PR head (#44310)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-16 01:48:25 -07:00
ZiruandNiu Ziru 5dd37af412 [Doc] [XPU] Cookbook: Update the XPU Docker version to 0.5.22 (#44647)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
2026-10-16 16:13:24 +08:00
amote-i 9d394dfbd7 [Doc] [NPU] docs: refresh associated dependency versions in npu docs (#44695) 2026-10-16 15:48:37 +08:00
Ziang Li 7098ec387c [Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036) 2026-10-16 00:38:50 -07:00
Baizhou Zhang dfc89580f1 [Doc] cookbook: Add Muse Spark Open SWA ratio calculator (#44687) 2026-10-16 00:00:12 -07:00
amote-i 92580581da [Doc] [NPU] docs: Freeze qwen3-235b-a22b recommended image to a fixed version (#44650) 2026-10-16 14:14:05 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 fd4b75c696 [Doc] cookbook: Add SemiAnalysis AgentX launches to Muse Spark Open, refresh DeepSeek-V4.1-Flash (#44654)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 12:45:07 +08:00
MickandMick Qian e5274752a8 [Doc] diffusion: align PR title conventions (#44646)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-16 11:29:20 +08:00
sglang-botandsglang-bot c15edf314d [Doc] blogs: Sync LMSYS SGLang blog cards (#44616)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-10-16 00:52:14 +00:00
ec7ab9d0c2 [Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-15 15:50:25 -07:00
snadampal aa5c7e887c [Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
2026-10-15 13:19:22 -07:00
a8aaf95b58 [Cookbook] Add cookbook for muse spark open (#44527)
Co-authored-by: thomawan <thomawan@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: zijie <zijie.chen@amd.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-10-15 10:20:38 -07:00
Yihao WangandClaude Opus 5.5 5b12ec163c [Doc] cookbook: Expand the FLUX.3 Image Klein model description (#44515)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 08:56:54 -07:00
Jimmy ShongandJimmy Shong 05cbe241be [Doc] cookbook: Add Nemotron 3.5 Super VL (#44510)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
2026-10-15 08:39:14 -07:00
28b98e5d13 [Doc] cookbook: Add the FLUX.3 prompt upsampler section (#44512)
Co-authored-by: Sandro Cavallari <scavallari@gmail.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-15 08:38:33 -07:00
09b7383624 [diffusion] model: support FLUX.3 image (#44418)
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-15 21:50:59 +08:00
amote-i abf92826ee [NPU] [DOC] update NPU best practices and model deployment docs to CANN 9.1.0 (#44432) 2026-10-15 20:22:54 +08:00
Zhang Yiyang (SII)andMick Qian 23c2a026db [diffusion] model: support MOSS-Image (#44325)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-15 19:23:56 +08:00
GeorgeSherifandXiaoyu Zhang 8f853b0041 [Doc] cookbook: Add Jais 3 deployment recipes (#42766)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-15 16:09:44 +08:00
MickandMick Qian f2b73d4f9b [diffusion] doc: document reference resizing, LoRA auto mode and image profiling (#44377)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-15 13:41:44 +08:00
Thomas Wang 4851d182a1 [Doc][AMD] Update v41 amd cookbook 1015 (#44368) 2026-10-14 19:33:08 -07:00
Yuhao YangandClaude Opus 5.5 9fa9308e95 [Doc] cookbook: Add Step 5 Preview cookbook (#44357)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-15 09:21:06 +08:00
amote-i 3a9cae27ed [Doc] [NPU] docs: Update NPU CANN version to 9.1.0 (#44177) 2026-10-15 00:27:18 +08:00
Xinyuan Tong ed40c7fc66 [Doc] cookbook: add Ling-3.1-flash (#44301) 2026-10-14 22:40:01 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 72730d6360 [Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 16:07:40 +08:00
Mohammad Miadh AngkadandMohammad Angkad 6daae9c98e [Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-14 00:01:32 -07:00
ANSHUMAN TRIPATHY 30bdd09aed DSPARK enable for XPU (#33739) 2026-10-14 13:10:24 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 721953c6f6 [Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:03:51 +08:00
HEJIAN SANGandClaude Opus 5.5 a832609b92 [Feature] Return output top logprobs as flat base64 arrays on request (#42890)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 15:58:31 -07:00
Xinyuan TongandNihar Patel 7dc2930585 [Feature] Add Aaronson-Gumbel text watermarking (#37577)
Co-authored-by: Nihar Patel <nihpat95@gmail.com>
2026-10-13 12:47:50 -07:00
Xinyuan Tong 5eda6b7e67 docs: add MiniCPM-V 4.7 cookbook (#43829) 2026-10-13 12:04:47 -07:00
Khoa Phamandvincentzed 8bf145d119 [DCP] Decode context parallelism for DSA (GLM-5.2 / GLM-5.3) with MTP (#43735)
Co-authored-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
2026-10-13 11:35:34 -07:00
Ho-Ren (Jack) ChuangandXiaoyu Zhang 5100f8d11d [DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.3-Flash with BF16 KV Cache (#41790)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-13 20:30:13 +08:00
amote-i 29974d543e [NPU] [DOC] update kimi k3 cookbook and supported features on NPU (#44052) 2026-10-13 20:27:26 +08:00
LittleNyimaandMick Qian 5727f08932 [diffusion] feat: add configurable reference image resizing for MiniMax H3 Ref2VA (#35839)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-13 19:48:18 +08:00
Ziang Li 01f6840693 [FlashInfer] Add startup autotuning for MegaMoE (#43789) 2026-10-13 02:30:31 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 dbad07a06f [Docs] Cookbook: refresh SemiAnalysis AgentX launches (DeepSeek-V4.1 GB200/GB300, GLM-5.2 FP8 B300) (#43983)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 14:39:45 +08:00
Jimmy Shong 3eebf987ed [PD] Support heterogeneous TP for hybrid SWA KV transfer (#40909) 2026-10-12 23:21:54 -07:00
Thomas Wang c2dfd5d3d6 [AMD] Update v4 amd cookbook 1012 (#43962) 2026-10-12 19:57:55 -07:00