 MickandMick Qian
|
780a5b1acc
|
[Doc] diffusion: document prompt enhancer tasks and link Cosmos recipes (#45705)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-22 10:28:58 +08:00 |
|
 
|
b453996b7d
|
[Doc] diffusion/minimax-h3: Refresh VDN-H3 B200 benchmarks, fix 8-step bench presets and popular-models snippet (#45267)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-22 10:09:13 +08:00 |
|
 
|
7e5256d1ba
|
[Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-21 11:57:26 -07:00 |
|
zijiexia
|
75878f27c8
|
[Doc] cookbook: Add Recursive Flint cookbook (#45625)
|
2026-10-21 08:58:16 -07:00 |
|
Shiyang Lyu
|
cdbd478422
|
[Doc] [NPU] cookbook: add tested A2 deployment and A3 reference for MiniMax-M2.5 (#40120)
|
2026-10-21 22:59:37 +08:00 |
|
Peng Xingchen
|
7163e97462
|
[Doc] [NPU] GLM: Add Ascend cookbook deployment recipes (#45597)
|
2026-10-21 22:44:08 +08:00 |
|
 
|
8e3e2980db
|
[Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:09:04 +08:00 |
|
unclezhou
|
e109bc1832
|
[Doc] [NPU] deepseek-v4: Add A3/950 single-node cookbook recipes (#45602)
|
2026-10-21 21:16:49 +08:00 |
|
amote-i
|
fda84f80b7
|
[Doc] [NPU] docs: reference released Qwen3.8-Max W4A8 checkpoint in tutorial (#45574)
|
2026-10-21 19:38:17 +08:00 |
|
bz f
|
9c10e0dd61
|
[Doc] [NPU] cookbook: add NPU (A3 series) deployment scenarios for Qwen3.6 (#38678)
|
2026-10-21 17:37:24 +08:00 |
|
Shangming Cai
|
be65391abd
|
[Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338)
|
2026-10-21 17:16:19 +08:00 |
|
 Peng Xingchenandpengxingchen0810
|
4449d7ecb0
|
[Doc] [NPU] GLM: Add GLM-5.3 and GLM-5.3-Flash deployment tutorials (#43372)
Co-authored-by: pengxingchen0810 <pengxingchen0810@noreply.gitcode.com>
|
2026-10-21 15:02:58 +08:00 |
|
Junlin Wu
|
844d2b5dec
|
[Fix] [NPU] qwen3.5: Fix dense serving on Ascend 950 (#32745)
|
2026-10-21 09:50:38 +03:00 |
|
Shangming Cai
|
574f9cdb2e
|
[CI] slash-command: Add /run-cpu-ci to run only the CPU unit suite (#45501)
|
2026-10-21 13:59:16 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
1689cb2d52
|
[Doc] cookbook: Add GLM-5.3 AgentX section and refresh with eight open InferenceX PRs (#45513)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-21 13:22:38 +08:00 |
|
Chunan Zeng
|
93088901fb
|
[Chore] attention: Remove the tokenspeed_mla backend and dependency (#44803)
|
2026-10-20 18:50:05 -07:00 |
|
 
|
c1c287a429
|
[Doc] cookbook: add TPU7x recipe for GLM-5.3-Flash (#45326)
Co-authored-by: Qinghan Chen <qinghan.chen@radixark.net>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-20 17:10:18 -07:00 |
|
Cheng Wan
|
027208ae02
|
[Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896)
|
2026-10-20 16:26:40 -07:00 |
|
 averyjones4andaveryjones4
|
c1e43b95f4
|
[Doc] cookbook: Add DeepReinforce Ornith-1.5 (#45455)
Co-authored-by: averyjones4 <averyjones4@users.noreply.github.com>
|
2026-10-20 16:08:53 -07:00 |
|
 
|
7656071309
|
[Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
|
2026-10-20 22:19:07 +08:00 |
|
Shuwen Wang
|
15e8e687db
|
[Chore] environ: Remove retired unified radix tree environment variable (#45090)
|
2026-10-20 07:02:43 +00:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
9e23107772
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-20 14:48:48 +08:00 |
|
 lpdinkandZhangheng
|
4a651146de
|
[Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-10-20 14:09:13 +08:00 |
|
Duyi-Wang
|
50fa3727eb
|
[Doc] [AMD] cookbook: Fix DeepSeek-V4 PD image and c1 capacity (#45297)
|
2026-10-19 22:45:50 -07:00 |
|
 Qiaolin Yuandzijiexia
|
28448a86d4
|
[Doc] cookbook: Default Qwen3.8-Flash-Next datacenter recipes to FP8 KV cache and QSA indexer (#45245)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-19 15:57:22 -07:00 |
|
Mingyi
|
9a949403f1
|
[Doc] tpu: Introduce SGLang-TorchTPU in README and TPU guide (#45246)
|
2026-10-19 15:34:47 -07:00 |
|
YAMY
|
722669e606
|
[Feat] [NVIDIA] megakernels: Add --enable-nvidia-megakernel and a layer for NVIDIA megakernel plugins (#44945)
|
2026-10-19 11:54:44 -07:00 |
|
AMD-yanfeiwang
|
678913a0f0
|
[Feat] sgl-model-gateway: Add --decode-dispatch-limit to pick PD decode workers near KV arrival (#44689)
|
2026-10-20 02:16:21 +08:00 |
|
 Jan SchalkampandXiaoyu Zhang
|
8e7601ae4a
|
[Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 23:10:04 +08:00 |
|
Thomas Wang
|
5d9c956f8e
|
[Doc] [AMD] dsv4: Update amd cookbook 1016 (#45070)
|
2026-10-19 16:11:11 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
af9bb2a32d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 15:24:08 +08:00 |
|
 
|
97857f9f96
|
[Doc] cookbook: GB300 full-set accuracy and tool follow-up output for Ling-3.1-flash (#44307)
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-18 23:29:09 -07:00 |
|
Liangsheng Yin
|
82c9a8b037
|
[Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075)
|
2026-10-18 21:16:45 -07:00 |
|
 Ankur SinghandClaude Opus 5.5
|
7b1710324c
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.8-Flash-Next H200 (v0.5.22, TP2 points) (#45039)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Force merge to unblock SA AgentX submission
|
2026-10-19 10:31:51 +08:00 |
|
Kotthagattu Meher Sai
|
7f96dc6874
|
[Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345)
|
2026-10-19 10:19:52 +08:00 |
|
Jimmy Shong
|
0dc6de2e74
|
[Doc] nemotron-3.5-super: update H200 and Spark wizard recipes (#44587)
|
2026-10-18 18:22:05 -07:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Liangsheng Yin
|
6708426728
|
[Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043)
|
2026-10-18 16:41:21 -07:00 |
|
Liangsheng Yin
|
0f4aedfecc
|
[Perf] deepseek-v4.1: Default decoder SWA bounded replay on for both PD roles on CUDA (#45035)
|
2026-10-18 11:53:35 -07:00 |
|
 
|
5a930cfd88
|
[Fix] glm4v: Clamp request video budgets to the deployment limit (#43871)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 17:31:33 +08:00 |
|
+14        
|
d33dd0566a
|
[Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-18 01:00:24 -07:00 |
|
Bowen Wang
|
3671503e44
|
[Feat] bench: report goodput and SLO attainment in bench_serving (#43967)
|
2026-10-18 13:31:48 +08:00 |
|
Thomas Wang
|
e5dc10e73b
|
[Doc] [AMD] dsv41: Update amd cookbook 1016 (#44903)
|
2026-10-17 22:10:42 -07:00 |
|
Baizhou Zhang
|
a8b939da43
|
Revert "[Doc] cookbook: Add Muse Spark Open SWA ratio calculator" (#44947)
|
2026-10-17 20:55:00 -07:00 |
|
 
|
531b426281
|
[Feat] diffusion/model: support Cosmos Dreams and Cosmos Multiview (#39475) (#39475)
Co-authored-by: Kedi Wu <kediw@nvidia.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-18 11:15:57 +08:00 |
|
zijiexia
|
3b0a154e60
|
[Doc] cookbook: Add DeepSeek V4.1 Flash 1017 variant (#44937)
|
2026-10-17 20:04:41 -07:00 |
|
 zijiexiaandClaude Sonnet 5.5
|
df24bca4ba
|
[Doc] popular-models: Replace Kimi-K3 with Muse Spark Open (#44693)
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
|
2026-10-17 19:54:45 -07:00 |
|
+3        
|
d4191a4624
|
[Fix] diffusion: stabilize FLUX.3 serving and reuse static conditioning (#44493)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Fabio Camaiora <fcamaiora@nvidia.com>
Co-authored-by: Linda-Stadter <lstadter@nvidia.com>
|
2026-10-17 20:46:13 +08:00 |
|
 
|
9771e5a4f0
|
[Feat] diffusion: Per-task prompt enhancer config and the FLUX.3 Klein upsampler protocol (#44662)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-17 20:45:07 +08:00 |
|
 
|
a2953d7b7f
|
[Fix] deepseek-v4.1: Serve prompt-logprob requests under decoder SWA bounded replay (#44850)
Co-authored-by: Pedram Ghazi <pedram.ghazi@amd.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-10-17 01:25:33 -07:00 |
|