Commit Graph
2023 Commits
Author SHA1 Message Date
Jzz1943 8a6770d566 [Fix] NIXL: Preserve explicit UCX network device selection (#45722) 2026-10-22 20:07:27 +08:00
weireweireandweireweire 96f013b452 [Doc] Cookbook: update GB300 DSV4.1 disagg AgentX launches from InferenceX #4303 (#45495)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-10-22 19:18:55 +08:00
Ankit DhallandAnkit Dhall f727076ed0 [Feat] diffusion: support wan-animate-2 distilled model (#44085)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
2026-10-22 15:37:08 +08:00
Shangming Cai 9569a36561 [Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001) 2026-10-22 14:30:12 +08:00
Richard Wang ce66b3ab59 [Feat] systemone: serve Kev pointer head decision models (#45413) 2026-10-22 14:16:52 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 12370da115 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45749)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 14:15:19 +08:00
WenhaoZhangandMick d9ce511646 [Feat] diffusion: support FastH3 Omni (Ref2VA 8-step PDD) (#45530)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-22 13:07:13 +08:00
MickandMick Qian 3472e16f96 [Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 13:06:07 +08:00
zijieandZijie Chen f91b81b82a [Doc] [AMD] cookbook: Add Muse Spark Open MI355X AgentX recipe (#45689)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
2026-10-21 21:12:52 -07:00
Thomas Wang 9ee9858805 [Doc] [AMD] dsv41: Update amd cookbook 1021 (#45693) 2026-10-21 20:33:34 -07:00
WenhaoZhang 1962cbeebe [Perf] diffusion: convrot_int8 comfy_kitchen issues one GEMM per layer by default (#44179) 2026-10-22 11:30:32 +08:00
Viraat ChandraandClaude Opus 5.5 5f62e23d30 [Doc] cookbook: Add Muse Spark Open GB300 Dynamo + SGLang deployments measured with AA AgentPerf (#45629)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-22 11:24:58 +08:00
MickandMick Qian 780a5b1acc [Doc] diffusion: document prompt enhancer tasks and link Cosmos recipes (#45705)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-22 10:28:58 +08:00
b453996b7d [Doc] diffusion/minimax-h3: Refresh VDN-H3 B200 benchmarks, fix 8-step bench presets and popular-models snippet (#45267)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-22 10:09:13 +08:00
7e5256d1ba [Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
2026-10-21 11:57:26 -07:00
zijiexia 75878f27c8 [Doc] cookbook: Add Recursive Flint cookbook (#45625) 2026-10-21 08:58:16 -07:00
Shiyang Lyu cdbd478422 [Doc] [NPU] cookbook: add tested A2 deployment and A3 reference for MiniMax-M2.5 (#40120) 2026-10-21 22:59:37 +08:00
Peng Xingchen 7163e97462 [Doc] [NPU] GLM: Add Ascend cookbook deployment recipes (#45597) 2026-10-21 22:44:08 +08:00
8e3e2980db [Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-21 22:09:04 +08:00
unclezhou e109bc1832 [Doc] [NPU] deepseek-v4: Add A3/950 single-node cookbook recipes (#45602) 2026-10-21 21:16:49 +08:00
amote-i fda84f80b7 [Doc] [NPU] docs: reference released Qwen3.8-Max W4A8 checkpoint in tutorial (#45574) 2026-10-21 19:38:17 +08:00
bz f 9c10e0dd61 [Doc] [NPU] cookbook: add NPU (A3 series) deployment scenarios for Qwen3.6 (#38678) 2026-10-21 17:37:24 +08:00
Shangming Cai be65391abd [Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338) 2026-10-21 17:16:19 +08:00
Peng Xingchenandpengxingchen0810 4449d7ecb0 [Doc] [NPU] GLM: Add GLM-5.3 and GLM-5.3-Flash deployment tutorials (#43372)
Co-authored-by: pengxingchen0810 <pengxingchen0810@noreply.gitcode.com>
2026-10-21 15:02:58 +08:00
Junlin Wu 844d2b5dec [Fix] [NPU] qwen3.5: Fix dense serving on Ascend 950 (#32745) 2026-10-21 09:50:38 +03:00
Shangming Cai 574f9cdb2e [CI] slash-command: Add /run-cpu-ci to run only the CPU unit suite (#45501) 2026-10-21 13:59:16 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1689cb2d52 [Doc] cookbook: Add GLM-5.3 AgentX section and refresh with eight open InferenceX PRs (#45513)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-21 13:22:38 +08:00
Chunan Zeng 93088901fb [Chore] attention: Remove the tokenspeed_mla backend and dependency (#44803) 2026-10-20 18:50:05 -07:00
c1c287a429 [Doc] cookbook: add TPU7x recipe for GLM-5.3-Flash (#45326)
Co-authored-by: Qinghan Chen <qinghan.chen@radixark.net>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-20 17:10:18 -07:00
Cheng Wan 027208ae02 [Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896) 2026-10-20 16:26:40 -07:00
averyjones4andaveryjones4 c1e43b95f4 [Doc] cookbook: Add DeepReinforce Ornith-1.5 (#45455)
Co-authored-by: averyjones4 <averyjones4@users.noreply.github.com>
2026-10-20 16:08:53 -07:00
7656071309 [Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
2026-10-20 22:19:07 +08:00
Shuwen Wang 15e8e687db [Chore] environ: Remove retired unified radix tree environment variable (#45090) 2026-10-20 07:02:43 +00:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 9e23107772 [Doc] cookbook: Refresh SemiAnalysis AgentX launches with five open InferenceX PRs (#45311)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-20 14:48:48 +08:00
lpdinkandZhangheng 4a651146de [Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-20 14:09:13 +08:00
Duyi-Wang 50fa3727eb [Doc] [AMD] cookbook: Fix DeepSeek-V4 PD image and c1 capacity (#45297) 2026-10-19 22:45:50 -07:00
Qiaolin Yuandzijiexia 28448a86d4 [Doc] cookbook: Default Qwen3.8-Flash-Next datacenter recipes to FP8 KV cache and QSA indexer (#45245)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-19 15:57:22 -07:00
Mingyi 9a949403f1 [Doc] tpu: Introduce SGLang-TorchTPU in README and TPU guide (#45246) 2026-10-19 15:34:47 -07:00
YAMY 722669e606 [Feat] [NVIDIA] megakernels: Add --enable-nvidia-megakernel and a layer for NVIDIA megakernel plugins (#44945) 2026-10-19 11:54:44 -07:00
AMD-yanfeiwang 678913a0f0 [Feat] sgl-model-gateway: Add --decode-dispatch-limit to pick PD decode workers near KV arrival (#44689) 2026-10-20 02:16:21 +08:00
Jan SchalkampandXiaoyu Zhang 8e7601ae4a [Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-19 23:10:04 +08:00
Thomas Wang 5d9c956f8e [Doc] [AMD] dsv4: Update amd cookbook 1016 (#45070) 2026-10-19 16:11:11 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 af9bb2a32d [Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 15:24:08 +08:00
97857f9f96 [Doc] cookbook: GB300 full-set accuracy and tool follow-up output for Ling-3.1-flash (#44307)
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-10-18 23:29:09 -07:00
Liangsheng Yin 82c9a8b037 [Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075) 2026-10-18 21:16:45 -07:00
Ankur SinghandClaude Opus 5.5 7b1710324c [Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.8-Flash-Next H200 (v0.5.22, TP2 points) (#45039)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>

Force merge to unblock SA AgentX submission
2026-10-19 10:31:51 +08:00
Kotthagattu Meher Sai 7f96dc6874 [Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345) 2026-10-19 10:19:52 +08:00
Jimmy Shong 0dc6de2e74 [Doc] nemotron-3.5-super: update H200 and Spark wizard recipes (#44587) 2026-10-18 18:22:05 -07:00
Xiaoyu ZhangandClaude Opus 5.5 329072d99a [Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-19 08:55:47 +08:00
Liangsheng Yin 6708426728 [Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043) 2026-10-18 16:41:21 -07:00