 Jackey Huaandhnyls2002
|
e22a530859
|
[Feat] openai: Render DeepSeek-V4/V4.1 chat prompts with deepseek-recipe (#45315)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-23 18:05:35 -07:00 |
|
Ziang Li
|
197be2203a
|
[Doc] quantization: Link W4A16 design from environment reference (#46170)
|
2026-10-23 15:49:18 -07:00 |
|
 Alex NailsandClaude Opus 5.5
|
baf80c61b7
|
[Feat] platforms: Let out-of-tree platforms bind group devices and custom ops (#45897)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 12:02:42 -07:00 |
|
 
|
3e5f5505ed
|
[Perf] diffusion: Serve image responses from in-memory encoded bytes (#45987)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-23 21:16:44 +08:00 |
|
 
|
2b8e4cde95
|
[Doc] [CPU] Cookbook: Update to the cookbook for models supported by Intel Xeon CPUs (#40092)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-23 16:22:50 +08:00 |
|
 MickandMick Qian
|
363e6c6b4d
|
[Feat] diffusion/disaggregation: split FLUX.3 prompt and image encoders (#45309)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-23 10:35:41 +08:00 |
|
Jzz1943
|
8a6770d566
|
[Fix] NIXL: Preserve explicit UCX network device selection (#45722)
|
2026-10-22 20:07:27 +08:00 |
|
Shangming Cai
|
9569a36561
|
[Feat] scheduler: Gate --prefill-decode-interval on running batch size (#44001)
|
2026-10-22 14:30:12 +08:00 |
|
Richard Wang
|
ce66b3ab59
|
[Feat] systemone: serve Kev pointer head decision models (#45413)
|
2026-10-22 14:16:52 +08:00 |
|
 MickandMick Qian
|
3472e16f96
|
[Refactor] diffusion: remove the deprecated kitchen_int8 alias (#45706)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-22 13:06:07 +08:00 |
|
WenhaoZhang
|
1962cbeebe
|
[Perf] diffusion: convrot_int8 comfy_kitchen issues one GEMM per layer by default (#44179)
|
2026-10-22 11:30:32 +08:00 |
|
 MickandMick Qian
|
780a5b1acc
|
[Doc] diffusion: document prompt enhancer tasks and link Cosmos recipes (#45705)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-22 10:28:58 +08:00 |
|
 
|
7e5256d1ba
|
[Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-21 11:57:26 -07:00 |
|
Peng Xingchen
|
7163e97462
|
[Doc] [NPU] GLM: Add Ascend cookbook deployment recipes (#45597)
|
2026-10-21 22:44:08 +08:00 |
|
 
|
8e3e2980db
|
[Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:09:04 +08:00 |
|
amote-i
|
fda84f80b7
|
[Doc] [NPU] docs: reference released Qwen3.8-Max W4A8 checkpoint in tutorial (#45574)
|
2026-10-21 19:38:17 +08:00 |
|
Shangming Cai
|
be65391abd
|
[Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338)
|
2026-10-21 17:16:19 +08:00 |
|
 Peng Xingchenandpengxingchen0810
|
4449d7ecb0
|
[Doc] [NPU] GLM: Add GLM-5.3 and GLM-5.3-Flash deployment tutorials (#43372)
Co-authored-by: pengxingchen0810 <pengxingchen0810@noreply.gitcode.com>
|
2026-10-21 15:02:58 +08:00 |
|
Junlin Wu
|
844d2b5dec
|
[Fix] [NPU] qwen3.5: Fix dense serving on Ascend 950 (#32745)
|
2026-10-21 09:50:38 +03:00 |
|
Shangming Cai
|
574f9cdb2e
|
[CI] slash-command: Add /run-cpu-ci to run only the CPU unit suite (#45501)
|
2026-10-21 13:59:16 +08:00 |
|
Chunan Zeng
|
93088901fb
|
[Chore] attention: Remove the tokenspeed_mla backend and dependency (#44803)
|
2026-10-20 18:50:05 -07:00 |
|
Cheng Wan
|
027208ae02
|
[Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896)
|
2026-10-20 16:26:40 -07:00 |
|
 
|
7656071309
|
[Feat] platform: Add initial T-HEAD SAIL platform support [2/N] (#43826)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: yzshi <163985193+Yunzshi310@users.noreply.github.com>
|
2026-10-20 22:19:07 +08:00 |
|
 lpdinkandZhangheng
|
4a651146de
|
[Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-10-20 14:09:13 +08:00 |
|
Mingyi
|
9a949403f1
|
[Doc] tpu: Introduce SGLang-TorchTPU in README and TPU guide (#45246)
|
2026-10-19 15:34:47 -07:00 |
|
YAMY
|
722669e606
|
[Feat] [NVIDIA] megakernels: Add --enable-nvidia-megakernel and a layer for NVIDIA megakernel plugins (#44945)
|
2026-10-19 11:54:44 -07:00 |
|
AMD-yanfeiwang
|
678913a0f0
|
[Feat] sgl-model-gateway: Add --decode-dispatch-limit to pick PD decode workers near KV arrival (#44689)
|
2026-10-20 02:16:21 +08:00 |
|
 Jan SchalkampandXiaoyu Zhang
|
8e7601ae4a
|
[Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 23:10:04 +08:00 |
|
Kotthagattu Meher Sai
|
7f96dc6874
|
[Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345)
|
2026-10-19 10:19:52 +08:00 |
|
 Xiaoyu ZhangandClaude Opus 5.5
|
329072d99a
|
[Refactor] kernels/diffusion/tests: Prune dead code and fix tests that never ran (#44690)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 08:55:47 +08:00 |
|
Liangsheng Yin
|
6708426728
|
[Fix] spec: Remove --speculative-skip-dp-mlp-sync (#45043)
|
2026-10-18 16:41:21 -07:00 |
|
 
|
5a930cfd88
|
[Fix] glm4v: Clamp request video budgets to the deployment limit (#43871)
Co-authored-by: cipheraxat <cipheraxat@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-18 17:31:33 +08:00 |
|
+14        
|
d33dd0566a
|
[Feat] srt: Add muse spark runtime, multimodal support and tests (3/5) (#44666)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-18 01:00:24 -07:00 |
|
Bowen Wang
|
3671503e44
|
[Feat] bench: report goodput and SLO attainment in bench_serving (#43967)
|
2026-10-18 13:31:48 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
3fc08b939a
|
[Feat] server-args: Add --enable-hicache alias for --enable-hierarchical-cache (#44849)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-17 13:22:34 +08:00 |
|
 feixiangpengandzijiexia
|
9590dc80cc
|
[Doc] hicache: Explain HiCache host pool sizing with a storage backend (#44790)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-17 11:28:37 +08:00 |
|
 
|
63a9b7a713
|
[Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-16 10:36:35 -07:00 |
|
 
|
f05da43d44
|
[Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:39:27 -07:00 |
|
 ZiruandNiu Ziru
|
5dd37af412
|
[Doc] [XPU] Cookbook: Update the XPU Docker version to 0.5.22 (#44647)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-16 16:13:24 +08:00 |
|
amote-i
|
9d394dfbd7
|
[Doc] [NPU] docs: refresh associated dependency versions in npu docs (#44695)
|
2026-10-16 15:48:37 +08:00 |
|
Ziang Li
|
7098ec387c
|
[Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036)
|
2026-10-16 00:38:50 -07:00 |
|
amote-i
|
92580581da
|
[Doc] [NPU] docs: Freeze qwen3-235b-a22b recommended image to a fixed version (#44650)
|
2026-10-16 14:14:05 +08:00 |
|
 MickandMick Qian
|
e5274752a8
|
[Doc] diffusion: align PR title conventions (#44646)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-16 11:29:20 +08:00 |
|
 
|
ec7ab9d0c2
|
[Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-15 15:50:25 -07:00 |
|
snadampal
|
aa5c7e887c
|
[Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
|
2026-10-15 13:19:22 -07:00 |
|
        
|
09b7383624
|
[diffusion] model: support FLUX.3 image (#44418)
Co-authored-by: Dom Brown <3886319+DomBrown@users.noreply.github.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Nikita Korobov <14355239+nekorobov@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 21:50:59 +08:00 |
|
amote-i
|
abf92826ee
|
[NPU] [DOC] update NPU best practices and model deployment docs to CANN 9.1.0 (#44432)
|
2026-10-15 20:22:54 +08:00 |
|
 MickandMick Qian
|
f2b73d4f9b
|
[diffusion] doc: document reference resizing, LoRA auto mode and image profiling (#44377)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-15 13:41:44 +08:00 |
|
amote-i
|
3a9cae27ed
|
[Doc] [NPU] docs: Update NPU CANN version to 9.1.0 (#44177)
|
2026-10-15 00:27:18 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
6daae9c98e
|
[Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 00:01:32 -07:00 |
|