Liangsheng Yin
|
da7b97a737
|
[Perf] dsv4: Publish prefill read-done under the request window and on V4.1 (#45582)
|
2026-10-21 16:29:28 -07:00 |
|
 
|
ed1f56fead
|
[Fix] [Apple] mlx: Give the stub model a shared-expert layout (#45419)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-10-21 15:54:49 -07:00 |
|
Baizhou Zhang
|
f4035cab0b
|
[Feat] cp: Enable GLM-5.3 Flash interleave BCG with batched prefill and DFlash2 (#43182)
|
2026-10-21 15:51:28 -07:00 |
|
   
|
991b846227
|
[Perf] speculative: Parallelize EAGLE spec-decode KV index building over token blocks (flashinfer draft decode; verify/draft-extend for flashinfer, flashinfer_mla, aiter) (#42803)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-21 15:26:35 -07:00 |
|
maocheng23
|
4b9936b5e3
|
[Fix] deepseek_v4: Fix mHC prewarm when chunked prefill is disabled (#43448)
|
2026-10-21 15:21:31 -07:00 |
|
Liangsheng Yin
|
99cf403c9e
|
[Fix] dsv4: Write idle SWA stores to an idle request-window layout (#45586)
|
2026-10-21 15:18:34 -07:00 |
|
em-dreyer
|
aa5880e2b8
|
[Fix] bailing: Renormalize top-k routing weights by default for Ling-2.5/2.6 (#45662)
|
2026-10-21 14:53:58 -07:00 |
|
Liangsheng Yin
|
f3f0f7b68c
|
[Perf] dsv4: Let the decoder tail leave the prefill graph under DP attention with MegaMoE (#45581)
|
2026-10-21 14:44:21 -07:00 |
|
Liangsheng Yin
|
f5eca05b05
|
[Fix] [SM100] quantization: Honor deep_gemm for 32x32 block-FP8 linears (#45585)
|
2026-10-21 14:42:50 -07:00 |
|
 
|
29e78045fb
|
[Fix] dsv4: Skip DP-attention pad rows in the engram hasher and low-ratio sources (#40424)
Co-authored-by: jiashuai <jiashuai@baidu.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-21 14:37:55 -07:00 |
|
Liangsheng Yin
|
f7d4f06242
|
[Perf] dsv4: Compute request-window history rows once per batch (#45579)
|
2026-10-21 14:01:19 -07:00 |
|
Liangsheng Yin
|
bc412213c1
|
[Perf] dsv4: Gather V4.1 index-K slots once per forward and cache the prefill index plan (#45577)
|
2026-10-21 14:00:35 -07:00 |
|
Liangsheng Yin
|
620718c8ea
|
[Fix] moe: Keep the DeepSeek V4.1 vision router off the packed-ids path under routing simulation (#45575)
|
2026-10-21 13:58:44 -07:00 |
|
Liangsheng Yin
|
97945831f9
|
[Perf] dsv4: Restore sparse prefill for request-window rows (#45573)
|
2026-10-21 13:54:32 -07:00 |
|
 Liangsheng Yinandlixiufei-leo
|
2c7a9e3b50
|
[Fix] radix-cache: Order linker offloads behind the forward that writes the pages (#45559)
Co-authored-by: lixiufei-leo <294029388+lixiufei-leo@users.noreply.github.com>
|
2026-10-21 13:53:37 -07:00 |
|
Khoa Pham
|
028de2c5d4
|
[Perf] dsv41: Use tuned MXFP8 tactics at decode sizes (#45630)
|
2026-10-21 13:35:56 -07:00 |
|
 Yoni GozlanandJimmy Shong
|
a2e4ffbcea
|
[Fix] parser: Accept whole-number floats for integer tool arguments (#43941)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 13:04:15 -07:00 |
|
 
|
a3d00eff58
|
[Perf] srt: Record on the host whether an extend batch completes a prompt (#45487)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 11:58:25 -07:00 |
|
 
|
7e5256d1ba
|
[Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-21 11:57:26 -07:00 |
|
Baizhou Zhang
|
f06d1bb1f4
|
[Perf] cuda-graph: Capture FlashInfer KDA prefill (#45473)
|
2026-10-21 11:57:23 -07:00 |
|
 
|
740d5f9f9e
|
[Perf] scheduler: Plan hybrid Mamba extend batches without host-device syncs (#45472)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Shiyan Deng <20773414+842974287@users.noreply.github.com>
|
2026-10-21 11:56:50 -07:00 |
|
 
|
5e79333c95
|
[Refactor] radix-tree: Reuse the insert walk, component hooks and bindings for custom tree cores (#45439)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-21 10:53:26 -07:00 |
|
paulzhang-tm
|
b57b5e2286
|
[Fix] disaggregation: Synchronize deferred decode KV release across TP ranks (#45453)
|
2026-10-22 01:37:28 +08:00 |
|
Khoa Pham
|
ed268dd320
|
[Fix] moe: Apply SGLANG_SIMULATE_* routing on DeepSeek-V4.1 vision-biased gates (#45628)
|
2026-10-21 10:00:15 -07:00 |
|
vorapolsiloai
|
6e98c84c60
|
[Perf] [AMD] quark: Add opt-in AITER ASM FP4 GEMM for Quark dense linear (#39598)
|
2026-10-21 09:37:47 -07:00 |
|
Michael
|
4b1a44bc77
|
[Test] [AMD] diffusion: Avoid Python 3.11-only enterContext in test_usp_ring_replicated (#45409)
|
2026-10-22 00:11:08 +08:00 |
|
 Huang LongandShangming Cai
|
af49ada16d
|
[Fix] pd: Allow runtime role switching with DP and DP attention (#44215)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:58:29 +08:00 |
|
 
|
8e3e2980db
|
[Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:09:04 +08:00 |
|
amote-i
|
2815eed49c
|
[Fix] [NPU] pre_warm_nccl: init npu backend before the parallel runtime touches a device (#43039)
|
2026-10-21 19:44:30 +08:00 |
|
 Avaya Aggarwalandniehen6174
|
62b4127668
|
[Feat] comfyui: Apply ControlNet residuals in Flux integrated mode (#43698)
Co-authored-by: niehen6174 <1639206518@qq.com>
|
2026-10-21 19:29:43 +08:00 |
|
 
|
ca72dad953
|
[Fix] rust-server: Answer health probes a busy scheduler skipped on the response ring (#45475)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 03:41:36 -07:00 |
|
Jimmy Shong
|
5bf10d4c79
|
[Fix] nemotron: Correct weight-export failures and GEMV dispatch (#45082)
|
2026-10-21 18:38:35 +08:00 |
|
Jzz1943
|
2e7c9d851c
|
[Feat] NIXL: Support per-GPU UCX device selection (#43482)
|
2026-10-21 17:54:11 +08:00 |
|
Shangming Cai
|
be65391abd
|
[Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338)
|
2026-10-21 17:16:19 +08:00 |
|
Thomas Wang
|
1278087336
|
[Fix] [AMD] mono-kernel: Update sgl-amd-mono version (#45546)
|
2026-10-21 02:02:03 -07:00 |
|
 
|
2c9d919071
|
[Fix] srt: Pin the source address of TCP ZMQ connects for the peer allowlist (#45437)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
|
2026-10-21 01:59:03 -07:00 |
|
 
|
21f775cd97
|
[Feat] rust-server: Let the launcher set the default max_new_tokens for /generate (#45431)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 01:58:34 -07:00 |
|
 Aurick QiaoandXiaoyu Zhang
|
7a632cf998
|
[Fix] quantization: Preserve BF16 NaNs in per-token FP8 quantization (#42689)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-21 16:52:28 +08:00 |
|
   
|
8bd6aa9a6c
|
[Feat] parser: Enrich chat_parsing streaming events (#40478)
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 01:46:26 -07:00 |
|
 AlexandJimmy Shong
|
dbe0a9a7c9
|
[Fix] nemotron_vl: Preserve tokenized prompts during media expansion (#44184)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 01:40:51 -07:00 |
|
Liangsheng Yin
|
6efdd33d07
|
[Refactor] spec: Move platform dispatch and Triton kernels into kernels/ops (#45504)
|
2026-10-21 01:22:16 -07:00 |
|
 
|
6cac4dc3fe
|
[Refactor] diffusion: Rollout controller as a scheduler-step plugin instead of mixins (#44603)
Signed-off-by: rockdu <kangrdu@gmail.com>
Co-authored-by: WenhaoZhang <42087078+niehen6174@users.noreply.github.com>
Co-authored-by: JingwenGu0829 <75733630+JingwenGu0829@users.noreply.github.com>
|
2026-10-21 16:04:33 +08:00 |
|
 Avaya AggarwalandWenhaoZhang
|
fee32a5c1f
|
[Feat] ComfyUI: Add online INT8 quantization for BF16 Qwen-Image-2.1 single files (#44865)
Co-authored-by: WenhaoZhang <42087078+niehen6174@users.noreply.github.com>
|
2026-10-21 16:01:18 +08:00 |
|
Jzz1943
|
a361f0c410
|
[Fix] kda: Align graph tracking branch dtype with the recurrent state pool (#44886)
|
2026-10-21 15:58:34 +08:00 |
|
 
|
f7b8c6fe40
|
[Fix] glm-5.2: Record side-stream work right before its join to keep CUDA-graph replay on one stream (#45349)
Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-21 15:36:54 +08:00 |
|
 Hongkuan Zhouandishandhanani
|
8acfabbd67
|
[Fix] observability: Correct speculative FPM timing and decode lengths (#38711)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-21 15:31:18 +08:00 |
|
Junlin Wu
|
844d2b5dec
|
[Fix] [NPU] qwen3.5: Fix dense serving on Ascend 950 (#32745)
|
2026-10-21 09:50:38 +03:00 |
|
Jimmy Shong
|
8599b7251f
|
[Chore] deps: Bump the OpenAI SDK to 2.8.0 for Responses shell tools (2/8) (#45291)
|
2026-10-20 23:49:30 -07:00 |
|
wutao
|
fb6e6a09ce
|
[Fix] [NPU] disaggregation: Fix host-pool backup for decode retraction (#43814)
|
2026-10-21 14:48:01 +08:00 |
|
 Khoa PhamandAMD-yanfeiwang
|
da7e3f1c12
|
[Fix] cache: Accept packed draft layer mappings in the UMBP linker (#44929)
Co-authored-by: AMD-yanfeiwang <yanfei.wang@amd.com>
|
2026-10-20 23:27:22 -07:00 |
|