wutao
|
67bbfcee3c
|
[Perf] [NPU] scheduler: Remove blocking seq_lens D2H from graph replay (#45170)
|
2026-10-22 09:50:04 +08:00 |
|
Liangsheng Yin
|
d61f618276
|
[Perf] spec: Let DSPARK prefill publish read-done by placing its draft KV inject before the target forward (#45682)
|
2026-10-21 18:40:44 -07:00 |
|
 
|
4049941a82
|
[Fix] [NPU] scope: fix dtype error in sampling backend ascend (#39609)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
|
2026-10-22 04:34:29 +03:00 |
|
 Khoa PhamandClaude Opus 5.5
|
aa10927271
|
[Perf] dsv41: Mega-mHC and the wo_a einsum write MXFP8 for wqkv_a and wo_b (#45632)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-21 18:27:21 -07:00 |
|
Baizhou Zhang
|
59149553b9
|
[Refactor] attention: centralize linear and draft TP group selection (#45684)
|
2026-10-21 18:25:40 -07:00 |
|
Jimmy Shong
|
9301ca37a0
|
[Fix] modelopt: Correct NVFP4 TRT-LLM clamps for untied gate/up scales (#45386)
|
2026-10-21 17:37:07 -07:00 |
|
  
|
eacd0a07d7
|
[Feat] bench: support --tokenize-prompt for generated-shared-prefix (#40900)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: chaoyujiang <chaoyujiang@hygon.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-22 08:17:15 +08:00 |
|
Khoa Pham
|
ed89693c4a
|
[Perf] dsv41: Fuse the q_norm MXFP8 quantize for wq_b at every row count (#45633)
|
2026-10-21 16:56:45 -07:00 |
|
Liangsheng Yin
|
da7b97a737
|
[Perf] dsv4: Publish prefill read-done under the request window and on V4.1 (#45582)
|
2026-10-21 16:29:28 -07:00 |
|
 
|
ed1f56fead
|
[Fix] [Apple] mlx: Give the stub model a shared-expert layout (#45419)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-10-21 15:54:49 -07:00 |
|
Baizhou Zhang
|
f4035cab0b
|
[Feat] cp: Enable GLM-5.3 Flash interleave BCG with batched prefill and DFlash2 (#43182)
|
2026-10-21 15:51:28 -07:00 |
|
   
|
991b846227
|
[Perf] speculative: Parallelize EAGLE spec-decode KV index building over token blocks (flashinfer draft decode; verify/draft-extend for flashinfer, flashinfer_mla, aiter) (#42803)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-10-21 15:26:35 -07:00 |
|
maocheng23
|
4b9936b5e3
|
[Fix] deepseek_v4: Fix mHC prewarm when chunked prefill is disabled (#43448)
|
2026-10-21 15:21:31 -07:00 |
|
Liangsheng Yin
|
99cf403c9e
|
[Fix] dsv4: Write idle SWA stores to an idle request-window layout (#45586)
|
2026-10-21 15:18:34 -07:00 |
|
em-dreyer
|
aa5880e2b8
|
[Fix] bailing: Renormalize top-k routing weights by default for Ling-2.5/2.6 (#45662)
|
2026-10-21 14:53:58 -07:00 |
|
Liangsheng Yin
|
f3f0f7b68c
|
[Perf] dsv4: Let the decoder tail leave the prefill graph under DP attention with MegaMoE (#45581)
|
2026-10-21 14:44:21 -07:00 |
|
Liangsheng Yin
|
f5eca05b05
|
[Fix] [SM100] quantization: Honor deep_gemm for 32x32 block-FP8 linears (#45585)
|
2026-10-21 14:42:50 -07:00 |
|
 
|
29e78045fb
|
[Fix] dsv4: Skip DP-attention pad rows in the engram hasher and low-ratio sources (#40424)
Co-authored-by: jiashuai <jiashuai@baidu.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-21 14:37:55 -07:00 |
|
Liangsheng Yin
|
f7d4f06242
|
[Perf] dsv4: Compute request-window history rows once per batch (#45579)
|
2026-10-21 14:01:19 -07:00 |
|
Liangsheng Yin
|
bc412213c1
|
[Perf] dsv4: Gather V4.1 index-K slots once per forward and cache the prefill index plan (#45577)
|
2026-10-21 14:00:35 -07:00 |
|
Liangsheng Yin
|
620718c8ea
|
[Fix] moe: Keep the DeepSeek V4.1 vision router off the packed-ids path under routing simulation (#45575)
|
2026-10-21 13:58:44 -07:00 |
|
Liangsheng Yin
|
97945831f9
|
[Perf] dsv4: Restore sparse prefill for request-window rows (#45573)
|
2026-10-21 13:54:32 -07:00 |
|
 Liangsheng Yinandlixiufei-leo
|
2c7a9e3b50
|
[Fix] radix-cache: Order linker offloads behind the forward that writes the pages (#45559)
Co-authored-by: lixiufei-leo <294029388+lixiufei-leo@users.noreply.github.com>
|
2026-10-21 13:53:37 -07:00 |
|
Khoa Pham
|
028de2c5d4
|
[Perf] dsv41: Use tuned MXFP8 tactics at decode sizes (#45630)
|
2026-10-21 13:35:56 -07:00 |
|
 Yoni GozlanandJimmy Shong
|
a2e4ffbcea
|
[Fix] parser: Accept whole-number floats for integer tool arguments (#43941)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 13:04:15 -07:00 |
|
 
|
a3d00eff58
|
[Perf] srt: Record on the host whether an extend batch completes a prompt (#45487)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 11:58:25 -07:00 |
|
 
|
7e5256d1ba
|
[Feat] srt: Balance uvicorn tokenizer workers with per-worker SO_REUSEPORT listeners (#45482)
Co-authored-by: luccafong <116399278+luccafong@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-21 11:57:26 -07:00 |
|
Baizhou Zhang
|
f06d1bb1f4
|
[Perf] cuda-graph: Capture FlashInfer KDA prefill (#45473)
|
2026-10-21 11:57:23 -07:00 |
|
 
|
740d5f9f9e
|
[Perf] scheduler: Plan hybrid Mamba extend batches without host-device syncs (#45472)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Shiyan Deng <20773414+842974287@users.noreply.github.com>
|
2026-10-21 11:56:50 -07:00 |
|
 
|
5e79333c95
|
[Refactor] radix-tree: Reuse the insert walk, component hooks and bindings for custom tree cores (#45439)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-21 10:53:26 -07:00 |
|
paulzhang-tm
|
b57b5e2286
|
[Fix] disaggregation: Synchronize deferred decode KV release across TP ranks (#45453)
|
2026-10-22 01:37:28 +08:00 |
|
Khoa Pham
|
ed268dd320
|
[Fix] moe: Apply SGLANG_SIMULATE_* routing on DeepSeek-V4.1 vision-biased gates (#45628)
|
2026-10-21 10:00:15 -07:00 |
|
vorapolsiloai
|
6e98c84c60
|
[Perf] [AMD] quark: Add opt-in AITER ASM FP4 GEMM for Quark dense linear (#39598)
|
2026-10-21 09:37:47 -07:00 |
|
Michael
|
4b1a44bc77
|
[Test] [AMD] diffusion: Avoid Python 3.11-only enterContext in test_usp_ring_replicated (#45409)
|
2026-10-22 00:11:08 +08:00 |
|
 Huang LongandShangming Cai
|
af49ada16d
|
[Fix] pd: Allow runtime role switching with DP and DP attention (#44215)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:58:29 +08:00 |
|
 
|
8e3e2980db
|
[Feat] [Intel] disaggregation: Support XPU for staging-buffer KV transfer (#40861)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-21 22:09:04 +08:00 |
|
amote-i
|
2815eed49c
|
[Fix] [NPU] pre_warm_nccl: init npu backend before the parallel runtime touches a device (#43039)
|
2026-10-21 19:44:30 +08:00 |
|
 Avaya Aggarwalandniehen6174
|
62b4127668
|
[Feat] comfyui: Apply ControlNet residuals in Flux integrated mode (#43698)
Co-authored-by: niehen6174 <1639206518@qq.com>
|
2026-10-21 19:29:43 +08:00 |
|
 
|
ca72dad953
|
[Fix] rust-server: Answer health probes a busy scheduler skipped on the response ring (#45475)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 03:41:36 -07:00 |
|
Jimmy Shong
|
5bf10d4c79
|
[Fix] nemotron: Correct weight-export failures and GEMV dispatch (#45082)
|
2026-10-21 18:38:35 +08:00 |
|
Jzz1943
|
2e7c9d851c
|
[Feat] NIXL: Support per-GPU UCX device selection (#43482)
|
2026-10-21 17:54:11 +08:00 |
|
Shangming Cai
|
be65391abd
|
[Feat] mooncake: Enable the failed-session probe by default with backoff and idle pruning (#45338)
|
2026-10-21 17:16:19 +08:00 |
|
Thomas Wang
|
1278087336
|
[Fix] [AMD] mono-kernel: Update sgl-amd-mono version (#45546)
|
2026-10-21 02:02:03 -07:00 |
|
 
|
2c9d919071
|
[Fix] srt: Pin the source address of TCP ZMQ connects for the peer allowlist (#45437)
Co-authored-by: Lu Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
|
2026-10-21 01:59:03 -07:00 |
|
 
|
21f775cd97
|
[Feat] rust-server: Let the launcher set the default max_new_tokens for /generate (#45431)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-21 01:58:34 -07:00 |
|
 Aurick QiaoandXiaoyu Zhang
|
7a632cf998
|
[Fix] quantization: Preserve BF16 NaNs in per-token FP8 quantization (#42689)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-21 16:52:28 +08:00 |
|
   
|
8bd6aa9a6c
|
[Feat] parser: Enrich chat_parsing streaming events (#40478)
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 01:46:26 -07:00 |
|
 AlexandJimmy Shong
|
dbe0a9a7c9
|
[Fix] nemotron_vl: Preserve tokenized prompts during media expansion (#44184)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-21 01:40:51 -07:00 |
|
Liangsheng Yin
|
6efdd33d07
|
[Refactor] spec: Move platform dispatch and Triton kernels into kernels/ops (#45504)
|
2026-10-21 01:22:16 -07:00 |
|
 
|
6cac4dc3fe
|
[Refactor] diffusion: Rollout controller as a scheduler-step plugin instead of mixins (#44603)
Signed-off-by: rockdu <kangrdu@gmail.com>
Co-authored-by: WenhaoZhang <42087078+niehen6174@users.noreply.github.com>
Co-authored-by: JingwenGu0829 <75733630+JingwenGu0829@users.noreply.github.com>
|
2026-10-21 16:04:33 +08:00 |
|