 metamergebotandjiayisuse
|
989ccf4863
|
[Feat] disaggregation: Let a KV transfer backend skip the checksum for an incomparable peer (#44605)
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-16 10:36:46 -07:00 |
|
 
|
63a9b7a713
|
[Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-16 10:36:35 -07:00 |
|
 
|
26a2f18c02
|
[Feat] sglang-server: serve /v1/loads from the Rust frontend (#44532)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 10:35:37 -07:00 |
|
Xinyuan Tong
|
a038a0dca0
|
[Fix] dsv41: Preserve tool-result image order and current-turn thinking (#44751)
|
2026-10-16 23:39:50 +08:00 |
|
 Benjamin TruongandClaude Opus 5.5
|
7c99ace127
|
[Fix] dsa: Fix ragged seed indices before MTP draft decode (#42565)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 19:37:41 +08:00 |
|
 Xinyi SongandHAI
|
4afae5568b
|
[Perf] [AMD] dsv4: Add a separate MegaMoE decode instance (#44657)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-16 03:11:02 -07:00 |
|
 
|
2adc76ad61
|
[Perf] [AMD] dsv4: reuse the q_lora fp8 quant for the C4 indexer wq_b (4/8) (#41903)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:55:25 -07:00 |
|
 kkandDuyi-Wang
|
baf451fcd6
|
[Perf] [AMD] dsv4: carry aiter DSv4 GEMM tuned rows and mHC tile_m=16 until aiter ships them (7/8) (#44008)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:47:41 -07:00 |
|
 
|
f05da43d44
|
[Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:39:27 -07:00 |
|
 
|
42eb556e66
|
[Perf] [AMD] dsv4: optional e8m0 mxscale GEMM for dense 128x128 fp8 linears (6/8) (#44007)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-16 02:28:31 -07:00 |
|
caihuali95
|
8d229d96e0
|
[Fix] unified-memory: enabling trtllm_mha with decode graphs and speculative decoding (#42930)
|
2026-10-16 02:24:06 -07:00 |
|
 kkandDuyi-Wang
|
6efc96abf9
|
[Perf] [AMD] dsv4: FP4 indexer on aiter's row-group kernel for decode and target-verify (5/8) (#44006)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:16:06 -07:00 |
|
 kkandDuyi-Wang
|
9fde8bcc46
|
[Perf] [AMD] moe: small-batch sort with histogram + bitonic sort for 32 < P <= 256 (3/8) (#44004)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:09:32 -07:00 |
|
 kkandDuyi-Wang
|
f0ff18353d
|
[Perf] [AMD] dsv4: fp8 verify writes the SWA ring in the fused norm/rope kernel (2/8) (#44003)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 01:58:00 -07:00 |
|
 kkandDuyi-Wang
|
ab5858ac8a
|
[Perf] [AMD] dsv4: fp8 unified_kv decode/verify on FlyDSL v4 nm decode with a latency-model split plan (1/8) (#44016)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 01:50:16 -07:00 |
|
Liangsheng Yin
|
fad7d95a7f
|
[Fix] deepseek-v4.1: Keep the DSpark draft SWA out of the radix tree (#44673)
|
2026-10-16 01:18:58 -07:00 |
|
 kkandwunhuang
|
bdc4ec15ce
|
[Perf] [AMD] dspark: No per-step host sync in decode (1/4) (#44405)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-16 01:13:37 -07:00 |
|
jiaqiang-dot-liu
|
a448fdf316
|
[Perf] [AMD] qwen3: Fuse QK-norm + RoPE + KV cache write for dense Qwen3 decode (#44267)
|
2026-10-16 00:51:55 -07:00 |
|
Ziang Li
|
7098ec387c
|
[Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036)
|
2026-10-16 00:38:50 -07:00 |
|
 Liangsheng YinandJingshu Chen
|
3a5d46e946
|
[Perf] pd: Stage decode-side KV preallocation lengths through pinned memory (#38955)
Co-authored-by: Jingshu Chen <96519051+elmo2019@users.noreply.github.com>
|
2026-10-16 00:34:56 -07:00 |
|
Xiaoyu Zhang
|
51faf52305
|
[Fix] monokernels: Honor resolved CUDA graph configuration (#44630)
|
2026-10-16 15:06:14 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
44be30d216
|
[Chore] deps: Bump FlashInfer to 0.7.2 (#44591)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-15 22:51:21 -07:00 |
|
Shu Wang
|
83940471b4
|
[Fix] [NVIDIA] allreduce-fusion: Decline MNNVL fusion across NVLink cliques (#44387)
|
2026-10-15 22:50:33 -07:00 |
|
Yuwei An
|
06934575b9
|
[Fix] DSv4.1: Fix BCG image handling and add multimodal bounded replay coverage (#44131)
|
2026-10-15 22:32:55 -07:00 |
|
 
|
2a08e261ec
|
[Feat] MiniCPM-V-4.7: add model support (#41993)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-10-16 13:24:48 +08:00 |
|
 Kolade FajimiandXiaoyu Zhang
|
5117bfbaeb
|
[Fix] compressed-tensors: Serve NVFP4 W4A4 linears via FP4 Marlin when --fp4-gemm-backend marlin is set on SM100 (#44213)
Signed-off-by: kolade fajimi <fajimikolade23@gmail.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-16 12:36:02 +08:00 |
|
HuangJi
|
6d70787398
|
[Fix] diffusion: Align Qwen-Image 2.1 resolution and handle RGBA JPEG output (#44275)
|
2026-10-16 12:35:04 +08:00 |
|
Mick
|
3420baea8c
|
[diffusion] CI: batch performance failure-policy runner scenarios (#44508)
|
2026-10-16 11:04:05 +08:00 |
|
 ashwini rathiandClaude Opus 5.5
|
75e25a21bd
|
[Fix] [XPU] nightly: Fix rerank, zimage, flux2 and EAGLE parity (#44100)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 10:27:51 +08:00 |
|
 Chetan Kumar VermaandClaude Sonnet 5
|
75e77fca25
|
[Fix] wan: fix opt-in Wan2.2 progressive mode and one-step transitions (#43768)
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
|
2026-10-16 10:22:09 +08:00 |
|
Shuwen Wang
|
f9df33494a
|
[Fix] scheduler: Keep PD decode non-idle while deferred KV releases are held (#44386)
|
2026-10-15 19:17:51 -07:00 |
|
 Chetan Kumar VermaandClaude Opus 5.5
|
1e33d2c4bd
|
[Perf] [XPU] usp: Enable packed Ulysses QKV all-to-all (#39989)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-16 10:08:50 +08:00 |
|
 
|
4e85e8ed37
|
[Fix] imports: Bind FlashInfer lazily at four import sites so the server starts without it (#44430)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: yeqcharlotte <yeqcharlotte@users.noreply.github.com>
|
2026-10-15 18:52:33 -07:00 |
|
 
|
e3961eb6fa
|
[Fix] utils: Allowlist torch.bcomplex32 in SafeUnpickler (#44440)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: zx3xyy <zx3xyy@users.noreply.github.com>
|
2026-10-15 17:50:43 -07:00 |
|
 
|
f110b2f801
|
[Feat] rust-server: Report cached_tokens and reasoning_tokens in meta_info (#44531)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 17:50:27 -07:00 |
|
 
|
d393298736
|
[Fix] tokenizer_manager: re-report only emitted customized_info keys on cumulative streams (#44537)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 17:49:49 -07:00 |
|
 metamergebotandYe Qi
|
bda6ef7e01
|
[Perf] [NVIDIA] scheduler: Pageable host staging and inline hidden-state/DSpark readback under Confidential Computing (#44568)
Co-authored-by: Ye (Charlotte) Qi <7269575+yeqcharlotte@users.noreply.github.com>
|
2026-10-15 17:48:50 -07:00 |
|
 
|
ed8c3139f1
|
[Fix] deepseek-v4.1: Keep the full SWA window for short bounded-replay extends (#41303)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-15 17:32:50 -07:00 |
|
Khoa Pham
|
a93f16f0cf
|
[Perf] deepseek-v4.1: Integrate FlashMLA MegaAttention with NVFP4 KV (#43922)
|
2026-10-15 17:21:43 -07:00 |
|
Liangsheng Yin
|
d14fa5db9b
|
[Perf] pd: Copy prebuilt decode batch inputs to the GPU without host syncs (#44598)
|
2026-10-15 17:20:02 -07:00 |
|
Khoa Pham
|
4cca7fcd3e
|
chore: bump sgl-kernel version to 0.4.10 (#44590)
|
2026-10-15 15:50:51 -07:00 |
|
 
|
ec7ab9d0c2
|
[Feat] [AMD] monokernels: one runtime switch for vendor monokernel plugins (#44353)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-15 15:50:25 -07:00 |
|
 
|
0b1a73599a
|
[Feat] rust-server: Apply the x-override-* request headers (#44312)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 15:50:04 -07:00 |
|
William Hu
|
4e0609ea27
|
[Fix] moe: Preserve negative routing sentinel in EP mapping (#40498)
|
2026-10-15 15:05:08 -07:00 |
|
Yuwei An
|
91f6ef2322
|
[DSv4.1] Fuse request-window KV copies (#44555)
|
2026-10-15 14:11:51 -07:00 |
|
snadampal
|
aa5c7e887c
|
[Feat] docker: Add AWS EFA image variants built on published images (#41006)
Signed-off-by: Sunita Nadampalli <nadampal@amazon.com>
|
2026-10-15 13:19:22 -07:00 |
|
 Ziyi XuandClaude Opus 5.5
|
bc76a6b819
|
[DSv4] Sparse prefill: build compressed lengths without a host sync (#44557)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-15 12:45:56 -07:00 |
|
  
|
87211088c9
|
perf: fix overlap scheduling for NVIDIA Confidential Computing(CC) on Blackwell (#36810)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-15 12:09:09 -07:00 |
|
 
|
02a43eeef6
|
[Feat] rust-server: Attach configured metadata headers to a healthy /health_generate (#44315)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-15 12:04:23 -07:00 |
|
 
|
173e0f2e9b
|
[Feat] hicache: Add opt-in tail-only SWA backups in buffer mode (#44173)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-15 12:02:59 -07:00 |
|