 AaravandAarav
|
d5d87899f9
|
[Fix] DSA: skip-topk pipeline handoff for owed outputs (#43832)
Co-authored-by: Aarav <211792885+AaravMehta-07@users.noreply.github.com>
|
2026-10-16 14:35:23 -07:00 |
|
 Khoa PhamandTrevor Morris
|
71b60fa46c
|
[Fix] engram: Avoid blocking history copies during PD admission (#44787)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
|
2026-10-16 14:29:05 -07:00 |
|
 
|
2948662026
|
[Perf] dp-attention: Exchange the scheduler's MLP sync rows with gather + broadcast on gloo (#44622)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: hanming-lu <hanming-lu@users.noreply.github.com>
|
2026-10-16 13:53:41 -07:00 |
|
 metamergebotandmetamergebot
|
f39c2693aa
|
[CI] rust-server: Raise the ChunkEvent frame-size cap to 152 bytes (#44773)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-16 13:47:52 -07:00 |
|
Chunan Zeng
|
07950be745
|
[Perf] [NVIDIA] custom-all-reduce: Add 2shot_push all-reduce and retune SM100 TP4/TP8 (#42811)
|
2026-10-16 13:43:18 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
21791e7023
|
[CI] [NVIDIA] DSv4.1-Flash: Split GB300 accuracy test into one file per config (#44696)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-16 13:40:03 -07:00 |
|
 metamergebotandmetamergebot
|
a31a8c2bbd
|
[CI] tests: Let test_hicache_storage size its host cache to the runner (#44729)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-16 13:38:39 -07:00 |
|
Liangsheng Yin
|
a18a908066
|
[Test] mem_cache: Free SWA peers below the eviction floor in the SWA repair test (#44777)
|
2026-10-16 12:41:39 -07:00 |
|
+14        
|
456231e251
|
[Feat] kernels: Add muse spark operators and collective GEMM (2/5) (#44665)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-16 10:49:35 -07:00 |
|
 ormandjandhnyls2002
|
80c54e6ac5
|
[Fix] [AMD] hicache: Serve encoder-replay prefix hits with a paged DSpark draft SWA (#42716)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-16 10:45:16 -07:00 |
|
 
|
553068af25
|
[Fix] rust-server: Honour cache_salt and require_reasoning on /generate (#44533)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 10:38:09 -07:00 |
|
 
|
453b251dbd
|
[Fix] hicache: Bound the storage prefetch timeout from the first blocked admission poll (#44614)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-16 10:37:11 -07:00 |
|
 metamergebotandjiayisuse
|
989ccf4863
|
[Feat] disaggregation: Let a KV transfer backend skip the checksum for an incomparable peer (#44605)
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-16 10:36:46 -07:00 |
|
 
|
63a9b7a713
|
[Feat] http_server: Make the multi-worker ASGI app path configurable (#44583)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-16 10:36:35 -07:00 |
|
 
|
26a2f18c02
|
[Feat] sglang-server: serve /v1/loads from the Rust frontend (#44532)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-16 10:35:37 -07:00 |
|
Xinyuan Tong
|
a038a0dca0
|
[Fix] dsv41: Preserve tool-result image order and current-turn thinking (#44751)
|
2026-10-16 23:39:50 +08:00 |
|
Duyi-Wang
|
ed2ebad342
|
[Doc] [AMD] cookbook: Refresh DeepSeek V4 AgentX PD recipe optimizations (#44454)
|
2026-10-16 23:34:01 +08:00 |
|
 Jimmy ShongandJimmy Shong
|
2c2986be2b
|
docs: add Beam 1.0 deployment cookbook (#44694)
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
|
2026-10-16 13:29:14 +00:00 |
|
 Benjamin TruongandClaude Opus 5.5
|
7c99ace127
|
[Fix] dsa: Fix ragged seed indices before MTP draft decode (#42565)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 19:37:41 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
5e240a200d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.5 and DeepSeek-V4.1-Flash GB300 (#44712)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-16 19:31:08 +08:00 |
|
 Xinyi SongandHAI
|
4afae5568b
|
[Perf] [AMD] dsv4: Add a separate MegaMoE decode instance (#44657)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-16 03:11:02 -07:00 |
|
 
|
2adc76ad61
|
[Perf] [AMD] dsv4: reuse the q_lora fp8 quant for the C4 indexer wq_b (4/8) (#41903)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:55:25 -07:00 |
|
YC Yen-Ching Tseng
|
9246acd462
|
[CI] [AMD] aiter: pin aiter commit to 2bb549 for rocm10.1 gfx1250 (#44620)
|
2026-10-16 17:50:20 +08:00 |
|
 kkandDuyi-Wang
|
baf451fcd6
|
[Perf] [AMD] dsv4: carry aiter DSv4 GEMM tuned rows and mHC tile_m=16 until aiter ships them (7/8) (#44008)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:47:41 -07:00 |
|
 
|
f05da43d44
|
[Feat] [AMD] disagg: Support DSV4 decode radix cache on ROCm unified KV (bf16/fp8, DSpark) (#30929)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:39:27 -07:00 |
|
 
|
42eb556e66
|
[Perf] [AMD] dsv4: optional e8m0 mxscale GEMM for dense 128x128 fp8 linears (6/8) (#44007)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-10-16 02:28:31 -07:00 |
|
caihuali95
|
8d229d96e0
|
[Fix] unified-memory: enabling trtllm_mha with decode graphs and speculative decoding (#42930)
|
2026-10-16 02:24:06 -07:00 |
|
 kkandDuyi-Wang
|
6efc96abf9
|
[Perf] [AMD] dsv4: FP4 indexer on aiter's row-group kernel for decode and target-verify (5/8) (#44006)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:16:06 -07:00 |
|
 kkandDuyi-Wang
|
9fde8bcc46
|
[Perf] [AMD] moe: small-batch sort with histogram + bitonic sort for 32 < P <= 256 (3/8) (#44004)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 02:09:32 -07:00 |
|
 kkandDuyi-Wang
|
f0ff18353d
|
[Perf] [AMD] dsv4: fp8 verify writes the SWA ring in the fused norm/rope kernel (2/8) (#44003)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 01:58:00 -07:00 |
|
 MingyiandZijie Xia
|
56a3c4fa16
|
[Doc] cookbook: Add RTX Spark Qwen3.6 NVFP4 recipe (#44707)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-10-16 01:55:41 -07:00 |
|
Liangsheng Yin
|
81c9d804b0
|
[CI] pr-check-comment: Comment on PRs when lint or title check fails (#44708)
|
2026-10-16 01:54:38 -07:00 |
|
 kkandDuyi-Wang
|
ab5858ac8a
|
[Perf] [AMD] dsv4: fp8 unified_kv decode/verify on FlyDSL v4 nm decode with a latency-model split plan (1/8) (#44016)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
|
2026-10-16 01:50:16 -07:00 |
|
 Xinyuan Tongandzijiexia
|
9baace8456
|
[Doc] cookbook: refresh MiniCPM-V 4.7 DSPARK benchmarks at the final model PR head (#44310)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-16 01:48:25 -07:00 |
|
  
|
3d61bdd2c9
|
[Feat] sgl-router: Serve the remaining native gRPC inference RPCs (#42681)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-16 16:23:17 +08:00 |
|
 kkandwunhuang
|
536cdb4b04
|
[Feat] [AMD] docker: Install the sgl-amd-mono monokernel plugin in the ROCm image (#44621)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-16 01:20:40 -07:00 |
|
Liangsheng Yin
|
fad7d95a7f
|
[Fix] deepseek-v4.1: Keep the DSpark draft SWA out of the radix tree (#44673)
|
2026-10-16 01:18:58 -07:00 |
|
Baizhou Zhang
|
06b81b120e
|
[CI] deepgemm: Increase B200 release test timeout to 180 minutes (#44706)
|
2026-10-16 01:14:54 -07:00 |
|
 kkandwunhuang
|
bdc4ec15ce
|
[Perf] [AMD] dspark: No per-step host sync in decode (1/4) (#44405)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-16 01:13:37 -07:00 |
|
 ZiruandNiu Ziru
|
5dd37af412
|
[Doc] [XPU] Cookbook: Update the XPU Docker version to 0.5.22 (#44647)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-16 16:13:24 +08:00 |
|
jiaqiang-dot-liu
|
a448fdf316
|
[Perf] [AMD] qwen3: Fuse QK-norm + RoPE + KV cache write for dense Qwen3 decode (#44267)
|
2026-10-16 00:51:55 -07:00 |
|
amote-i
|
9d394dfbd7
|
[Doc] [NPU] docs: refresh associated dependency versions in npu docs (#44695)
|
2026-10-16 15:48:37 +08:00 |
|
Ziang Li
|
7098ec387c
|
[Feat] FlashInfer: Add NVFP4 W4A16 and SiTU support to MegaMoE (#44036)
|
2026-10-16 00:38:50 -07:00 |
|
 Liangsheng YinandJingshu Chen
|
3a5d46e946
|
[Perf] pd: Stage decode-side KV preallocation lengths through pinned memory (#38955)
Co-authored-by: Jingshu Chen <96519051+elmo2019@users.noreply.github.com>
|
2026-10-16 00:34:56 -07:00 |
|
Xiaoyu Zhang
|
51faf52305
|
[Fix] monokernels: Honor resolved CUDA graph configuration (#44630)
|
2026-10-16 15:06:14 +08:00 |
|
Baizhou Zhang
|
dfc89580f1
|
[Doc] cookbook: Add Muse Spark Open SWA ratio calculator (#44687)
|
2026-10-16 00:00:12 -07:00 |
|
amote-i
|
92580581da
|
[Doc] [NPU] docs: Freeze qwen3-235b-a22b recommended image to a fixed version (#44650)
|
2026-10-16 14:14:05 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
44be30d216
|
[Chore] deps: Bump FlashInfer to 0.7.2 (#44591)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-15 22:51:21 -07:00 |
|
Shu Wang
|
83940471b4
|
[Fix] [NVIDIA] allreduce-fusion: Decline MNNVL fusion across NVLink cliques (#44387)
|
2026-10-15 22:50:33 -07:00 |
|
+14        
|
e1d20574da
|
[Chore] docker: Add muse spark CUDA image and DeepGEMM patches (1/5) (#44664)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Ethan Che <eche@meta.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Jiajun Li <guapisolo@gmail.com>
Co-authored-by: Jiajun Li <jiajun.li@radixark.ai>
Co-authored-by: Jimmy Shiu <jimmysh341@gmail.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Wookje Han <52435620+wookjeHan@users.noreply.github.com>
Co-authored-by: Wookje Han <wookjeh@nvl72d079-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d094-T17.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d157-T16.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d170-T04.cm.cluster>
Co-authored-by: Wookje Han <wookjeh@nvl72d214-T17.cm.cluster>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Yuhao Yang <yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: ethche <ethche@gmail.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-10-15 22:46:22 -07:00 |
|