 
|
720617bb5b
|
[AMD] Reuse KV gather indices across ASM context prefill layers (#39901)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-22 12:08:05 -07:00 |
|
Shangming Cai
|
6f4c2b9b91
|
[HiCache] Demote internal-node mamba states on write_back eviction (#40680)
|
2026-09-23 02:18:58 +08:00 |
|
Cheng Wan
|
91c329cc86
|
Take the model config out of the parallel group build, and finish retiring the parallel getters (#40707)
|
2026-09-22 10:55:21 -07:00 |
|
Pei Li
|
66454d704b
|
[Feature] Support --tokenizer-worker-num > 1 in the offline Engine API (#40260)
|
2026-09-22 10:50:01 -07:00 |
|
 YAMYandzhangxiaolei
|
6fd98c98b9
|
[Qwen3.8-Next] Pipeline-parallel serving and PD-prefill MTP for Qwen4-Exp (#40501)
Co-authored-by: zhangxiaolei <zhangxiaolei.666@bytedance.com>
|
2026-09-22 08:46:44 -07:00 |
|
 
|
c79510cc2a
|
[DSv4.1] Score prefill consumer index layers on candidate blocks with DeepGEMM (#40352)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
|
2026-09-22 22:06:06 +08:00 |
|
 
|
4a1b69abc8
|
[diffusion] docs: correct the resident-layer help text to match its scope (#40593)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-22 20:32:59 +08:00 |
|
pllimax
|
244db08d60
|
[NPU][CI] Constrain evalscope dependency versions (#40133)
|
2026-09-22 20:15:11 +08:00 |
|
Wookje Han
|
bc3a63ebdb
|
[Fix] Missing SWA eviction during decode preallocation (#40309)
|
2026-09-22 20:11:40 +08:00 |
|
Shunkangz
|
ddebc52f23
|
[kv-shard 3/4] Enable Control plane (#38468)
|
2026-09-22 19:57:44 +08:00 |
|
 
|
2524b61f9b
|
[diffusion] feat: allow a component use retain its layerwise resident set (#40592)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-22 19:56:21 +08:00 |
|
Shangming Cai
|
861b11f087
|
[PD] Simplify late-abort quiescent ack branch to else (#40711)
|
2026-09-22 19:08:47 +08:00 |
|
cctry
|
8ef6d31cb9
|
[PD] Preserve abort ACKs until in-flight KV transfers drain (#40645)
|
2026-09-22 18:46:07 +08:00 |
|
 Emre AlbayrakandXiaoyu Zhang
|
9d58189c12
|
[diffusion] attention: add fp8_fa_sm120 FP8 backend for SM120 GPUs (#40175)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-22 17:44:37 +08:00 |
|
 
|
debbb5cde9
|
[AMD] Drop the redundant scale zero-fill before AITER per-tensor FP8 quant (#40557)
Co-authored-by: siliangchen-amd <{"message":"Although you appear to have the correct authorization credentials, the `amd-eng-emu` enterprise has an IP allow list enabled, and your IP address is not permitted to access this resource.","documentation_url":"https://docs.github.com/rest/users/users#get-the-authenticated-user","status":"403"}siliangchen-amd@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-22 17:43:31 +08:00 |
|
Zhaoyi Li
|
70a2bb2a30
|
[AMD][DI] Keep loopback in UCX_NET_DEVICES (#40641)
|
2026-09-22 02:15:18 -07:00 |
|
 jacky.chengandchuyeh
|
790551c382
|
[AMD] Skip full-vocab softmax in EAGLE topk==1 draft on ROCm (#35872)
Co-authored-by: chuyeh <chuyeh@users.noreply.github.com>
|
2026-09-22 01:57:37 -07:00 |
|
 chuyehandjacky.cheng
|
c2f14bfbc4
|
[AMD] Use exact CU share for gfx950 segment-plan headroom (#39503)
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-22 01:49:59 -07:00 |
|
inkcherry
|
367e3700cf
|
avoid host sync in DSpark prefill slot expansion (#40111)
|
2026-09-22 01:20:49 -07:00 |
|
 
|
6412ad8c64
|
[AMD] Pack Qwen3.5 GDN input projections on ROCm (#39902)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-22 00:52:40 -07:00 |
|
Po-Han Huang (NVIDIA)
|
771c9d782d
|
[PD] Validate Mooncake EFA allocator compatibility (#39973)
|
2026-09-22 15:12:29 +08:00 |
|
Suraj
|
1815e490de
|
[observability] Fix negative queue_time for retracted requests (#39312)
|
2026-09-22 15:08:01 +08:00 |
|
Kevin Mi
|
8ac19cc19f
|
[AMD][Kimi-K3] Fix deferred KDA gate projection and update DCP cookbook (#39066)
PR Test (Arm64) / check-changes (push) Successful in 10s
PR Test (NPU) / set-image-config (push) Successful in 1s
PR Test (NPU) / Recommend tests from coverage (push) Skipped
PR Test (NPU) / check-changes (push) Successful in 12s
PR Test (sgl-router) / gate (push) Successful in 8s
PR Test (Xeon) / check-changes (push) Successful in 9s
PR Test (XPU) / check-changes (push) Successful in 16s
pr-test-arm64.yml / pr-gate (push) Successful in 3s
PR Test (Arm64) / pr-gate (push) Successful in 3s
pr-test-npu.yml / pr-gate (push) Successful in 2s
PR Test (NPU) / pr-gate (push) Successful in 2s
PR Test (sgl-router) / tier-1 — lint (push) Failing after 33s
PR Test (sgl-router) / tier-2 — build + test (push) Skipped
PR Test (sgl-router) / tier-3 — docker (placeholder) (push) Skipped
PR Test (sgl-router) / tier-3 — k8s integration (push) Skipped
PR Test (sgl-router) / tier-3 — e2e (push) Skipped
pr-test-xpu.yml / pr-gate (push) Successful in 2s
PR Test (XPU) / pr-gate (push) Successful in 2s
pr-test-xeon.yml / pr-gate (push) Successful in 3s
PR Test (Xeon) / pr-gate (push) Successful in 3s
PR Test (sgl-router) / finish (push) Successful in 1s
Lint / lint (push) Failing after 2m51s
PR Test (NPU) / base-a-test-1-npu-a2 (push) Canceled after 0s
PR Test (NPU) / base-b-test-1-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-4-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-8-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-b-test-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (0) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (1) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-4-npu-a3 (0) (push) Canceled after 0s
PR Test (NPU) / multimodal-gen-test-4-npu-a3 (1) (push) Canceled after 0s
PR Test (NPU) / base-c-test-acc-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-acc-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-perf-2-npu-a3 (push) Canceled after 0s
PR Test (NPU) / base-c-test-perf-16-npu-a3 (push) Canceled after 0s
PR Test (NPU) / Analyze failure report (push) Canceled after 0s
PR Test (NPU) / setup-covstub (push) Canceled after 0s
PR Test (NPU) / pr-test-npu-finish (push) Canceled after 0s
pr-test-npu.yml / run (${{ fromJson(inputs.partitions).arr }}) (push) Canceled after 0s
PR Test (XPU) / finish (push) Canceled after 0s
PR Test (Arm64) / build-test (push) Canceled after 0s
PR Test (XPU) / stage-a-test-1-gpu-xpu (push) Canceled after 0s
PR Test (XPU) / multimodal-gen-test-1-gpu-xpu (push) Canceled after 0s
PR Test (Xeon) / build-test (gnr, gnr, xeon-gnr, stage-a-tp-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr1, 0, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr2, 1, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
PR Test (Xeon) / build-test (spr3, 2, 3, spr, xeon-spr, stage-a-test-cpu-intel,stage-b-test-cpu-intel) (push) Canceled after 0s
|
2026-09-22 06:35:12 +00:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
4c81cd1b09
|
[KDA] Fix missing beta sigmoid in PTX prefill (#40685)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-21 23:24:38 -07:00 |
|
Khoa Pham
|
bc22e1de9e
|
[DSpark] Fix draft CUDA graph stream explosion (#40658)
|
2026-09-21 23:05:45 -07:00 |
|
 Guangda LiuandGuangda Liu
|
04c0913434
|
[HiSparse] Add MHA hisparse support for MiniMax M3 (#31446)
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
|
2026-09-22 13:28:03 +08:00 |
|
    
|
095e45100b
|
[AMD] [GLM-5.3-Flash Day 0] Route mHC through AITER on gfx950 (#38545)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 22:24:29 -07:00 |
|
Piotr Mazurek
|
b01961e295
|
[LFM2-VL] Add DSpark speculative decoding (#40651)
|
2026-09-21 21:49:51 -07:00 |
|
YAMY
|
9b59fc5db5
|
[ModelOpt][PP] Keep BF16 shared experts out of the NVFP4 fusion so TP1 pipeline stages can load (#40628)
|
2026-09-21 21:45:58 -07:00 |
|
 
|
a9f02b0fa4
|
[NPU] Fix xgrammar apply_vocab_mask device dispatch to use torch.ops.npu (#36120)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-09-21 21:34:15 -07:00 |
|
 
|
877a293d6d
|
[Benchmark] Optionally clear HiCache storage between cases (#40659)
Co-authored-by: metamergebot <324680979+metamergebot@users.noreply.github.com>
Co-authored-by: Pengchao Wang <wpc@fb.com>
|
2026-09-21 21:31:21 -07:00 |
|
    
|
e1daf68304
|
[AMD] [GLM-5.3-Flash Day 0] Honor fused and per-expert names in quark exclude (#39317)
Co-authored-by: Yikai Zhang <ykzhang12@gmail.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-21 21:26:42 -07:00 |
|
 Khoa PhamandQiaolin Yu
|
018b73c7a0
|
[PD] Pack draft KV head slices for DCP transfers (#40500)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-09-21 21:11:27 -07:00 |
|
    
|
b44e248682
|
[AMD] [GLM-5.3-Flash Day 0] Enable FP8 and Quark MXFP4 MoE on gfx950 (#38546)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-21 21:07:37 -07:00 |
|
jthomson04
|
15ba54bd5d
|
perf(engine): avoid timed waits for Engine responses (#39486)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
|
2026-09-21 20:42:03 -07:00 |
|
 Jan BernlöhrandPo-Han Huang
|
56fee88e23
|
fix(moe): support Llama4 NVFP4 router input weights on SM120 (#35504)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-09-21 20:18:11 -07:00 |
|
   
|
90cf471723
|
[AMD] [GLM-5.3-Flash Day 0] Support non-2048 top-k widths in the DSA page-table transform (#39340)
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-09-21 19:50:17 -07:00 |
|
 
|
5f9c6b9eb0
|
[diffusion] fix: separate a use-scoped layerwise release from release_all (#40590)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-22 10:38:44 +08:00 |
|
 MickandMick Qian
|
a1b2b976fe
|
[diffusion] CI: restore public Qwen-Image 2.1 TP2 E2E coverage (#40507)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-22 10:38:00 +08:00 |
|
Yuhan Zhou
|
15eba3b464
|
Feat: Add TensorCast storage as a new HiCache backend (#27265)
|
2026-09-22 10:19:04 +08:00 |
|
jacky.cheng
|
bc30fa1759
|
[AMD][Fix] AgentX HIP TPOT regression when SGLANG_SIMULATE_ACC_LEN is set (#40598)
|
2026-09-21 19:16:15 -07:00 |
|
 Mohammad Miadh Angkadandmmangkad
|
e332e1b84e
|
[Fix] Don't write conv state from the fused KDA verify kernel (#39524)
Co-authored-by: mmangkad <mohammad.angkad@radixark.ai>
|
2026-09-21 18:33:03 -07:00 |
|
 Dayananda VandClaude Opus 5
|
35eb7cf8d6
|
[Intel][XPU][KVCanary] Enable KV Canary on Intel XPU (#33520)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-22 09:19:01 +08:00 |
|
Khoa Pham
|
c4d3770a68
|
[Kimi K3] Fix CUDA graph stream explosion (#40640)
|
2026-09-21 17:49:50 -07:00 |
|
jacky.cheng
|
31b577bb08
|
[AMD] Pad QSA MQA decode Q-heads to 16 for ROCm MFMA (#38875)
|
2026-09-21 17:43:46 -07:00 |
|
 
|
042b6a488f
|
[AMD] [GLM-5.3-Flash Day 0] Enable zero-RoPE MHA prefill on ROCm (#39338)
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
|
2026-09-21 17:38:07 -07:00 |
|
Cheng Wan
|
582389cec5
|
[Fix] Keep diffusion encoder TP context bindings consistent (#40646)
|
2026-09-21 17:23:15 -07:00 |
|
 Tao LiandXiaoyu Zhang
|
c53cc8e1eb
|
[NPU][BugFix] Avoid M-RoPE recompilation for variable sequence lengths (#40371)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-22 08:19:25 +08:00 |
|
avalliappan-nvidia
|
61d0cf2074
|
[Spec] Windowed draft-decode attention for built-in EAGLE / MTP drafts (#32673)
|
2026-09-22 08:17:57 +08:00 |
|
 Vedant V JhaveriandCopilot
|
9fdb71732a
|
Avoid materializing GDN QKV tensors during target verification (#33778)
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
2026-09-21 17:04:18 -07:00 |
|