Commit Graph
2920 Commits
Author SHA1 Message Date
Michael 54989b1fd0 [AMD] ci: add label-gated extra-a tier (kv_canary + mock_model unit tests) (#27822) 2026-06-12 15:12:56 -07:00
85712fa5b0 Fix Responses API request handling (#25881)
Co-authored-by: Kai-Hsun Chen <kaihsun@apache.org>
Co-authored-by: Kristin Cowalcijk <kristincowalcijk@gmail.com>
Co-authored-by: aerosta <63026763+aerosta@users.noreply.github.com>
Co-authored-by: glaziermag <glaziermag@users.noreply.github.com>
Co-authored-by: Blake Ledden <blake.ledden@gmail.com>
Co-authored-by: PanJason <pyyjason@gmail.com>
Co-authored-by: Leoyzen <leoyzen@gmail.com>
Co-authored-by: kennyu <966806+kennyu@users.noreply.github.com>
2026-06-12 14:47:55 -07:00
+3 b3270264e4 Fix Anthropic Messages API compatibility (#25876)
Co-authored-by: Jairo David Campaña Rosero <jairocampana10001@gmail.com>
Co-authored-by: Karan Bansal <3264937+karanb192@users.noreply.github.com>
Co-authored-by: eason <85663565+mango766@users.noreply.github.com>
Co-authored-by: Yufeng He <40085740+he-yufeng@users.noreply.github.com>
Co-authored-by: qingchanghan <17794466+qingchanghan@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Ajay Anubolu <124525760+AjAnubolu@users.noreply.github.com>
Co-authored-by: Ravitez Dondeti <13931987+dondetir@users.noreply.github.com>
Co-authored-by: Ratish P <114130421+Ratish1@users.noreply.github.com>
Co-authored-by: Xiaoshuai Zhang <15795935+jetd1@users.noreply.github.com>
Co-authored-by: Ricardo-M-L <69202550+Ricardo-M-L@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuan.tong@radixark.ai>
2026-06-12 14:46:57 -07:00
Michael 65d76bd3f6 [AMD] Fix CI base-a fwd_occupancy: disable SGLANG_SANITIZE_NAN_LOGITS in AMD CI (#28075) 2026-06-12 14:14:34 -07:00
ybyang 1e71c1a859 fix(pd): disable overlap for spec+grammar in disagg decode loop (#28039) 2026-06-12 14:08:36 -07:00
Zach Zhu 627ed3476b Fix invalid KVFP4QuantizeUtil references (#28013)
Signed-off-by: Zach Zhu <zzqshu@126.com>
2026-06-12 13:44:11 -07:00
David Wang bb33594c1a flashinfer swa kv pool fix (dflash gemma 4) (#27737) 2026-06-12 11:35:05 -07:00
cctry 75998d0421 Fix --mem-fraction-static not accounting for EAGLE draft model KV cache (#23862) 2026-06-12 10:35:48 -07:00
Yuan Luoandluoyuan.luo c80d8fe78a [Perf] Skip per-call mat_a/scales_a padding in cutlass FP8 blockwise GEMM (#27896)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-12 12:01:53 -04:00
qiaozpandishandhanani fcae6767d5 Add bucketed multi-dir layout for NIXL file storage (#27672)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-06-12 05:34:55 -07:00
luoroger37 18989f3d48 [PD] Fix resource leak on prealloc/transfer abort and idle check (#28022) 2026-06-12 18:20:24 +08:00
Bingxu Chen 1cd5cb1220 [AMD] [CI] Add dsv4 accuracy PR gate to pr-test-amd-rocm720 (#27149) 2026-06-11 23:42:16 -07:00
ashwini rathi fe887e6935 test(xpu): add multi-feature and embedding stage-b tests (#27861) 2026-06-12 14:36:28 +08:00
Bi Xueandispobock 3c1f9eafa5 [sgl] proactively release out-of-window SWA slots after chunked prefill (#27402)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-06-12 14:17:18 +08:00
Jumiar ca17bd8347 perf: eliminate CUDA syncs in VLM embed path (#26082) 2026-06-12 13:15:56 +08:00
0a1fb0da86 add LRU eviction for mooncacke embedding cache (#25954)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
2026-06-12 12:38:13 +08:00
syy-hw 3a3a759464 [NPU] Add Gemma4 Sliding Window Attention support on Ascend backend (#26147) 2026-06-12 11:44:38 +08:00
Yihao Wang f5c9f88ee2 [plugin][distributed] use active platform's backend in get_default_distributed_backend (#23969) 2026-06-11 20:05:17 -07:00
Liangsheng Yin 3ffe72517f [Spec] Remove the dead spec V1 scheduler paths (#27977) 2026-06-11 18:31:13 -07:00
Cheng Wan 2e74ff192c [DSV4] Use int64 for compressor out_loc tensors (#27973) 2026-06-11 17:45:34 -07:00
Cheng Wan 97a0031799 [lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984) 2026-06-11 17:38:05 -07:00
Liangsheng Yin c0480a88be [Spec] Retire Spec V1 (#27964) 2026-06-11 16:15:15 -07:00
Liangsheng Yin acdb39edd2 [Spec] Remove the DFLASH V1 worker path (#27959) 2026-06-11 14:37:58 -07:00
Michael 12d3f02be8 [AMD] Fix DSA device-to-host direct test on rocm720 (page_size%16 assert) (#27850) 2026-06-11 14:24:23 -07:00
Liangsheng Yin 1ac75c3463 [CI] Fix GB300 TestDummyWithSBO crash: disable NaN assert and coredump for dummy weights (#27955) 2026-06-11 14:17:03 -07:00
Xiaoyu ZhangandBBuf 1a6b5561db Fix MLA scaling when YARN scaling is disabled (#26203)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
2026-06-11 22:17:55 +08:00
shuwennandClaude Opus 4.8 66076f2409 [mem_cache][3/N] refactor: move HiSparse allocators to allocator/hisparse.py (#26678)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 19:50:24 +08:00
Mohammad Miadh Angkad 7e245afefe [CI] Fix registered sigmoid gate mul test location (#27909) 2026-06-11 18:52:37 +08:00
luoroger37 54cba63b6c Fix paged SWA free mapping cleanup (#27779) 2026-06-11 18:25:24 +08:00
Cheng Wan 9425ba2478 Remove extra_pytest_path from pr-test.yml (#27856) 2026-06-10 21:16:14 -07:00
Zhangheng 5e0271536a [UnifiedTree]: HybridModel launches HiCache via UnifiedTree by default. (#27759) 2026-06-11 12:03:36 +08:00
Cheng Wan f4f30d7d23 [Fix] Use int64 seq_lens across all CUDA graph runners and backends (#27840) 2026-06-10 19:54:58 -07:00
David Wang 588d1f7bc9 [Feature] Spec V2 DFlash Support (#23000) 2026-06-10 19:27:42 -07:00
Yongji Wuandhzh0425 db061e97c0 [Unified] Fix UnifiedRadixCache write_backup issue in write-back mode(#27108)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-06-11 08:28:24 +08:00
740305e1d9 [HiCache] Add opt-in LRU eviction to file storage backend (CP-aware) (#26670)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-11 08:21:59 +08:00
Baizhou Zhang 125ef88892 Disable async assert in Nemotron nightly tests (#27838) 2026-06-10 16:28:14 -07:00
Liangsheng Yin 16124fc9b2 [Metrics] Fix fwd_occupancy reading NaN on every decode log line; probe-free base-a (#27836) 2026-06-10 15:42:19 -07:00
Mohammad Miadh Angkad bdf3ef6421 [CI] Fix registered QK Gemma RMSNorm test location (#27839) 2026-06-10 15:21:59 -07:00
Baizhou Zhang 3c1b0fb226 [1/n] [CP] Simplify prefill context parallel server args (#27312) 2026-06-10 14:11:38 -07:00
shuwennandQiaolin Yu 3600a9ac5f [SPEC] feat: init adaptive spec params from config (#27493)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
2026-06-10 18:55:25 +00:00
billishyahaoandHAI 0ae27405d0 [AMD] Support eplb for moriep (#22985)
Co-authored-by: HAI <hixiao@gmail.com>
2026-06-10 10:23:51 -07:00
Kai-Hsun Chen 8c6bbe0658 [deepseek] Enable DP attention + TBO + shared experts fusion (#27510) 2026-06-10 09:42:27 -07:00
Michael 6a16f29af6 [AMD] ci: register 8 framework / unit tests to run on AMD CI (#25939) 2026-06-10 08:41:22 -07:00
Yuan Luoandluoyuan.luo 518e35fae7 [KDA] Add CuteDSL Prefill Kernel on SM100 (#27488)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-10 21:25:19 +08:00
Mohammad Miadh Angkad 4faaa9ba92 [CI] Fix stale ngram bookkeeping owner sites (#27803) 2026-06-10 04:51:46 -07:00
111009ea54 [Feature] [Ngram spec] Support ngram spec v2 (#17260)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Ratish P <114130421+Ratish1@users.noreply.github.com>
2026-06-10 02:46:00 -07:00
ChengYao-amdandgithub-actions[bot] 255843d454 Support for Zyphra zaya1 model (#26347)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-06-10 02:44:47 -07:00
DarkSharpnessandClaude b40f365732 [CI] Move misplaced mhc kernel test into test/registered/kernels (#27781)
Co-authored-by: Claude <noreply@anthropic.com>
2026-06-10 01:49:18 -07:00
Ziang Li 01f10acd06 Implement online nvfp4 quantization (#26083) 2026-06-10 00:26:51 -07:00
nbarzilie e76e4959b5 [CI][PD] Add unit tests for nixl backend (#26908) 2026-06-10 14:31:59 +08:00