Commit Graph
12987 Commits
Author SHA1 Message Date
Kangyan-Zhou 32352f7edf [CI] Fix bot-cherry-pick: use state == "MERGED" instead of invalid merged field (#25987) 2026-05-21 20:10:12 +08:00
Shangming Cai fbebdd5105 [CI] Enable nixl disaggregation test for decode radix cache (#25990) 2026-05-21 19:29:24 +08:00
loading66 2e0d2d4c18 [NPU][DOCS]Add best practice and benchmark result parameter description (#25875) 2026-05-21 19:08:10 +08:00
Kangyan-Zhou 64f21b1589 [CI] Improve bot-cherry-pick: accept PR number, require merged, explicit title (#25981) 2026-05-21 18:32:57 +08:00
8562d5ae94 [AMD] Relaxing Timeout for AMD stage-a (#25978)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
Co-authored-by: bingxche <bingxche@amd.com>
2026-05-21 17:32:51 +08:00
jianzhao-xu f66881f03c [NPU]Ascend NPU Performance Profiling Guide and Ascend NPU Operator Development Guide (#25384) 2026-05-21 17:32:25 +08:00
Bingxu ChenandCursor e72e3145a0 [AMD] Upgrade AITER (#25896)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-21 02:10:43 -07:00
Liangsheng Yin baeac179f7 [Spec] Route seq_lens through FutureMap; drop verify_done.wait (#25879) 2026-05-21 01:51:40 -07:00
DarkSharpnessandClaude 19f55c0e6d [Refactor] major JIT kernel clean up for dsv4 (#25884)
Co-authored-by: Claude <noreply@anthropic.com>
2026-05-21 01:14:31 -07:00
Liangsheng Yin 1b3d8da827 cap API quota for runner-utilization / amd-ci-job-monitor (#25965) 2026-05-21 01:13:37 -07:00
hxie c3f9bc9818 Fix nixl mla key and backup skipping (#24376) 2026-05-21 00:48:28 -07:00
看海的人 b9ae8353d2 [NPU] Support model DeepSeek-OCR and DeepSeek-OCR-2 (#25257) 2026-05-21 15:21:20 +08:00
Liwansi 190488e9a8 [NPU] Support chunk prefill for Qwen3.5/Qwen3.6 models (#25839) 2026-05-21 14:44:25 +08:00
Kangyan-Zhou 4ea8282cb7 [Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938) 2026-05-21 14:36:56 +08:00
Xinyuan Tong 40faf44f7a [auto-detect] match Ring-2.6/Ling XML kv tool-call format via vocab signature (#25366) 2026-05-20 23:34:52 -07:00
Bingxu ChenandCursor Agent 45cadc215f [AMD][CI] Clean up AMD nightly + pr-test workflows (#25266)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-05-20 23:30:26 -07:00
ybyang b5b9c809e1 fix(model-gateway): rustfmt nightly in conversations/handlers.rs (#25947) 2026-05-20 23:29:51 -07:00
sushil Dubey c4f14650b9 fix act fun for xpu (#23809) 2026-05-21 14:02:21 +08:00
Lianmin ZhengandJaewon 8fa56a0ab1 Fix FlashInfer A2A token cap sizing (#25907)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
2026-05-20 23:01:28 -07:00
xutizhou e8608bdcb5 Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367) 2026-05-20 22:58:08 -07:00
Charles Chen 847cbada9c Support Gemma4 MoE NVFP4 (#25054) 2026-05-20 22:45:15 -07:00
Cheng WanandClaude Sonnet 4.6 888a8794ef [Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 22:38:12 -07:00
YAMY 3a6de13cd8 perf(dsv4): add MHC token-count prewarm (#25810) 2026-05-20 22:22:41 -07:00
Mick 1ac3e33622 [diffusion] optimize: enable inference mode in pipeline executor (#25891) 2026-05-21 13:20:24 +08:00
Brilliant Hanabi e56db8bd24 fix: use base GPU ID CUDA device for multimodal processor (#21191) 2026-05-21 13:18:37 +08:00
84ea47eb22 [CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-05-21 13:09:18 +08:00
Cheng WanandClaude Sonnet 4.6 79b937aefb [Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 21:26:32 -07:00
YC Yen-Ching Tseng 90efa9c83f [AMD] Fix AMD stage-a-test-small-1-gpu (#25932) 2026-05-20 20:51:49 -07:00
Randall LinandCursor 791a2f057f Add overridable hooks for custom chat serving implementations (#25807)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-21 11:21:25 +08:00
Zheng Wengang 74c6294ba9 [BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759) 2026-05-21 11:07:21 +08:00
Mohammad Miadh Angkad a449ee4822 [Deps] Use cu13 extra for nvidia cutlass dsl (#25576) 2026-05-21 10:31:27 +08:00
jiayisunxandMa Mingfei 34479c19bd [XPU] upgrade triton-xpu version to 3.7.1 (#25730)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-21 10:29:20 +08:00
Kangyan-ZhouandClaude Opus 4.7 4868b92d47 [CI] Fix bot-cherry-pick auth: GITHUB_TOKEN for push, dedicated PAT for PR (#25926)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-21 10:28:42 +08:00
Cheng WanandClaude Sonnet 4.6 a528eb7564 fix: rustfmt service_discovery.rs warn! line length (#25927)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 19:25:11 -07:00
silencejade e603beab55 [NPU] Add Qwen3.5-397B-A17B best practice doc (#25594) 2026-05-21 10:02:12 +08:00
Hanming Lu ddf3817924 Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917) 2026-05-20 18:49:01 -07:00
Pai Liu cf1fd26d16 benchmark/lora: make number of LoRA adapters configurable (#25363) 2026-05-20 18:23:13 -07:00
Kevin Flansburg 643d44d699 [BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226) 2026-05-20 18:20:19 -07:00
Lianmin Zheng c4a7d12092 Enable breakable CUDA graph for eagle (#25795) 2026-05-20 18:02:04 -07:00
huangtingweiandZhiqiang Xie f9f82d238c fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-05-20 17:28:38 -07:00
Liangsheng Yin 512d164916 Address overlap future token map by request-pool index (#25862) 2026-05-20 16:34:00 -07:00
grunerandAmit Gruner b7d0df4b6f [SMG] Support regular worker discovery alongside PD workers in IGW mode (#25294)
Co-authored-by: Amit Gruner <agruner@crusoe.ai>
2026-05-21 07:23:55 +08:00
Kaixi 9f2bc24b35 Fix/dsv4 flash eagle dummy ima (#25892) 2026-05-20 15:41:28 -07:00
BingjiaWang ce7141ef98 add git gemm warpper for dispatch_bf16_fp32_backend (#25860) 2026-05-20 15:24:10 -07:00
Hanming Lu 371b6c9ea0 [Scheduler] fix chunked prefill not always being full (#25741) 2026-05-20 15:03:11 -07:00
Qiaolin Yu 1a17d753f1 [perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460) 2026-05-20 14:20:49 -07:00
Yuzhen Zhou dac78768f0 [RL][TITO] Preserve whitespace in reasoning parser outputs (#24251) 2026-05-20 19:45:09 +00:00
YAMY 801d7e3eed [DSA] Make MQA logits free memory ratio configurable (#25859) 2026-05-20 12:27:16 -07:00
Ratish P 5e7bf73757 Fix bench_serving non-stream reasoning content (#25298) 2026-05-20 18:41:46 +00:00
jasonjk-park 1f209b4433 Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681) 2026-05-20 11:34:45 -07:00