Commit Graph
11225 Commits
Author SHA1 Message Date
amote-i 81efcc353a [NPU] Optimized the wording in the npu docs (#21998) 2026-04-03 11:51:40 +08:00
Baizhou Zhang efa7b2d5d3 Revert "[MUSA][9/N] Add FA3 attention backend support through MATE (MUSA AI Tensor Engine)" (#22002) 2026-04-02 20:42:13 -07:00
lviy 5f0df1e2ad [Bugfix] Fix incorrect dp-attention parallel info in bench_one_batch (#21519) 2026-04-02 20:13:53 -07:00
Yuhao Yang 69e89a1fcc [VLM] Enable per-image MM splitting by default and remove MULTI_IMAGES modality (#21899) 2026-04-03 11:04:41 +08:00
narutolhy 8897ac58f0 [PP] qwen3 vl skip layer id for pp (#19135) 2026-04-03 10:51:53 +08:00
Mook 991f3aa5b3 [Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+) (#19652) 2026-04-03 10:48:15 +08:00
Khoa Pham 2b5aed94f5 Remove maxItems=1 restriction when tool_choice is specified (#20208) 2026-04-03 02:35:24 +00:00
Thomasandzhangshuai 0539c62bc1 [Diffusion][NPU] Add support for MOVA (#21633)
Co-authored-by: zhangshuai (S) <z00836796@china.huawei.com>
2026-04-03 05:33:14 +03:00
Kangyan-ZhouandClaude Opus 4.6 1f97714f9b [CI] Add timeouts to Slack upload urlopen and WebClient (#21903)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 19:30:55 -07:00
Xiaoyu Zhang 89affff290 Skip broken AutoModel mapping entries when resolving Llava submodules (#21892) 2026-04-03 09:04:26 +08:00
Baizhou ZhangandClaude Opus 4.6 29d8e959d7 [CI] Remove stale Ascend suite entries from test/srt/run_suite.py (#21978)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 16:47:19 -07:00
Adarsh Shirawalmath 34ddf135fd [Feature] Stronger transformers modeling backend with TP, PP, MoE, VLMs, and torch compile (#19163) 2026-04-02 16:02:33 -07:00
oriandR0CKSTAR 939cf398a9 [MUSA][9/N] Add FA3 attention backend support through MATE (MUSA AI Tensor Engine) (#17985)
Co-authored-by: R0CKSTAR <xiaodong.ye@mthreads.com>
2026-04-02 15:04:31 -07:00
Ethan (Yusheng) Su 566b4a4f1c [4/n] Support gpt oss 20b lora (#21570) 2026-04-02 12:57:38 -07:00
Lianmin Zheng fe38410c3e Remove logging for subprocess watchdog start (#21968) 2026-04-02 11:30:33 -07:00
Feng Su 8732b2e9c6 [CI] [Tracing] Add ci for tracing and fix bugs (#21740) 2026-04-02 10:50:50 -07:00
Mick 2278a321ca [diffusion] chore: fix stage profiler for multi-stage denoising (#21955) 2026-04-03 01:16:38 +08:00
DarkSharpness df94cdcebb [Parallel State Refactor 1/n] Remove stream of PyNCCL (#20866) 2026-04-03 00:47:50 +08:00
Ke Bao b21db86e2f [CI] Fix gpu deps import in cpu test (#21950) 2026-04-03 00:06:31 +08:00
Todobe 083304ca44 [NPU] Support GLM-4.7-Flash on NPU (#21408) 2026-04-02 17:44:50 +08:00
Liangsheng YinandDarkSharpness 9d9537fbd3 Migrate ngram corpus from torch cpp_extension to TVM FFI jit_kernel (#21920)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-04-02 02:18:11 -07:00
Qiaolin Yu b684b0b72f Fix spec v2 + logprob when max_num_token is set (#20799) 2026-04-02 01:55:16 -07:00
foraxeandyunzhi e55a35fbcd test: add manual init test for mooncake transfer engine (#21842)
Co-authored-by: yunzhi <ningyunxiao.nyx@antgroup.com>
2026-04-02 16:01:10 +08:00
Baizhou Zhang c7d03a6215 Revert "Rollback flashmla to older version [1/2]" (#21922) 2026-04-02 00:27:02 -07:00
Baizhou Zhang fbc1f92453 [DSA] Set trtllm kernels as nsa default for Blackwell (#21914) 2026-04-02 00:22:27 -07:00
Yilong Zhao f30df723bf scheduler: add prefill-only update in merge batch (#21840) 2026-04-01 23:33:06 -07:00
Trevor Morris d24ea24e18 [NVIDIA] Enable fp8 flashinfer_trtllm_routed MoE for MiniMax-M2.5 (#20394) 2026-04-01 23:02:06 -07:00
Liangsheng Yin f25bf86065 Fix ngram doc for speculative_num_draft_tokens default (#21910) 2026-04-01 22:18:24 -07:00
Khoa Pham f836658077 [Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225) 2026-04-01 22:09:46 -07:00
Liangsheng Yin 269589ad71 Return HTTP 400 for streaming validation errors (#21900) 2026-04-01 21:58:12 -07:00
Khoa Pham 153359b4dd Multi tool streaming fix (#20004) 2026-04-01 21:53:05 -07:00
Mook 7a59e05dd1 [Kernel] Fuse temperature + softmax in sampling for decode speedup (#20501) 2026-04-02 12:46:36 +08:00
Kangyan-ZhouandClaude Opus 4.6 afa14ffac9 Skip Go stdlib and NVIDIA tool CVEs in Trivy scan (#21905)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 21:41:16 -07:00
Brayden Zhong cb0c2cbfdb Enable multi-thread weight loading by default (#20289) 2026-04-01 21:27:20 -07:00
Zhangheng fae66b4050 Support PP key for file backend (#21901) 2026-04-02 12:23:58 +08:00
David Cheung ed427e1299 Migrate all callers from /get_server_info to /server_info (#21463) 2026-04-01 21:17:50 -07:00
Prozac614andMick 24997fe42c [diffusion] CI: add initial nvfp4 ci test for b200 (#21767)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-04-02 11:31:08 +08:00
Kangyan-Zhou 648632b6c4 [CI] Remove crashing Kimi K2.5 EAGLE3/MTP variants, keep TP8 and TP8+DP8 (#21898) 2026-04-01 20:27:24 -07:00
Kangyan-Zhou 9a7f198343 [CI] Increase multimodal server test timeout from 60 to 90 minutes (#21897) 2026-04-01 20:19:45 -07:00
Liangsheng YinandClaude Opus 4.6 875a615993 fix(ci): update est_time for 57 tests based on runtime analysis (#21896)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 20:16:13 -07:00
Yuhao Yang 2ef12073f4 [VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841) 2026-04-01 20:09:47 -07:00
Shangming Cai 7004df6094 chore: bump mooncake version to 0.3.10.post1 (#21844) 2026-04-02 10:54:22 +08:00
Hanlin BiandHanlin Bi 0f6bedf6ed fix pcg torch dynamo recompile in mxfp8 Triton path (#21888)
Co-authored-by: Hanlin Bi <hanlinbi@umich.edu>
2026-04-02 01:57:49 +00:00
Noa Neria 8d9145d97e Direct model loading from object storage with Runai Model Streamer (#17948)
Signed-off-by: Noa Neria <noa@run.ai>
2026-04-01 18:41:22 -07:00
Liangsheng Yin ae3b207dfd Allow /rerun-test to checkout fork PR branch for trusted users (#21890) 2026-04-01 18:20:29 -07:00
Derek YuandBrayden Zhong 51ad717089 [CI] Add Per-Tensor, Blockwise FP8 Tests on SM120 (#20717)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-04-02 01:20:14 +00:00
Derek Yu 83c3158014 [CI] Add Llama 3.1 8B Instruct FP4 CI test on SM120 (#20648) 2026-04-02 01:17:38 +00:00
huangtingwei 6dd2f774de [HiCache & PD]Fixed detailed cache hit breakdown in PD scenarios. (#21764) 2026-04-01 17:44:55 -07:00
shuwennandZhiqiang Xie 9cb362f70e [HiCache] fix: Clone host indices to avoid memory leak (#21624)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-04-01 17:42:07 -07:00
Liangsheng Yin d7256eb69a Unify GSM8K eval path to Chat API for regression CI readiness (#21667) 2026-04-01 17:12:19 -07:00