 Qiaolin Yu
|
b684b0b72f
|
Fix spec v2 + logprob when max_num_token is set (#20799)
|
2026-04-02 01:55:16 -07:00 |
|
|
foraxeandyunzhi
|
e55a35fbcd
|
test: add manual init test for mooncake transfer engine (#21842)
Co-authored-by: yunzhi <ningyunxiao.nyx@antgroup.com>
|
2026-04-02 16:01:10 +08:00 |
|
|
Baizhou Zhang
|
c7d03a6215
|
Revert "Rollback flashmla to older version [1/2]" (#21922)
|
2026-04-02 00:27:02 -07:00 |
|
|
Baizhou Zhang
|
fbc1f92453
|
[DSA] Set trtllm kernels as nsa default for Blackwell (#21914)
|
2026-04-02 00:22:27 -07:00 |
|
|
Yilong Zhao
|
f30df723bf
|
scheduler: add prefill-only update in merge batch (#21840)
|
2026-04-01 23:33:06 -07:00 |
|
|
Trevor Morris
|
d24ea24e18
|
[NVIDIA] Enable fp8 flashinfer_trtllm_routed MoE for MiniMax-M2.5 (#20394)
|
2026-04-01 23:02:06 -07:00 |
|
|
Liangsheng Yin
|
f25bf86065
|
Fix ngram doc for speculative_num_draft_tokens default (#21910)
|
2026-04-01 22:18:24 -07:00 |
|
|
Khoa Pham
|
f836658077
|
[Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225)
|
2026-04-01 22:09:46 -07:00 |
|
|
Liangsheng Yin
|
269589ad71
|
Return HTTP 400 for streaming validation errors (#21900)
|
2026-04-01 21:58:12 -07:00 |
|
|
Khoa Pham
|
153359b4dd
|
Multi tool streaming fix (#20004)
|
2026-04-01 21:53:05 -07:00 |
|
|
Mook
|
7a59e05dd1
|
[Kernel] Fuse temperature + softmax in sampling for decode speedup (#20501)
|
2026-04-02 12:46:36 +08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.6
|
afa14ffac9
|
Skip Go stdlib and NVIDIA tool CVEs in Trivy scan (#21905)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-01 21:41:16 -07:00 |
|
|
Brayden Zhong
|
cb0c2cbfdb
|
Enable multi-thread weight loading by default (#20289)
|
2026-04-01 21:27:20 -07:00 |
|
|
Zhangheng
|
fae66b4050
|
Support PP key for file backend (#21901)
|
2026-04-02 12:23:58 +08:00 |
|
|
David Cheung
|
ed427e1299
|
Migrate all callers from /get_server_info to /server_info (#21463)
|
2026-04-01 21:17:50 -07:00 |
|
|
Prozac614andMick
|
24997fe42c
|
[diffusion] CI: add initial nvfp4 ci test for b200 (#21767)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-04-02 11:31:08 +08:00 |
|
|
Kangyan-Zhou
|
648632b6c4
|
[CI] Remove crashing Kimi K2.5 EAGLE3/MTP variants, keep TP8 and TP8+DP8 (#21898)
|
2026-04-01 20:27:24 -07:00 |
|
|
Kangyan-Zhou
|
9a7f198343
|
[CI] Increase multimodal server test timeout from 60 to 90 minutes (#21897)
|
2026-04-01 20:19:45 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
875a615993
|
fix(ci): update est_time for 57 tests based on runtime analysis (#21896)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-01 20:16:13 -07:00 |
|
|
Yuhao Yang
|
2ef12073f4
|
[VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841)
|
2026-04-01 20:09:47 -07:00 |
|
|
Shangming Cai
|
7004df6094
|
chore: bump mooncake version to 0.3.10.post1 (#21844)
|
2026-04-02 10:54:22 +08:00 |
|
|
Hanlin BiandHanlin Bi
|
0f6bedf6ed
|
fix pcg torch dynamo recompile in mxfp8 Triton path (#21888)
Co-authored-by: Hanlin Bi <hanlinbi@umich.edu>
|
2026-04-02 01:57:49 +00:00 |
|
|
Noa Neria
|
8d9145d97e
|
Direct model loading from object storage with Runai Model Streamer (#17948)
Signed-off-by: Noa Neria <noa@run.ai>
|
2026-04-01 18:41:22 -07:00 |
|
|
Liangsheng Yin
|
ae3b207dfd
|
Allow /rerun-test to checkout fork PR branch for trusted users (#21890)
|
2026-04-01 18:20:29 -07:00 |
|
|
Derek YuandBrayden Zhong
|
51ad717089
|
[CI] Add Per-Tensor, Blockwise FP8 Tests on SM120 (#20717)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-04-02 01:20:14 +00:00 |
|
|
Derek Yu
|
83c3158014
|
[CI] Add Llama 3.1 8B Instruct FP4 CI test on SM120 (#20648)
|
2026-04-02 01:17:38 +00:00 |
|
|
huangtingwei
|
6dd2f774de
|
[HiCache & PD]Fixed detailed cache hit breakdown in PD scenarios. (#21764)
|
2026-04-01 17:44:55 -07:00 |
|
|
shuwennandZhiqiang Xie
|
9cb362f70e
|
[HiCache] fix: Clone host indices to avoid memory leak (#21624)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-04-01 17:42:07 -07:00 |
|
|
Liangsheng Yin
|
d7256eb69a
|
Unify GSM8K eval path to Chat API for regression CI readiness (#21667)
|
2026-04-01 17:12:19 -07:00 |
|
|
ishandhanani
|
1081a25983
|
revert: remove TTL-based hard pin from HiRadixCache (#21884)
|
2026-04-01 16:51:15 -07:00 |
|
|
Alison ShaoandAlison Shao
|
1ac74e652e
|
[Misc] Fix comparator e2e tests: add polars dep + fix dp-attention test (#21804)
Co-authored-by: Alison Shao <alison.shao@mac.lan>
|
2026-04-01 15:44:35 -07:00 |
|
|
Liangsheng Yin
|
70fc4ce3ef
|
Add merge prohibition policy during CI maintenance mode (#21882)
|
2026-04-01 15:08:09 -07:00 |
|
|
YAMY
|
821a8a99fb
|
[Disagg] GPU staging buffer with dynamic ring allocator for heterogeneous TP KV transfer (#19890)
|
2026-04-01 14:09:18 -07:00 |
|
|
Baizhou Zhang
|
5e12c4e08e
|
[DSA] Support trtllm sparse mla kernel for prefill batches (#21783)
|
2026-04-01 13:55:05 -07:00 |
|
|
Trevor Morris
|
8950d129bd
|
[refactor] Clean up duplicate flashinfer trtllm moe code (#21233)
|
2026-04-01 13:52:22 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
0138708576
|
[Misc] Add network timeout to eval dataset downloads (#21873)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-04-01 13:16:14 -07:00 |
|
|
Ziang Li
|
a19ef3a615
|
[FlashInver v0.6.7] Integrate flashinfer_trtllm mxfp8 gemm (#21576)
|
2026-04-01 15:55:06 -04:00 |
|
|
shuwenn
|
a1c725bdc5
|
fix: pre-init tokenizer_manager to avoid AttributeError in shutdown (#21824)
|
2026-04-01 10:54:53 -07:00 |
|
|
R0CKSTARandMick
|
ca3286d2d5
|
[diffusion] hardware: support FA3 attention backend on MUSA (attn backend, 14/N) (#18648)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-04-01 10:49:34 -07:00 |
|
|
shuwenn
|
6098c51bc2
|
fix(MiMo-V2-Flash): add mimo reasoning parser (#21414)
|
2026-04-02 00:47:27 +08:00 |
|
|
yuefeng Wu
|
c9f5d1d502
|
[Diffusion][NPU] add ring sp performance benchmark page in npu (#21811)
|
2026-04-01 18:53:10 +03:00 |
|
|
DarkSharpness
|
20f4193589
|
[Feature] JIT rmsnorm update (with claude) (#21834)
|
2026-04-01 23:40:00 +08:00 |
|
|
Ratish PandXiaoyu Zhang
|
4f5b55e379
|
[diffusion][CI]: Add individual component accuracy CI for diffusion models (#18709)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-04-01 21:51:36 +08:00 |
|
|
Cherry_ming
|
e67b95d66b
|
[NPU]Add a full test pipeline on NPU, resolve issues in the NPU test architecture (#20751)
|
2026-04-01 19:56:31 +08:00 |
|
|
Liangsheng Yin
|
ac039bd04e
|
Use CustomTestCase for TestSessionControl to enable CI retry (#21830)
|
2026-04-01 04:26:11 -07:00 |
|
|
Yuhao Yang
|
1aabe44b64
|
[VLM] remove AsyncMMDataProcessor wrapper (#21651)
|
2026-04-01 17:39:50 +08:00 |
|
|
amote-i
|
80b1bc5f56
|
[NPU] update ascend docs (#21807)
|
2026-04-01 17:14:26 +08:00 |
|
|
Mick
|
7bba319f1e
|
[diffusion] fix: respect --prompt-path (#21756)
|
2026-04-01 16:47:59 +08:00 |
|
|
wduan-hai
|
95b881452e
|
Fix in-place mode in pause generation (#21705)
|
2026-04-01 01:36:28 -07:00 |
|
|
yunkchenandShangming Cai
|
eec70286ec
|
[Bugfix] Fix effective_mamba_size over-allocation (#20858)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-04-01 16:17:14 +08:00 |
|