Commit Graph
2351 Commits
Author SHA1 Message Date
Piotr MazurekandPiotr Mazurek b5e8c4b9e3 model: support LFM2-VL (Liquid Foundation Model 2 Vision-Language) (#21230)
Co-authored-by: Piotr Mazurek <piotr.mazurek@liquid.ai>
2026-04-04 16:36:04 +08:00
Ethan (Yusheng) Su ff8e47edf9 [5/n] Lora support cuda graph (#21647) 2026-04-04 00:31:46 -07:00
Huaiyu, Zheng 68f4c52d34 fix ut test_moe (#21735) 2026-04-03 21:57:11 -07:00
faceless void de9859073f Add --stream-response-default-include-usage server flag (#16711) 2026-04-03 21:36:00 -07:00
Liangsheng Yin 95cdbce34f [Test] Extract common PD server setup into base fixture (#22080) 2026-04-03 16:37:12 -07:00
Lawrence Wu 9593d434c4 fix: pause_generation should not populate running_batch on prefill nodes (#20273) 2026-04-03 16:16:06 -07:00
Sundara Raman Ramachandran 90e86800f4 [Score API] Implement EngineScoreMixin for scoring functionality and refactor Tok… (#21342) 2026-04-03 15:17:42 -07:00
Brayden Zhong 6aafe756b9 Revert "[Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+… (#22047) 2026-04-03 13:12:30 -07:00
Ke Bao 896ea75820 Remove reverted test (#22058) 2026-04-03 23:51:37 +08:00
Ke Bao 47f4fd275a [CI] Fix test suite names and add suite validation (#21937) 2026-04-03 23:47:17 +08:00
Ke Bao 9f409d0749 [CI] Adjust CI server launch timeout (#22045) 2026-04-03 22:38:07 +08:00
Xiaoyu Zhang ee9d922f5a Revert "[Kernel] Fuse temperature + softmax in sampling for decode speedup" (#22046) 2026-04-03 21:32:08 +08:00
shuwenn 4f84ce5807 [CI] ci: add test_http_server_auth.py to CI (#21866) 2026-04-03 16:32:18 +08:00
Michael d07d0a15ce [AMD] Add MiniMax-M2.5 nightly perf benchmarks for MI30x and MI35x (#21524) 2026-04-03 01:01:03 -07:00
Mook 991f3aa5b3 [Feature] NVFP4 Marlin fallback for non-Blackwell GPUs (SM75+) (#19652) 2026-04-03 10:48:15 +08:00
Khoa Pham 2b5aed94f5 Remove maxItems=1 restriction when tool_choice is specified (#20208) 2026-04-03 02:35:24 +00:00
Xiaoyu Zhang 89affff290 Skip broken AutoModel mapping entries when resolving Llava submodules (#21892) 2026-04-03 09:04:26 +08:00
Baizhou ZhangandClaude Opus 4.6 29d8e959d7 [CI] Remove stale Ascend suite entries from test/srt/run_suite.py (#21978)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 16:47:19 -07:00
Adarsh Shirawalmath 34ddf135fd [Feature] Stronger transformers modeling backend with TP, PP, MoE, VLMs, and torch compile (#19163) 2026-04-02 16:02:33 -07:00
Ethan (Yusheng) Su 566b4a4f1c [4/n] Support gpt oss 20b lora (#21570) 2026-04-02 12:57:38 -07:00
Feng Su 8732b2e9c6 [CI] [Tracing] Add ci for tracing and fix bugs (#21740) 2026-04-02 10:50:50 -07:00
Ke Bao b21db86e2f [CI] Fix gpu deps import in cpu test (#21950) 2026-04-03 00:06:31 +08:00
Liangsheng YinandDarkSharpness 9d9537fbd3 Migrate ngram corpus from torch cpp_extension to TVM FFI jit_kernel (#21920)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-04-02 02:18:11 -07:00
foraxeandyunzhi e55a35fbcd test: add manual init test for mooncake transfer engine (#21842)
Co-authored-by: yunzhi <ningyunxiao.nyx@antgroup.com>
2026-04-02 16:01:10 +08:00
Khoa Pham f836658077 [Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225) 2026-04-01 22:09:46 -07:00
Liangsheng Yin 269589ad71 Return HTTP 400 for streaming validation errors (#21900) 2026-04-01 21:58:12 -07:00
Khoa Pham 153359b4dd Multi tool streaming fix (#20004) 2026-04-01 21:53:05 -07:00
Mook 7a59e05dd1 [Kernel] Fuse temperature + softmax in sampling for decode speedup (#20501) 2026-04-02 12:46:36 +08:00
David Cheung ed427e1299 Migrate all callers from /get_server_info to /server_info (#21463) 2026-04-01 21:17:50 -07:00
Kangyan-Zhou 648632b6c4 [CI] Remove crashing Kimi K2.5 EAGLE3/MTP variants, keep TP8 and TP8+DP8 (#21898) 2026-04-01 20:27:24 -07:00
Liangsheng YinandClaude Opus 4.6 875a615993 fix(ci): update est_time for 57 tests based on runtime analysis (#21896)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-01 20:16:13 -07:00
Yuhao Yang 2ef12073f4 [VLM] Add VLM TP=4 per-commit CI test and improve MMMU eval prompt/parser (#21841) 2026-04-01 20:09:47 -07:00
Noa Neria 8d9145d97e Direct model loading from object storage with Runai Model Streamer (#17948)
Signed-off-by: Noa Neria <noa@run.ai>
2026-04-01 18:41:22 -07:00
Derek YuandBrayden Zhong 51ad717089 [CI] Add Per-Tensor, Blockwise FP8 Tests on SM120 (#20717)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-04-02 01:20:14 +00:00
Derek Yu 83c3158014 [CI] Add Llama 3.1 8B Instruct FP4 CI test on SM120 (#20648) 2026-04-02 01:17:38 +00:00
Liangsheng Yin d7256eb69a Unify GSM8K eval path to Chat API for regression CI readiness (#21667) 2026-04-01 17:12:19 -07:00
Alison ShaoandAlison Shao 1ac74e652e [Misc] Fix comparator e2e tests: add polars dep + fix dp-attention test (#21804)
Co-authored-by: Alison Shao <alison.shao@mac.lan>
2026-04-01 15:44:35 -07:00
Ziang Li a19ef3a615 [FlashInver v0.6.7] Integrate flashinfer_trtllm mxfp8 gemm (#21576) 2026-04-01 15:55:06 -04:00
Cherry_ming e67b95d66b [NPU]Add a full test pipeline on NPU, resolve issues in the NPU test architecture (#20751) 2026-04-01 19:56:31 +08:00
Liangsheng Yin ac039bd04e Use CustomTestCase for TestSessionControl to enable CI retry (#21830) 2026-04-01 04:26:11 -07:00
Yuhao Yang 1aabe44b64 [VLM] remove AsyncMMDataProcessor wrapper (#21651) 2026-04-01 17:39:50 +08:00
wduan-hai 95b881452e Fix in-place mode in pause generation (#21705) 2026-04-01 01:36:28 -07:00
72d3d8f4cf [Feature Restoration] repetition_penalty is essential for GLM-V models (#21258)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-03-31 23:29:49 -07:00
Ethan (Yusheng) SuandBaizhou Zhang cffc95edf4 [3/n] lora moe - Support Qwen3-VL-30B-A3B-Instruct (#21469)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-31 23:15:16 -07:00
ca3ba05a7a chore: bump flashinfer version to 0.6.7 (#21422)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-31 21:18:16 -07:00
KnightLTC 2488233ad5 [bugfix]GLM-4V model (#17122) 2026-04-01 10:37:40 +08:00
Qiaolin Yu 5f6250769a Reduce redundant speculative decoding CI tests (#21779) 2026-03-31 17:40:20 -07:00
Liangsheng Yin b6fe0cca99 Switch MooncakeSpec to EAGLE3 + Llama-3.1 (#21794) 2026-03-31 17:12:20 -07:00
Liangsheng Yin d047d41bad Increase hicache eval to 200 examples (#21791) 2026-03-31 16:58:44 -07:00
Liangsheng Yin 7932e4c3e6 Remove redundant test_moe_eval_accuracy_large (#21787) 2026-03-31 16:45:03 -07:00