Commit Graph
183 Commits
Author SHA1 Message Date
Vladimir221andronnie_zheng 27032cecd9 [Ascend]Support of piecewise graph compilation for prefill on NPU (#12287)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-12-11 21:10:07 +08:00
Yuan Luoandluoyuan.luo 03836d85d2 [GLM-4.6V] Support Pipeline Parallelism for GLM-4.6V & GLM-4.1V (#14720)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-10 16:40:12 +08:00
Even Zhou 589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
Xiaoyu Zhang dc69462456 [CI fix] Fix image download failures in VLM CI tests (#13613) 2025-11-20 11:18:06 +08:00
Liangsheng Yin 196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Kangyan-Zhou c0d1a3383b Remove jet-ai/Jet-Nemotron-2B in nightly text tests as this is constantly failing (#13540) 2025-11-18 13:58:16 -08:00
Vedant V Jhaveri aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) 2025-11-17 15:35:18 -08:00
Liangsheng Yin ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
Liangsheng Yin 1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
fzyzcjy b0ee99dd03 Super tiny fix typo (#13001) 2025-11-11 00:47:45 +08:00
Zijian Zhang 3633f8b0cf Add Jet-Nemotron (#12448) 2025-11-09 01:32:47 -08:00
alisonshao d3a03aeef8 Refs/heads/add nightly test multi gpu configs (#12870) 2025-11-08 15:14:50 -08:00
Jonah Bernard bc25ea6762 [MoE] Add Comprehensive MoE Integration Tests (#12090) 2025-11-07 00:34:46 -08:00
Lianmin Zheng c7d57d5bb3 Fix CI and style (#12658) 2025-11-05 15:08:15 -08:00
Glen Liu cbf23dbbfa [Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175) 2025-11-04 21:41:40 -08:00
Kaixi Hou 0711d1509b [NVIDIA] Fix cutedsl backend of MoE (#12353) 2025-11-04 18:54:55 -08:00
Liangsheng YinandLianmin Zheng 300b4c212e [CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
2025-10-31 17:20:20 +08:00
Rain H 750940ae36 Eagle3 DP attention for Qwen3 MoE (#12002) 2025-10-29 20:25:17 +08:00
Weiwei caa4819bfc Add support for AutoRound quantized models (#10153) 2025-10-27 18:17:29 +08:00
770529a731 model: support deepseek-ocr (#11891)
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2025-10-24 03:15:17 +08:00
JohnnyandBaizhou Zhang 252dc4e112 [NVIDIA] FA3/FA4 Fix (#11606)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-19 17:10:10 -07:00
Liangsheng Yin 7a020e0f3b [Test] Add basic matched stop for beta eagle (#11833) 2025-10-20 01:17:00 +08:00
YanbingJiangandMa Mingfei cbac499750 Split test_intel_amx_attention_backend.py to pass CI of timeout (#11370)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2025-10-15 19:22:32 -07:00
Lianmin Zheng cd7e1bd591 Sync code and test CI; rename some env vars (#11686) 2025-10-15 18:37:03 -07:00
4c03dbaaef [CI][XPU]enable sglang CI on Intel XPU (#9493)
Co-authored-by: huaiyuzh <huaiyu.zheng@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-10-15 17:13:19 -07:00
Lianmin Zheng 548a57b1f3 Fix port conflicts in CI (#11497) 2025-10-12 06:46:36 -07:00
Kai-Hsun Chen 1103dc6204 [chore][2/N] Avoid using default mutable parameters (#11479)
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
2025-10-12 20:34:04 +08:00
Mick 64d1505c0a ci: unify the model launch method of nightly ci (#11230) 2025-10-07 18:13:14 -07:00
1519a89cfd Remove overlap thread (#11210)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
2025-10-07 20:12:12 +08:00
e2daeb351c [Auto Sync] Update test_utils.py (20251006) (#11280)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
2025-10-06 15:49:57 -07:00
fzyzcjy fdc4e1e570 Tiny move files to utils folder (#11166) 2025-10-03 22:40:06 +08:00
Liangsheng Yin de89ef49da [CI]] Tee server logs to both file and stdout/stderr using PIPE (#11185) 2025-10-03 12:31:13 +08:00
Vedant V Jhaveri 7e61737d3f [Generative Scores API] add performance tests to CICD (#10830) 2025-10-02 19:57:55 -07:00
Ke Bao 91847e382a Fix eagle radix cache (#10846) 2025-09-30 22:59:20 +08:00
Zhihao Zhanganda4zhangfei 24f7cb1ece [speculative decoding] rename lookahead to ngram (#11010)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
2025-09-28 21:06:59 -07:00
Mick 2e7633982c fix: show failed models in nightly ci (#10986) 2025-09-28 12:38:29 -07:00
Mick 777eb53897 ci: refactor nightly test (#10495) 2025-09-26 15:24:30 -07:00
e7bc600304 [Feature] Speculative decoding support lookahead (#9873)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2025-09-18 16:42:41 -07:00
harrisonlimh 14fdd52740 feat: add priority based scheduling with priority based request acceptance and preemption (#8746) 2025-09-16 17:10:10 -07:00
Shu Wang 3df05f4d6a [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) 2025-09-11 20:18:43 -07:00
ryang dccf52f9c8 [UT for RL] Add UT to cover release/resume memory case for moe model (#8803) 2025-09-09 19:25:12 -07:00
Yineng Zhang b7d1f17b8d Revert "enable auto-round quantization model (#6226)" (#10148) 2025-09-07 22:31:11 -07:00
Weiwei c8295d2353 enable auto-round quantization model (#6226)
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
2025-09-07 22:05:35 -07:00
Qiaolin Yu 8cda5a622c Standalone speculative decoding (#10090) 2025-09-07 20:55:09 -07:00
Liangsheng Yin 6e95f5e5bd Simplify Router arguments passing and build it in docker image (#9964) 2025-09-05 12:13:55 +08:00
DiweiSun 029e0af31d ci: enhance xeon ci (#9395) 2025-08-21 03:35:17 -07:00
Hank Han 81da16f6d3 [CI] add deepseek w4a8 test on h20 ci (#7758) 2025-08-16 01:54:13 -07:00
Minglei Zhu 6ee6619b7a add zai-org/GLM-4.5-Air-FP8 model into nightly CI (#8894) 2025-08-08 01:44:19 -07:00
Lianmin Zheng e314b084c5 [FIX] Fix the nightly CI by disabling swa mem pool for gemma2 (#8693) 2025-08-02 18:43:14 -07:00
harrisonlimh 747dd45077 feat: throttle requests at scheduler based on --max_queued_requests (#7565) 2025-07-28 22:32:33 +08:00