Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) Liangsheng Yin 2025-11-16 23:15:36 +08:00
• e019f233f9 Remove unused code / testcases in lang (#13335) Liangsheng Yin 2025-11-16 22:48:35 +08:00
• b1c688fba2 refactor: cleanup vision attention related codes (#13228) 5 people 2025-11-16 06:44:40 -08:00
• 8e3663d4e8 Add default enable_memory_saver to HybridLinearKVPool (#13371) Zilin Zhu 2025-11-16 22:35:13 +08:00
• 9edb0e0da3 Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339) Zilin Zhu 2025-11-16 22:02:22 +08:00
• 95f43669b5 [2 / 2] apply sgl-kernel weak_ref_tensor (#12978) Xiaoyu ZhangandYuan Luo 2025-11-16 21:24:35 +08:00
• 50691d7b49 [opt kimi k2 2/n] apply kimi k2 thinking moe_fused_gate (#13332) Xiaoyu Zhang 2025-11-16 21:20:08 +08:00
• 6afe396399 diffusion: support fa4 in fa backend for blackwell (#13263) Yuhao YangandMick 2025-11-16 21:02:45 +08:00
• 191f5c7795 diffusion: correct check-changes for multimodal_gen (#13375) Mick 2025-11-16 20:32:33 +08:00
• d724670873 [diffusion] refactor and added tests for Flux, T2V, TI2V, I2V(#13344) Adarsh Shirawalmath 2025-11-16 17:28:04 +05:30
• efc5d8f5ed [model-gateway] fix SDist step readme path (#13373) Simo Lin 2025-11-16 03:16:52 -08:00
• ef32a252d0 [model-gateway] fix model gateway pypi release workflow path (#13372) Simo Lin 2025-11-16 02:33:49 -08:00
• 9509c4ccd3 [RL] enable offloading hybrid linear attn model (#13336) Zilin Zhu 2025-11-16 17:12:52 +08:00
• 4e19c1d541 Add missing models (#13369) Kangyan-Zhou 2025-11-16 00:04:47 -08:00
• 78a4b446c6 Fix dpsk-r1-fp4 tp8 by reverting two commits (#13162 and #13341) (#13348) Qiaolin YuandKangyan-Zhou 2025-11-15 21:31:36 -08:00
• f969664172 [Performance] Move the contiguous to torch compile region (#13199) DarkSharpness 2025-11-16 12:49:52 +08:00
• f35f7f1245 [Piecewise CUDA Graph] Support W4A8 (#13179) b8zhong 2025-11-15 19:53:50 -08:00
• 12c789ebd1 [Ascend]support xgrammar backend for ascend npu (#12310) ash-sighandronnie_zheng 2025-11-16 11:39:24 +08:00
• 597d416070 [feature] Add layerwise NVTX support (#11870) kyleliang-nv 2025-11-15 19:20:56 -08:00
• 1ca205f6da chore: bump sgl-kernel version to 0.3.17.post1 (#13358) sglang-bot 2025-11-16 11:11:41 +08:00
• 24a25ffa20 [Piecewise CUDA Graph] Support ModelOpt FP4 (#13101) b8zhong 2025-11-15 19:03:19 -08:00
• db7299aa30 [Fix] Register custom ops only if they exist (#13321) Lianmin Zheng 2025-11-15 17:48:17 -08:00
• 13366843a4 [CI] check unit-test-backend-8-gpu-h20 in workflow (#13355) Cheng Wan 2025-11-15 16:44:10 -08:00
• be353ffd13 Add missing models (#13351) Kangyan-Zhou 2025-11-15 13:51:20 -08:00
• 20e59f9510 Add FP32 dtype support for RoPE - Part1 (#13181) iLeGend 2025-11-16 03:37:18 +08:00
• 0d116b9a0b Clean up deprecated tile_tokens_dim for next flashinfer (#13341) Vincent Zhong 2025-11-15 11:50:15 -05:00
• 4a56fa5cf2 chore: bump sgl-kernel version to 0.3.17.post1 (#13325) sglang-bot 2025-11-15 23:36:32 +08:00
• 51f9b9628b [optimize] Provide Usrbio compilation and installation commands (#12329) FlyPanda 2025-11-15 23:06:24 +08:00
• daf494b681 tiny fix lint (#13337) Liangsheng Yin 2025-11-15 23:05:08 +08:00
• 37e8724ef3 perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001) xlzheng 2025-11-15 22:02:42 +08:00
• 10592e9c08 [Ascend][Feat] Add Ascend sampling backend (#12692) Zhihao Lyuandronnie_zheng 2025-11-15 21:59:58 +08:00
• 2aec8b6e1b [Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443) Even Zhou 2025-11-15 21:51:07 +08:00
• 0d41ddfbd0 Temporarily disable test_vision_openai_server_a CI (#13331) Ke Bao 2025-11-15 19:46:49 +08:00
• 37c8761567 [model-gateway] remove grpc feature flag and mark as default (#13330) Simo Lin 2025-11-15 03:16:57 -08:00
• 3f400f25df [Diffusion] add health endpoints to diffusion server (#13329) Adarsh Shirawalmath 2025-11-15 16:42:37 +05:30
• d91b16eb16 Opt tp: tp attn support tp reduce scattered input (#10568) Yongfei Xu 2025-11-15 18:08:12 +08:00
• 4a10e37ba7 [router] Fix flaky router e2e tests (#13306) Xinyue Zhang 2025-11-15 02:00:25 -08:00
• b051d76dab Fix: add missing get_embed_and_head in MiniMax M2 for Eagle3 (#13297) Charles Chen 2025-11-15 01:36:03 -08:00
• d52d992a90 Update README (#13326) Yineng Zhang 2025-11-15 01:33:10 -08:00
• d971f22898 Super tiny expose transform_scale_ue8m0 API for RL frameworks (#13323) fzyzcjy 2025-11-15 17:31:04 +08:00
• 1d3d42bda0 [opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287) Xiaoyu Zhang 2025-11-15 17:14:19 +08:00
• 8e9f05ece1 Update marlin moe kernel interface (#13322) Ke Bao 2025-11-15 17:10:39 +08:00
• bc083521a8 [RL] support update_weights_from_tensor for mtp (#7415) Zilin Zhu 2025-11-15 16:57:01 +08:00
• 33f08a98b0 Tiny refactor condition to requant scale ue8m0 (#13286) fzyzcjy 2025-11-15 16:36:00 +08:00
• 8e6083bfcf Support inverse transform ue8m0 scale (#13285) fzyzcjy 2025-11-15 16:34:32 +08:00
• 2fbc78a083 Support fast gemm when in batch invariant DeepGEMM fallback (#13259) fzyzcjy 2025-11-15 16:34:15 +08:00
• f0b5ccf5f5 [RL] Allow bypassing /health check (#13320) Zilin Zhu 2025-11-15 16:33:54 +08:00
• b732ffa404 [model-gateway] move python to binding folder (#13295) Simo Lin 2025-11-15 00:32:21 -08:00
• 56fc483073 [RL] support only do cpu backup on draft model (#13318) Zilin Zhu 2025-11-15 16:31:57 +08:00
• 2a96e302cb Revert moe sum reduce for marlin moe (#13314) Ke Bao 2025-11-15 15:57:41 +08:00
• 8a4373405e re-submit 12911 but relax the requirement for deepgemm (#13226) Minglei Zhu 2025-11-14 23:37:12 -08:00
• f0021c0dc8 Add feature flag for mm inputs processing optimization (#13278) Yuan Luoandluoyuan.luo 2025-11-15 14:43:44 +08:00
• 7ee3e36412 Fix: test_vlm_offline_throughput output throughput (#13279) Douglas Yang 2025-11-14 22:31:48 -08:00
• 6d5e16fb1c feat: Add FP4 (E2M1) KV Cache Support for MHA (#12612) Ho-Ren (Jack) ChuangandYichen Wang 2025-11-14 22:31:35 -08:00
• 67e6f1438d Consolidate similar tests to reduce duplication (#12871) alisonshao 2025-11-14 22:29:44 -08:00
• 34851471b2 Add more statistics for spec decoding (#13317) Zilin Zhu 2025-11-15 14:20:28 +08:00
• c2083116e3 [Diffusion] switch to local calculate_dimensions (#13294) Adarsh Shirawalmath 2025-11-15 11:25:13 +05:30
• 10285ec204 [Misc]Add date to cu13 dev image tag (#13316) Baizhou Zhang 2025-11-14 19:42:50 -08:00
• 9b3fc186bc Fix syntax errors in cpp_radix_tree (#13315) Yiming 2025-11-15 11:35:43 +08:00
• 172c71a23d [model-gateway] smg release 0.2.3 (#13312) Simo Lin 2025-11-14 19:04:20 -08:00
• af373636da CI: add server performance test for SGLang diffusion (#13091) Adarsh ShirawalmathandMick 2025-11-15 07:41:19 +05:30
• a5be6ef98e [Deterministic] Support Qwen3-Next model deterministic inference (#13100) Minglei Zhu 2025-11-14 18:01:18 -08:00
• 8f4e18a294 Add missing model for 2-gpu-runner in nightly tests (#13311) Kangyan-Zhou 2025-11-14 17:34:43 -08:00
• e9681444bd Add missing model in model validate list (#13310) Kangyan-Zhou 2025-11-14 17:29:21 -08:00
• eae59b337e Piecewise Cuda Graph Support for gpt-oss model (#13045) Yuwei An 2025-11-14 17:28:00 -08:00
• 14dc052382 [router]Replace requests lib with openai in e2e_response_api (#13293) Xinyue Zhang 2025-11-14 16:56:40 -08:00
• b223669136 Remove nightly b200 tests and revert a change for test file (#13305) Kangyan-Zhou 2025-11-14 16:30:22 -08:00
• dcc47a56c9 Implement nightly test workflow naming conventions (#13170) alisonshao 2025-11-14 16:14:53 -08:00
• 6448b4cd2c Fix NSA indexer nightly test failed issues (#13298) Johnsonms 2025-11-14 13:14:57 -08:00
• 5ae0ac4244 [NVIDIA] Fix use case of SGLANG_ENABLE_FLASHINFER_GEMM (#13274) Kaixi HouandBaizhou Zhang 2025-11-14 12:51:11 -08:00
• 22f641ab4f [minor] remove debug code in python/sglang/srt/compilation/weak_ref_tensor_jit.py (#13235) Lianmin ZhengandStefan He 2025-11-14 12:22:24 -08:00
• 0997c78d2c Support FP8 Per Token Quant Piecewise (#13272) Stefan He 2025-11-14 11:40:12 -08:00
• fd3be107bb [Doc] Add item for repetition punishment (#13260) Zesen SenmiaoORZ 2025-11-14 14:15:56 -05:00
• 665f43bdd8 model: support teleflm (#10573) Praneth Paruchuri 2025-11-15 00:44:49 +05:30
• a53f2d6c12 Support orion (#10665) Praneth Paruchuri 2025-11-15 00:38:32 +05:30
• a7002e614b [Deepseek V3.2] Clean up MTP (#13236) hlu1 2025-11-14 11:01:37 -08:00
• 84e151ac7f LLama4 Attention: Update assertion msg (#12777) Kshiteej K 2025-11-14 19:52:50 +01:00
• 875a25ddef refactor: remove duplicate function _get_bootstrap_info_from_server (#13277) Yingchun Lai 2025-11-15 02:48:17 +08:00
• fc55b45e5f Optimized prefill cache allocation for NPU (#13288) Vitaly Tuzov 2025-11-14 21:40:17 +03:00
• 0050ff254f [BugFix] fix bench_serving error when multimodal image is testing (#13254) Ling Zhang 2025-11-14 22:46:19 +08:00
• af9f71f9c5 Add script to create a model with fewer layers for debugging (#13284) fzyzcjy 2025-11-14 22:13:27 +08:00
• 15264232ee Super tiny fix CI (#13283) fzyzcjy 2025-11-14 21:45:10 +08:00
• f8d3d80f63 chore: bump flashinfer v0.5.2 (#13242) Yineng Zhang 2025-11-14 02:47:09 -08:00
• 5027739f2c [CPU] Use covt_e4m3_bf16 to optim BF16 to FP8 convert (#12191) wangyxbh 2025-11-14 01:36:51 -08:00
• 3701f34dab Tiny add utility to parse server logs (#12605) fzyzcjy 2025-11-14 17:34:22 +08:00
• 821fb060c3 Enhance dumper comparator with tensor unifier and location finder (#12623) fzyzcjy 2025-11-14 17:34:08 +08:00
• ace27c0c01 Tiny enhance dumper with ctx and enable flags (#12622) fzyzcjy 2025-11-14 17:33:49 +08:00
• ed1d18d472 Tiny fix update version logic location (#12620) fzyzcjy 2025-11-14 17:33:36 +08:00
• e7b57b0d04 [BugFix] weight load bug when checkpoint expert.gate and exepert.up_proj are not fused (#13113) Morpheus Guoandyuechguo 2025-11-14 16:35:44 +08:00
• 49141df94a Extend lint test to test/ directory (#13247) Kangyan-Zhou 2025-11-14 00:01:48 -08:00
• 7b79cc4fe2 ci: speed up b200 ci (#13237) b8zhong 2025-11-13 23:57:33 -08:00
• 385ff0e56f [model-gateway] change mg labeler from router to model-gateway (#13265) Simo Lin 2025-11-14 16:29:09 +09:00
• fc5da1e80b [Tool Call] Steamline function arguments when tool_choice="auto" for deepseekv31_detector (#11589) Muqi Li 2025-11-14 15:06:02 +08:00
• 04848ba7cb Add 3 models to 2 gpu runner in model downloading from nightly tests (#13261) Kangyan-Zhou 2025-11-13 22:59:18 -08:00
• 9bc6a9adbe Update model weight validation logic to handle special weight file naming (#13256) Kangyan-Zhou 2025-11-13 22:07:49 -08:00
• 7cdaedb8fb Remove glm41v from CI to speed up CI (#13257) Binyao Jiang 2025-11-13 21:14:04 -08:00
• 1f134f850a fix outdated router doc (#13255) fzyzcjy 2025-11-14 13:00:42 +08:00
• 5f72d36d40 Fix nightly tests to fail properly when any job fails (#13096) alisonshao 2025-11-13 19:10:35 -08:00
• 7a2254b260 [Auto Sync] Update backend.py, forward_batch_info.py, piece... (20251113) (#13221) 3 people 2025-11-13 18:54:11 -08:00
• b5904999c0 docker: Fix apt-add-repository (#13213) Kshiteej K 2025-11-14 03:41:29 +01:00