Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• b992828ad2 fix: fix bug on kimi2.5 with dp2 and tp4 (#18604) haowen-hanandhanhaowen 2026-02-15 16:32:13 +08:00
• 274bf6607a [diffusion] fix: enable torch.compile for UlyssesAttention (#18840) Ratish P 2026-02-15 13:24:27 +05:30
• ad1bdb93df perf: add minimax-2.5 fused_moe tuning config for h20 (#18833) zhangxiaolei123456 2026-02-15 15:46:56 +08:00
• 922fbc21e2 [Perf] Tune MiniMax M2 fused moe kernel on H100 GPU (#18851) jackey hua 2026-02-15 02:30:52 -05:00
• 944a9f6fcf Fix/qwen3 5 amd rope cutedsl fallback (#18753) andyluo7andseungrokj 2026-02-14 22:09:44 -08:00
• 91230dcca8 [FIX] Correct JIT kernel compilation on newer GPUs with outdated driver metadata. (#18496) muse-coderandXiaoyu Zhang 2026-02-15 12:14:39 +08:00
• 1ce3420784 Model: Support IBM Granite (Dense/Mamba + MoE) (#18040) Bhavneek Singh 2026-02-15 12:24:41 +09:00
• 4cf4f0859f [Doc] Convert the speculative decoding notebook to markdow (#18395) shuwenn 2026-02-15 10:18:56 +08:00
• b33769786f [Auto Sync] Update grpc_request_manager.py, tokenizer_manag... (20260214) (#18838) Lianmin Zhengandgithub-actions[bot] 2026-02-14 18:12:32 -08:00
• 190fa8246f Fix model loading for DeepSeek-V3.2-AWQ (#16907) Guangda LiuandGuangda Liu 2026-02-15 09:39:53 +08:00
• 8b2020584c [Auto Sync] Update test_deterministic.py (20260214) (#18839) 3 people 2026-02-14 17:19:30 -08:00
• b1b69ae0a9 Add CI permissions (#18847) Mohammad Miadh Angkad 2026-02-15 08:24:36 +08:00
• 4067d9487d [diffusion] feat: opt vae decode with channels_last_3d (#18540) Xiaoyu Zhang 2026-02-14 23:19:45 +08:00
• c29394e3c8 [kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475) Xiaoyu Zhang 2026-02-14 23:06:21 +08:00
• ae95869292 Enable SGLANG_ENABLE_SPEC_V2 for nightly speculative decoding tests (#18719) Kangyan-ZhouandClaude Opus 4.6 2026-02-14 23:00:33 +08:00
• 92cdd398cd feat: Support mrope_section with rope_type: "yarn" (#13313) Raayan Dhar 2026-02-14 06:51:44 -08:00
• f51e9d9ca1 Add ci test for ring model (#18829) Ke Bao 2026-02-14 22:20:23 +08:00
• c8aa2a6534 Fix dsv32 encode_messages (#18126) ybyang 2026-02-14 16:44:13 +08:00
• 34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) Johnsonms 2026-02-14 00:40:15 -08:00
• 38473f8ee0 [AMD] Fix sgl-model-gateway Build Errors in ROCm Docker Release (#18836) Bingxu Chen 2026-02-14 16:07:26 +08:00
• e2eb5bf28d [DLLM] Update CODEOWNERS for diffusion LLM (#18834) Zehuan Li 2026-02-14 15:31:42 +08:00
• fa0ef6e4f7 [VLM][LLM] Optimize fused_moe triton kernel tma (#18782) Yuan Luoandluoyuan.luo 2026-02-14 14:35:26 +08:00
• f6c18c3a85 Fix/partial gen from waiting queue miss metadata (#17610) JD 2026-02-13 19:04:08 -08:00
• 45a4697d45 [diffusion][MUSA] fix: MUSA platform breakage caused by PR #13662 (#18456) R0CKSTAR 2026-02-14 11:00:39 +08:00
• 8ef3e3d56b Fix CI concurrency collision between scheduled runs and fork PRs (#18826) Alison Shao 2026-02-13 18:48:31 -08:00
• 066b0b70d9 Handle abort for retracted requests in disagg decode prealloc queue (#18705) 3 people 2026-02-14 10:39:39 +08:00
• bd39de7d5e [Env] centralize hicache vars in environ.py (#17204) shuwenn 2026-02-14 10:02:31 +08:00
• dcea74d63f Add timeout abort kits for normal / eagle. (#18815) Liangsheng Yin 2026-02-13 17:57:30 -08:00
• 4474fb98b4 [PD-Disagg] Fix double free when prebuilt batch is aborted. (#18822) Liangsheng Yin 2026-02-13 17:46:35 -08:00
• ab0fb248fd feat: add SGLANG_DISTRIBUTED_INIT_METHOD_OVERRIDE env var (#18743) Leon Gao 2026-02-13 17:37:33 -08:00
• 8be18c655d [Perf] refactor piecewise cuda graph support of Qwen3-Next (#17613) Minglei Zhu 2026-02-13 17:30:50 -08:00
• 3a1c388b43 Update performance dashboard for nightly tests (#18824) Kangyan-Zhou 2026-02-14 09:28:28 +08:00
• 3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) shuwenn 2026-02-14 08:46:09 +08:00
• eccf875d49 [CI] Revive 8-GPU trace upload in nightly test workflow (#18820) Kangyan-ZhouandClaude Opus 4.6 2026-02-14 08:37:08 +08:00
• 1be41e9036 [FlashInfer] Bump FlashInfer version from 0.6.2 to 0.6.3 (#18448) Mohammad Miadh Angkad 2026-02-14 07:43:33 +08:00
• 710d873ba6 Update notified user in post_ci_failures_to_slack.py (#18817) Kangyan-Zhou 2026-02-14 06:48:56 +08:00
• 191d354f53 fix double-free kv cache for requests that have already finished and been freed during preemption (#18694) JD 2026-02-13 13:17:44 -08:00
• 008ea46af1 [Auto Sync] Update loader.py, weight_utils.py (20260213) (#18779) 4 people 2026-02-13 12:22:50 -08:00
• 4c6afbeeaa [bugfix] fix mamba slot leak when scheduling fails with radix cache (#15840) (#16067) Qi Jiaandyizhang2077 2026-02-13 23:43:57 +08:00
• 8b4c364960 refactor context parallel state (#17213) dongjiyingdjyandShunkang 2026-02-13 23:18:17 +08:00
• 0012d6a4eb [Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543) Linyu WuandXiaoyu Zhang 2026-02-13 22:29:22 +08:00
• 37273408eb [diffusion] chore: use batched P2P ops in VAE parallel decoding (#18728) Mick 2026-02-13 22:11:20 +08:00
• acc940d302 [diffusion] fix typo (#18790) triple-mu 2026-02-13 21:59:39 +08:00
• 9a32f8ccb9 [CI] Move test_load_lora_from_tensor test to H100 (#18797) Baizhou Zhang 2026-02-13 21:28:00 +08:00
• 07633349c9 [diffusion] fix: webui task_type check (#18462) R0CKSTARandMick 2026-02-13 21:19:16 +08:00
• efdd676d56 [diffusion] refactor: merge redundant default_dtype and param_dtype parameters in FSDP loader (#18789) Mick 2026-02-13 21:18:02 +08:00
• 98ad284ebf Added cuda availability guard (#18480) Kaixi 2026-02-13 13:18:34 +01:00
• a0ebaa6498 Cleanup debug log for Ring model (#18793) Ke Bao 2026-02-13 18:36:20 +08:00
• a9d59776cc Enhence gsm8k test (#18791) Ke Bao 2026-02-13 18:08:57 +08:00
• eacab2868a Adjust mamba cache allocation (#18786) Ke Bao 2026-02-13 18:06:23 +08:00
• a6c4b52ac5 Cleanup unused rerun stages (#18788) Ke Bao 2026-02-13 17:44:42 +08:00
• e4b2b57620 [schedule] Fix streaming return of customized_info (#18654) Yinghai Lu 2026-02-13 01:19:16 -08:00
• 356e338607 [diffusion] feat: support SparseVideoGen2 attention backend (#17507) Xinwei QiangandMick 2026-02-13 16:20:46 +08:00
• d97eb111a3 Support LingV2_5 model (#18598) 7 people 2026-02-13 16:09:15 +08:00
• 013a199bc6 [CI] Skip cutedsl gdn performance test in jit_kernel ci (#18783) Xiaoyu Zhang 2026-02-13 15:49:30 +08:00
• 1f39bf6523 [Bugfix] Add warnings when NSA indexer cache indice mismatch in PD module (#18727) Shangming Cai 2026-02-13 15:20:05 +08:00
• e6f7a372ef Rename request timeout env vars for waiting/running stages (#18766) Liangsheng Yin 2026-02-12 22:58:40 -08:00
• 5700b19cbf [diffusion] feat: support tp for qwen-image-edit-2511 (#18619) xiaoyeandMick 2026-02-13 13:04:29 +08:00
• d29e331491 [Spec] Move forward timeout before verify to fix Eagle v1 filter mismatch (#18760) Liangsheng Yin 2026-02-12 20:58:34 -08:00
• 7d4ae057ec [Kernel] Add JIT rotary_embedding_kernel (#17934) 4 people 2026-02-13 12:41:25 +08:00
• 32e0286829 [diffusion] fix: fixe local model loading issue in bench_serving (#18687) 3 people 2026-02-13 12:57:52 +09:00
• f4d80f9d42 [diffusion] feat: allows quality adjustment of generated images/videos (#17937) HuangJi 2026-02-13 11:56:20 +08:00
• 6555b2a71d [diffusion] fix: fix ci on amd (#18716) Bingxu ChenandMick 2026-02-13 11:51:24 +08:00
• f65c885e7c Modify glm5 readme on npu (#18768) BourneSun0527 2026-02-13 11:42:40 +08:00
• bc2405e6c1 feat: support release lookup (#18450) shuwenn 2026-02-13 10:47:02 +08:00
• c56a5efbaa [Auto Sync] Update grok.py (20260213) (#18765) 3 people 2026-02-12 18:41:41 -08:00
• d5f66fec15 Revert changes to weight_utils.py (#18759) Lianmin Zheng 2026-02-12 17:15:16 -08:00
• dd77bd4651 Fix invalid import paths in glm_image.py (#18757) Alison Shao 2026-02-12 16:44:34 -08:00
• 9815ee934c [Auto Sync] Update weight_utils.py (20260212) (#18692) 3 people 2026-02-12 16:26:05 -08:00
• b48fe1d95e [Diffusion] [BUG] Fix missing initialization of GLM-Image text encoder config (#18704) Hao JinandHao Jin 2026-02-12 16:19:22 -08:00
• f4417475b8 Build ROCm7.2 Image with latest AITER v0.1.10.post3 (#18741) HAI 2026-02-12 14:30:13 -08:00
• 2a8a48c0ca Reuse initialized transfer engine in mooncake store (#18460) Shangming Cai 2026-02-13 01:21:35 +08:00
• 0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) Simo Lin 2026-02-12 09:17:24 -08:00
• e730c728d3 fix: image version in pypi pr workflow (#18735) Douglas Yang 2026-02-12 08:18:01 -08:00
• 9e9e949261 speed up sgl-kernel build (#18586) Xiaoyu Zhang 2026-02-12 23:43:22 +08:00
• 2f283d8152 refactor: consolidate gRPC client into shared crate dependency (#18730) Simo Lin 2026-02-12 06:43:24 -08:00
• 1b8f68af57 Fix B200 installation issue (#18725) Kangyan-Zhou 2026-02-12 22:06:23 +08:00
• b168723424 [BUGFIX] fix bug in handle mamba radix cache in server_args (#18723) Yi Zhang 2026-02-12 21:33:32 +08:00
• 92c5749f41 refactor: replace local proto compilation with smg-grpc-proto package (#18682) Simo Lin 2026-02-12 05:29:24 -08:00
• c59b9223e6 Add spec_accept_histogram request statistic (#18332) Scott Lee 2026-02-12 05:09:21 -08:00
• 0abe4a22c6 Fix flaky penalty tests by using higher temperature for effect comparison (#18380) Alison ShaoandLiangsheng Yin 2026-02-12 05:08:37 -08:00
• f116b3a51b Make PR based docker and pypi workflow work for forked PR (#18720) Kangyan-Zhou 2026-02-12 21:05:17 +08:00
• f3656432c7 add tool_choice=auto nightly test case (#18302) Hudson Xing 2026-02-12 03:28:05 -08:00
• e20e6c28b9 [AMD] Fix accuracy issue when running TP4 dsv3 model with mtp (#18607) 3 people 2026-02-12 17:13:16 +08:00
• d6f0ef677b [AMD] reset AMD image release time and reduce CI queue time (#18707) YC Tseng 2026-02-12 17:05:53 +08:00
• f20b1703ce [CI] Fix torchaudio/torchvision CUDA version mismatch (#18211) Alison Shao 2026-02-11 23:47:32 -08:00
• 1edc69be08 [Ascend]Support qwen3.5 (#18544) chenxu214 2026-02-12 15:22:47 +08:00
• 0305d12df2 [AMD] Enable release image build for ROCm 7.2.0 (#18698) Alan Kao 2026-02-12 15:16:54 +08:00
• feaa9e7e00 [diffusion] fix: replace TextEncoderConfig with Qwen3TextConfig for Z-Image (#18560) Vinh H. PhamandMick 2026-02-12 13:31:23 +07:00
• c9297661b9 fix: /metrics endpoint always reports engine_type="unified" in PD disaggregation mode (#18552) JooYeonandjoo_yeon.lee 2026-02-12 15:20:43 +09:00
• d91ce176bf Update README commands to include model-path option (#18557) Li JinliangandMick 2026-02-12 14:15:26 +08:00
• 4ed2548427 [Qwen3_5] Refactor Qwen3_5ForCausalLMMTP class implementation (#18538) Zheng Li 2026-02-12 13:38:26 +08:00
• 454676811e [Flashinfer Autotune] Fix FlashInfer FP4 MoE autotuning crash by removing incorrect flatten on hidden_states_scale (#18500) YAMY 2026-02-11 21:31:27 -08:00
• 20554a0a4f [AMD] rocm 7.2 image release, PR test, Nightly Test (#17799) 4 people 2026-02-12 13:29:25 +08:00
• 93ede0db19 Update ci permission (#18693) Ke Bao 2026-02-12 13:25:43 +08:00
• 3404dda592 Try fix the max-parallel for maunally triggered test again. (#18686) Liangsheng Yin 2026-02-11 20:08:25 -08:00
• e422bcaed8 [Mamba] Add float16 support for SSM cache dtype (#18444) danielafrimi 2026-02-12 05:27:47 +02:00
• 7e262b6496 Update modelopt quantization config parsing (#13919) Zhiyu 2026-02-11 19:08:29 -08:00
• b2d7fd5c87 fix the max-parallel for /rerun-stage (#18658) Liangsheng Yin 2026-02-11 19:06:51 -08:00
• 123f57b84b update glm5 readme on npu (#18657) fy 2026-02-12 10:37:12 +08:00