Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 922525ee6d fix: fix serve command without diffusion dependency (#13246) Mick 2025-11-14 10:24:18 +08:00
• ee3e337c62 [feat] make warmup timeout configurable through SGLANG_WARMUP_TIMEOUT (#13243) billishyahao 2025-11-14 10:14:37 +08:00
• e523e2167a remove deprecated tile_tokens_dim (#13186) b8zhong 2025-11-13 17:09:27 -08:00
• 2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) Hubert Lu 2025-11-13 17:03:41 -08:00
• 19f6a33ce9 [Auto Sync] Update pynccl_wrapper.py, environ.py, registry.... (20251111) (#13097) 3 people 2025-11-13 15:58:47 -08:00
• e9c0c55833 [sgl-kernel] clean up fa fetch in CMakeLists.txt (#12392) Fan Yin 2025-11-14 07:42:09 +08:00
• 9b41f31a66 Use 32x32 black image for VLM server warmup and bring glm4.1v back to UT (#13222) Binyao Jiang 2025-11-13 14:21:43 -08:00
• 9db3add319 Update GDN causal conv1d cuda kernel - prepare for new changes (#13188) Binyao Jiang 2025-11-13 14:09:47 -08:00
• c9e5799bd1 [router][grpc] Refine docs in minimax_m2 to match other parsers (#13218) Chang Su 2025-11-13 13:47:24 -08:00
• 2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) Fan Yin 2025-11-14 04:45:21 +08:00
• 8779100768 Fix wrong running_bs in priority scheduling (#13142) dtc 2025-11-14 03:56:38 +08:00
• dd192a55f4 [Feature] Enable CUDA graph for PD-Multiplexing. (#11595) ykcombat 2025-11-14 03:39:40 +08:00
• bfe638f7e8 Fix broken Markdown formatting in DeepEP documentation (#13210) Taishi Nakamura 2025-11-14 04:34:57 +09:00
• 4ac65e3c7d [PD / HiCache]fix deocde kvcache offload manager memory leak (#12774) huangtingwei 2025-11-14 03:31:53 +08:00
• 0779c3d148 docs: update fused MoE config path (#13211) Junlin Zhou 2025-11-14 03:14:01 +08:00
• 5c2d72ba63 Bump actions/download-artifact from v4 to v6 for B200 workers (#13220) Kangyan-Zhou 2025-11-13 10:23:58 -08:00
• 9bd511a582 Add model validation for all GPU runners to prevent cache corruption (#13171) alisonshaoandKangyan Zhou 2025-11-13 10:16:41 -08:00
• 85b8c5c4cd Set max parallel for 1-gpu runner (#13215) Liangsheng Yin 2025-11-14 01:36:43 +08:00
• c8b7516fe8 Fix accept rate in speculative decoding metrics (#13212) neo 2025-11-14 00:54:50 +08:00
• 67e9d287ee [Quantization] Support Quark Dense + MoE FP8 & FP8 PTPC (#10485) 3 people 2025-11-13 08:16:00 -08:00
• e7e89349c9 Enable Flashinfer TRTLLM-GEN-MoE FP8 blockwise kernel for Qwen3-Next on Blackwell (#12543) Sam 2025-11-13 19:44:44 +08:00
• aead0ef5e5 [FEAT][ROCM] enable fused shared expert for Rocm (#12201) 3 people 2025-11-13 16:41:40 +08:00
• 6664083522 Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376) Shu Wang 2025-11-13 02:26:00 -06:00
• c2d69e8b56 fix: display served_model_name in /v1/models (#13155) Edmund Suen 2025-11-13 16:07:55 +08:00
• 4c1e909a80 [router] minmax-m2 xml tool parser (#13148) Simo Lin 2025-11-13 16:24:54 +09:00
• 2bb0317e19 Remove enable_dp_attention in deepseek nightly tests (#13190) Kangyan-Zhou 2025-11-12 22:58:57 -08:00
• 86255f27b4 Revert "fallback to triton mm_persistent kernel when deepGemm fail" (#13178) fzyzcjy 2025-11-13 14:03:35 +08:00
• e4b2937017 [AMD] Add AITER Custom All-Reduce (#13102) 3 people 2025-11-12 21:53:44 -08:00
• 7a8524b444 [Ascend] add npu synchronize (#13154) Mayyyyandmay_feimei 2025-11-13 11:03:32 +08:00
• 909d0d382f docker: fix build error in Dockerfile.diffusion (#12975) Edmund Suen 2025-11-13 09:58:16 +08:00
• e42df37df0 Remove EBNF Composer (#13163) Tejesh Anand 2025-11-12 17:55:30 -08:00
• 6d21392b0e [router] remove worker url requirement (#13172) Simo Lin 2025-11-13 10:32:58 +09:00
• a1cb717d0b Opt kimi_k2_thinking biased topk module (#13150) Xiaoyu Zhang 2025-11-13 08:52:06 +08:00
• c94564912e Add RequestMetricsExporter utility to export request-level metrics (#10973) Scott Lee 2025-11-12 16:33:37 -08:00
• c4b74c1db2 [Ascend] LoRA: adding Ascend LoRA backend with using kernels from sgl_kernel_npu (#12288) 3 people 2025-11-13 03:20:34 +03:00
• 7aa443903d Fix nan in global scaling factor for large scale nvfp4 EP (#13162) Shu Wang 2025-11-12 17:32:23 -06:00
• 4eda9969e8 [DeepseekV32]: use _concat_mla_absorb_q_general to replace torch.cat (#12215) bingpsandGuangda Liu 2025-11-13 07:20:01 +08:00
• 03a7e6f4db Add job and runner failure monitor workflow for CI (#13104) Douglas Yang 2025-11-12 14:04:50 -08:00
• 2cdde3d46d [router] Fix Flaky test_circuit_breaker_opens_and_recovers (#13164) Xinyue Zhang 2025-11-12 12:07:42 -08:00
• 401ed0c594 [router] Add comprehensive validation to Responses API (#13127) Keyang Ru 2025-11-12 11:19:27 -08:00
• 4ef4390540 bugfix: multi-model routing for /generate api (#12979) 3 people 2025-11-13 03:13:27 +08:00
• d646cf6347 [Auto Sync] Update test_deterministic.py (20251112) (#13128) Lianmin ZhengandStefan He 2025-11-12 11:12:23 -08:00
• 4edb240112 Fuse routed_scaling_factor to fused_marlin_moe (#12998) Ke Bao 2025-11-13 00:18:58 +08:00
• 706502ff6c [VLM] Support PP for Qwen2.5-VL (#13075) 3 people 2025-11-12 23:18:44 +08:00
• c2e56dadb2 [Ascend] torch_npu.npu_mrope for MRotaryEmbedding (#10907) 3 people 2025-11-12 16:45:54 +03:00
• 9c1c5c6d7d [ngram] use SGLANG_NGRAM_FORCE_GREEDY_VERIFY to control verify method (#13153) Zhihao Zhanganda4zhangfei 2025-11-12 21:07:33 +08:00
• 2d531946db [Ascend][feature] support L1+ L2 radixcache on ascend (#12214) 3 people 2025-11-12 20:45:24 +08:00
• ebaf86d441 chore: bump SGLang version to 0.5.5.post2 (#13129) sglang-bot 2025-11-12 20:35:20 +08:00
• 8359f185a1 [Feature] Propagate Trace Headers into Root Span for OpenTelemetry Cross-Service Context (#10808) zhanghaotong 2025-11-12 20:28:59 +08:00
• 5324f37ab3 [Ascend]adapt enable-profile-cuda-graph for NPU (#12617) 3 people 2025-11-12 14:57:24 +03:00
• 2864c49fbc [RPC] Fix handle_rpc_request with **recv_req.parameters (#7906) Charlie Ruan 2025-11-12 03:29:12 -08:00
• d26ec39ff2 Update aiter to v0.1.7.post1 (#13149) sogalin 2025-11-12 19:09:44 +08:00
• 9c546bfd6d Fix the Wrong Return Type of Scheduler.recv_requests (#7886) Yikai Zhang 2025-11-12 04:54:56 -06:00
• c9b581644d Dump total_throughput to output-file in bench_serving.py (#9790) Rohan Potdar 2025-11-12 04:48:28 -06:00
• e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) Chang Su 2025-11-12 02:29:20 -08:00
• ffeb28ba6f fix: duplicate resize images logic of qwen-vl series models (#12458) SijiaYang 2025-11-12 18:08:40 +08:00
• b40f605fde fix(tcp-port): replace bind_server_socket to get_zmq_socket(Port conflict) (#11961) Jimmyandwangchao 2025-11-12 18:05:16 +08:00
• 3cdec20c6b [router] add minmax m2 reasoning parser (#13137) Simo Lin 2025-11-12 18:27:05 +09:00
• d28caaf60a [router] Support complex assistant and tool messages in /chat/completions (#12860) 3 people 2025-11-12 00:14:15 -08:00
• ad8d24c39e Fix re-trigger actor of CI rate limit (#13136) Liangsheng Yin 2025-11-12 16:10:27 +08:00
• 018123b5b0 [misc] Remove performance and router-benchmark label matching (#13135) Chang Su 2025-11-12 00:04:20 -08:00
• 4983b7e7aa Fix strict level setting for Kimi K2 tool calls when not explicitly set (#13077) Xinyuan Tong 2025-11-12 00:01:42 -08:00
• f825137f8a fix: Remove dupulicated kv_events initialization in scheduler (#13132) wxsm 2025-11-12 15:54:47 +08:00
• ae68158f2e [router] move radix tree to policy crate and addreses some code styles (#13131) Simo Lin 2025-11-12 16:36:04 +09:00
• a7cc02e36e Fix run suite sanity check (#13133) Ke Bao 2025-11-12 15:29:10 +08:00
• 8ece99a9dc [CI] Update job dependency and move dpsk v3.2 tests to 8-gpu suite (#12942) Baizhou Zhang 2025-11-11 23:16:47 -08:00
• 44e391b6e9 [PD] Add custom gpu id to device topo support (#12817) Teng MaandShangming Cai 2025-11-12 15:00:45 +08:00
• 1a5c313f97 feat(engine): add rid parameter to methods in Engine class (#13095) ishandhanani 2025-11-11 22:37:54 -08:00
• 7ea5b42d70 [sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666) Qi YuhangandFan Yin 2025-11-12 13:23:25 +08:00
• 5ded5e2729 [Feature] Trace: Support http/protobuf span exporter protocol (#12396) zhanghaotong 2025-11-12 13:16:43 +08:00
• 33d1aeb07f diffusion: refactor task type of models (#13118) Mick 2025-11-12 12:39:34 +08:00
• dd909a511c Fix gpt oss 4gpu b200 trace links (#12872) alisonshao 2025-11-11 20:31:41 -08:00
• 60cb716720 [diffusion] log: improve logging while multiprocessing (#12997) Mick 2025-11-12 12:08:37 +08:00
• 151e13687a Don't fuse wk+weight_proj for nextn (#12863) Trevor Morris 2025-11-11 20:02:52 -08:00
• 2f9952cdbf diffusion: remove unused workflows folder (#13114) Mick 2025-11-12 11:51:24 +08:00
• 3e7cc27318 At least tell the user that ngram verify is greedy! (#13039) MayDomine 2025-11-12 11:29:33 +08:00
• 8f01a12d43 Improve overlap scheduling for better TTFT (#11856) vipwangerxiaoandPeng Wang 2025-11-12 11:24:04 +08:00
• 28b8c5792d Upgrade to ROCm 7.0 image (#13105) yctseng0211 2025-11-12 11:14:28 +08:00
• 7b877ab83d [Router] use call_id instead of id for matching function calls in Responses API for Harmony (#13056) Ziwen Zhao 2025-11-11 17:16:47 -08:00
• 0d4a418424 [Deepseek V3.2] Fix accuracy bug in the Indexer (#12583) hlu1 2025-11-11 16:15:26 -08:00
• 2ca25a8aab Revert "fix: display served_model_name in /v1/models" (#13093) Chang Su 2025-11-11 15:58:46 -08:00
• cc2e36c352 overlap shared + routed expert computation in kimi linear (#12660) b8zhong 2025-11-11 14:52:58 -08:00
• d8f7816aba [AMD CI] Update nightly docker build CI config. (#13090) Sai Enduri 2025-11-11 14:52:44 -08:00
• 99e25805f5 [Fix] Fix nan error for large scale ep (#12866) Baizhou Zhang 2025-11-11 14:44:57 -08:00
• 4a2768a86b Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915) Qiaolin Yu 2025-11-11 13:30:33 -08:00
• 9b247f7374 Export runner labels via env var (#13018) Kangyan-Zhou 2025-11-11 13:08:54 -08:00
• 36d147121f [AMD] Apply AITER_MXFP4_MOE_SF=1 only to gfx950 in aiter build (#13092) Hubert Lu 2025-11-11 12:26:09 -08:00
• e0e6a6efb2 Fix CPP Radix Cache and add test to CI (#11645) cctry 2025-11-11 11:51:37 -08:00
• e8114102fa [Fix] Update text_chunks in bench_serving chat completions (#13041) Ziming Huang 2025-11-12 03:41:11 +08:00
• 14a339fcc8 [Test] Handle streaming chunks with null content in case of stream end. (#10862) vikram singh shekhawatandsvc_repro_tool 2025-11-11 23:33:50 +05:30
• 5f662e786f Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088) Liangsheng YinandHubert Lu 2025-11-12 01:23:55 +08:00
• 7f5055ed5e Fix cached tokens usage bug (#12814) Frank MinorsandFrankMinions 2025-11-12 01:02:43 +08:00
• 63728b1154 [Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941) Johnsonms 2025-11-11 08:52:02 -08:00
• 5de25f786e [BugFix] Fix prefill memory leak in PD + GDN (#12994) Ziming Huang 2025-11-12 00:48:07 +08:00
• d52800dbf5 Support file:// scheme in load_video (#13076) Netanel Haber 2025-11-11 18:36:37 +02:00
• 38a704bccb refine stdout logging codes (#13015) yinghui 2025-11-11 08:16:14 -08:00
• a06c44f905 fix: display served_model_name in /v1/models (#13063) Edmund Suen 2025-11-12 00:13:58 +08:00
• 527b7d3f59 [RadixTree] Reduce Stack Push/Pop Overhead for Leaf Nodes, Improve radix_tree Leaf Collection Performance (#12199) PiteXChen 2025-11-11 23:35:39 +08:00
• f09eee036d Tiny simplify evcition metrics collector (#12983) Liangsheng Yin 2025-11-11 23:23:48 +08:00
• e38994dd71 Update rope dtype config (#13037) Ke Bao 2025-11-11 22:47:29 +08:00