Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 6292d97135 [diffusion] fix: fix pack qkv opt break tensor parallel (#15225) Xiaoyu Zhang 2025-12-16 14:33:49 +08:00
• c843419562 Remove duplicate bs=1 in nightly benchmark (#15162) Baizhou Zhang 2025-12-15 22:09:22 -08:00
• 3e4d431a44 [Feature] Add AIME25 dataset support for SGLang simple_eval (#14990) 3 people 2025-12-16 14:59:40 +09:00
• 538e733e08 [AMD CI] Fix typo. (#15229) Sai Enduri 2025-12-15 21:47:01 -08:00
• 22587bc0b4 [BugFix] Fix CPU inference failure (#15231) Yibo Cai 2025-12-16 13:32:41 +08:00
• 02d24244e4 [AMD CI] Temporarily disable 2 gpu accuracy test. (#15204) Sai Enduri 2025-12-15 20:57:26 -08:00
• 1da5cd638f [Bugfix][Tool Call] Add null system prompt to support tool system prompt (#15092) Muqi Li 2025-12-16 11:40:10 +08:00
• a9a2cdd8ec Add EPD disaggregation doc (#15224) Tianyu Guo 2025-12-16 11:22:05 +08:00
• 4733fcff1f [Feature] npu support enable_torch_compile for torchair backend (#13410) XDaoHongandZhengdQin 2025-12-16 09:23:51 +08:00
• 3ffa260474 chore: update CI_PERMISSIONS (#15212) Yineng Zhang 2025-12-15 15:09:05 -08:00
• 61f362c694 feature: create docker image from pr branch (#15185) Douglas Yang 2025-12-15 10:53:50 -08:00
• e7157c9b77 Add cache for flashinfer installation (#15153) Kangyan-Zhou 2025-12-15 10:37:34 -08:00
• 30da2f0598 [NPU][eagle3] support qwen eagle3 on NPU (#14820) Liwansi 2025-12-16 02:25:13 +08:00
• 4901693110 [diffusion] perf: support FFN pack gate and up proj for Z-Image(#15201) 3 people 2025-12-16 01:18:47 +08:00
• 3d484be547 fix(attention): Prevent trtllm_mha auto-selection with eagle3 speculative decoding (#15127) ratish 2025-12-15 20:42:26 +04:00
• c0d94440b7 [diffusion] perf: support pack qkv for Z-Image (#15191) Xiaoyu Zhang 2025-12-16 00:22:24 +08:00
• 1dedb63860 [diffusion] chore: minor code cleanups (#15190) Mickandgemini-code-assist[bot] 2025-12-15 23:57:02 +08:00
• 7bc8b1532e [diffusion] fix: fix AttributeError in _build_parallelism_config when accessing tp_group.device_group (#15196) Xiaoyu ZhangandMick 2025-12-15 23:41:06 +08:00
• 9003a4369d Add missing assertion in NemotronH path (#15193) roikoren755 2025-12-15 16:17:21 +02:00
• 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) Simo Lin 2025-12-15 04:57:42 -08:00
• b098b1ae24 [diffusion] fix: fix video model sp when resolution is not specified (#15047) MickandBrain97 2025-12-15 20:25:43 +08:00
• abd3e048f2 [diffusion] fix: fix pytorch non-writable array warning (#15017) Lancer 2025-12-15 20:18:54 +08:00
• 92c29d43ac [diffusion] fix: cache dit with parallel (#15163) Xiaoyu ZhangandMick 2025-12-15 19:15:51 +08:00
• bf6438142a chore: change npu pr-test a2 runner (#15152) Goalina 2025-12-15 19:03:19 +08:00
• f03bfa4ce3 [Feature] Fuse mrope all in 1 kernel (#14906) DarkSharpness 2025-12-15 18:50:55 +08:00
• 89ad390843 Fix num running requests (load) wrong cleared for ongoing requests (#15116) fzyzcjy 2025-12-15 17:40:04 +08:00
• 2ea844ec81 Fused two elementwise kernels for k_nope and k_pe concat (#14862) kk 2025-12-15 17:33:33 +08:00
• 1e2d753804 fix: adding date and fixing release name issue (#15174) Douglas Yang 2025-12-15 01:11:03 -08:00
• d16ff357db [CPU] Add Gemma3RMSNorm kernel in sgl-kernel and add ut (#9324) blzheng 2025-12-15 16:24:02 +08:00
• af49e30242 feature: PR wheel (#15170) Douglas Yang 2025-12-15 00:22:47 -08:00
• 01b955ac3d [diffusion] model: support mutli-image input and qwen-image-edit-2509 (#15005) Yuhao Yang 2025-12-15 16:17:10 +08:00
• 16e6bc20b0 fix CompressedTensorsW8A8Int8 min_capability (#13914) 3 people 2025-12-15 15:50:39 +08:00
• 372507649d Tiny improve summary text in bench_one_batch_server.py (#15158) Liangsheng Yin 2025-12-15 14:59:11 +08:00
• 7b9156c773 [model-gateway] add mcp and discovery metrics (#15156) Simo Lin 2025-12-14 22:54:53 -08:00
• 21cfebac65 fix: move ci-bot (#15154) Douglas Yang 2025-12-14 22:47:19 -08:00
• 702426b06a Fix import warnings (#15144) Lianmin Zheng 2025-12-14 21:25:18 -08:00
• 9e9a61691e ci: adding errors to Github summary (#14778) Douglas Yang 2025-12-14 21:08:16 -08:00
• bd9c3a47d6 [model-gateway] Add streaming metrics for harmony gRPC router (#15147) Simo Lin 2025-12-14 20:54:43 -08:00
• 1e641ee4a7 [model-gateway] upgrade axum and axum server (#15146) Simo Lin 2025-12-14 20:54:01 -08:00
• fb96669ff9 [model-gateway] Add Layer 3 worker metrics (smg_worker_*) (#15130) Simo Lin 2025-12-14 20:25:46 -08:00
• 3912ee4991 [VLM] feat: support chunked vit attention (#14907) Yuan Luoandluoyuan.luo 2025-12-15 12:11:02 +08:00
• 1ab9b8e0a3 Enable TRT AllReduce Fusion by default (#14764) b8zhongandBrayden Zhong 2025-12-14 20:01:49 -08:00
• e61dabf5e4 [Qwen3-next] support mamba radix cache for overlap scheduler (#14792) Hanming Lu 2025-12-14 18:54:16 -08:00
• 36e7c8c59f docs: update usage (#15142) Yineng Zhang 2025-12-14 18:42:21 -08:00
• 037c3982af Fix H200 CI by commenting out Warmup Weights and JIT Compilation (#15139) Kangyan-Zhou 2025-12-14 18:04:28 -08:00
• 62b3fdae43 Fix cache aware wrong routing caused by incorrect load tracking (#15101) fzyzcjy 2025-12-15 10:03:54 +08:00
• 1cd0c3bfb7 Add cyb70289 to CI permissions (#14938) Yibo Cai 2025-12-15 09:51:30 +08:00
• 2c899431f8 fix: adjusting frequency for ci failure monitor (#15134) Douglas Yang 2025-12-14 17:49:57 -08:00
• 4513f549ee [diffusion] fix: fix default resolution 720p width from 1080 to 1280 (#15058) Xiaoyu Zhang 2025-12-15 09:16:47 +08:00
• c96903074c [NSA] Fix NSA backend assertion error when running DeepSeek-V3.2 PP with radix-cache (#15086) YAMY 2025-12-14 17:13:18 -08:00
• 4449c17011 [model-gateway] fix circuit breaker metrics (#15099) fzyzcjyandSimo Lin 2025-12-15 07:43:04 +08:00
• 5ca962ce7f [model-gateway] extract circuit breaker state struct (#15098) fzyzcjy 2025-12-15 07:40:23 +08:00
• bab20a849e [model-gateway] Parallelize metrics requests (#14953) Praneth Paruchuri 2025-12-15 05:08:45 +05:30
• 0e4108ba29 feat(gateway): Add server-side TLS support (#15052) ratish 2025-12-15 03:37:55 +04:00
• 99cb2ed988 [refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044) Hudson Xing 2025-12-14 15:22:37 -08:00
• 0612175ce1 [model-gateway] add streaming metrics (TTFT, TPOT, tokens, duration) for gRPC router (#15125) Simo Lin 2025-12-14 14:39:10 -08:00
• 8c96fcda70 feature: ci failure monitor slack bot (#15110) Douglas YangandClaude Sonnet 4.5 2025-12-14 13:47:15 -08:00
• ea7c69ce28 [hotfix]: Add missing args for 3FS bench_client.py (#14791) zhanghengandZhiqiang Xie 2025-12-15 05:13:19 +08:00
• 8102e36b5d Add NanoV3 reasoning parser support (#15113) danielafrimi 2025-12-14 22:09:44 +02:00
• 3f0482174a Fix Mamba2-based models' default attention backend (#15117) roikoren755 2025-12-14 21:08:48 +02:00
• b11af135eb [model-gateway] feat(metrics): implement Layer 2 router metrics (smg_router_*) (#15124) Simo Lin 2025-12-14 10:34:12 -08:00
• f9bceea064 [model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121) Simo Lin 2025-12-14 09:39:15 -08:00
• 997ea57eaf Fix tensor mismatch error in sepc + topk > 1 + page_size > 1 (#14874) Ziming Huang 2025-12-15 01:10:58 +08:00
• 47633c191f [model-gateway] Add new SMG metrics architecture with 6 layers (#15106) Simo Lin 2025-12-14 08:37:19 -08:00
• 64b5c3ab90 [diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090) Xiaoyu ZhangandMick 2025-12-15 00:33:29 +08:00
• d277a86dea [CI] Add disaggregation decode PP test (#15114) Shangming Cai 2025-12-14 23:54:25 +08:00
• 9acb21ae27 feat: support EPD disaggregation (#12263) 6 people 2025-12-14 22:30:08 +08:00
• a9ce1623cd [kernel][moe] add moe topk fast (#13969) zyl_keep_movingandXiaoyu Zhang 2025-12-14 22:26:40 +08:00
• 6f0c77d7f8 [diffusion] app: support webui (#14961) Li JinliangandMick 2025-12-14 21:07:36 +08:00
• e3f51e823e [diffusion] feat: add support for additional sampling parameters in video generation API (#15062) Xiaoyu ZhangandMick 2025-12-14 19:44:03 +08:00
• fdfabb7afc [diffusion] fix: tiny fix _templated_ring_attention bug (#15053) 3 people 2025-12-14 19:41:53 +08:00
• 19c16748ce [diffusion] feat: support resolution check for video model (#14881) 3 people 2025-12-14 17:50:13 +08:00
• 5c75907e62 Introduce native kv cache move (#15108) Liangsheng Yin 2025-12-14 17:23:28 +08:00
• 4ea3642250 [NPU] bug fix for multi stream (#15048) liupeng374 2025-12-14 16:38:12 +08:00
• f50af32d8b [scheduler] remove scheduler allgather for best throughout (#14294) liupeng374 2025-12-14 16:37:49 +08:00
• 729529190d [ci] Move dpsk-r1-fp4 b200 test to stage b (#15084) Qiaolin Yu 2025-12-13 23:14:08 -08:00
• 2ae5bed193 [NPU][CI] change de trigger of release image workflow (#14969) monkeyLoveding 2025-12-14 15:11:47 +08:00
• 54df514bac Avoid confusing zero value metric when worker is removed (#15096) fzyzcjy 2025-12-14 13:57:20 +08:00
• 681c68cfbf Fix issue not reported when load decrement is incorrect (#15061) fzyzcjyandgemini-code-assist[bot] 2025-12-14 13:17:35 +08:00
• 74ea45cc4b [model-gateway] optimize metric labels to avoid unnecessary allocations (#15095) Simo Lin 2025-12-13 21:10:45 -08:00
• 0fa044ad63 [model-gateway] Add circuit breaker and discovery watcher metrics (#15094) Simo Lin 2025-12-13 20:47:04 -08:00
• 7d8e42c979 [model-gateway] Fix metric emission gaps and name mismatch (#15093) Simo Lin 2025-12-13 20:16:30 -08:00
• 6abdf73f4d [Fix] Environment variable SGL_* is deprecated (#14943) Huang Lin 2025-12-14 11:55:43 +08:00
• 20ce9938b5 [model-gateway] Remove unused TokenizerMetrics to reduce CPU overhead (#15087) Simo Lin 2025-12-13 18:54:18 -08:00
• 168a31eb00 Support prefill max requests limitation (#14993) fzyzcjy 2025-12-14 10:52:10 +08:00
• 69cfb17b9a [Fix] avoid stream sync in _compute_mrope_positions (#14956) narutolhy 2025-12-13 18:50:57 -08:00
• a7a4b1755d [Doc][TPU]add sglang-jax tpu docs (#15056) Brian 2025-12-14 09:29:41 +08:00
• fdc93b019c Add sglang:decode_sum_seq_lens metric (#15066) fzyzcjy 2025-12-14 08:42:45 +08:00
• fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) Simo Lin 2025-12-13 15:00:16 -08:00
• 96705514bd fix: dpskv32 chat history processing, default drop_thinking to true (#15064) Xinyuan Tong 2025-12-13 20:16:04 +00:00
• ab3ffd1c8e Add nightly accuracy test for DeepSeek V3.2 (#14935) Baizhou Zhang 2025-12-13 12:11:16 -08:00
• 2285affffa [model-gateway] Avoid MCP Server Initialization Issue (#15065) Wenyi Xu 2025-12-14 03:20:16 +08:00
• a81cc1b8b3 add transformers version validation for glm-4.6v moe models (#14998) Yuhao Yang 2025-12-14 02:54:08 +08:00
• 3134d2b2a7 [scheduler] enhance scheduler in dp_attention mixed case with spec (#14201) liupeng374 2025-12-14 02:52:26 +08:00
• 06b58c5dc5 fix flaky image access in ci by switching to raw content url (#14940) Yuhao Yang 2025-12-14 02:52:06 +08:00
• ea07a283b2 fix: adding schedule for nightly wheel (#15054) Douglas Yang 2025-12-13 10:48:21 -08:00
• ea91a720d5 feature: ci failure monitor improvements (#15055) Douglas Yang 2025-12-13 10:47:52 -08:00
• 5d9c6bac07 [bug] fix grpc secheduler launcher breaking change (#15080) Simo Lin 2025-12-13 10:36:49 -08:00
• e048ee90fc [model-gateway] Simplify error response creation (#15079) Simo Lin 2025-12-13 10:28:24 -08:00
• ed52d01b0b Fix spec info's filter when reqs are finished right after prefill (#14742) Liangsheng Yin 2025-12-14 00:32:54 +08:00