Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 90e7d4f78f Tiny adjust CI run suite (#15074) Liangsheng Yin 2025-12-14 00:05:19 +08:00
• c20d43d2e6 [diffusion] doc: update profiling.md with output location details (#15072) Mick 2025-12-13 23:15:23 +08:00
• d977dd2e07 Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740) Liangsheng Yin 2025-12-13 23:04:41 +08:00
• 0c23331e2e [diffusion] doc: add multimodal-gen profiling doc (#15069) 3 people 2025-12-13 22:26:20 +08:00
• 993278b488 Fix double decrease load (#15060) fzyzcjy 2025-12-13 22:12:35 +08:00
• 9e9d910744 Fix load metric not updated when using guard (#15059) fzyzcjy 2025-12-13 22:11:52 +08:00
• 3b8a824b8b [VLM] Support VLM ViT Piecewise CUDA Graph (#14422) 3 people 2025-12-13 20:49:40 +08:00
• f1bbd26ff7 Clean up GDN Init (#14855) Stefan He 2025-12-13 02:56:54 -08:00
• d36299ad77 [NPU] perf update with kvcache nz & w4a8 quant (#14423) liupeng374 2025-12-13 17:39:55 +08:00
• 0e7d7969d5 [PP Prefill][NIXL] Fix PP mode transfer completion tracking to wait for all ranks (#15027) YAMY 2025-12-13 00:55:28 -08:00
• 80554598d3 Fix GLM-4.6 tool calls don't support streaming output for arguments i… (#13989) cynialandgemini-code-assist[bot] 2025-12-13 16:37:18 +08:00
• b2e240bc4a feature: adding nightly wheel workflow and indexer (#14924) Douglas Yang 2025-12-13 00:26:10 -08:00
• dcc5f5c0da [diffusion] feat: Improve LoRA compatibility by adding unified format detection and diffusers-based normalization (#14659) Fenglin Yu 2025-12-13 03:04:36 -05:00
• 4eda4194f2 [Fix] Disable trtllm moe backend for draft model for a qucik fix (#15002) Sam 2025-12-13 15:58:47 +08:00
• 875f84db7b [diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034) Mick 2025-12-13 13:42:38 +08:00
• f6031adf08 Mistral Large 3 NVFP4 support (#14485) 4 people 2025-12-13 06:34:42 +01:00
• 2a39cfe0ff call check_quantized_moe_compatibility after initialize (#13876) Chunyuan WU 2025-12-13 13:32:19 +08:00
• bf17e769fe Add sgl_router_attempt_http_responses_total for single attempt information (#15037) fzyzcjy 2025-12-13 13:29:18 +08:00
• 9a5d6a84ab Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036) fzyzcjy 2025-12-13 13:28:32 +08:00
• 31c23e5fe3 Provide more fine grained error reason for reqwest error (#15032) fzyzcjy 2025-12-13 13:27:06 +08:00
• 06617a9ec8 Tiny change http router response format to unify (#15031) fzyzcjy 2025-12-13 13:25:45 +08:00
• e79ca95961 Tiny unify grpc existing error responses into new format (#15030) fzyzcjy 2025-12-13 13:25:10 +08:00
• 9d3b411c56 Add code field and unify error responses for router (#15028) fzyzcjy 2025-12-13 13:21:34 +08:00
• 05325db349 Super tiny remove unused log_request (#15035) fzyzcjy 2025-12-13 13:21:24 +08:00
• 01e3b3f3a3 Fix decode OOM caused by retraction (#14939) Liangsheng Yin 2025-12-13 13:59:17 +09:00
• 8698867479 [CI]Add gb200 runner back (#15024) Baizhou Zhang 2025-12-12 20:19:34 -08:00
• 291396544e Add a special label for b200 CI runner that can run kernel tests (#15033) Kangyan-Zhou 2025-12-12 19:41:36 -08:00
• 665cb02003 Fix regression caused by fa3 block_table (#15009) Shu Wang 2025-12-12 21:11:09 -06:00
• 7160283800 Tiny remove the duplicate function in spec v2 (#14957) Liangsheng Yin 2025-12-13 12:08:27 +09:00
• 77873343c4 tiny update: use rope kernel in sgl-kernel for amd (#14955) Qiaolin Yu 2025-12-12 18:48:12 -08:00
• 267170bf1d Clean up server args and engine startup processes (#15015) Lianmin Zheng 2025-12-12 18:46:07 -08:00
• 313f59ad80 Add soft watchdogs to debug soft hangs (#15023) fzyzcjy 2025-12-13 10:41:35 +08:00
• 487cf81a68 Tiny extract SchedulerWatchdog (#15021) fzyzcjy 2025-12-13 10:40:32 +08:00
• df111bc0fe Super tiny add gsp-fast-prepare (#14992) fzyzcjy 2025-12-13 09:45:21 +08:00
• 6d2b3324ef Super tiny fix confusing slash_command_handler hint (#14976) fzyzcjy 2025-12-13 09:42:50 +08:00
• 8cc77261ec Super tiny remove unused argument (#14966) fzyzcjy 2025-12-13 09:41:01 +08:00
• d143b02097 [registry] Add a strict mode to model registration (#14933) Yinghai Lu 2025-12-12 17:25:48 -08:00
• 9b9d21312a Feature/Fix multi lora scheduler blocking issue and evict LoRA None lastly (#14795) Chenxi Li 2025-12-12 17:13:05 -08:00
• 44fd701732 Tune triton fused moe for the case of glm-4.6-fp8 b200 tp4 (#15020) Qiaolin Yu 2025-12-12 17:04:56 -08:00
• 9a56273ad2 [model-gateway] refactor: unify worker management into modular workflow structure (#15010) Simo Lin 2025-12-12 15:25:35 -08:00
• b737a125c5 Update ci permission (#15014) Lianmin Zheng 2025-12-12 14:11:40 -08:00
• 1b5e903480 Refactor of http and engine entrypoints to allow custom override (#14869) Lianmin Zheng 2025-12-12 12:01:08 -08:00
• 171b442ad3 Add KV4-capable backend flashmla and update server args (#14989) Ho-Ren (Jack) Chuang 2025-12-12 11:50:27 -08:00
• 4b7b5af36a Revert several PRs (#14958) Yineng Zhangandfzyzcjy 2025-12-12 11:25:12 -08:00
• ec242f516e Super tiny extract route_typed_request_once (#14951) fzyzcjy 2025-12-13 03:10:10 +08:00
• b243154614 Fix CI by reverting incorrect metric check logic (#15004) Kangyan-Zhou 2025-12-12 10:07:38 -08:00
• 526fd0082f [model-gateway] refactor: workflow engine cleanup and minor optimization (#15001) Simo Lin 2025-12-12 09:03:28 -08:00
• 56d0ad47f4 [model-gateway] fix: handle workflow deadlock and optimize cycle detection (#15000) Simo Lin 2025-12-12 08:53:45 -08:00
• 306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) Simo Lin 2025-12-12 08:31:12 -08:00
• 10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) Simo Lin 2025-12-12 06:29:12 -08:00
• c7c837cd1d Update CODEOWNERS for multimodal_gen (#14995) Mick 2025-12-12 22:08:16 +08:00
• 3e1e71575c [diffusion] docker: Tiny fix Docker Hub link in installation documentation (#14987) 3 people 2025-12-12 20:25:36 +08:00
• 8fa8d9d7e8 [PD] Add decode PP event loop for PD disaggregation (#14945) Kevin LiandShangming Cai 2025-12-12 04:15:00 -08:00
• c8cf1cafdb [1/N] Update doc of Pipeline Parallelism (#14985) Shangming Caiandalpha-baby 2025-12-12 19:32:52 +08:00
• d71baa72dc [diffusion] dependency: upgrade cache-dit for better compatibility (#14534) DefTruth 2025-12-12 18:52:58 +08:00
• 82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) Mick 2025-12-12 18:48:07 +08:00
• 94e1251131 enable flashinfer-jit-cache in image build and ci install to speed up model launch (#14959) gongwei-130 2025-12-11 23:20:44 -08:00
• 4dabfbc827 [Fix] suppress remote weight loading engine w/o mooncake installed (#14937) Zaili Wang 2025-12-12 15:12:26 +08:00
• d7ed8a8c24 [NVIDIA] Enable TRTLLM BF16 MoE on Blackwell GPUs (#13798) Sam 2025-12-12 14:56:13 +08:00
• c05d3afb5d [NPU] optimization for dsv3.2 (#14572) ZhengdQin 2025-12-12 14:52:16 +08:00
• edb172e927 Super tiny refactor error.rs logic (#14949) fzyzcjy 2025-12-12 14:48:18 +08:00
• fe6d38d2fa fix: trtllm mha attention auto-selection on sm120 (#14842) b8zhongandBrayden Zhong 2025-12-11 22:35:25 -08:00
• dab31e4cc7 direct register custom op for mm_fp4 (#13699) b8zhongandBrayden Zhong 2025-12-11 22:33:17 -08:00
• a7fa31ff17 Super tiny move error.rs (#14944) fzyzcjy 2025-12-12 14:25:30 +08:00
• bd91f8824a Super tiny remove non-updated sgl_router_worker_load (#14888) fzyzcjy 2025-12-12 13:19:30 +08:00
• b47adb807e Tiny add e2e http request arrival metric (#14893) fzyzcjy 2025-12-12 13:18:23 +08:00
• b2b5bdb06e Tiny add router e2e duration histogram (#14892) fzyzcjy 2025-12-12 13:18:13 +08:00
• 22fe5da13e Fix negative duration panic in token bucket wait time calculation (#14941) JinYan Su 2025-12-12 13:16:47 +08:00
• 1834401e7c [model-gateway] optimize worker selection (#14894) Praneth Paruchuri 2025-12-12 10:45:12 +05:30
• 198c8ecf98 [diffusion] fix: support applying different LoRA adapters to different transformers in multi-transformer pipelines (#14839) Prozac614 2025-12-12 13:08:57 +08:00
• c01b2ee094 [PP] Refactor PP to async mode (#11852) 6 people 2025-12-12 12:54:16 +08:00
• 8f5adac8c6 [RL] refactor flash rl weight reload in sglang (#14870) Peng Zhangandeternally-z 2025-12-12 12:50:47 +08:00
• 76743a983e [DLLM] Add documentation for diffusion LLMs (#14358) 3 people 2025-12-12 12:29:51 +08:00
• 8bf10e71cd remove dpsk3.2 sys prompt (#14923) Xinyuan Tong 2025-12-12 04:26:13 +00:00
• e4873d0439 Super tiny remove sgl_router_active_workers (#14891) fzyzcjy 2025-12-12 12:00:55 +08:00
• c660d8dfd0 Re-org eagle unit tests (#14909) Liangsheng Yin 2025-12-12 12:25:39 +09:00
• 10146af099 Check KV4 compatibility with attention backends and add KV4 support to the attention_backend doc (#14467) Ho-Ren (Jack) Chuang 2025-12-11 19:00:53 -08:00
• b62e7e3bfe [CI]add nightly CI for glm4v_moe arch model (#14927) Minglei ZhuandBinyao Jiang 2025-12-11 18:29:45 -08:00
• 6ce36b1232 fix: making the publish trace error check broader (#14931) Douglas Yang 2025-12-11 18:19:57 -08:00
• e9e7f15eb5 [bugfix] fix TBO crashes when attn_tp_size > 1 (#13730) Yuhao YaoandCheng Wan 2025-12-12 10:18:40 +08:00
• 0aa3dec5c7 Fix black formatting in ci_utils.py (#14932) Alison Shao 2025-12-11 17:28:52 -08:00
• 4885f8b9c1 fix: handle Jinja2 template errors as client errors in OpenAIServingChat (#14748) Xinyuan Tong 2025-12-12 01:06:26 +00:00
• f832994c32 [CI] Add Mistral Large 3 Eagle nightly performance test (#14525) Alison Shao 2025-12-11 17:01:50 -08:00
• e59435c34b Add retry logic for scheduled CI tests (#14771) Alison Shao 2025-12-11 16:59:58 -08:00
• d6bd2d1126 [CPU] layernorm & fused add-layernorm kernels (#14074) Zaili Wang 2025-12-12 08:58:23 +08:00
• 9975acf50f [refactor] Update reasoning parameter to require_reasoning (#14922) Xinyuan Tong 2025-12-12 00:55:59 +00:00
• 70758d457e support non-disturbing remote-instance-weight-loader (#13125) amysaq2023 2025-12-12 08:45:32 +08:00
• fd1ebbb0d6 update mistral detector (#14921) Xinyuan Tong 2025-12-12 00:43:36 +00:00
• 3d98bd5edf ci: adding more nightly tests to bot bump workflows (#14928) Douglas Yang 2025-12-11 16:26:21 -08:00
• aa3716b29d Update CI_PERMISSIONS.json Kangyan-Zhou 2025-12-11 15:55:50 -08:00
• 6107268fe7 extend timeout for b200 test (#14925) b8zhongandBrayden Zhong 2025-12-11 15:43:53 -08:00
• 5c8bd8b51b chore: bump SGLang version to 0.5.6.post2 (#14858) sglang-botandsglang-bot 2025-12-11 12:29:52 -08:00
• b05b346a13 [loader] enable private loader (#14620) Yinghai Lu 2025-12-11 11:49:46 -08:00
• 5c961756a3 [FIX][DS32]openai protocol: support openai message role: developer (#14304) Jimmy 2025-12-12 03:34:41 +08:00
• c5f1e86117 Update CI_PERMISSIONS.json (#14917) Kangyan-Zhou 2025-12-11 10:14:42 -08:00
• 2c4d376d23 [SMG][DS32][fix] support dsv32, add role developer (#14307) Jimmy 2025-12-12 00:09:09 +08:00
• d0f756aec9 [docs] Fix kernel name (#14887) almaslof 2025-12-11 17:48:16 +02:00
• 6f99dc97f7 [model-gateway] fix imports and delete unused code (#14911) Simo Lin 2025-12-11 07:42:47 -08:00
• cd1c1fa5bc [model-gateway] fix annotation error and code formating (#14910) Simo Lin 2025-12-11 07:06:32 -08:00
• 5b0872d2d7 [model-gateway] code clean up on oai router in responses (#14852) Simo Lin 2025-12-11 06:55:09 -08:00