Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• e11f795f63 chore: bump sgl-kernel version to 0.3.18.post3 (#14427) sglang-botandsglang-bot 2025-12-05 14:09:02 -08:00
• 959a17466d [model-gateway] fix code owner for wasm (#14516) Simo Lin 2025-12-05 13:48:25 -08:00
• b72f0268c7 [model-gateway] fix left over sgl-router names in wasm (#14514) Simo Lin 2025-12-05 13:16:58 -08:00
• 09376fd738 [model-gateway] fix logs in smg workflow (#14513) Simo Lin 2025-12-05 12:50:50 -08:00
• aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) Simo Lin 2025-12-05 12:41:48 -08:00
• 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) Simo Lin 2025-12-05 12:04:48 -08:00
• 1ea6b740a7 [model-gateway] Make Tokenizer Builder Aware of Env Vars Like HF_ENDPOINT (#14405) Wenyi Xu 2025-12-06 02:42:06 +08:00
• e73173b0d7 Fix removing worker will make it healthy forever in prometheus metrics (#14420) fzyzcjy 2025-12-06 02:40:42 +08:00
• 16e8463a90 Add Mistral Large 3 basic test to PR CI (#14460) Alison Shao 2025-12-05 10:38:52 -08:00
• cf9a774cf8 [model-gateway] fix server info comment (#14508) Simo Lin 2025-12-05 10:09:58 -08:00
• ec7b2c16d9 tiny remove deprecated endpoint call (#13607) b8zhong 2025-12-05 09:54:49 -08:00
• 1569fc7f49 [model-gateway] reorganized conversation handler (#14507) Simo Linandkey4ng 2025-12-05 09:31:27 -08:00
• 5a46fb153d [model-gateway] Add WASM support for middleware (#12471) Tony Lu 2025-12-06 01:29:07 +08:00
• 38daa29466 Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093) Hudson XingandQiaolin Yu 2025-12-05 08:53:55 -08:00
• 66984a8b3d [diffusion] feat: support cache-dit integration (#14234) 4 people 2025-12-06 00:52:22 +08:00
• 889b46ea50 [Spec] Mamba2 support in target models (#13434) roikoren755 2025-12-05 18:50:46 +02:00
• 05284378d6 [model-gateway] move conversation to first class routing (#14506) Simo Linandkey4ng 2025-12-05 08:44:13 -08:00
• a89045603b [diffusion] chore: set allowing overriding protected fields of sampling params as default behavior (#14471) Mick 2025-12-06 00:22:42 +08:00
• 662809874c Add Mistral Large 3 to nightly CI tests (#14459) Alison Shao 2025-12-05 07:16:27 -08:00
• 205f041e96 Add Mistral Large 3 Eagle Support (#14466) elvischenvandLinda-Stadter 2025-12-05 23:11:41 +08:00
• 7235a7fbe9 [misc] add model arch and type to server info and use it for harmony (#14456) Simo Lin 2025-12-05 06:51:00 -08:00
• 8fce9e7b2a support GLM-V vision model dp (#14097) Yuxuan Zhang 2025-12-05 21:03:54 +08:00
• 5347732219 [diffusion] fix: Fix profiler trace missing Python stack in diffusion pipeline (#14499) Xiaoyu Zhang 2025-12-05 20:12:35 +08:00
• 2ce121a1c3 Enable RadixCache for Mamba2 models (#13584) roikoren755 2025-12-05 12:23:58 +02:00
• 35ba6fe19e [diffusion] fix: fix CLIP text encoder attention mask not used (#14364) 3 people 2025-12-05 16:30:10 +08:00
• 498ea41ca6 dockerfile: add runtime stage + ubuntu 24.04 (#13861) ishandhanani 2025-12-05 00:28:36 -08:00
• 7c744d137d [diffusion] cli: add argument --adjust-frames and --override-protected-fields (#13996) 3 people 2025-12-04 23:32:06 -08:00
• 46b05ef58f [diffusion] fix: fix bug about pin memory when offloading (#14472) zyksir 2025-12-04 23:26:30 -08:00
• beec8eed6a [diffusion] chore: further improve model searching logic (#14484) Mick 2025-12-05 15:04:55 +08:00
• b76e303e6a clean up gemlite usage (#14444) Minglei Zhu 2025-12-04 21:52:56 -08:00
• 80a575e4e8 Add YAMY1234 to CI Permission (#14475) Baizhou Zhang 2025-12-04 21:25:49 -08:00
• 4c5074eb78 Add AMD stage support to /rerun-stage command and fix related bugs (#14463) Alison Shao 2025-12-04 21:13:52 -08:00
• 41429a8c10 [ez] Fix typing (#14473) Yinghai Lu 2025-12-04 20:23:13 -08:00
• 532037df78 Add CI permissions for user 'yushengsu-thu' (#14468) Alison Shao 2025-12-04 19:01:50 -08:00
• fa0ca97694 [diffusion] improve: further optimize model load (#13836) zyksir 2025-12-04 18:45:20 -08:00
• b5d3998508 Rename secrets.WHL_TOKEN -> secrets.GH_PAT_FOR_WHL_RELEASE (#14421) sglang-botandLianmin Zheng 2025-12-04 18:24:54 -08:00
• 2ecee7571c [Bug] fix not desired disable fused share experts caused by rocm logic (#14432) Junrong Lin 2025-12-05 09:55:07 +08:00
• 6d37e70883 ministral3 (#14251) Xinyuan TongandYueming Yuan 2025-12-04 22:31:26 +00:00
• c1006fd8a1 [model-gateway] grpc to leverage event type (#14450) Simo LinandChang Su 2025-12-04 14:30:19 -08:00
• 29c6c2ea9d [model-gateway] add mistral 3 image processor (#14445) Simo LinandChang Su 2025-12-04 13:16:04 -08:00
• eb85fa6daf [model-gateway] move all responses api event from oai to proto (#14446) Simo Linandkey4ng 2025-12-04 13:11:03 -08:00
• 0e6441b434 fix: Correct environment variable syntax in docker-compose configuration (#8287) Kay Yan 2025-12-05 05:03:39 +08:00
• 88d1bab537 add doc for quantized kv cache (#14348) 3 people 2025-12-04 13:01:05 -08:00
• 922756aaa1 [FIX] trtllm-moe-fp4-renorm for Qwen series models (#14350) Sam 2025-12-05 04:52:21 +08:00
• d8faf2f361 [model-gateway] move oai header util to router header util (#14441) Simo Linandkey4ng 2025-12-04 11:02:50 -08:00
• 7dfcc78155 [DeepseekV3.2][NSA][Indexer] Fix PAGED top-k transform for NSA indexer chunked execution on H200 (#14325) YAMY 2025-12-04 10:25:03 -08:00
• 7f3308bc68 [model-gateway] extract conversation out of oai router (#14440) Simo Linandkey4ng 2025-12-04 10:16:14 -08:00
• fdc2ef58db [model-gateway] add llama4 vision image processor (#14438) Simo Lin 2025-12-04 09:52:36 -08:00
• 1808df48fe [NPU]add nightly-test-npu (#14143) Cherry_ming 2025-12-05 00:43:35 +08:00
• b01fc161eb [model-gateway] introduce request ctx for oai router (#14434) Simo Linandkey4ng 2025-12-04 08:31:44 -08:00
• 788628b56f [diffusion] feat: Add Configurable Generator Device and Seed Support via API (#14366) 3 people 2025-12-05 00:25:09 +08:00
• 11d33c0e8f [model-gateway] add phi4 vision image processor (#14430) Simo Lin 2025-12-04 07:40:33 -08:00
• 441420e149 Add mooncake transfer_engine_bench into maunal test (#14429) Liangsheng Yinandgemini-code-assist[bot] 2025-12-04 22:35:00 +08:00
• 29a2d4b59f Add 'NPU' to the runtime exception message in get_device (#14225) Raul Torresandronnie_zheng 2025-12-04 14:34:31 +00:00
• 079ac237da [diffusion] fix: fix gen video doc (#14409) R0CKSTARandMick 2025-12-04 22:05:38 +08:00
• 8428078436 Add Mistral Large 3 support. (#14213) 3 people 2025-12-04 13:00:05 +01:00
• af35023e65 [bug fix] fix ima with get_mla_kv_buffer_kernel overflow (#14224) Xuchun Shang 2025-12-04 17:20:11 +08:00
• cb8df87fc1 [1/2] Add rope kernel in sgl-kernel (#14334) Qiaolin Yu 2025-12-04 00:45:44 -08:00
• e3ab23c1a6 Try to fix B200 DeepEP error (#14399) fzyzcjy 2025-12-04 16:41:24 +08:00
• 70d2587324 [CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446) jianan-guandZheng, Beilei 2025-12-04 16:38:47 +08:00
• 894c0dc57c [NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359) Even Zhou 2025-12-04 16:15:31 +08:00
• d6c490192d [AMD] fix the regression issue for DeepseekV3 on MI300 (#14383) yctseng0211 2025-12-04 15:30:11 +08:00
• fa78c44a3d [model-gateway] introduce provider in openai router (#14394) Simo Lin 2025-12-03 22:47:20 -08:00
• 654a78f9c8 [model-gateway] add phi3 vision image processor (#14381) Simo Lin 2025-12-03 22:32:40 -08:00
• f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) Ma Mingfei 2025-12-04 13:41:42 +08:00
• 78647e08dd [model-gateway][doc] Add STDIO Explicitly to Example in README (#14393) Wenyi Xu 2025-12-04 12:36:44 +08:00
• 46f21a5956 use faster covnersion from float8_e4m3fn to bfloat16 (#12316) Ma Mingfei 2025-12-04 12:34:05 +08:00
• b2b09f5f24 [VLM] Introduce Cache for positional embedding ids for Qwen-VL family (#14292) Yuan Luoandluoyuan.luo 2025-12-04 12:32:00 +08:00
• 04df80a9a1 Support PP x PD decode with nixl backend (#14392) Kevin Li 2025-12-03 20:22:17 -08:00
• 4f73e53dcc [CPU] document updates (#14272) Zaili Wang 2025-12-04 11:56:06 +08:00
• 16ff892c18 [sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731) Qi YuhangandYineng Zhang 2025-12-04 10:09:09 +08:00
• df026bb110 Fix sgl-router silently parse selector wrongly causing OME fail to discover pods (#14359) fzyzcjy 2025-12-04 09:56:37 +08:00
• d42c167bfd [model-gateway] add qwen3_vl model image processor (#14377) Simo Lin 2025-12-03 17:16:37 -08:00
• 388151053d [model-gateway] use worker crate in openai router (#14330) Simo Lin 2025-12-03 13:36:32 -08:00
• 9d82340298 Revert "Revert "enable csgmv automatically on cuda"" (#14277) b8zhong 2025-12-03 13:12:30 -08:00
• 8ab5d8b40d [model-gateway] add qwen2.5_vl model image processor (#14375) Simo Lin 2025-12-03 12:51:30 -08:00
• 03575ce38d [model-gateway] add qwen2_vl model image processor and tests (#14374) Simo Lin 2025-12-03 12:34:06 -08:00
• 80518bea65 Fix validation to detect missing model files before loading (#14253) alisonshao 2025-12-03 11:36:07 -08:00
• 7e78825d5a [Tiny]Small fixes in deepseek v32 doc (#14372) Baizhou ZhangandXinyuan Tong 2025-12-03 11:35:40 -08:00
• 5bbd83a2c8 ci: Migrate AMD workflows to new MI325 runners; temporarily disabled failed CI's to be added back (#14226) sunxxuns 2025-12-03 14:33:27 -05:00
• abf6272bdd [model-gateway] add llava model image processor and tests (#14371) Simo Lin 2025-12-03 11:18:00 -08:00
• 46d7b35ec7 Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326) Lianmin Zheng 2025-12-03 10:33:37 -08:00
• 20aad5b5ab Single Batch Overlap for MoE Models (#9660) 6 people 2025-12-04 02:07:42 +08:00
• 974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) blzheng 2025-12-03 23:46:08 +08:00
• aca0d01d3f [diffusion] doc: add vae path to cli doc#14004 (#14355) 3 people 2025-12-03 10:13:25 -05:00
• dc1635023f [NPU][Doc] updated installation guide for Ascend NPU (#13585) 3 people 2025-12-03 16:58:49 +03:00
• 24903b88ba Tiny adjust CI testcases (#14362) Liangsheng Yin 2025-12-03 21:19:51 +08:00
• 443d7bcd83 [Ascend] fix AscendAttnMaskBuilder bug to support float16 models (#14271) Michelle Wu 2025-12-03 19:37:16 +08:00
• 16d8de2284 [bugfix] NpuFuseEPMoE miss initialization parameters (#14295) chenxu140 2025-12-03 19:36:41 +08:00
• d122e32467 [NPU] bug fix: w_vc need contiguous for NPU batch_matmul_transpose ops (#13980) ZhengdQin 2025-12-03 19:35:18 +08:00
• 96cc10834a [CI] update estimated elapsed time of some unittests (#14347) Cheng Wan 2025-12-03 01:21:40 -08:00
• 77512ae0d7 [bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333) Yuhao YaoandCheng Wan 2025-12-03 17:20:33 +08:00
• c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) Xuan Liao 2025-12-03 17:03:48 +08:00
• 58ac3f317b [model-gateway] add image processor and transformer structure (#14344) Simo Lin 2025-12-03 00:04:06 -08:00
• 93452a8252 [PD] Support decode pp for PD disaggregation (#14265) Shangming Cai 2025-12-03 14:35:29 +08:00
• 65c8568c4a sync attention, deepseek doc (#14335) b8zhongandBrayden Zhong 2025-12-02 21:19:40 -08:00
• 4bcc5879af [Doc] Fix DeepSeek V32 Doc (#14336) Baizhou Zhang 2025-12-02 21:06:55 -08:00
• d5ea8c7176 [model-gateway] multimodality initialization (#13350) Simo Lin 2025-12-02 19:41:40 -08:00
• 42271376d1 [bug fix] use npu phy id in container env (#14266) Vikramandjinke15 2025-12-03 11:33:43 +08:00
• 84e0abb7b1 Update CODEOWNERS for multimodal (#14329) Mick 2025-12-03 11:04:40 +08:00