Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) Xiaoyu Zhang 2025-12-25 16:24:37 +08:00
• a89e85e739 [1/N][Sparse With Hicache]: Add Sparse Interface (#14741) 4 people 2025-12-25 16:12:47 +08:00
• cbf9f13493 Adjust server args for Mimo-v2-flash model (#15803) Ke BaoandLiangsheng Yin 2025-12-25 16:04:39 +08:00
• eb3da9c1dd fuse ssm state store into chunk_gated_delta_rule_fwd_h (#15409) Yi Zhang 2025-12-25 16:03:15 +08:00
• 72a980c6d5 ci: migrate MLA tests to test/registered/mla/ (#15798) Alison Shao 2025-12-24 23:29:30 -08:00
• ccf2330b28 Tiny fix missing record_router_upstream_response (#15811) fzyzcjy 2025-12-25 15:20:43 +08:00
• b9af8d2eb9 [VLM] Support apply qk norm in multi cuda streams (#15720) Yuan Luoandluoyuan.luo 2025-12-25 14:35:07 +08:00
• 10a9573efd [diffusion] CI: add tests to validate the size, extension, and format of output images/videos. (#15736) Prozac614 2025-12-25 14:00:22 +08:00
• 49ab72f837 [diffusion] fix: remove unused LoRA application logic from RowParallelLinearWithLoRA class in linear.py (#15801) Prozac614 2025-12-25 13:43:38 +08:00
• 8865424f14 [diffusion] refactor: refactor attention backend checking to use backend enum (#15555) R0CKSTAR 2025-12-25 11:51:40 +08:00
• b311c43d13 Clarify None handling in sglang's environ (#15770) Liangsheng Yin 2025-12-25 11:40:17 +08:00
• 0c39730b18 DP: support piggyback server load report (#11469) Huaixin Chang 2025-12-25 11:35:05 +08:00
• 45adad37d0 Add manual routing policy for router (#15586) fzyzcjy 2025-12-25 11:27:36 +08:00
• 1ba897f330 Tiny refactor select_workers API for future passing more information (#15596) fzyzcjy 2025-12-25 10:31:10 +08:00
• 38dd4fbb66 Add overlap scheduling for embeddings code path (#14032) satyamk7054andSatyam Kumar 2025-12-24 18:24:18 -08:00
• ecd2d09a6c Fix code sync scripts (#15787) Lianmin Zheng 2025-12-24 16:13:23 -08:00
• 92ddc46824 [Auto Sync] Update server_args.py (20251223) (#15700) 3 people 2025-12-24 14:55:14 -08:00
• 5454d2a7ae [model-gateway] release smg 0.3.0 (#15781) Simo Lin 2025-12-24 16:23:57 -05:00
• 17b38f88bc Add LoRA metrics for potential auto scaling (#15149) Chenxi Li 2025-12-24 12:13:52 -08:00
• ae434f7821 Move limit-mm-data-per-request to make code clean (#15775) Xinyuan Tong 2025-12-24 18:59:39 +00:00
• 643aeefe6d [model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782) Simo Lin 2025-12-24 13:54:48 -05:00
• 186a56f6e2 fix(monitoring): update Grafana dashboard metrics prefix from sglang: to sglang_ (#15758) ゆり 2025-12-25 02:43:51 +08:00
• 17e65466de fix: nightly fix b200 gpqa (#15745) Douglas Yang 2025-12-24 10:29:45 -08:00
• 370bd27f3a [model-gateway] Implement Zero-Copy Vision Tensor Access (#15750) Praneth Paruchuri 2025-12-24 22:45:44 +05:30
• b27b5a834e [bug] fix code formatting which blocks ci (#15780) Simo Lin 2025-12-24 12:14:13 -05:00
• 2f7c629235 [model-gateway] Fix IGW routing and optimize RouterManager (#15741) Simo Lin 2025-12-24 11:28:53 -05:00
• 2fb3160598 [NPU] Bug fix in device detect (#14137) Mayyyy 2025-12-25 00:18:39 +08:00
• 8bf7f240b6 [NPU]qwen3 pp bugfix (#15390) Liwansi 2025-12-25 00:14:40 +08:00
• 2c5679f314 [diffusion] refactor: unify the profiling api for all executors (#15718) Mick 2025-12-24 23:26:09 +08:00
• 159b128357 Tiny add flush for CI crash locating (#15769) Liangsheng Yin 2025-12-24 22:47:10 +08:00
• 9338f63f7d Add request counter in addition to existing response counter (#15768) fzyzcjy 2025-12-24 22:22:38 +08:00
• 8196998a03 Tiny add num retracted tokens metric (#15653) fzyzcjy 2025-12-24 22:15:23 +08:00
• aa21c6e3f1 Super tiny code cleanup (#15652) fzyzcjy 2025-12-24 22:15:00 +08:00
• fd4a558e71 Add metrics for having prefill and decode in different ranks (#15752) fzyzcjy 2025-12-24 21:35:35 +08:00
• b3b818fd86 Tiny unify realtime_tokens_total metric (#15747) fzyzcjy 2025-12-24 21:29:43 +08:00
• d5fbbfd988 Retry removing wrong logic about max total token in spec decoding (#15748) Liangsheng Yin 2025-12-24 21:13:26 +08:00
• e245cac0c5 Support JSON format request logging for easier parsing (#15743) fzyzcjy 2025-12-24 19:52:43 +08:00
• c6a6ba4368 Tiny refactor request logger (#15740) fzyzcjy 2025-12-24 19:51:26 +08:00
• d6108166bc Fix smg_http_requests_total semantics (#15655) fzyzcjy 2025-12-24 17:41:01 +08:00
• ddb3970eb4 Tiny env cleanup in deepgemm (#15706) vincentzed 2025-12-24 03:58:46 -05:00
• f65fa04748 [model-gateway]Enable IGW mode with gRPC router and auto enable IGW when service discovery is turned on (#15459) Arthur Cheng 2025-12-24 00:27:58 -08:00
• 7e027691c8 update benchmark README to use --fp8-gemm-backend instead of env var (#15689) Lee Nau 2025-12-24 02:23:31 -05:00
• cb719c74ad [2/N] clean duplicate code of logprob processing in spec. (#15593) Liangsheng Yin 2025-12-24 15:21:13 +08:00
• ff903a7eea Simplify server args (#15704) Lianmin Zheng 2025-12-23 22:46:12 -08:00
• eee3700d84 [diffusion] feat: support lora strength (#15691) Prozac614 2025-12-24 13:31:23 +08:00
• e254cdf326 [CI] Remove pcg-omni-ci (#15656) Yuwei An 2025-12-23 21:28:05 -08:00
• dfb5357448 [diffusion] http-server: relax openai image endpoint's strict content_type limit (#15717) Mick 2025-12-24 13:26:13 +08:00
• 9665574937 [docs] major SGL Model Gateway documentation update (#15715) Simo Lin 2025-12-23 20:26:09 -08:00
• ac320a6f04 Move some quant args to its own section in environ variables doc (#15722) vincentzed 2025-12-23 23:11:08 -05:00
• 6292c24437 Tiny fix test eagle infer b. (#15716) Liangsheng Yin 2025-12-24 11:57:15 +08:00
• 5f5a567768 Tiny add flush in the suite partition status print. (#15719) Liangsheng Yin 2025-12-24 11:55:59 +08:00
• 3bf07c684f [Feature][MM] split the images of one request into multiparts (#11828) 5 people 2025-12-24 11:22:04 +08:00
• e7b09efc0a [AMD] Add AMD Nightly Performance & VLMs Accuracy Tests (#15500) michael-amd 2025-12-23 19:03:27 -08:00
• 99d3bcdfed [model-gateway] add back router worker health metric and fix init state (#15622) fzyzcjy 2025-12-24 10:50:38 +08:00
• 4d64f15086 [mode;-gateway] add back fixes of incorrect metrics after worker removal (#15624) fzyzcjy 2025-12-24 10:50:03 +08:00
• aef7ca7cf2 Raise the accept length bar in dpsk-r1-fp4 spec decoding tests (#15705) Qiaolin Yu 2025-12-23 18:38:02 -08:00
• fe712aa3df [bug fix] fix hicache jit kernel (#15177) Xuchun Shang 2025-12-24 10:31:21 +08:00
• 846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) Simo Lin 2025-12-23 17:32:07 -08:00
• 5c64a20da7 Update MiniMax-M2 ToolCall and add MiniMax-M2.1 in Docs (#15538) 3 people 2025-12-24 07:11:52 +08:00
• cf81737693 Add kv_transfer_total_mb to metrics (#15667) Lianmin Zheng 2025-12-23 11:16:55 -08:00
• aa6ac96635 [model-gateway] Fix tokenizer caching and improve error handling (#15695) Simo Lin 2025-12-23 10:33:38 -08:00
• 0d0367e9d0 Tiny fix CI (#15696) Liangsheng Yin 2025-12-24 01:51:08 +08:00
• bd572360f3 Tiny apply gsm8k mixin to ngram test (#15606) Liangsheng Yin 2025-12-24 01:30:26 +08:00
• 5f3a47d8a7 [model-gateway]: add gRPC router embeddings endpoint implementation (#15273) ratish 2025-12-23 21:12:22 +04:00
• 80ae2229d3 [model-gateway] Optimize router selection with lock-free snapshots (#15672) Praneth Paruchuri 2025-12-23 22:39:30 +05:30
• 705287b2e5 Tiny add more information in retract logging. (#15694) Liangsheng Yin 2025-12-24 00:43:36 +08:00
• 762846531f Fix Illegal Memory Access when fa3 + spec + topk + page_size > 1 (#15469) Yubo WangandLiangsheng Yin 2025-12-23 08:13:57 -08:00
• dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) Arthur Cheng 2025-12-23 07:58:47 -08:00
• 53f974b973 fix: potential crash for missing stream attribute (#15644) shuwenn 2025-12-23 23:24:31 +08:00
• 6a5764a719 Super tiny add test_soft_watchdog to nightly (#15692) fzyzcjy 2025-12-23 22:46:15 +08:00
• 291f11ae39 [Minor] Enhance JIT kernel and add dev docs (#14570) DarkSharpness 2025-12-23 22:34:59 +08:00
• d7301c89ba [Feature] support fastsafetensors (#15091) Teng MaandXuchun Shang 2025-12-23 22:33:56 +08:00
• 758b9067a0 [CI] fix UT assert error in test_tokenizer_manager.py (#15646) shuwenn 2025-12-23 22:24:33 +08:00
• ffc23ef877 [diffusion] feat: generalize layerwise offloader to flux1 (#15633) ryang 2025-12-23 22:22:40 +08:00
• b3f83cc1c5 Fix pipeline parallelism doc typos (#15688) Shangming Cai 2025-12-23 22:19:15 +08:00
• c15fa1c577 [2/N] Update doc of Pipeline Parallelism with case study (#15684) Shangming Cai 2025-12-23 20:56:15 +08:00
• fa2966983a Support PP for zmq_to_scheduler (#15312) Tianyu Guo 2025-12-23 17:07:55 +08:00
• f9dd90ac35 fix: increasing H200 test timeout (#15600) Douglas Yang 2025-12-23 01:00:37 -08:00
• 66902e0f1b [AMD] CI - Improve image discovery with remote registry fallback (#15463) Bingxu Chen 2025-12-23 15:04:58 +08:00
• e50f356f6f [AMD] CI - Detect the aiter version and rebuild if needed (#15460) yctseng0211 2025-12-23 14:42:48 +08:00
• ac42797cf7 [CI] Enable retry logic for flaky CI tests (#14983) Alison Shao 2025-12-22 22:23:42 -08:00
• 883747ced1 [CI] Migrate Attention Backend tests to test/registered/attention/ (#15563) Alison Shao 2025-12-22 22:17:52 -08:00
• 989d4b3012 [CI] Migrate nightly tests to test/registered/ (#15582) Alison Shao 2025-12-22 22:16:32 -08:00
• bc3ca30023 [PD] Support fake decode for PD disaggregation without prefill node (#14628) Baidu-AIAKandsunhailiang 2025-12-23 12:43:33 +08:00
• 061f41affc MoE: Skip SiLU/GELU activation for masked experts (#15539) yuchengz816-botandRunkai Tao 2025-12-22 22:08:31 -05:00
• 82f1d6157f [GLM-ASR] GLM-ASR Support (#15570) Yuxuan ZhangandXinyuan Tong 2025-12-23 09:37:55 +08:00
• 5e1a495c65 Improve engine customization interface (#15635) Lianmin Zheng 2025-12-22 14:24:16 -08:00
• 34013d9d5a chore: bump sgl-kernel version to 0.3.20 (#15590) sglang-botandsglang-bot 2025-12-22 12:32:34 -08:00
• 7759716786 bugfix[schedule]: Refactor sort method and add related UT (#13576) 4 people 2025-12-23 03:13:57 +08:00
• 3c882db3ad Adjust wrong mtp meaning introduce by mimo (#15632) Liangsheng Yinandgemini-code-assist[bot] 2025-12-23 02:06:46 +08:00
• b736a1525a Tiny add back missing router per attempt response metric (#15621) fzyzcjy 2025-12-23 01:59:10 +08:00
• 6984837d82 Fix router gRPC mode launch error caused by async loading (#15368) fzyzcjy 2025-12-23 01:39:01 +08:00
• 2142881b7e [model-gateway] return 503 when all workers are circuit-broken (#15611) Simo Lin 2025-12-22 04:06:09 -10:00
• d77f3fccbf [Diffusion] Support peak memory record in offline generate and serving (#15610) Xiaoyu Zhang 2025-12-22 21:21:21 +08:00
• 828dec1c7c [VLM] Tiny: Unify VLM environment variables (#15572) Yuan Luoandluoyuan.luo 2025-12-22 17:32:37 +08:00
• 575a49dc0e [diffusion] chore: remove default post-denoising dit offload in local mode (#15573) ryang 2025-12-22 17:01:35 +08:00
• e62e17442e Tiny enable soft watchdog in CI for stuck without logs (#15616) fzyzcjy 2025-12-22 17:01:04 +08:00
• d5431ff894 Tiny add stuck simulation (#15613) fzyzcjy 2025-12-22 17:00:18 +08:00
• 454a2544f2 Support soft watchdog for tokenizer/detokenizer/dp-controller processes (#15607) fzyzcjy 2025-12-22 16:59:16 +08:00
• 89619a9904 Tiny avoid EnvField misuse (#15612) fzyzcjy 2025-12-22 16:20:47 +08:00