Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• ba9102f924 Add lmsys/gpt-oss-20b-bf16 to model validation check (#13557) Liangsheng Yin 2025-11-19 14:23:01 +08:00
• b638abbae6 chore: bump sgl-kernel version to 0.3.17.post2 (#13542) sglang-bot 2025-11-18 22:08:23 -08:00
• 3798055929 purge unnecessary env variable set in deterministic test (#13481) Minglei Zhu 2025-11-18 20:43:51 -08:00
• 075ba74dd4 [Doc] Update HiCache and Mooncake docs & Mooncake Setup Error Checking (#12740) ykwd 2025-11-19 12:03:27 +08:00
• f7be98e113 [CI] fix amd 1 gpu basic test (#13551) Liangsheng Yin 2025-11-19 11:47:41 +08:00
• 9a1a9a4209 [AMD CI] Local cache fallback. (#13452) Sai Enduriandgemini-code-assist[bot] 2025-11-18 19:23:45 -08:00
• 6c2e5fcd91 [feat][Ascend][Mindspore]: support model-impl of mindspore (#9234) Chen Haozhe 2025-11-19 04:17:47 +03:00
• 0d2d687812 [router][grpc] Support num_reasoning_tokens in haromy models (#13047) Chang Su 2025-11-18 16:40:32 -08:00
• 9f59194f29 [Fix] Fix DeepSeek V3 MTP on B200 (#13548) Baizhou Zhang 2025-11-18 16:30:26 -08:00
• cf1f0166b6 Add Qwen/Qwen1.5-MoE-A2.7B to model list (#13543) Kangyan-Zhou 2025-11-18 14:43:38 -08:00
• 10969ae4be [chore] Disable ccache for sgl-kernel release (#13541) Baizhou Zhang 2025-11-18 14:28:58 -08:00
• 92ad2ff9ce Flashinfer TRTLLM-GEN-MoE + Qwen3 (#13489) b8zhong 2025-11-18 14:18:29 -08:00
• 9b64f6f359 [fix] Fixes accuracy issues caused by incorrect use of rope (#13495) Baidu-AIAK 2025-11-19 06:17:33 +08:00
• c0d1a3383b Remove jet-ai/Jet-Nemotron-2B in nightly text tests as this is constantly failing (#13540) Kangyan-Zhou 2025-11-18 13:58:16 -08:00
• a9d22b751d fix lora test (#13537) gongwei-130 2025-11-18 12:40:35 -08:00
• 6b9459e86c [docker] fix dockerfile naming for diffusion (#13534) Simo Lin 2025-11-18 12:18:32 -08:00
• 3a6ec47b0b [model-gateway] limit opened files in docker build to fix edge case (#13536) Chang Su 2025-11-18 12:17:38 -08:00
• b8e32e7965 [model-gateway] fix gateway docker build due to recent py code change (#13532) Chang Su 2025-11-18 11:24:25 -08:00
• f5566acc2a [CI] fix CI skipped on main (#13527) Liangsheng Yin 2025-11-19 01:19:08 +08:00
• d79e12941c Small cleanups related to LoRA weight loading (#13474) Glen Liu 2025-11-18 12:14:34 -05:00
• 6e9b154981 [CI] fix skipping pr-gate on main (#13525) Liangsheng Yin 2025-11-19 00:57:22 +08:00
• 109f27ba3a [CI] update pr-gate to be compatible with new slash triggering mananer. (#13522) Liangsheng Yin 2025-11-19 00:49:13 +08:00
• c1a30aa765 Add /tag-and-rerun-ci (#13521) sglang-bot 2025-11-18 06:53:53 -08:00
• 2e1dbdb258 Update docs (#13519) Lianmin Zhengandsglang-bot 2025-11-18 06:24:58 -08:00
• 6d025fd35b Trigger CI retry with edit (#13516) Lianmin Zhengandsglang-bot 2025-11-18 05:42:31 -08:00
• 518467be64 [Feature] Re:Enable hybrid mem saver (#12962) Junrong Lin 2025-11-18 21:29:15 +08:00
• 63807079b9 Add docs on trigger ci (#13513) Lianmin Zhengandsglang-bot 2025-11-18 05:23:05 -08:00
• f6cfe9f197 Use slash command to trigger CI (#13512) Lianmin Zhengandsglang-bot 2025-11-18 04:39:58 -08:00
• 7bc99d4164 README.md -> FOLDER_README.md (#13510) Lianmin Zhengandsglang-bot 2025-11-18 04:10:04 -08:00
• e2d6746808 Add .github/CI_PERMISSIONS.json to define the CI permissions (#13509) Lianmin Zhengandsglang-bot 2025-11-18 04:00:15 -08:00
• 6beb6e991f fix: create git tags directly instead of temporary branches (#13168) alisonshao 2025-11-18 03:23:27 -08:00
• 7e88b9c128 [BugFix] Accuracy and function Issue when run ptpc quant model (#13157) Morpheus Guoandyuechguo 2025-11-18 17:54:58 +08:00
• cfcf2758aa [HiCache] Critical fix to host memory double free (#13501) Zhiqiang XieandHao Chen 2025-11-18 01:34:23 -08:00
• ac81db66c2 [VLM][feat] Support encoder DP for Qwen2.5-VL (#13126) 4 people 2025-11-18 16:13:18 +08:00
• 33905005ee [CI] fix lint yml (syntax error) (#13496) Liangsheng Yin 2025-11-18 15:53:33 +08:00
• 820e13c9c1 [opt kimi k2 3/n] opt kimi_k2 moe_fused_gate kernel (#13374) Xiaoyu Zhang 2025-11-18 15:36:31 +08:00
• 595adf6d93 [CI] Add input for pr-gate (#13491) Liangsheng Yin 2025-11-18 15:35:49 +08:00
• a5ad0069b2 fix: change performance log directory to cache path (#13482) Cheng WanandMick 2025-11-17 23:18:43 -08:00
• 4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) Liangsheng Yin 2025-11-18 14:59:46 +08:00
• 67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) Liangsheng Yin 2025-11-18 14:24:58 +08:00
• 0c96677902 CI: fix NFS EBUSY error in PR test workflow (#13460) 3 people 2025-11-17 21:25:29 -08:00
• f33860777c [Piecewise CUDA Graph] Support ModelOpt FP8 (#13094) b8zhong 2025-11-17 20:46:24 -08:00
• 4ce8fb3cc2 Fix lora test (#13479) Liangsheng Yin 2025-11-18 12:21:57 +08:00
• 4c3573e493 [PD] Clarify init method docstrings for kvsender and kvreceiver (#13476) Shangming Cai 2025-11-18 12:20:19 +08:00
• f1be8aa0f2 chore: add an unified server arg for multimodal inputs preprocess config(#12149) 3 people 2025-11-18 12:18:50 +08:00
• aa8ecbda7a model: support JetVLM (#13289) Zijian Zhang 2025-11-18 12:02:03 +08:00
• 9188feccca [model-gateway] use worker startup time out for worker registration (#13473) Simo Lin 2025-11-17 19:28:21 -08:00
• 26ca07469b [GLM4.6v] Relax the constraint of non-user role chat completion message schema for new GLM-v release (#13258) Binyao Jiang 2025-11-17 18:58:17 -08:00
• 90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) Binyao Jiang 2025-11-17 18:58:00 -08:00
• d7984f3125 Adding CI Monitor Improvements (#13462) Douglas Yang 2025-11-17 18:42:35 -08:00
• 7119d188f6 [CI] re-enable test_vision_openai_server_a ci (#13444) Yuhao Yang 2025-11-18 10:32:59 +08:00
• fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) Sai Enduri 2025-11-17 18:13:24 -08:00
• 9846f8ed72 fix MambaPool clear method after refactoring (#13449) Minglei Zhu 2025-11-17 18:03:45 -08:00
• 85ae508e8b Add bfloat16 tuned fused moe config for Dpsk-MTP layer on B200 (#13455) Baizhou Zhang 2025-11-17 17:44:31 -08:00
• d879e37f1b Add interface_v1 option for dynamic HiCache backend (#13140) pansichengandZhiqiang Xie 2025-11-18 09:42:17 +08:00
• e2c9a59023 Update pr-test.yml to fix invalid job name error Kangyan-Zhou 2025-11-17 17:08:02 -08:00
• a1e37b0258 Temporarily comment out multimodal gen test to recover runners (#13463) Kangyan-Zhou 2025-11-17 16:55:04 -08:00
• e389f91dec [NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264) 3 people 2025-11-17 16:13:28 -08:00
• aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) Vedant V Jhaveri 2025-11-17 15:35:18 -08:00
• ea89a3a0c5 Fixes validation errors for Wan-AI models which store model weights in subdirectories (#13461) Kangyan-Zhou 2025-11-17 15:33:02 -08:00
• 2bc7c5ebef Fix 8-gpu B200 nightly tests (#13457) Kangyan-Zhou 2025-11-17 13:26:56 -08:00
• a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) Sirut Buasai 2025-11-17 13:14:17 -08:00
• 58f8f4e408 Add missing models (#13456) Kangyan-Zhou 2025-11-17 13:10:37 -08:00
• 25acbbc612 Remove verbs from GET endpoint paths to follow REST standards (#13273) Simo Lin 2025-11-17 12:34:36 -08:00
• a8fcbf6fe3 [Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022) hlu1 2025-11-17 12:20:49 -08:00
• e486308c99 Temporarily disable model hooks CI (#13450) Liangsheng Yin 2025-11-18 02:35:13 +08:00
• 6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) Liangsheng Yin 2025-11-18 02:08:19 +08:00
• ff00b6adbe diffusion: fix loading with local model_path (#13445) Mick 2025-11-18 00:56:30 +08:00
• 7b44526038 [Ci tiny fix] Lower score threshold in evaluation test (#13443) Xiaoyu Zhang 2025-11-18 00:45:20 +08:00
• c236d05f8c Fix log time stats (#13418) Rain H 2025-11-17 23:10:49 +08:00
• df56139226 Adding user defined hooks support (#13217) Carlo Mussolini 2025-11-17 15:07:37 +00:00
• 15db5497d3 [feature] Custom base path on FastAPI server (#5879) 4 people 2025-11-17 22:40:09 +08:00
• 9ba3597d2a Fix cache_tokens calculate issue when retracted (#11900) Mike QiuandMike_Qiu 2025-11-17 21:25:38 +08:00
• 80797c2a15 [PD][bug fix] fix memleak when last_batch is none (#13144) Xuchun ShangandShangming Cai 2025-11-17 21:22:20 +08:00
• 7afff8fd1a diffusion: fix wan2.2 ti2v num_frames adjust logic (#13379) 3 people 2025-11-17 20:53:15 +08:00
• ac406d4301 fix uneven PP layer indices (#13282) AlphaBabyandXuchun Shang 2025-11-17 19:54:23 +08:00
• b436113fc2 [model-gateway] Add Gateway Release Tooling (#13420) Simo Lin 2025-11-17 03:26:48 -08:00
• 8b5e2c5368 [Tiny fix] Fix bench_speculative.py run bug (#13416) Xiaoyu Zhang 2025-11-17 18:58:19 +08:00
• b24235b8bb [model-gateway] update workflow names for gateway and exclude npu (#13415) Simo Lin 2025-11-17 02:04:07 -08:00
• ae7698fbd5 Remove deprecated scripts (#13399) Liangsheng Yin 2025-11-17 16:54:39 +08:00
• a3e4fe4b41 refactor linear memory pool (#13004) Yi Zhang 2025-11-17 16:24:29 +08:00
• f3e9336dcb Support weight update for blackwell DeepGEMM (#13324) fzyzcjy 2025-11-17 15:55:26 +08:00
• 290fcd8971 [HiCache] add GPU id to IB dev topo for mooncake storage backend (#13112) Teng Ma 2025-11-17 15:48:29 +08:00
• 1dcde53928 [HiCache] support memory_pool_host page head layout (#11644) huangtingwei 2025-11-17 13:45:17 +08:00
• 15bc1f5cd7 Update .github/MAINTAINER.md (#13398) Ying Shengandsglang-bot 2025-11-16 21:32:24 -08:00
• 4d59761623 [Doc] Update CI oncall list (#13396) 3 people 2025-11-16 20:43:12 -08:00
• ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) Liangsheng Yin 2025-11-17 12:21:20 +08:00
• 147b782352 [RL] re-abort_request when model_update_lock is still locked (#13338) Zilin Zhu 2025-11-17 12:13:39 +08:00
• d368c7451a (1/n)support context parallel with deepseekv3.2-DSA (#12065) lixiaolx 2025-11-17 12:12:25 +08:00
• 7e626d12b7 Update docs (#13391) Lianmin Zhengandsglang-bot 2025-11-16 19:36:33 -08:00
• 2a5773440e refactor: replace worker pool with semaphore-based concurrency in jobqueue (#13383) Rivers 2025-11-17 09:57:59 +08:00
• 7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) sglang-bot 2025-11-16 17:55:38 -08:00
• d64dd3e18e [Tiny]Fix 1-gpu nightly test bugs (#13389) Baizhou Zhang 2025-11-16 15:54:17 -08:00
• 3ccd7fa669 [CI] Fix B200 CI (#13387) Baizhou Zhang 2025-11-16 15:13:57 -08:00
• 254f62d879 Support spec decoding when LoRA is applied to target model (#12903) Lifu Huang 2025-11-16 13:20:23 -08:00
• 2b8b9d8496 [CI] use cached deepep installation in gb200 CI (#13388) Cheng Wan 2025-11-16 12:49:01 -08:00
• e970892ffa fix import qwenvl error in RL engine (#12874) DangKai 2025-11-17 04:01:16 +08:00
• d5fa58c4dd fix nightly docker build (#13386) b8zhong 2025-11-16 11:21:09 -08:00
• 9f011f617f fix generative_models.md table - remove newlines (#13385) Netanel Haber 2025-11-16 20:33:38 +02:00
• 3b18fd4cf5 [router] bindings for go (#13384) ybyang 2025-11-17 02:12:10 +08:00