Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• cb30d056e3 add decode round robin policy (#15164) Hexq0210 2025-12-22 14:48:52 +08:00
• 677930c276 Add glm-4.6-fp8 with/without mtp in nightly ci (#15566) Qiaolin Yu 2025-12-21 22:27:02 -08:00
• beae3f961c Adapt fixture-kit to gsm8k mixin (#15599) Liangsheng Yin 2025-12-22 14:19:35 +08:00
• 1167867e8d [model-gateway] add retry support to OpenAI router chat endpoint (#15589) Simo Lin 2025-12-21 18:28:51 -10:00
• ad7f35fb9d Support gsp send routing id in bench serving (#15588) fzyzcjy 2025-12-22 11:32:24 +08:00
• f4100732b8 Tiny fix bench serving GSP mode cache file strategy (#15587) fzyzcjy 2025-12-22 11:27:55 +08:00
• 468931b572 [Tiny]Move deepseek fp4 cutlass moe test to per-commit test (#15565) Baizhou Zhang 2025-12-21 18:08:07 -08:00
• 796969caf0 Optimize Rust CI builds with proper sccache configuration (#15581) Simo Lin 2025-12-21 15:32:13 -10:00
• 122c250336 [model-gateway] add retry and circuit breaker support to gRPC routers (#15585) Simo Lin 2025-12-21 15:12:36 -10:00
• a3a552232d [feature] support hicache-3fs usrbio lib build for ubuntu24.04 (#15230) FlyPanda 2025-12-22 09:00:38 +08:00
• 0bf95e6d69 Fix type mismatch in LoRA batch validation causing assertion failures (#15427) Chenxi Li 2025-12-21 15:54:41 -08:00
• a92de891b8 Split dpsk fp4 4 gpu tests and move the mtp part to real stage b (#15553) Qiaolin Yu 2025-12-21 15:51:43 -08:00
• b9d786059f [model-gateway] refactor WorkerManager with fan_out helper and thin handlers (#15583) Simo Lin 2025-12-21 13:29:37 -10:00
• 1354063a48 [model-gateway] add WorkerService abstraction for worker business logic (#15580) Simo Lin 2025-12-21 12:35:35 -10:00
• 254de6d2fd Add triton_fused_moe config for GLM-4.6-FP8 tp8 blackwell (#15569) Qiaolin Yu 2025-12-21 13:41:22 -08:00
• 350fbbf4dc fix ds3.2 nsa backend prefill TBO (#14901) Jincong Chen 2025-12-22 05:16:46 +08:00
• a39126672a chore: bump sgl-kernel version to 0.3.20 (#15564) sglang-bot 2025-12-21 13:15:23 -08:00
• e1dcd0df3e [model-gateway] minor code clean up (#15578) Simo Lin 2025-12-21 11:00:32 -10:00
• 393e2f9b62 Revert "[FusedMoE] Fix fused w13 tp sharded weight loading" (#15579) Liangsheng Yin 2025-12-22 04:15:24 +08:00
• 8766a1dd24 [1 / N] Clean up logprob utils (#15509) Liangsheng Yin 2025-12-22 03:12:25 +08:00
• 1d9ba2ce4d [model-gateway] Use UUIDs for router-managed worker resources (#15540) shuwenn 2025-12-22 01:40:03 +08:00
• ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) Haoran Wang 2025-12-22 01:39:24 +08:00
• c69c1c4f07 [CI] Fix AMD CI to exclude multimodal_gen from main_package filter (#15558) sunxxuns 2025-12-21 03:58:17 -05:00
• bed301a5ac [Feature] Enable return routed experts (#12162) 3 people 2025-12-21 15:16:43 +08:00
• 8fe3e37468 Support piecewise cuda graph for dsv3 fp4 (#15531) Ke Bao 2025-12-21 14:50:32 +08:00
• 6014365564 [EAGLE] Fix slow Triton compilation in EAGLE KV cache copy by chunking large num_locs_upper (#15111) YAMY 2025-12-20 22:14:14 -08:00
• fc05acc2c7 [FusedMoE] Fix fused w13 tp sharded weight loading (#15432) Yinghai Lu 2025-12-20 21:59:36 -08:00
• 1ed946680a [diffusion] bench: improve bench_serving by adding more controlling args (#15554) Mick 2025-12-21 13:37:45 +08:00
• d7fbe73bf2 [diffusion] chore: minor improvements and typo-fixing (#15556) Mick 2025-12-21 13:37:10 +08:00
• 42bff706df [diffusion] profiling: simplify --perf-dump-path JSON output (remove duplicate denoise steps) (#15537) Xiaoyu Zhangandgemini-code-assist[bot] 2025-12-21 12:56:46 +08:00
• 26704c23c0 [model-gateway]: Tool parser for glm47 (#15520) Haoran Wang 2025-12-21 12:07:51 +08:00
• 43b7c17474 [CI] Fix /rerun-stage command by using requests for workflow dispatch (#15447) Alison Shao 2025-12-20 19:50:56 -08:00
• 96740d6983 feature: revamp nightly tests with combined runner (#15324) Douglas Yang 2025-12-20 19:25:22 -08:00
• 9a3bdf2c95 [CI] Migrate CUDA Graph tests to test/registered/cuda_graph/ (#15436) Alison Shao 2025-12-20 18:55:39 -08:00
• 4b351f6b95 Apply new moe align block size kernel (#14134) Xiaoyu Zhang 2025-12-21 10:13:32 +08:00
• 7fa4906f4f [sgl-kernel] Streamline kernel size report (Top 20 only) and clean up (#15552) Xiaoyu Zhang 2025-12-21 10:00:47 +08:00
• 050f108c29 Optimize Bailing-MoE with FlashInfer Fused All-Reduce (#15526) Yuan Luoandluoyuan.luo 2025-12-21 09:34:04 +08:00
• 47cdb65a45 fix: update argument extraction in R1 chat template (#15547) Xinyuan Tong 2025-12-21 01:18:49 +00:00
• 1d90b194b2 [model-gateway] bugfix: backward compatibility for GET endpoints (#15413) shuwenn 2025-12-21 04:37:53 +08:00
• 537ef18d17 [model-gateway] Optimize WASM Runtime with Instance Pooling and Component Caching (#15515) Praneth Paruchuri 2025-12-21 01:57:02 +05:30
• 69412ccb1f [model-gateway] add model gateway multi-arch docker build, test and document docker image (#15544) Simo Lin 2025-12-20 09:56:59 -10:00
• d3885d4ba6 Fix docker gateway image name and add latest tag (#15542) Simo Lin 2025-12-20 09:05:03 -10:00
• 0a346d3bd9 feat: Add limit-mm-data-per-request argument to server arguments (#15418) Xinyuan Tong 2025-12-20 18:44:47 +00:00
• bc18cb8631 [diffusion] refactor: change zmq socket type to router for scheduler (#15479) Mick 2025-12-21 00:39:54 +08:00
• bee8ac5b88 [diffusion] doc: add --perf-dump-path section to profiling doc (#15533) Xiaoyu Zhang 2025-12-21 00:15:27 +08:00
• 41bd76e18b [diffusion] log: fix wrong use of suppress_other_loggers (#15534) Mick 2025-12-20 23:43:55 +08:00
• c6ca1b3afc [diffusion] chore: allow all attention backends if not specified (#15530) Mick 2025-12-20 23:14:55 +08:00
• 8999ce754f [diffusion] perf: support zero-cost weight offload and overlap with compute for wan-series (#15511) Xiaoyu Zhang 2025-12-20 22:52:40 +08:00
• dce2ed4467 fix MiMo-V2-Flash typo (#15536) Yingchun Lai 2025-12-20 22:49:06 +08:00
• 019517a356 [VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320) Yuan Luoandluoyuan.luo 2025-12-20 21:00:07 +08:00
• 1f1f05a85e vlm: refactor engine vlm params and support processor output as input (#14091) 8 people 2025-12-20 18:31:24 +08:00
• 165f5c04cb Optimize MiMo-V2-Flash by flashinfer fused allreduce (#15464) Yuan Luoandluoyuan.luo 2025-12-20 17:45:18 +08:00
• 3e01f3a533 [NPU] [BUGFIX] [CRITICAL!] Fix NPU inference (torch_npu._npu_reshape_and_cache() crash) (#15484) Артем Савкин 2025-12-20 09:53:46 +03:00
• 51e2eaa458 [AMD] Support fast_topk kernels in sgl-kernel (#15172) Hubert Lu 2025-12-20 14:19:09 +08:00
• 6468cb5823 [AMD] remove the redundant projection (#15178) yctseng0211 2025-12-20 14:10:46 +08:00
• e220da1723 tiny fix sampling seed for completion api (#15498) Qiaolin Yu 2025-12-19 20:32:13 -08:00
• b82c7a0ae7 [GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333) Yuxuan Zhang 2025-12-20 12:30:44 +08:00
• c0f9b51992 [diffusion] refactor: deprecate workloadtype (#15267) Mickandgemini-code-assist[bot] 2025-12-20 11:24:31 +08:00
• 5529ab5895 [model-gateway] Implement RAII load guard with response body attachment (#15507) Simo Lin 2025-12-19 17:14:52 -10:00
• 74a3349bea [ci] remove rust benchmark in unit test ci (#15510) Simo Lin 2025-12-19 16:59:41 -10:00
• b9ebf0ed63 Clean hidden_states_before_norm (#15485) Liangsheng Yin 2025-12-20 09:38:46 +08:00
• 3c116d5e5a [router] bugfix: cache_aware in grpc inbalance forward (#15473) kun-llfl 2025-12-20 08:25:46 +08:00
• 71a602883a [model-gateway] simplify workflow engine backoff and reduce duplicate reads (#15505) Simo Lin 2025-12-19 14:23:02 -10:00
• 61405b3d00 [model-gateway] Run workflow event subscribers concurrently (#15504) Simo Lin 2025-12-19 13:49:51 -10:00
• 0adfc42b99 [model-gateway] Optimize workflow engine with pre-computed dependency graph (#15503) Simo Lin 2025-12-19 13:44:57 -10:00
• ba72e759ca [model-gateway] Improve logging across core modules (#15497) Simo Lin 2025-12-19 11:35:28 -10:00
• 6afc5d497b [DSv32] Move deep_gemm.get_paged_mqa_logits_metadata to init time as metadata (#15040) YL D 2025-12-20 05:23:33 +08:00
• 2ee6c810b8 [AMD] Add TP=8 models to nightly test and make TP=2 test stable (#15296) michael-amd 2025-12-19 13:15:19 -08:00
• bd16244d93 [model-gateway] Improve logging in policies module (#15496) Simo Lin 2025-12-19 11:02:57 -10:00
• b5eb0214ca [model-gateway] Improve logging in data_connector module (#15495) Simo Lin 2025-12-19 10:57:18 -10:00
• d72e908ba5 [model-gateway] refactor: extract common graceful shutdown code before TLS branch (#15494) Simo Lin 2025-12-19 10:56:33 -10:00
• 50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) Simo Lin 2025-12-19 10:35:50 -10:00
• ef908aeb40 fixed trtllm nvfp4 backend for moe (#15022) Khush Gupta 2025-12-19 13:49:21 -05:00
• 9d0347b33a EP Support for Piecewise Cuda Graph (#14164) Yuwei An 2025-12-19 09:59:27 -08:00
• 05eb0bcc61 [diffusion] http-server: support vertex generate pathway (#15348) Yashika Gandhi - Google 2025-12-19 09:47:17 -08:00
• 5dccd9bdcc Enhance protection rules of code owners (#15406) Liangsheng Yin 2025-12-20 00:25:57 +08:00
• 933cef16cc Tiny fix mimo model conflicts with main (#15483) Liangsheng Yin 2025-12-19 23:20:59 +08:00
• 241ae17b25 [NPU] bugfix for chunkedprefill (#15166) Hexq0210 2025-12-19 22:41:17 +08:00
• 2c5a446006 [NPU]Fix for ipc handle with npu (#14138) Mayyyy 2025-12-19 22:39:04 +08:00
• f3705b0115 [diffusion] doc: add doc for attention backends (#15408) Xiaoyu Zhangandgemini-code-assist[bot] 2025-12-19 22:10:29 +08:00
• 5a0ad7310e fix: update model name after weights update (#15416) shuwenn 2025-12-19 21:53:14 +08:00
• 5045aa34d3 Add MiDasheng Model Support (#15219) Jackie 2025-12-19 21:41:59 +08:00
• ff1e2ce24d [diffusion] fix: fix wrong validation on 2k resolution (#15478) Mick 2025-12-19 21:28:45 +08:00
• 1e58248808 [diffusion] multi-platform: add Sage Attention 3 Support for sm 120 (RTX5090) (#15382) ryangandMengxi Li 2025-12-19 21:27:02 +08:00
• 46be74b4b4 [diffusion] kernel: timestep embedding kernel implementation (#12995) 3 people 2025-12-19 20:59:50 +08:00
• 1c65802648 [diffusion] feat: support multiple input images for generate mode (#15394) suyeduand也渡 2025-12-19 20:08:10 +08:00
• ba41080892 [diffusion] model: support qwen-image-edit-2511 (#15458) Yuhao Yang 2025-12-19 20:06:00 +08:00
• 89512029f1 [diffusion]Support url image input (#15262) HuangJi 2025-12-19 19:37:23 +08:00
• 92e6b3c30e [Auto Sync] Update scheduler_runtime_checker_mixin.py (20251219) (#15437) 3 people 2025-12-19 01:46:03 -08:00
• 6559e43f30 Support FP8 MLA prefill and 128k context. (#14395) weiliang 2025-12-19 17:24:00 +08:00
• af780c59f3 [AMD] add unit-test-backend-8-gpu-amd back (#15253) yctseng0211andSai Enduri 2025-12-19 16:59:28 +08:00
• a21aa87ec5 [AMD] Fix and add accuracy-test-2-gpu-amd back (#15415) yctseng0211andbingxche 2025-12-19 16:41:14 +08:00
• fb17845723 fix: unreachable error check in retraction (#15433) shuwennandLiangsheng Yin 2025-12-19 16:33:34 +08:00
• 65c098592d [sgl-kernel] chore: update deepgemm version (#13402) Fan Yin 2025-12-19 16:20:24 +08:00
• 4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760) 5 people 2025-12-19 02:38:46 -05:00
• f2d64e6782 [amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340) sunxxunsandThomas Wang 2025-12-19 02:36:03 -05:00
• 0e869f0868 [diffusion] refactor: refactor _build_req_from_sampling to use shallow_asdict (#13782) coco 2025-12-19 15:19:56 +08:00
• 173940927f Add customized sampler registration (#15423) Qiaolin Yu 2025-12-18 23:10:23 -08:00
• f228b662a7 Update readme (#15425) Lianmin Zheng 2025-12-18 23:06:00 -08:00
• a36142aa71 Fix Mindspore model import warning (#15287) b8zhongandEven Zhou 2025-12-18 20:15:33 -08:00