Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• ce4e836be5 Add per-request decode tp size (#14678) Lianmin ZhengandByron Hsu 2025-12-08 20:24:31 -08:00
• 0e0b0c0566 Revert "[Bug] fix not desired disable fused share experts caused by r… (#14676) Yineng Zhang 2025-12-08 20:06:52 -08:00
• e6f0ddda44 [CI] Migrate Eagle 1-GPU tests to test/registered/ (#14529) Alison Shao 2025-12-08 19:56:36 -08:00
• af20657cd4 Tiny support sgl-router http response status code metrics (#14689) fzyzcjy 2025-12-09 11:54:35 +08:00
• 08da4c2618 [Bugfix] Fix KeyError for Mistral-Large-3 rope_scaling config (#14627) Alison Shao 2025-12-08 19:16:00 -08:00
• ef3f8c97e1 Add ffmpeg into sglang docker - required by transformers multimodal V… (#14679) Binyao Jiang 2025-12-08 18:00:23 -08:00
• e5201bda34 [CI] Unblock gb200 cutedsl test (#14469) Baizhou Zhang 2025-12-08 17:58:25 -08:00
• 60d36e7be7 [NPU] chore: bump basic software version to 8.3.rc2 (#14614) Even Zhou 2025-12-09 09:14:27 +08:00
• 6f657070ef [SMG]feat: implement TokenGuardBody for managing token return (#14653) Jimmy 2025-12-09 08:44:46 +08:00
• c106b54b57 Aiter fp8 kv cache (#13147) kk 2025-12-09 08:39:53 +08:00
• 119fd956fb Tiny support printing requests in bench_serving for observability (#14652) fzyzcjy 2025-12-09 08:27:58 +08:00
• eac5b66485 [RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334) PiteXChenandZhiqiang Xie 2025-12-09 07:55:09 +08:00
• 07404d7689 [HiCache] fix condition check when use decode offload (#14489) Francis 2025-12-09 07:52:40 +08:00
• 93043f7b13 [CI] Increase max-parallel to 15 for high priority PRs (#14675) Alison Shao 2025-12-08 15:40:37 -08:00
• edde5e5d40 [model-gateway] add OTEL integration to grpc router (#14671) Simo Lin 2025-12-08 14:45:05 -08:00
• 6abb8051e8 Bump up diffusers to latest official release version (#14670) Binyao Jiang 2025-12-08 13:41:01 -08:00
• 2e3946d889 Fix cache-aware router should pick min load instead of min tenant size (#14650) fzyzcjy 2025-12-09 05:33:34 +08:00
• 32f8b6064e improve default glm mtp setting (#14457) b8zhong 2025-12-08 13:27:13 -08:00
• b9bef31a15 fix: use .get() when accessing strict mem-check env variable (#14657) Yuhao Yang 2025-12-09 05:25:42 +08:00
• 8550822d6b [model-gateway] Optimize memory usage in HTTP router (#14667) Simo Lin 2025-12-08 13:10:31 -08:00
• 8810152e88 vlm: Use fa3 as the default backend for qwen3 vl (#14634) Mick 2025-12-09 04:56:20 +08:00
• 7bf16c6339 [model-gateway] fix WASM arbitrary file read security vol (#14664) Simo Lin 2025-12-08 12:11:16 -08:00
• 39f9a9c2a5 [model-gateway] reduce cpu overhead in grpc router (#14663) Simo Lin 2025-12-08 11:54:56 -08:00
• d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) Simo Lin 2025-12-08 09:44:40 -08:00
• 763888b5a8 [AMD] change fused rms quant interface for aiter upgrade (#14497) yctseng0211 2025-12-09 01:09:23 +08:00
• 9a327bdfcf chore: bump SGLang version to 0.5.6.post1 (#14651) sglang-bot 2025-12-08 08:35:28 -08:00
• 2de98010b5 chore: bump sgl-kernel version to 0.3.19 (#14649) sglang-bot 2025-12-08 06:53:08 -08:00
• 8200fb56cb update transformers package version to 5.0.0rc0 (#14356) Yuhao Yang 2025-12-08 22:46:01 +08:00
• cb4cdb43a4 Fix dp-aware incompatible with service-discovery (#14629) fzyzcjy 2025-12-08 22:39:27 +08:00
• 80cfca50bc [diffusion] chore: further refine output resolution adjustment logic (#14558) Mickandgemini-code-assist[bot] 2025-12-08 19:08:38 +08:00
• 7871593cc8 [cpu] Implement all gather/reduce for arm64 cpu (#12527) Yibo Cai 2025-12-08 19:03:04 +08:00
• 4a62a0e3cd chore: bump sgl-kernel version to 0.3.19 (#14632) sglang-bot 2025-12-08 03:02:24 -08:00
• 12a08efc20 [diffusion] feat: add support for LoRA layers in transformer_2 within LoRAPipeline (#14606) Prozac614 2025-12-08 17:57:13 +08:00
• 06836ad02a [Reasoning + Structured Output] make reasoning compatible with structured output (#12551) Muqi LiandXinyuan Tong 2025-12-08 17:28:39 +08:00
• f72a77038f modify the sgl-kernel to be compatible with transformers 5.x. (#14625) Yuhao Yang 2025-12-08 16:39:00 +08:00
• aeff0d386b Fix amd rope definition (#14556) Qiaolin Yu 2025-12-07 23:47:03 -08:00
• cf0478d602 [Glm46v] Bug fix for accuracy drop and unable to launch server (#14585) 4 people 2025-12-07 23:45:02 -08:00
• a2ca9bd4f1 Super tiny fix unused code in router (#14618) fzyzcjy 2025-12-08 15:12:09 +08:00
• 36361adcbf [DLLM] Add initial cuda graph support (#14203) Tiwei Bie 2025-12-08 14:12:35 +08:00
• 661e9775d0 [2/2] Add rope kernel in sgl-kernel (#14452) Qiaolin Yu 2025-12-07 21:37:29 -08:00
• 2970f22917 [model-gateway] fix WASM unbounded request/response body read vuln (#14612) Simo Lin 2025-12-07 20:47:25 -08:00
• c08b780fe0 Super tiny remove unused select_worker_pair (#14609) fzyzcjy 2025-12-08 12:32:38 +08:00
• 8fbf7dd56f [model-gateway] refactor otel to be more efficient (#14604) Simo Lin 2025-12-07 20:09:25 -08:00
• 1915a1f8a7 Super tiny remove unneeded policy flag (#14608) fzyzcjy 2025-12-08 11:35:07 +08:00
• 85d0ccfac0 Tiny fix missing policy decision recording (#14605) fzyzcjy 2025-12-08 11:24:27 +08:00
• a4ffd665c0 [model-gateway] fix WASM memory limit per module (#14600) Simo Lin 2025-12-07 19:15:19 -08:00
• 559202b544 [CI] Fix unit-test-backend-8-gpu-b200 running on every /rerun-stage (#14591) Alison Shao 2025-12-07 18:42:04 -08:00
• f57d4fe78e [feat] use cachebuffer to store mm feature to speedup hash (#14386) Nicholas 2025-12-08 10:35:20 +08:00
• b7b7524e95 [Tool Call] Fix DeepSeekV32Detector skipping functions with no params in streaming mode (#14573) wentx 2025-12-08 10:32:10 +08:00
• 6799847ebf [CI]Unblock and split spec v2+dp test (#14551) Baizhou Zhang 2025-12-07 17:39:25 -08:00
• 03b835e7d1 Refactor tuning block wise kernel and opt Qwen/Qwen3-VL-32B-Instruct-FP8 (#14141) Xiaoyu Zhang 2025-12-08 09:24:58 +08:00
• aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) Simo Lin 2025-12-07 16:50:39 -08:00
• 5e2cda6158 [model-gateway] Fixed WASM Security Vulnerability - Execution Timeout (#14588) Simo Lin 2025-12-07 16:05:53 -08:00
• b0bbc7f53d [model-gateway] extra accumulator and tool handler in oai router (#14587) Simo Lin 2025-12-07 15:52:12 -08:00
• 673c11ba73 [Minor] Temporarily skipping deepep large mtp test (#14586) Baizhou Zhang 2025-12-07 13:59:16 -08:00
• 3b47973af8 [CI] Tiny speed up VLM CI (#14517) b8zhongandBrayden Zhong 2025-12-07 13:30:41 -08:00
• f6423b626c Rename TensorRT Model Optimizer to Model Optimizer (#14455) Zhiyu 2025-12-07 13:18:20 -08:00
• 84efe54bc4 Fix FP8 KV Triton type issue and add regression test (#14553) Hudson Xing 2025-12-07 10:51:46 -08:00
• 948b6acee8 [BugFix] fix prefixcache performance and accuracy on ascend (#13573) khalilzhk 2025-12-08 02:16:20 +08:00
• f124539a01 [NPU]LoRA: Adding Torch Native backend (#14132) Vladimir Serov 2025-12-07 21:16:07 +03:00
• c8683ae305 [diffusion] cli: profiling utilities support (#14185) 4 people 2025-12-08 00:59:45 +08:00
• 125e17efd5 Add small model test for spec v2 + dp + trtllm_mla (#14576) Liangsheng Yin 2025-12-07 23:55:00 +08:00
• 88c459c6c8 Tiny remove wrong import from python.sglang (#14577) Liangsheng Yin 2025-12-07 22:07:49 +08:00
• ae6a6630e4 Add Expert Parallelism (EP) support for kimi-k2-thinking (#13725) Xiaoyu Zhang 2025-12-07 20:28:57 +08:00
• 26d95008b6 [apply][2/2] Fused qk_norm_rope for Qwen3-MoE (#13998) Yuan Luoandluoyuan.luo 2025-12-07 20:25:18 +08:00
• f2b5dcc976 Add unit-test-backend-8-gpu-b200 to rerun-stage command (#14569) Alison Shao 2025-12-07 03:09:07 -08:00
• 9abcab3ffa [DLLM] feat: Add threshold based parallel decoding support (#14412) 3 people 2025-12-07 18:25:33 +08:00
• e5135b73f4 Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544) Xiaoyu Zhang 2025-12-07 15:29:41 +08:00
• 41d61faa99 [FLA] Add explicit kernel arguments to kda.py for Kimi Linear support (#14561) Alison Shao 2025-12-06 22:45:41 -08:00
• 3c7886ec4c Fix attention backend logic for Qwen3-Next on SM100 (#14560) Chen1022 2025-12-07 14:03:34 +08:00
• 0e4d8790d7 feat(ci): add framework target to release-docker workflows (#14559) ishandhanani 2025-12-06 21:25:24 -08:00
• 6d5d76ad97 remove unecessary dual stream token threshold from the rest of models (qwen moe, kimi linear, etc.) (#14337) b8zhong 2025-12-06 19:57:26 -08:00
• 91c9c14c28 DOC update nemo-skills in docs (#14555) George ArmstrongandBaizhou Zhang 2025-12-06 19:03:08 -08:00
• 32a32cf7d2 Enhance prefill PP node robustness (#14494) Rain H 2025-12-07 10:00:54 +08:00
• be4a3ec376 support piecewise cuda graph for Olmo models (#14476) Minglei Zhu 2025-12-06 17:57:44 -08:00
• ff6e3ea934 [docs] Add missing word in argument description (#14205) almaslof 2025-12-07 03:56:54 +02:00
• dd91d38e6a [Doc] Add short explanation on page size (#14557) b8zhong 2025-12-06 17:26:30 -08:00
• 5f6f550af8 Update DeepSeek V3 docs to use B200 (#14447) Lee Nau 2025-12-06 17:22:11 -08:00
• 5edbe351cb Update CI_PERMISSIONS.json (#14552) harrisonlimh 2025-12-06 14:01:32 -08:00
• d2b42477c7 chore: bump sgl-kernel version to 0.3.18.post3 (#14518) sglang-bot 2025-12-06 13:15:16 -08:00
• 9dfa01a435 [Misc]Register and refactor some environs for dpsk-fp4 and DeepEp (#14538) Baizhou Zhang 2025-12-06 12:29:16 -08:00
• e592ee6545 [Qwen3-next] remove heuristics and add radix cache kl test (#14520) Hanming Lu 2025-12-06 12:11:40 -08:00
• cee93a6f26 [Bug fix] Add /model_info endpoint to mini_lb (#14535) Alison Shao 2025-12-06 11:34:03 -08:00
• bc388471d2 [1/n] Fix hanging during DeepGemm Warmup (#14493) Baizhou Zhang 2025-12-06 10:44:02 -08:00
• 3e40c63674 fix "GrammarMatcher has terminated after accepting the stop token, but is trying to find the next token mask" when both reasoning and spec are enabled (#14464) gongwei-130 2025-12-06 06:15:22 -08:00
• 80122e4f4c [diffusion] lora: fix LoRA dtype handling and weight attribute access for z-image model (#14543) WenhaoZhangandniehen6174 2025-12-06 22:14:44 +08:00
• e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) Feng Su 2025-12-06 21:59:04 +08:00
• 6d41791823 [diffusion] perf: add QKV fusion optimization for Flux models (#14505) Xiaoyu ZhangandMick 2025-12-06 20:44:16 +08:00
• 35a9a07370 [diffusion] refactor: simplify sampling params' override logic (#14539) Mick 2025-12-06 20:23:49 +08:00
• ea177372bd support mtp with deepseek r1 nvfp4 model (#13115) Rain JiangandTrevor Morris 2025-12-06 00:45:54 -08:00
• 42fcf5438f Revert "tiny remove deprecated endpoint call" (#14533) Baizhou Zhang 2025-12-05 23:48:54 -08:00
• d257bf87b9 [CPU] add mamba fla kernels for Qwen3-next (#12324) blzheng 2025-12-06 14:16:23 +08:00
• 7b0c7ad163 Revise DP Multi-Modal Encoder Document (#14290) Yuhao Yang 2025-12-06 12:56:53 +08:00
• d30d6b368f [bug] fix notebook to include new keys from model_info (#14528) Simo Lin 2025-12-05 20:44:03 -08:00
• d881f31488 [diffusion] chore: temporarily upgrade diffusers to make Z-image compatible with Cache-DiT (#14530) Mick 2025-12-06 12:39:37 +08:00
• 2ac5b98395 fix: fix rmsnorm -> layernorm in qwen3 omni (#11791) Vincent ZhongandBrayden Zhong 2025-12-05 23:12:57 -05:00
• a0dde90af6 [CODEOWNER] update codeowner for qwen3-next related (#14522) Hanming Lu 2025-12-05 16:15:10 -08:00
• b988c18eae Fix safetensors validation to catch corruption after download (#14465) Alison Shao 2025-12-05 16:04:00 -08:00
• e41664ba1a [Docs] Add /rerun-stage command to contribution guide (#14521) Alison Shao 2025-12-05 15:46:47 -08:00
• 3d1b591aa1 Tiny use trtllm_mha as default when possible (#14291) fzyzcjy 2025-12-06 06:26:03 +08:00