Commit Graph

Select branches

Hide Pull Requests

bot/update-est-time-20260928

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• 5fbec0e445 ci: prune per-commit CUDA tests — move 25 files + 13 testcases to test/manual/ (#24721) Alison Shao 2026-05-08 15:53:23 -07:00
• aefd8e257f Re-land #23109: rebase-required mode + fix for grep-no-match abort (#24180) Alison Shao 2026-05-08 15:28:57 -07:00
• fa8985486e [test/fix]: isolate VLM MMMU eval output dirs to fix nightly-4-gpu cross-test pollution (#24623) Jimmy Shongandgemini-code-assist[bot] 2026-05-08 17:01:53 -05:00
• 5dc4c7bef1 Add speculative decoding naming convention rule (#24094) Liangsheng Yin 2026-05-08 14:52:31 -07:00
• 096ad02b06 [Model] Laguna-XS.2 Model Support (#24204) Jimmy Shong 2026-05-08 16:43:13 -05:00
• 7b707c9222 disable the combination of --enable-two-batch-overlap and --enforce-s… (#24720) Cheng Wan 2026-05-08 14:27:35 -07:00
• 09912fd89d Remove unnecessary bf16 assert in rotate_activation (#24686) Yuhao Yang 2026-05-09 05:00:52 +08:00
• f30d1d0b0a logits: remove blocking H2D copy (#24627) Yilong Zhao 2026-05-08 13:22:13 -07:00
• 672f778512 [NemotronH] Fix expert scale weight loading (#24434) Ethan Feng 2026-05-09 03:37:06 +08:00
• 2cf1a4ab38 feat: Add KV events for Mamba radix cache (#23678) zhongdaor-nvandzhongdaor-nv 2026-05-08 11:53:36 -07:00
• ca7a8cc61d [Bugfix] Fix a bug causing NVFP4 to be tested on all gpus like SM90 devices. (#24604) Xu Zouandxz-keg 2026-05-09 02:51:30 +08:00
• e40e339c72 Filter non-int token ids in benchmark and observe decode-side bootstrap/alloc metrics (#24684) Lianmin Zheng 2026-05-08 11:45:37 -07:00
• 73b8eda103 [diffusion] fix: fix FA3 varlen out argument handling (#24688) Mick 2026-05-08 19:01:49 +08:00
• 17888fa92a [diffusion] doc: update ltx2 multi-gpu deployment guide (#24682) Mick 2026-05-08 18:38:05 +08:00
• 7f8e7a9130 fix(aiter): drop FP8 KV upcast; use native FP8 path in paged_attentio… (#24129) fanxingranandfanxingran 2026-05-08 17:47:48 +08:00
• f21d4868dc [AMD] Replace naive triton RMSNorm with aiter RMSNorm for diffusion model (#24360) jacky.cheng 2026-05-08 17:44:13 +08:00
• e1150f66db [AMD][diffusion] Temporal-unfolded batched Conv2D for ROCm VAE decode (#22971) YC Yen-Ching Tseng 2026-05-08 17:32:14 +08:00
• d32e283947 [NPU] [DOC] refresh npu supported model list (#24676) amote-i 2026-05-08 17:08:15 +08:00
• 80d0226b68 Turn on JIT custom AR implementation by default (#24363) Brayden Zhongandb8zhong 2026-05-08 05:05:31 -04:00
• 73792629d4 [AMD] Intro SGLANG_DIFFUSION_AITER_FP8_ATTN (#24677) HAI 2026-05-08 01:31:00 -07:00
• 76a1f169b3 [AMD] Add AMD FP8 MLA attention test for Wan2.2-T2V-A14B (#23955) jacky.cheng 2026-05-08 16:03:51 +08:00
• b22d3cd606 [AMD] Support fp8 MLA for diffusion model (#20319) jacky.cheng 2026-05-08 15:56:24 +08:00
• 19afe73e03 [AMD] Cherry-pick aiter commit for mhc_pre fix (#24665) Thomas Wang 2026-05-08 14:49:39 +08:00
• 55d8223c2b [sgl-kernel/cpu] support w8a8 int8 model for arm cpu (#16045) Yibo Cai 2026-05-08 14:47:06 +08:00
• 47e9ec11ad [NPU] [DOC] fix ascend_npu_support_new_models TOC (#24658) amote-i 2026-05-08 14:07:00 +08:00
• e1bc001872 fix(mimo_v2): auto-disable multimodal when vision/audio configs are absent (#24652) JoyFuture 2026-05-08 13:40:08 +08:00
• 7deed98e1b [fix] /pause_generation and /continue_generation wrong for --tokenizer-worker-num > 1 (#24462) maocheng23andlawrence-harmonic 2026-05-07 21:32:21 -07:00
• 2afb450501 [diffusion] optimize: optimize frame returns path (#24616) Mick 2026-05-08 12:10:09 +08:00
• cdf5771f91 [MUSA][17/N] ci: Add MUSA diffusion, sgl-kernel tests, and CI workflow support (#20672) 3 people 2026-05-08 11:45:21 +08:00
• 15e6572f21 [MUSA][18/N] Add MUSA-optimized kernel implementations for hot ops (#23255) JoeyandR0CKSTAR 2026-05-08 11:38:33 +08:00
• 461bc8af49 [NPU][Doc] Update GLM-5 docs, enabling deepep by default (#23708) cen121212 2026-05-08 11:12:35 +08:00
• 5fa3bb2eaf Enable flashinfer::trtllm_allreduce_fusion with PDL (#23765) 3 people 2026-05-07 22:41:10 -04:00
• d9dddd4d7d [SPEC V2][2/N] feat: adaptive spec support spec v2 (#23336) shuwennandQiaolin-Yu 2026-05-08 09:33:47 +08:00
• 35870d55ac Deepseek V4 (#23882) +616 people 2026-05-07 18:32:21 -07:00
• 55224fff08 Add Arm64 CPU Phase 1A CI bootstrap (#22123) Mandepudi Rani ChowdaryandMa Mingfei 2026-05-07 20:28:23 -05:00
• 3c3f0bd55e Cache empty MatchResult in RadixCache (#24470) Lianmin Zheng 2026-05-07 17:13:20 -07:00
• c4bb3ce273 Fix stuck when enabling MTP on DSA models (#24635) Baizhou Zhang 2026-05-07 17:06:28 -07:00
• 95fb722dd2 Add registry for custom speculative algorithms (#23991) Liangsheng Yin 2026-05-07 16:11:45 -07:00
• c2c57068da fix(http): apply SGLANG_TIMEOUT_KEEP_ALIVE in common.py (#24323) Revanth Reddy Airre 2026-05-07 16:01:41 -07:00
• 5b589ed2e7 feat(constrained): two-phase reasoning grammar + --enable-strict-thinking (#23953) Xinyuan Tong 2026-05-07 22:21:51 +01:00
• af2a2ac618 fix(function_call): handle Kimi-K2.5 bare numeric tool call IDs (#23950) Xinyuan Tong 2026-05-07 22:20:02 +01:00
• d8f9d32a05 feat(reasoning): auto-detect reasoning/tool-call parser from chat template (#23952) Xinyuan Tong 2026-05-07 22:19:16 +01:00
• d2c1034163 [Gemma 4] Adding MTP support (#24436) Khoa PhamandPengyu Chen 2026-05-07 14:08:41 -07:00
• f1395af543 fix(openai): map reasoning.enabled to thinking AND enable_thinking (#23951) Xinyuan Tong 2026-05-07 22:01:35 +01:00
• 9cffa5ed6f [MUSA] Bump torchada to 0.1.54 (#24592) R0CKSTAR 2026-05-08 02:45:49 +08:00
• be088f8076 fix(router): configure HTTP client connection settings (#24330) Revanth Reddy Airre 2026-05-07 11:42:45 -07:00
• 90a618e37b [NPU][diffusion] add selectable parallel VAE decode strategies (#23248) 4 people 2026-05-08 02:37:03 +08:00
• 80a6014243 ✨ [diffusion][npu][quant] Add MXFP8 quantization support for Wan2.2 Diffusion on Ascend NPU (#20922) 3 people 2026-05-08 02:30:56 +08:00
• 7d397ad23d [NPU]Support model Trinity-mini for Npu, accuracy 90% (#18172) McZyWuandsglang-npu-bot 2026-05-08 01:58:18 +08:00
• b0225a69dc [diffusion] optimize: precompute LTX2 guidance perturbation states (#24494) Mick 2026-05-08 01:18:42 +08:00
• c18879054f [AMD] Route PR multimodal tests to MI325 (#24614) YC Yen-Ching Tsengandbingxche 2026-05-07 23:26:05 +08:00
• 9c41b1058f [diffusion] refactor: refactor cfg parallelism framework to support multi-branch CFG for LTX2 (#23736) ykcai-danielandMick 2026-05-07 07:56:55 -07:00
• 263cb3b222 [LoRA] Torch Native enhancement: embedding and graph optimization (#21885) Vladimir Serovandronnie_zheng 2026-05-07 17:28:38 +03:00
• 811d138c8a Nixl async transfer (#23967) ovidiusm 2026-05-07 16:05:43 +02:00
• ec4560304b [Bug Fix] Preserve decode state across retract-resume of GLM-5.1 (#23346) Yuxuan ZhangandShangming Cai 2026-05-07 15:37:53 +02:00
• e264b5785d [PD] Centralize per-room cleanup in common backend (#24601) Shangming Cai 2026-05-07 18:47:55 +08:00
• 3b2c730320 [AMD] Enable dual-stream MoE on ROCm (#24005) inkcherry 2026-05-07 17:27:24 +08:00
• 92f281f856 [Spec][trtllm] use decode kernel for draft extend (#24566) Hanming Lu 2026-05-07 02:25:26 -07:00
• a6dc49545e Let bypass-fastfail label skip stage-to-stage wait (#24598) Liangsheng Yin 2026-05-07 02:20:27 -07:00
• 684638e053 Fix prefill batch iter logging under overlap (#20845) weireweire 2026-05-07 17:10:42 +08:00
• 9dfb1d2ebe [Intel GPU] Fix flash_mla_get_workspace_size call in intel_xpu (#24372) Polisetty V R K Jyothendra Varma 2026-05-07 11:15:32 +05:30
• a2586f1c53 [CI] pin NeMo-Skills install to known-good SHA in accuracy_test_runner (#24581) Kangyan-ZhouandClaude Opus 4.7 2026-05-06 22:24:48 -07:00
• f0368a6666 [LoRA] Use deterministic lora_id for --lora-paths so multi-node ranks agree (#24555) Yanbin Jiangandgh1595 2026-05-06 22:20:15 -07:00
• d363315de9 fix(router): make HTTP pool idle timeout configurable (#24329) Revanth Reddy Airre 2026-05-06 22:11:11 -07:00
• 8bb0ce192b Add bypass-fastfail label for check-stage-health (#24577) Liangsheng Yin 2026-05-06 21:34:06 -07:00
• 9ba4aac47b Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559) fzyzcjy 2026-05-07 12:06:04 +08:00
• 65ce9965ce [Bug Fix] Fix RunAI streamer: corrupted weights, missing quant init, and broken URIs for multimodal models (#22715) Jun LiuandAlex Nails 2026-05-07 11:20:04 +09:00
• ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) Baizhou Zhang 2026-05-06 18:59:01 -07:00
• eaf074d50e propagate pytest exit code from test __main__ entries (#24487) Liangsheng Yin 2026-05-06 18:46:52 -07:00
• 4a279d9c36 [R3] Avoid implicit CUDA sync in routed experts DP slicing (#24550) Yuzhen ZhouandByron Hsu 2026-05-06 18:37:36 -07:00
• 27445f9836 Add ChatCompletionRequest-style support to /v1/tokenize (#23981) huangtingwei 2026-05-07 09:35:20 +08:00
• 3fe8bc987e Support Triton MLA FP8 KV cache (#20479) Brayden Zhongandb8zhong 2026-05-06 21:32:39 -04:00
• 2e642ea187 [diffusion] chore: align LTX-2 with official (#24313) Mick 2026-05-07 08:46:28 +08:00
• 7fa48916f5 Expand support matrix for pypi wheel release (#24565) Baizhou Zhang 2026-05-06 17:39:02 -07:00
• a9a8b20a90 [codex] Optimize Z-Image packed QKV (#24117) Xiaoyu Zhang 2026-05-07 07:51:22 +08:00
• 9e1336d406 [Misc] Fix breaking weight checker test (#24553) Baizhou Zhang 2026-05-06 15:42:54 -07:00
• ece7e95b65 [LoRA] Fix qkv_proj LoRA buffer sizing when tp_size > num_key_value_heads (#24420) gh1595andYanbin Jiang 2026-05-06 14:51:30 -07:00
• e72246c6e6 ci: bump test_mimo_models.py est_time 330 → 610 (#24551) Alison Shao 2026-05-06 14:35:43 -07:00
• bc70488695 [CI] Temporarily disable marco/mcdse-2b-v1 in test_embedding_models (#24279) jsheng_LinkedinandClaude Opus 4.7 2026-05-06 14:28:39 -07:00
• b859f7ffba Improve metrics, observability, and PD deploy tooling (#24521) Lianmin Zheng 2026-05-06 11:27:35 -07:00
• d86f2916cc Fix diffusion fallback guards and validation (#23335) Xiaoyu Zhang 2026-05-07 00:05:43 +08:00
• 32d9998b9d [PD] Prevent update_status to Failed from cleared entries (#24539) Shangming Cai 2026-05-06 23:32:04 +08:00
• bfc1aeae13 [CP] Register KV cache allgather buffer with symmetric memory (#24040) sky 2026-05-06 23:24:36 +08:00
• c4c5541618 Support getting checksums in weight checker (#24537) fzyzcjy 2026-05-06 22:59:28 +08:00
• ae5ae840f6 Refactor buffer patterns in weight checker (#24538) fzyzcjy 2026-05-06 22:52:07 +08:00
• 800deaaefa Add unit and end-to-end tests for weight checker (#24536) fzyzcjy 2026-05-06 22:48:48 +08:00
• eb5f0fbeef Support swa HiCache for unified radix cache (#23391) Ke Baoandhzh0425 2026-05-06 22:19:25 +08:00
• 491051c622 Cherry pick weight_checker _weight_fp32 buffer skip from #22663 (#24534) fzyzcjyandJD 2026-05-06 21:21:12 +08:00
• 0d40931b08 Cherry pick weight_checker non-persistent buffer pattern list from #21278 (#24533) fzyzcjyandJD 2026-05-06 21:14:01 +08:00
• 864f9633f2 Cherry pick weight_checker fp8 dequant fix and non-persistent buffer skip from #21494 (#24532) fzyzcjyandYueming Yuan 2026-05-06 21:13:17 +08:00
• d4d4b04d66 [PD] Fix missing update_status call in abort() across all KV backends (#24522) Lianmin Zheng 2026-05-06 05:30:11 -07:00
• 163bf1ba71 [PD] Fix KV transfer metrics (#24416) 3 people 2026-05-06 03:44:48 -07:00
• 11b0e510aa Fix lint (#24520) fzyzcjy 2026-05-06 18:26:41 +08:00
• 7ec18f7e4e [Doc] Fix instruction on Cuda 13 environments (#24516) Baizhou Zhang 2026-05-06 02:37:23 -07:00
• b67df7cd1b [Codex] Diffusion handle non-contiguous CFG communication (#24332) Xiaoyu ZhangandBBuf Codex 2026-05-06 17:27:14 +08:00
• c8bc23522f Refactor: decouple segment tracking from comm registration (#21392) sky 2026-05-06 17:07:58 +08:00
• a858fda708 Add e2e test with log snapshot in dumper grafter (#24513) fzyzcjy 2026-05-06 17:00:13 +08:00
• 8527db0a91 Enhance diff and tensor-info logging in dumper grafter (#24512) fzyzcjy 2026-05-06 16:58:08 +08:00
• 75943cfbcf Support per-call extras and dataclass transform input in dumper grafter (#24511) fzyzcjy 2026-05-06 16:57:44 +08:00
• 833279eb2e Support multi-rank exchange via all_gather_object in dumper grafter (#24510) fzyzcjy 2026-05-06 16:57:20 +08:00