18694 Commits
Author SHA1 Message Date
Liangsheng Yin 8bb0ce192b Add bypass-fastfail label for check-stage-health (#24577) 2026-05-06 21:34:06 -07:00
fzyzcjy 9ba4aac47b Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559) 2026-05-06 21:06:04 -07:00
Jun LiuandAlex Nails 65ce9965ce [Bug Fix] Fix RunAI streamer: corrupted weights, missing quant init, and broken URIs for multimodal models (#22715)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-05-06 19:20:04 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
Liangsheng Yin eaf074d50e propagate pytest exit code from test __main__ entries (#24487) 2026-05-06 18:46:52 -07:00
Yuzhen ZhouandByron Hsu 4a279d9c36 [R3] Avoid implicit CUDA sync in routed experts DP slicing (#24550)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2026-05-06 18:37:36 -07:00
huangtingwei 27445f9836 Add ChatCompletionRequest-style support to /v1/tokenize (#23981) 2026-05-06 18:35:20 -07:00
Brayden Zhongandb8zhong 3fe8bc987e Support Triton MLA FP8 KV cache (#20479)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-06 18:32:39 -07:00
Mick 2e642ea187 [diffusion] chore: align LTX-2 with official (#24313) 2026-05-07 08:46:28 +08:00
Baizhou Zhang 7fa48916f5 Expand support matrix for pypi wheel release (#24565) 2026-05-06 17:39:02 -07:00
Xiaoyu Zhang a9a8b20a90 [codex] Optimize Z-Image packed QKV (#24117) 2026-05-07 07:51:22 +08:00
Baizhou Zhang 9e1336d406 [Misc] Fix breaking weight checker test (#24553) 2026-05-06 15:42:54 -07:00
gh1595andYanbin Jiang ece7e95b65 [LoRA] Fix qkv_proj LoRA buffer sizing when tp_size > num_key_value_heads (#24420)
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
2026-05-06 14:51:30 -07:00
Alison Shao e72246c6e6 ci: bump test_mimo_models.py est_time 330 → 610 (#24551) 2026-05-06 14:35:43 -07:00
jsheng_LinkedinandClaude Opus 4.7 bc70488695 [CI] Temporarily disable marco/mcdse-2b-v1 in test_embedding_models (#24279)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-06 14:28:39 -07:00
Lianmin Zheng b859f7ffba Improve metrics, observability, and PD deploy tooling (#24521) 2026-05-06 11:27:35 -07:00
Xiaoyu Zhang d86f2916cc Fix diffusion fallback guards and validation (#23335) 2026-05-07 00:05:43 +08:00
Shangming Cai 32d9998b9d [PD] Prevent update_status to Failed from cleared entries (#24539)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-05-06 23:32:04 +08:00
sky bfc1aeae13 [CP] Register KV cache allgather buffer with symmetric memory (#24040)
Signed-off-by: wangfakang <fakangwang@gmail.com>
2026-05-06 23:24:36 +08:00
fzyzcjy c4c5541618 Support getting checksums in weight checker (#24537) 2026-05-06 22:59:28 +08:00
fzyzcjy ae5ae840f6 Refactor buffer patterns in weight checker (#24538) 2026-05-06 22:52:07 +08:00
fzyzcjy 800deaaefa Add unit and end-to-end tests for weight checker (#24536) 2026-05-06 22:48:48 +08:00
Ke Baoandhzh0425 eb5f0fbeef Support swa HiCache for unified radix cache (#23391)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-05-06 22:19:25 +08:00
fzyzcjyandJD 491051c622 Cherry pick weight_checker _weight_fp32 buffer skip from #22663 (#24534)
Co-authored-by: JD <jaedon.guo@gmail.com>
2026-05-06 21:21:12 +08:00
fzyzcjyandJD 0d40931b08 Cherry pick weight_checker non-persistent buffer pattern list from #21278 (#24533)
Co-authored-by: JD <jaedon.guo@gmail.com>
2026-05-06 21:14:01 +08:00
fzyzcjyandYueming Yuan 864f9633f2 Cherry pick weight_checker fp8 dequant fix and non-persistent buffer skip from #21494 (#24532)
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
2026-05-06 21:13:17 +08:00
Lianmin Zheng d4d4b04d66 [PD] Fix missing update_status call in abort() across all KV backends (#24522) 2026-05-06 05:30:11 -07:00
163bf1ba71 [PD] Fix KV transfer metrics (#24416)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-05-06 03:44:48 -07:00
fzyzcjy 11b0e510aa Fix lint (#24520) 2026-05-06 18:26:41 +08:00
Baizhou Zhang 7ec18f7e4e [Doc] Fix instruction on Cuda 13 environments (#24516) 2026-05-06 02:37:23 -07:00
Xiaoyu ZhangandBBuf Codex b67df7cd1b [Codex] Diffusion handle non-contiguous CFG communication (#24332)
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
2026-05-06 17:27:14 +08:00
sky c8bc23522f Refactor: decouple segment tracking from comm registration (#21392)
Signed-off-by: wangfakang <fakangwang@gmail.com>
2026-05-06 17:07:58 +08:00
fzyzcjy a858fda708 Add e2e test with log snapshot in dumper grafter (#24513) 2026-05-06 17:00:13 +08:00
fzyzcjy 8527db0a91 Enhance diff and tensor-info logging in dumper grafter (#24512) 2026-05-06 16:58:08 +08:00
fzyzcjy 75943cfbcf Support per-call extras and dataclass transform input in dumper grafter (#24511) 2026-05-06 16:57:44 +08:00
fzyzcjy 833279eb2e Support multi-rank exchange via all_gather_object in dumper grafter (#24510) 2026-05-06 16:57:20 +08:00
fzyzcjy ebd64f5d40 Support user-supplied recv-side transform in dumper grafter (#24509) 2026-05-06 16:56:52 +08:00
fzyzcjy 9a65f0ac26 Support t2b direction and overlap protection in dumper grafter (#24508) 2026-05-06 16:56:24 +08:00
fzyzcjy 58487e68e5 Support cross-system tensor grafting in dumper (#24507) 2026-05-06 16:55:40 +08:00
fzyzcjy 61104d7d0a Add prefixed _log helper in dumper (#24506) 2026-05-06 16:54:20 +08:00
fzyzcjy 23172224b9 chore: Gitignore Claude scheduled_tasks.lock (#24505) 2026-05-06 16:53:56 +08:00
Alison Shao 094b90b1ec ci: drop 1-gpu-h100-h200 shared label (#24495) 2026-05-06 01:02:31 -07:00
Mick fbebfdec9a [diffusion] fix: fix diffusion FSDP sharding (#24431) 2026-05-06 14:55:51 +08:00
cctry 660a77f221 Silence noisy health-check race log in TokenizerManager (#24466) 2026-05-05 21:06:43 -07:00
3da87902d7 [HiSparse] Support FP8 KV cache by routing to flashmla_kv backend (#23013)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-05-06 03:18:30 +00:00
b2420d72ff [RL] DeepEP support for --enable-return-routed-experts (#16859)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Junrong Lin <33685709+ocss884@users.noreply.github.com>
2026-05-05 20:01:07 -07:00
Xiaoyu Zhang d7385b575f [Diffusion] Optimize Hunyuan3D shape denoising (#24287) 2026-05-06 10:10:09 +08:00
Jianhong Zhang c7019ff33d [NIXL][XPU] Use np.uint64 for pointer/length arrays in disaggregation KV transfer (#24188) 2026-05-06 10:09:03 +08:00
Qiaolin Yu a965f886bf [misc] update CI_PERMISSIONS.json (#24468) 2026-05-05 18:37:18 -07:00
Lianmin Zheng b91b05ae27 Add --random-input-len to send_one.py (#24464) 2026-05-05 17:49:33 -07:00