Commit Graph
12952 Commits
Author SHA1 Message Date
Hanming Lu ddf3817924 Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917) 2026-05-20 18:49:01 -07:00
Pai Liu cf1fd26d16 benchmark/lora: make number of LoRA adapters configurable (#25363) 2026-05-20 18:23:13 -07:00
Kevin Flansburg 643d44d699 [BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226) 2026-05-20 18:20:19 -07:00
Lianmin Zheng c4a7d12092 Enable breakable CUDA graph for eagle (#25795) 2026-05-20 18:02:04 -07:00
huangtingweiandZhiqiang Xie f9f82d238c fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-05-20 17:28:38 -07:00
Liangsheng Yin 512d164916 Address overlap future token map by request-pool index (#25862) 2026-05-20 16:34:00 -07:00
grunerandAmit Gruner b7d0df4b6f [SMG] Support regular worker discovery alongside PD workers in IGW mode (#25294)
Co-authored-by: Amit Gruner <agruner@crusoe.ai>
2026-05-21 07:23:55 +08:00
Kaixi 9f2bc24b35 Fix/dsv4 flash eagle dummy ima (#25892) 2026-05-20 15:41:28 -07:00
BingjiaWang ce7141ef98 add git gemm warpper for dispatch_bf16_fp32_backend (#25860) 2026-05-20 15:24:10 -07:00
Hanming Lu 371b6c9ea0 [Scheduler] fix chunked prefill not always being full (#25741) 2026-05-20 15:03:11 -07:00
Qiaolin Yu 1a17d753f1 [perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460) 2026-05-20 14:20:49 -07:00
Yuzhen Zhou dac78768f0 [RL][TITO] Preserve whitespace in reasoning parser outputs (#24251) 2026-05-20 19:45:09 +00:00
YAMY 801d7e3eed [DSA] Make MQA logits free memory ratio configurable (#25859) 2026-05-20 12:27:16 -07:00
Ratish P 5e7bf73757 Fix bench_serving non-stream reasoning content (#25298) 2026-05-20 18:41:46 +00:00
jasonjk-park 1f209b4433 Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681) 2026-05-20 11:34:45 -07:00
Lianmin Zheng 61ac6792e6 Add DevashishLal-CB to CI_PERMISSIONS.json (#25908) 2026-05-20 11:19:43 -07:00
Mark Smithandzhangjiadong1@corp.netease.com 33c57b8716 [Bug][RadixTree] Fix LRU list reference cycle leak in radix_cache (#25770)
Co-authored-by: zhangjiadong1@corp.netease.com <zhangjiadong1@corp.netease.com>
2026-05-21 01:06:05 +08:00
Jialin Ouyang 6e0b7f35ad [radix cache] pluggable RadixCache factory (--radix-cache-backend) (#25101) 2026-05-20 10:05:04 -07:00
Xiaoyu Zhang ccbbae00ea [codex] Reland Wan2.2 ModelOpt CI checkpoints (#25857) 2026-05-20 22:15:25 +08:00
Liwansi 55ba03db6a [NPU]use triton split_qkvgate_gemma_rmsnorm_rope for Qwen3.5 and Qwen3_next (#23925) 2026-05-20 20:22:10 +08:00
Liangsheng Yin 34d3e23232 spec_v2: consolidate seq_lens_cpu/sum maintenance into helper (#25818) 2026-05-20 04:42:26 -07:00
Liangsheng Yin 9b005d3608 disagg prebuilt: drop dead prepare_for_extend shift (#25819) 2026-05-20 04:39:47 -07:00
Liangsheng Yin eccd5c8253 pr-test: schedule 3x -> 2x; fix extra gate skipped on schedule (#25872) 2026-05-20 03:58:54 -07:00
Liangsheng Yin 1bd4f94598 [Test] Add fwd_occupancy sanity kit (#25886) 2026-05-20 03:34:37 -07:00
Chi McIsaac 47979fb252 [diffusion] fix: fix GLM-Image /v1/images/edits support (#25697) 2026-05-20 17:11:51 +08:00
Liangsheng Yin 614672fea5 [Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831) 2026-05-20 01:58:48 -07:00
Yuhong Guo 24d27c2035 [BugFix] Fix rid_to_state leak for aborted queued requests (#24070) 2026-05-20 01:32:44 -07:00
Matt Van HornandMatt Van Horn e99f87c974 fix: add missing distro dependency to runtime docker image (#25817)
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
2026-05-20 00:46:32 -07:00
044649c23a feat: Support flashinfer_cutedsl MoE runner with flashinfer alltoall backend (#22669)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-20 00:36:26 -07:00
Cheng Wan bdacb1be4d Update CODEOWNERS to replace 'nsa' with 'dsa' (#25861) 2026-05-20 00:31:23 -07:00
Kangyan-ZhouandClaude Opus 4.7 a1843524a5 ci(sgl-router): add PR test workflow (pre-positioned for feature PR) (#25854)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-20 15:20:03 +08:00
Cheng WanandClaude Sonnet 4.6 8131641bc6 [Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-20 00:18:04 -07:00
Faradawn Yang da6d549ab2 Update GLM-5 H200 FP8 (#25814)
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
2026-05-20 14:44:54 +08:00
Xinyuan TongandXinyuan Tong 52eebc82ae [Docs] MiMo-V2.5 cookbook: B200 benchmarks + multi-layer EAGLE acceptance profile + long-context reference (#25359)
Co-authored-by: Xinyuan Tong <xinyuan.tong@radixark.ai>
2026-05-19 23:15:21 -07:00
Michael 7fda3caea4 [AMD] test(sgl-kernel): seed RNG on ROCm in test_moe_topk_sigmoid to fix tie-break flake (#25356) 2026-05-19 23:01:13 -07:00
Xiaobaoandgithub-actions[bot] 0d3a94f643 [Bug] Correct Weight Offloader's Attribute Name for torch.nn.Parameter (#25786)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-05-19 22:28:59 -07:00
Yuan Luoandluoyuan.luo b7085d3860 [fp8] SM90 swap-AB scaled_mm dispatch (~1.16x kernel geomean, +5.8-18.5% end-to-end) (#25532)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-20 13:20:37 +08:00
Cheng WanandClaude Sonnet 4.6 052abcc0dd [Refactor] Pass PP start_layer via model constructor instead of forward_batch.token_to_kv_pool (#25825)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-19 22:16:07 -07:00
Cheng Wan a4b51d35ef Revert "[codex] Update Wan2.2 ModelOpt CI checkpoints" (#25845) 2026-05-19 21:45:20 -07:00
Xinyuan Tong 0aedc5678b loader: yield filtered MTP weights lazily to avoid OOM hang on multi-layer EAGLE (#25748) 2026-05-20 12:33:54 +08:00
Xiaoyu Zhang af22390af7 [codex] Align diffusion skills with nightly Nvidia benchmarks (#25842) 2026-05-20 12:18:05 +08:00
liuxianglong17andAdarsh Shirawalmath 579fed2090 Reduce excessively long logs caused by transformer version updates. (#25737)
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
2026-05-20 11:39:03 +08:00
Shangming Cai 1fbee74fb6 [PD] Clean early abort logic in PD module (#25677)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-05-20 11:17:42 +08:00
Kevin Flansburg 3b2178c412 [PD] Un-blacklist mooncake sessions when probe succeeds (#25287) 2026-05-20 11:16:28 +08:00
mingyue300 5fe655bf26 vlm: fix shared memory bug of deep copy mm_items (#24231) 2026-05-20 11:06:51 +08:00
ybyang a8c82c652e fix(dsv4): make pool configurator PP-aware (#25750) 2026-05-20 10:58:53 +08:00
ybyang ca29c2b0e7 fix(dsv4): drop stale pp_size=1 guard for V4 PD disaggregation (#25771) 2026-05-20 10:57:23 +08:00
jy-song-hub d69e9fbfdc [diffusion] fix: honor config precisions for delight/paint (#22289) 2026-05-20 10:38:48 +08:00
jy-song-hubandjxp 549ae16c6f [diffusion] fix: respect configured precision in Qwen layered path (#21980)
Co-authored-by: jxp <jingxin.pan123@gmail.com>
2026-05-20 10:38:03 +08:00
jy-song-hub 3a9d9d5832 [diffusion] fix: fix Hunyuan3D-2 DiT checkpoint param mapping (#22729) 2026-05-20 10:37:13 +08:00