 Kangyan-ZhouandLiangsheng Yin
|
caa9f08294
|
[CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-21 22:01:42 +08:00 |
|
|
Liangsheng Yin
|
baeac179f7
|
[Spec] Route seq_lens through FutureMap; drop verify_done.wait (#25879)
|
2026-05-21 01:51:40 -07:00 |
|
|
DarkSharpnessandClaude
|
19f55c0e6d
|
[Refactor] major JIT kernel clean up for dsv4 (#25884)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-21 01:14:31 -07:00 |
|
|
hxie
|
c3f9bc9818
|
Fix nixl mla key and backup skipping (#24376)
|
2026-05-21 00:48:28 -07:00 |
|
|
看海的人
|
b9ae8353d2
|
[NPU] Support model DeepSeek-OCR and DeepSeek-OCR-2 (#25257)
|
2026-05-21 15:21:20 +08:00 |
|
|
Liwansi
|
190488e9a8
|
[NPU] Support chunk prefill for Qwen3.5/Qwen3.6 models (#25839)
|
2026-05-21 14:44:25 +08:00 |
|
|
Kangyan-Zhou
|
4ea8282cb7
|
[Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938)
|
2026-05-21 14:36:56 +08:00 |
|
|
Xinyuan Tong
|
40faf44f7a
|
[auto-detect] match Ring-2.6/Ling XML kv tool-call format via vocab signature (#25366)
|
2026-05-20 23:34:52 -07:00 |
|
|
sushil Dubey
|
c4f14650b9
|
fix act fun for xpu (#23809)
|
2026-05-21 14:02:21 +08:00 |
|
|
Lianmin ZhengandJaewon
|
8fa56a0ab1
|
Fix FlashInfer A2A token cap sizing (#25907)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
|
2026-05-20 23:01:28 -07:00 |
|
|
xutizhou
|
e8608bdcb5
|
Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367)
|
2026-05-20 22:58:08 -07:00 |
|
|
Charles Chen
|
847cbada9c
|
Support Gemma4 MoE NVFP4 (#25054)
|
2026-05-20 22:45:15 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
888a8794ef
|
[Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 22:38:12 -07:00 |
|
|
YAMY
|
3a6de13cd8
|
perf(dsv4): add MHC token-count prewarm (#25810)
|
2026-05-20 22:22:41 -07:00 |
|
|
Mick
|
1ac3e33622
|
[diffusion] optimize: enable inference mode in pipeline executor (#25891)
|
2026-05-21 13:20:24 +08:00 |
|
|
Brilliant Hanabi
|
e56db8bd24
|
fix: use base GPU ID CUDA device for multimodal processor (#21191)
|
2026-05-21 13:18:37 +08:00 |
|
|
|
84ea47eb22
|
[CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-05-21 13:09:18 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
79b937aefb
|
[Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 21:26:32 -07:00 |
|
|
Randall LinandCursor
|
791a2f057f
|
Add overridable hooks for custom chat serving implementations (#25807)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 11:21:25 +08:00 |
|
|
Zheng Wengang
|
74c6294ba9
|
[BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759)
|
2026-05-21 11:07:21 +08:00 |
|
|
Mohammad Miadh Angkad
|
a449ee4822
|
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
|
2026-05-21 10:31:27 +08:00 |
|
|
Hanming Lu
|
ddf3817924
|
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
|
2026-05-20 18:49:01 -07:00 |
|
|
Kevin Flansburg
|
643d44d699
|
[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)
|
2026-05-20 18:20:19 -07:00 |
|
|
Lianmin Zheng
|
c4a7d12092
|
Enable breakable CUDA graph for eagle (#25795)
|
2026-05-20 18:02:04 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
f9f82d238c
|
fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-05-20 17:28:38 -07:00 |
|
|
Liangsheng Yin
|
512d164916
|
Address overlap future token map by request-pool index (#25862)
|
2026-05-20 16:34:00 -07:00 |
|
|
Kaixi
|
9f2bc24b35
|
Fix/dsv4 flash eagle dummy ima (#25892)
|
2026-05-20 15:41:28 -07:00 |
|
|
BingjiaWang
|
ce7141ef98
|
add git gemm warpper for dispatch_bf16_fp32_backend (#25860)
|
2026-05-20 15:24:10 -07:00 |
|
|
Hanming Lu
|
371b6c9ea0
|
[Scheduler] fix chunked prefill not always being full (#25741)
|
2026-05-20 15:03:11 -07:00 |
|
|
Qiaolin Yu
|
1a17d753f1
|
[perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460)
|
2026-05-20 14:20:49 -07:00 |
|
|
Yuzhen Zhou
|
dac78768f0
|
[RL][TITO] Preserve whitespace in reasoning parser outputs (#24251)
|
2026-05-20 19:45:09 +00:00 |
|
|
YAMY
|
801d7e3eed
|
[DSA] Make MQA logits free memory ratio configurable (#25859)
|
2026-05-20 12:27:16 -07:00 |
|
|
Ratish P
|
5e7bf73757
|
Fix bench_serving non-stream reasoning content (#25298)
|
2026-05-20 18:41:46 +00:00 |
|
|
jasonjk-park
|
1f209b4433
|
Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681)
|
2026-05-20 11:34:45 -07:00 |
|
|
Mark Smithandzhangjiadong1@corp.netease.com
|
33c57b8716
|
[Bug][RadixTree] Fix LRU list reference cycle leak in radix_cache (#25770)
Co-authored-by: zhangjiadong1@corp.netease.com <zhangjiadong1@corp.netease.com>
|
2026-05-21 01:06:05 +08:00 |
|
|
Jialin Ouyang
|
6e0b7f35ad
|
[radix cache] pluggable RadixCache factory (--radix-cache-backend) (#25101)
|
2026-05-20 10:05:04 -07:00 |
|
|
Xiaoyu Zhang
|
ccbbae00ea
|
[codex] Reland Wan2.2 ModelOpt CI checkpoints (#25857)
|
2026-05-20 22:15:25 +08:00 |
|
|
Liwansi
|
55ba03db6a
|
[NPU]use triton split_qkvgate_gemma_rmsnorm_rope for Qwen3.5 and Qwen3_next (#23925)
|
2026-05-20 20:22:10 +08:00 |
|
|
Liangsheng Yin
|
34d3e23232
|
spec_v2: consolidate seq_lens_cpu/sum maintenance into helper (#25818)
|
2026-05-20 04:42:26 -07:00 |
|
|
Liangsheng Yin
|
9b005d3608
|
disagg prebuilt: drop dead prepare_for_extend shift (#25819)
|
2026-05-20 04:39:47 -07:00 |
|
|
Liangsheng Yin
|
1bd4f94598
|
[Test] Add fwd_occupancy sanity kit (#25886)
|
2026-05-20 03:34:37 -07:00 |
|
|
Chi McIsaac
|
47979fb252
|
[diffusion] fix: fix GLM-Image /v1/images/edits support (#25697)
|
2026-05-20 17:11:51 +08:00 |
|
|
Liangsheng Yin
|
614672fea5
|
[Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831)
|
2026-05-20 01:58:48 -07:00 |
|
|
Yuhong Guo
|
24d27c2035
|
[BugFix] Fix rid_to_state leak for aborted queued requests (#24070)
|
2026-05-20 01:32:44 -07:00 |
|
|
Matt Van HornandMatt Van Horn
|
e99f87c974
|
fix: add missing distro dependency to runtime docker image (#25817)
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
|
2026-05-20 00:46:32 -07:00 |
|
|
|
044649c23a
|
feat: Support flashinfer_cutedsl MoE runner with flashinfer alltoall backend (#22669)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-20 00:36:26 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
8131641bc6
|
[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 00:18:04 -07:00 |
|
|
Xiaobaoandgithub-actions[bot]
|
0d3a94f643
|
[Bug] Correct Weight Offloader's Attribute Name for torch.nn.Parameter (#25786)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-05-19 22:28:59 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
052abcc0dd
|
[Refactor] Pass PP start_layer via model constructor instead of forward_batch.token_to_kv_pool (#25825)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-19 22:16:07 -07:00 |
|
|
Cheng Wan
|
a4b51d35ef
|
Revert "[codex] Update Wan2.2 ModelOpt CI checkpoints" (#25845)
|
2026-05-19 21:45:20 -07:00 |
|