 Liangsheng Yin
|
44ec2ee18d
|
[core] Unify output_tokens_buf in FutureMap (#25922)
|
2026-05-21 13:56:44 -07:00 |
|
|
Liangsheng Yin
|
c9a0e55eb5
|
[Spec] Polish FutureMap after #25879: rename callback, async guard, cleanup (#25962)
|
2026-05-21 13:56:22 -07:00 |
|
|
Jimmy Shong
|
1a85586738
|
[Fix]: Restrict Kimi-K2.5 shared-experts fusion to Quark MXFP4 checkpoints (#25974)
|
2026-05-21 13:07:45 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
b765faee30
|
[MoE Refactor] deprecate forward_npu and NpuFuseEPMoE (#25678)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-21 10:25:17 -07:00 |
|
|
Ethan (Yusheng) SuandCursor
|
a24c374f84
|
[lora] Remove synchronous .any().item() guard in LoRA MoE prefill path (#25531)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 23:58:57 +08:00 |
|
|
Mick
|
ca9dc17be4
|
[diffusion] chore: adjust layer wise-offload strategy (#25930)
|
2026-05-21 23:48:58 +08:00 |
|
|
liuxianglong17
|
32f996b75a
|
Avoiding the problem of printing a large number of compatibility warn… (#25956)
|
2026-05-21 22:10:23 +08:00 |
|
|
Kangyan-ZhouandLiangsheng Yin
|
caa9f08294
|
[CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-21 22:01:42 +08:00 |
|
|
Liangsheng Yin
|
baeac179f7
|
[Spec] Route seq_lens through FutureMap; drop verify_done.wait (#25879)
|
2026-05-21 01:51:40 -07:00 |
|
|
DarkSharpnessandClaude
|
19f55c0e6d
|
[Refactor] major JIT kernel clean up for dsv4 (#25884)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-21 01:14:31 -07:00 |
|
|
hxie
|
c3f9bc9818
|
Fix nixl mla key and backup skipping (#24376)
|
2026-05-21 00:48:28 -07:00 |
|
|
看海的人
|
b9ae8353d2
|
[NPU] Support model DeepSeek-OCR and DeepSeek-OCR-2 (#25257)
|
2026-05-21 15:21:20 +08:00 |
|
|
Liwansi
|
190488e9a8
|
[NPU] Support chunk prefill for Qwen3.5/Qwen3.6 models (#25839)
|
2026-05-21 14:44:25 +08:00 |
|
|
Kangyan-Zhou
|
4ea8282cb7
|
[Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938)
|
2026-05-21 14:36:56 +08:00 |
|
|
Xinyuan Tong
|
40faf44f7a
|
[auto-detect] match Ring-2.6/Ling XML kv tool-call format via vocab signature (#25366)
|
2026-05-20 23:34:52 -07:00 |
|
|
sushil Dubey
|
c4f14650b9
|
fix act fun for xpu (#23809)
|
2026-05-21 14:02:21 +08:00 |
|
|
Lianmin ZhengandJaewon
|
8fa56a0ab1
|
Fix FlashInfer A2A token cap sizing (#25907)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
|
2026-05-20 23:01:28 -07:00 |
|
|
xutizhou
|
e8608bdcb5
|
Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367)
|
2026-05-20 22:58:08 -07:00 |
|
|
Charles Chen
|
847cbada9c
|
Support Gemma4 MoE NVFP4 (#25054)
|
2026-05-20 22:45:15 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
888a8794ef
|
[Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 22:38:12 -07:00 |
|
|
YAMY
|
3a6de13cd8
|
perf(dsv4): add MHC token-count prewarm (#25810)
|
2026-05-20 22:22:41 -07:00 |
|
|
Mick
|
1ac3e33622
|
[diffusion] optimize: enable inference mode in pipeline executor (#25891)
|
2026-05-21 13:20:24 +08:00 |
|
|
Brilliant Hanabi
|
e56db8bd24
|
fix: use base GPU ID CUDA device for multimodal processor (#21191)
|
2026-05-21 13:18:37 +08:00 |
|
|
|
84ea47eb22
|
[CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-05-21 13:09:18 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
79b937aefb
|
[Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 21:26:32 -07:00 |
|
|
Randall LinandCursor
|
791a2f057f
|
Add overridable hooks for custom chat serving implementations (#25807)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 11:21:25 +08:00 |
|
|
Zheng Wengang
|
74c6294ba9
|
[BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759)
|
2026-05-21 11:07:21 +08:00 |
|
|
Mohammad Miadh Angkad
|
a449ee4822
|
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
|
2026-05-21 10:31:27 +08:00 |
|
|
Hanming Lu
|
ddf3817924
|
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
|
2026-05-20 18:49:01 -07:00 |
|
|
Kevin Flansburg
|
643d44d699
|
[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)
|
2026-05-20 18:20:19 -07:00 |
|
|
Lianmin Zheng
|
c4a7d12092
|
Enable breakable CUDA graph for eagle (#25795)
|
2026-05-20 18:02:04 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
f9f82d238c
|
fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-05-20 17:28:38 -07:00 |
|
|
Liangsheng Yin
|
512d164916
|
Address overlap future token map by request-pool index (#25862)
|
2026-05-20 16:34:00 -07:00 |
|
|
Kaixi
|
9f2bc24b35
|
Fix/dsv4 flash eagle dummy ima (#25892)
|
2026-05-20 15:41:28 -07:00 |
|
|
BingjiaWang
|
ce7141ef98
|
add git gemm warpper for dispatch_bf16_fp32_backend (#25860)
|
2026-05-20 15:24:10 -07:00 |
|
|
Hanming Lu
|
371b6c9ea0
|
[Scheduler] fix chunked prefill not always being full (#25741)
|
2026-05-20 15:03:11 -07:00 |
|
|
Qiaolin Yu
|
1a17d753f1
|
[perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460)
|
2026-05-20 14:20:49 -07:00 |
|
|
Yuzhen Zhou
|
dac78768f0
|
[RL][TITO] Preserve whitespace in reasoning parser outputs (#24251)
|
2026-05-20 19:45:09 +00:00 |
|
|
YAMY
|
801d7e3eed
|
[DSA] Make MQA logits free memory ratio configurable (#25859)
|
2026-05-20 12:27:16 -07:00 |
|
|
Ratish P
|
5e7bf73757
|
Fix bench_serving non-stream reasoning content (#25298)
|
2026-05-20 18:41:46 +00:00 |
|
|
jasonjk-park
|
1f209b4433
|
Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681)
|
2026-05-20 11:34:45 -07:00 |
|
|
Mark Smithandzhangjiadong1@corp.netease.com
|
33c57b8716
|
[Bug][RadixTree] Fix LRU list reference cycle leak in radix_cache (#25770)
Co-authored-by: zhangjiadong1@corp.netease.com <zhangjiadong1@corp.netease.com>
|
2026-05-21 01:06:05 +08:00 |
|
|
Jialin Ouyang
|
6e0b7f35ad
|
[radix cache] pluggable RadixCache factory (--radix-cache-backend) (#25101)
|
2026-05-20 10:05:04 -07:00 |
|
|
Xiaoyu Zhang
|
ccbbae00ea
|
[codex] Reland Wan2.2 ModelOpt CI checkpoints (#25857)
|
2026-05-20 22:15:25 +08:00 |
|
|
Liwansi
|
55ba03db6a
|
[NPU]use triton split_qkvgate_gemma_rmsnorm_rope for Qwen3.5 and Qwen3_next (#23925)
|
2026-05-20 20:22:10 +08:00 |
|
|
Liangsheng Yin
|
34d3e23232
|
spec_v2: consolidate seq_lens_cpu/sum maintenance into helper (#25818)
|
2026-05-20 04:42:26 -07:00 |
|
|
Liangsheng Yin
|
9b005d3608
|
disagg prebuilt: drop dead prepare_for_extend shift (#25819)
|
2026-05-20 04:39:47 -07:00 |
|
|
Liangsheng Yin
|
1bd4f94598
|
[Test] Add fwd_occupancy sanity kit (#25886)
|
2026-05-20 03:34:37 -07:00 |
|
|
Chi McIsaac
|
47979fb252
|
[diffusion] fix: fix GLM-Image /v1/images/edits support (#25697)
|
2026-05-20 17:11:51 +08:00 |
|
|
Liangsheng Yin
|
614672fea5
|
[Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831)
|
2026-05-20 01:58:48 -07:00 |
|