 Yuhao YangandKe Bao
|
c9153da5dc
|
Fix SWA double-free in disagg decode with MTP speculation (#25805)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-05-22 00:28:54 -07:00 |
|
|
Chi McIsaac
|
a7555fc997
|
[diffusion] fix: fix MOVA DAC bf16 on ROCm (#25674)
|
2026-05-22 15:18:49 +08:00 |
|
|
Liangsheng Yin
|
c4b6b5ea1e
|
[core] step 2: drop seq_lens sentinel; SB maintains GPU as seq_lens_cpu mirror (#26020)
|
2026-05-22 00:12:51 -07:00 |
|
|
Yuhao YangandYaochen Han
|
fa6f4dfb35
|
improve: combine vit calls for images from different reqs from one batch (#25910)
Co-authored-by: Yaochen Han <814073252@qq.com>
|
2026-05-22 14:57:41 +08:00 |
|
|
fzyzcjy
|
3f0814974c
|
Fix disaggregation bootstrap server lifetime (#25982)
|
2026-05-22 14:10:57 +08:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
f829cafa3e
|
[perf] skip add_special_tokens=False kwarg on chat-template tokenize for slow tokenizers (#25953)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-21 22:45:54 -07:00 |
|
|
Alex O. P.
|
ae7c4226eb
|
[diffusion] model: support FLUX.2-klein-base (#25661)
|
2026-05-22 11:24:46 +08:00 |
|
|
Liangsheng Yin
|
8b473aa0bc
|
[core] step 1: route non-spec seq_lens via FutureMap with per-mode bootstrap fixes (#25944)
|
2026-05-21 20:15:51 -07:00 |
|
|
longguoandYang
|
4374789abf
|
fix(mm): make multimodal data loading non-blocking to prevent health check stalls (#24751)
Signed-off-by: abinggo <107740309+abinggo@users.noreply.github.com>
Co-authored-by: Yang <ID+Y-aang@users.noreply.github.com>
|
2026-05-22 10:08:03 +08:00 |
|
|
Mick
|
16b3edc84f
|
[diffusion] feat: enable warmup for sglang serve by default (#25988)
|
2026-05-22 08:54:48 +08:00 |
|
|
Mick
|
f6d98a17ba
|
[diffusion] optimize: reuse cached dynamic lora weights (#25893)
|
2026-05-22 08:54:01 +08:00 |
|
|
nohup
|
7cf193fe1f
|
feat: support HybridLinearKVPool in chunked prefix cache handling (#25753)
|
2026-05-21 16:17:26 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
d765dfd043
|
refactor(attn): init hisparse_coordinator before attn_backend; replace lazy property with init-time capture (#26012)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-21 16:03:42 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
c5251a98a9
|
feat(model_runner): remove pool/backend refs from ForwardBatch via ForwardContext (#25983)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-21 14:01:49 -07:00 |
|
|
Liangsheng Yin
|
44ec2ee18d
|
[core] Unify output_tokens_buf in FutureMap (#25922)
|
2026-05-21 13:56:44 -07:00 |
|
|
Liangsheng Yin
|
c9a0e55eb5
|
[Spec] Polish FutureMap after #25879: rename callback, async guard, cleanup (#25962)
|
2026-05-21 13:56:22 -07:00 |
|
|
Jimmy Shong
|
1a85586738
|
[Fix]: Restrict Kimi-K2.5 shared-experts fusion to Quark MXFP4 checkpoints (#25974)
|
2026-05-21 13:07:45 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
b765faee30
|
[MoE Refactor] deprecate forward_npu and NpuFuseEPMoE (#25678)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-05-21 10:25:17 -07:00 |
|
|
Ethan (Yusheng) SuandCursor
|
a24c374f84
|
[lora] Remove synchronous .any().item() guard in LoRA MoE prefill path (#25531)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 23:58:57 +08:00 |
|
|
Mick
|
ca9dc17be4
|
[diffusion] chore: adjust layer wise-offload strategy (#25930)
|
2026-05-21 23:48:58 +08:00 |
|
|
liuxianglong17
|
32f996b75a
|
Avoiding the problem of printing a large number of compatibility warn… (#25956)
|
2026-05-21 22:10:23 +08:00 |
|
|
Kangyan-ZhouandLiangsheng Yin
|
caa9f08294
|
[CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-05-21 22:01:42 +08:00 |
|
|
Liangsheng Yin
|
baeac179f7
|
[Spec] Route seq_lens through FutureMap; drop verify_done.wait (#25879)
|
2026-05-21 01:51:40 -07:00 |
|
|
DarkSharpnessandClaude
|
19f55c0e6d
|
[Refactor] major JIT kernel clean up for dsv4 (#25884)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-05-21 01:14:31 -07:00 |
|
|
hxie
|
c3f9bc9818
|
Fix nixl mla key and backup skipping (#24376)
|
2026-05-21 00:48:28 -07:00 |
|
|
看海的人
|
b9ae8353d2
|
[NPU] Support model DeepSeek-OCR and DeepSeek-OCR-2 (#25257)
|
2026-05-21 15:21:20 +08:00 |
|
|
Liwansi
|
190488e9a8
|
[NPU] Support chunk prefill for Qwen3.5/Qwen3.6 models (#25839)
|
2026-05-21 14:44:25 +08:00 |
|
|
Kangyan-Zhou
|
4ea8282cb7
|
[Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938)
|
2026-05-21 14:36:56 +08:00 |
|
|
Xinyuan Tong
|
40faf44f7a
|
[auto-detect] match Ring-2.6/Ling XML kv tool-call format via vocab signature (#25366)
|
2026-05-20 23:34:52 -07:00 |
|
|
sushil Dubey
|
c4f14650b9
|
fix act fun for xpu (#23809)
|
2026-05-21 14:02:21 +08:00 |
|
|
Lianmin ZhengandJaewon
|
8fa56a0ab1
|
Fix FlashInfer A2A token cap sizing (#25907)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
|
2026-05-20 23:01:28 -07:00 |
|
|
xutizhou
|
e8608bdcb5
|
Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367)
|
2026-05-20 22:58:08 -07:00 |
|
|
Charles Chen
|
847cbada9c
|
Support Gemma4 MoE NVFP4 (#25054)
|
2026-05-20 22:45:15 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
888a8794ef
|
[Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 22:38:12 -07:00 |
|
|
YAMY
|
3a6de13cd8
|
perf(dsv4): add MHC token-count prewarm (#25810)
|
2026-05-20 22:22:41 -07:00 |
|
|
Mick
|
1ac3e33622
|
[diffusion] optimize: enable inference mode in pipeline executor (#25891)
|
2026-05-21 13:20:24 +08:00 |
|
|
Brilliant Hanabi
|
e56db8bd24
|
fix: use base GPU ID CUDA device for multimodal processor (#21191)
|
2026-05-21 13:18:37 +08:00 |
|
|
|
84ea47eb22
|
[CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-05-21 13:09:18 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
79b937aefb
|
[Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 21:26:32 -07:00 |
|
|
Randall LinandCursor
|
791a2f057f
|
Add overridable hooks for custom chat serving implementations (#25807)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 11:21:25 +08:00 |
|
|
Zheng Wengang
|
74c6294ba9
|
[BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759)
|
2026-05-21 11:07:21 +08:00 |
|
|
Mohammad Miadh Angkad
|
a449ee4822
|
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
|
2026-05-21 10:31:27 +08:00 |
|
|
Hanming Lu
|
ddf3817924
|
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
|
2026-05-20 18:49:01 -07:00 |
|
|
Kevin Flansburg
|
643d44d699
|
[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)
|
2026-05-20 18:20:19 -07:00 |
|
|
Lianmin Zheng
|
c4a7d12092
|
Enable breakable CUDA graph for eagle (#25795)
|
2026-05-20 18:02:04 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
f9f82d238c
|
fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-05-20 17:28:38 -07:00 |
|
|
Liangsheng Yin
|
512d164916
|
Address overlap future token map by request-pool index (#25862)
|
2026-05-20 16:34:00 -07:00 |
|
|
Kaixi
|
9f2bc24b35
|
Fix/dsv4 flash eagle dummy ima (#25892)
|
2026-05-20 15:41:28 -07:00 |
|
|
BingjiaWang
|
ce7141ef98
|
add git gemm warpper for dispatch_bf16_fp32_backend (#25860)
|
2026-05-20 15:24:10 -07:00 |
|
|
Hanming Lu
|
371b6c9ea0
|
[Scheduler] fix chunked prefill not always being full (#25741)
|
2026-05-20 15:03:11 -07:00 |
|