 Lianmin ZhengandJaewon
|
8fa56a0ab1
|
Fix FlashInfer A2A token cap sizing (#25907)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
|
2026-05-20 23:01:28 -07:00 |
|
|
xutizhou
|
e8608bdcb5
|
Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367)
|
2026-05-20 22:58:08 -07:00 |
|
|
Charles Chen
|
847cbada9c
|
Support Gemma4 MoE NVFP4 (#25054)
|
2026-05-20 22:45:15 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
888a8794ef
|
[Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 22:38:12 -07:00 |
|
|
YAMY
|
3a6de13cd8
|
perf(dsv4): add MHC token-count prewarm (#25810)
|
2026-05-20 22:22:41 -07:00 |
|
|
Mick
|
1ac3e33622
|
[diffusion] optimize: enable inference mode in pipeline executor (#25891)
|
2026-05-21 13:20:24 +08:00 |
|
|
Brilliant Hanabi
|
e56db8bd24
|
fix: use base GPU ID CUDA device for multimodal processor (#21191)
|
2026-05-21 13:18:37 +08:00 |
|
|
|
84ea47eb22
|
[CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
|
2026-05-21 13:09:18 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
79b937aefb
|
[Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 21:26:32 -07:00 |
|
|
Randall LinandCursor
|
791a2f057f
|
Add overridable hooks for custom chat serving implementations (#25807)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-05-21 11:21:25 +08:00 |
|
|
Zheng Wengang
|
74c6294ba9
|
[BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759)
|
2026-05-21 11:07:21 +08:00 |
|
|
Mohammad Miadh Angkad
|
a449ee4822
|
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
|
2026-05-21 10:31:27 +08:00 |
|
|
Hanming Lu
|
ddf3817924
|
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
|
2026-05-20 18:49:01 -07:00 |
|
|
Kevin Flansburg
|
643d44d699
|
[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)
|
2026-05-20 18:20:19 -07:00 |
|
|
Lianmin Zheng
|
c4a7d12092
|
Enable breakable CUDA graph for eagle (#25795)
|
2026-05-20 18:02:04 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
f9f82d238c
|
fix deepseek v4 hisparse (#25646)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-05-20 17:28:38 -07:00 |
|
|
Liangsheng Yin
|
512d164916
|
Address overlap future token map by request-pool index (#25862)
|
2026-05-20 16:34:00 -07:00 |
|
|
Kaixi
|
9f2bc24b35
|
Fix/dsv4 flash eagle dummy ima (#25892)
|
2026-05-20 15:41:28 -07:00 |
|
|
BingjiaWang
|
ce7141ef98
|
add git gemm warpper for dispatch_bf16_fp32_backend (#25860)
|
2026-05-20 15:24:10 -07:00 |
|
|
Hanming Lu
|
371b6c9ea0
|
[Scheduler] fix chunked prefill not always being full (#25741)
|
2026-05-20 15:03:11 -07:00 |
|
|
Qiaolin Yu
|
1a17d753f1
|
[perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460)
|
2026-05-20 14:20:49 -07:00 |
|
|
Yuzhen Zhou
|
dac78768f0
|
[RL][TITO] Preserve whitespace in reasoning parser outputs (#24251)
|
2026-05-20 19:45:09 +00:00 |
|
|
YAMY
|
801d7e3eed
|
[DSA] Make MQA logits free memory ratio configurable (#25859)
|
2026-05-20 12:27:16 -07:00 |
|
|
Ratish P
|
5e7bf73757
|
Fix bench_serving non-stream reasoning content (#25298)
|
2026-05-20 18:41:46 +00:00 |
|
|
jasonjk-park
|
1f209b4433
|
Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681)
|
2026-05-20 11:34:45 -07:00 |
|
|
Mark Smithandzhangjiadong1@corp.netease.com
|
33c57b8716
|
[Bug][RadixTree] Fix LRU list reference cycle leak in radix_cache (#25770)
Co-authored-by: zhangjiadong1@corp.netease.com <zhangjiadong1@corp.netease.com>
|
2026-05-21 01:06:05 +08:00 |
|
|
Jialin Ouyang
|
6e0b7f35ad
|
[radix cache] pluggable RadixCache factory (--radix-cache-backend) (#25101)
|
2026-05-20 10:05:04 -07:00 |
|
|
Xiaoyu Zhang
|
ccbbae00ea
|
[codex] Reland Wan2.2 ModelOpt CI checkpoints (#25857)
|
2026-05-20 22:15:25 +08:00 |
|
|
Liwansi
|
55ba03db6a
|
[NPU]use triton split_qkvgate_gemma_rmsnorm_rope for Qwen3.5 and Qwen3_next (#23925)
|
2026-05-20 20:22:10 +08:00 |
|
|
Liangsheng Yin
|
34d3e23232
|
spec_v2: consolidate seq_lens_cpu/sum maintenance into helper (#25818)
|
2026-05-20 04:42:26 -07:00 |
|
|
Liangsheng Yin
|
9b005d3608
|
disagg prebuilt: drop dead prepare_for_extend shift (#25819)
|
2026-05-20 04:39:47 -07:00 |
|
|
Liangsheng Yin
|
1bd4f94598
|
[Test] Add fwd_occupancy sanity kit (#25886)
|
2026-05-20 03:34:37 -07:00 |
|
|
Chi McIsaac
|
47979fb252
|
[diffusion] fix: fix GLM-Image /v1/images/edits support (#25697)
|
2026-05-20 17:11:51 +08:00 |
|
|
Liangsheng Yin
|
614672fea5
|
[Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831)
|
2026-05-20 01:58:48 -07:00 |
|
|
Yuhong Guo
|
24d27c2035
|
[BugFix] Fix rid_to_state leak for aborted queued requests (#24070)
|
2026-05-20 01:32:44 -07:00 |
|
|
Matt Van HornandMatt Van Horn
|
e99f87c974
|
fix: add missing distro dependency to runtime docker image (#25817)
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
|
2026-05-20 00:46:32 -07:00 |
|
|
|
044649c23a
|
feat: Support flashinfer_cutedsl MoE runner with flashinfer alltoall backend (#22669)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-05-20 00:36:26 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
8131641bc6
|
[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 00:18:04 -07:00 |
|
|
Xiaobaoandgithub-actions[bot]
|
0d3a94f643
|
[Bug] Correct Weight Offloader's Attribute Name for torch.nn.Parameter (#25786)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-05-19 22:28:59 -07:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
052abcc0dd
|
[Refactor] Pass PP start_layer via model constructor instead of forward_batch.token_to_kv_pool (#25825)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-19 22:16:07 -07:00 |
|
|
Cheng Wan
|
a4b51d35ef
|
Revert "[codex] Update Wan2.2 ModelOpt CI checkpoints" (#25845)
|
2026-05-19 21:45:20 -07:00 |
|
|
Xinyuan Tong
|
0aedc5678b
|
loader: yield filtered MTP weights lazily to avoid OOM hang on multi-layer EAGLE (#25748)
|
2026-05-20 12:33:54 +08:00 |
|
|
Xiaoyu Zhang
|
af22390af7
|
[codex] Align diffusion skills with nightly Nvidia benchmarks (#25842)
|
2026-05-20 12:18:05 +08:00 |
|
|
Shangming Cai
|
1fbee74fb6
|
[PD] Clean early abort logic in PD module (#25677)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-05-20 11:17:42 +08:00 |
|
|
Kevin Flansburg
|
3b2178c412
|
[PD] Un-blacklist mooncake sessions when probe succeeds (#25287)
|
2026-05-20 11:16:28 +08:00 |
|
|
mingyue300
|
5fe655bf26
|
vlm: fix shared memory bug of deep copy mm_items (#24231)
|
2026-05-20 11:06:51 +08:00 |
|
|
ybyang
|
a8c82c652e
|
fix(dsv4): make pool configurator PP-aware (#25750)
|
2026-05-20 10:58:53 +08:00 |
|
|
ybyang
|
ca29c2b0e7
|
fix(dsv4): drop stale pp_size=1 guard for V4 PD disaggregation (#25771)
|
2026-05-20 10:57:23 +08:00 |
|
|
jy-song-hub
|
d69e9fbfdc
|
[diffusion] fix: honor config precisions for delight/paint (#22289)
|
2026-05-20 10:38:48 +08:00 |
|
|
jy-song-hubandjxp
|
549ae16c6f
|
[diffusion] fix: respect configured precision in Qwen layered path (#21980)
Co-authored-by: jxp <jingxin.pan123@gmail.com>
|
2026-05-20 10:38:03 +08:00 |
|