-
6baa859a86
Add MiniCPM5 tool call parser for XML-style function calls (#25600)

zhangtao2-1andzhangtao
2026-05-22 23:09:40 +08:00
-
f5ed2687ec
[diffusion] CI: guard gt publishing from corrupt output (#26044)
Mick
2026-05-22 19:07:20 +08:00
-
8c916a715c
[diffusion] feat: support role-based component loading and stage affinity (#25168)
Heyang Huang
2026-05-22 18:50:23 +08:00
-
e1dcbca220
[FIX][1/2] fix step3-vl/deepseek-ocr image processor error (#24701)

kousakawangandwanghanpei
2026-05-22 18:39:47 +08:00
-
80680dc3fe
[Intel GPU] 1/N Fix tilelang import in deepseek v4 rope as optional (#25128)
Polisetty V R K Jyothendra Varma
2026-05-22 15:53:18 +05:30
-
d4082eab4d
[CI] pr-test-extra: add run_all_tests to workflow_dispatch inputs (#26110)

Kangyan-ZhouandClaude Opus 4.7
2026-05-22 18:03:39 +08:00
-
10751a4f0c
drop
FutureIndices wrapper class (#26085)
Liangsheng Yin
2026-05-22 02:44:42 -07:00
-
bd6c7e713c
[fix] Fallback DeepGEMM activation for unsupported shapes (#26025)
Yueming Yuan
2026-05-22 02:01:40 -07:00
-
4486a339a3
[CI] bot-cherry-pick: remove concurrency group to enable batch dispatch (#26074)

Kangyan-ZhouandClaude Opus 4.7
2026-05-22 16:27:46 +08:00
-
cf5f496183
[MUSA][22/N] ci(musa): repack wheels with +musa metadata, refine path filters, sync multimodal tests, and add nightly workflow (#25074)

johnnycxmandxinyue.fan
2026-05-22 16:24:25 +08:00
-
16d049f898
Add sglang-cherrypick skill for batching bot-cherry-pick dispatches (#26068)

Kangyan-ZhouandClaude Opus 4.7
2026-05-22 16:20:06 +08:00
-
63ecf2f62b
[CI] Drop unused 'environment: prod' from bot-cherry-pick job (#26067)
Kangyan-Zhou
2026-05-22 16:16:07 +08:00
-
06836aa38a
update code owner (#26060)
siyu
2026-05-22 16:13:28 +08:00
-
6339295556
[XPU] add apache-tvm-ffi dependency (#26053)
jiayisunx
2026-05-22 16:09:08 +08:00
-
88a37d7405
[docs] DeepSeek-V4 cookbook: split Quantization axis, add H100 SGLang FP8 (#26057)

zijiexiaandClaude Opus 4.7
2026-05-22 00:52:10 -07:00
-
c9153da5dc
Fix SWA double-free in disagg decode with MTP speculation (#25805)

Yuhao YangandKe Bao
2026-05-22 15:28:54 +08:00
-
a7555fc997
[diffusion] fix: fix MOVA DAC bf16 on ROCm (#25674)
Chi McIsaac
2026-05-22 03:18:49 -04:00
-
c4b6b5ea1e
[core] step 2: drop seq_lens sentinel; SB maintains GPU as
seq_lens_cpu mirror (#26020)
Liangsheng Yin
2026-05-22 00:12:51 -07:00
-
fa6f4dfb35
improve: combine vit calls for images from different reqs from one batch (#25910)

Yuhao YangandYaochen Han
2026-05-22 14:57:41 +08:00
-
3f0814974c
Fix disaggregation bootstrap server lifetime (#25982)
fzyzcjy
2026-05-22 14:10:57 +08:00
-
f829cafa3e
[perf] skip add_special_tokens=False kwarg on chat-template tokenize for slow tokenizers (#25953)

Khoa PhamandClaude Opus 4.7
2026-05-21 22:45:54 -07:00
-
acb8310183
ci: self-heal $GITHUB_PATH/$GITHUB_ENV writes (#26037)
Liangsheng Yin
2026-05-21 21:28:43 -07:00
-
610f55040d
update npu codeowners (#26042)
ybyang
2026-05-22 11:46:59 +08:00
-
ae7c4226eb
[diffusion] model: support FLUX.2-klein-base (#25661)
Alex O. P.
2026-05-22 05:24:46 +02:00
-
8b473aa0bc
[core] step 1: route non-spec
seq_lens via FutureMap with per-mode bootstrap fixes (#25944)
Liangsheng Yin
2026-05-21 20:15:51 -07:00
-
cc77c36029
Bugfix: Qwen3-VL-MoE adapt encoder_only (#23220)
jianzhao-xu
2026-05-22 11:12:13 +08:00
-
76b1efaffd
Fix SMG service discovery Clippy lint (#26034)
Mohammad Miadh Angkad
2026-05-22 10:51:13 +08:00
-
7c02ca7882
cancel pr ci: cover closed-no-merge; widen workflows; rerun-test opt-in (#26035)
Liangsheng Yin
2026-05-21 19:38:24 -07:00
-
4374789abf
fix(mm): make multimodal data loading non-blocking to prevent health check stalls (#24751)

longguoandYang
2026-05-22 10:08:03 +08:00
-
b2631a9a4d
[NPU] Docs op performance optimize (#25830)
McZyWu
2026-05-22 09:20:13 +08:00
-
16b3edc84f
[diffusion] feat: enable warmup for sglang serve by default (#25988)
Mick
2026-05-22 08:54:48 +08:00
-
f6d98a17ba
[diffusion] optimize: reuse cached dynamic lora weights (#25893)
Mick
2026-05-22 08:54:01 +08:00
-
7cf193fe1f
feat: support HybridLinearKVPool in chunked prefix cache handling (#25753)
nohup
2026-05-22 07:17:26 +08:00
-
d765dfd043
refactor(attn): init hisparse_coordinator before attn_backend; replace lazy property with init-time capture (#26012)

Cheng WanandClaude Sonnet 4.6
2026-05-21 16:03:42 -07:00
-
c5251a98a9
feat(model_runner): remove pool/backend refs from ForwardBatch via ForwardContext (#25983)

Cheng WanandClaude Sonnet 4.6
2026-05-21 14:01:49 -07:00
-
44ec2ee18d
[core] Unify output_tokens_buf in FutureMap (#25922)
Liangsheng Yin
2026-05-21 13:56:44 -07:00
-
c9a0e55eb5
[Spec] Polish FutureMap after #25879: rename callback, async guard, cleanup (#25962)
Liangsheng Yin
2026-05-21 13:56:22 -07:00
-
17dadebd4e
[Docs] DeepSeek-V4: switch H200 FP4 Pro to flashinfer_mxfp4, Flash Balanced too (#25923)

zijiexiaandClaude Opus 4.7
2026-05-21 13:51:40 -07:00
-
1a85586738
[Fix]: Restrict Kimi-K2.5 shared-experts fusion to Quark MXFP4 checkpoints (#25974)
Jimmy Shong
2026-05-21 13:07:45 -07:00
-
81d686d9fa
Default MegaMoE to W4A8 for Max-Throughput recipe (#26004)
Yuhao Yang
2026-05-22 02:54:16 +08:00
-
b765faee30
[MoE Refactor] deprecate forward_npu and NpuFuseEPMoE (#25678)

Cheng WanandClaude Opus 4.7
2026-05-21 10:25:17 -07:00
-
a24c374f84
[lora] Remove synchronous .any().item() guard in LoRA MoE prefill path (#25531)

Ethan (Yusheng) SuandCursor
2026-05-21 23:58:57 +08:00
-
ca9dc17be4
[diffusion] chore: adjust layer wise-offload strategy (#25930)
Mick
2026-05-21 23:48:58 +08:00
-
049bb83134
[CI] bot-cherry-pick: surface created PR number/URL in job summary (#26001)

Kangyan-ZhouandClaude Opus 4.7
2026-05-21 22:58:21 +08:00
-
32f996b75a
Avoiding the problem of printing a large number of compatibility warn… (#25956)
liuxianglong17
2026-05-21 22:10:23 +08:00
-
caa9f08294
[CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)

Kangyan-ZhouandLiangsheng Yin
2026-05-21 22:01:42 +08:00
-
ac83d8a339
docs: delete deprecated args from npu supported features (#25995)
amote-i
2026-05-21 20:20:29 +08:00
-
32352f7edf
[CI] Fix bot-cherry-pick: use state == "MERGED" instead of invalid
merged field (#25987)
Kangyan-Zhou
2026-05-21 20:10:12 +08:00
-
fbebdd5105
[CI] Enable nixl disaggregation test for decode radix cache (#25990)
Shangming Cai
2026-05-21 19:29:24 +08:00
-
2e0d2d4c18
[NPU][DOCS]Add best practice and benchmark result parameter description (#25875)
loading66
2026-05-21 19:08:10 +08:00
-
64f21b1589
[CI] Improve bot-cherry-pick: accept PR number, require merged, explicit title (#25981)
Kangyan-Zhou
2026-05-21 18:32:57 +08:00
-
8562d5ae94
[AMD] Relaxing Timeout for AMD stage-a (#25978)



2026-05-21 17:32:51 +08:00
-
f66881f03c
[NPU]Ascend NPU Performance Profiling Guide and Ascend NPU Operator Development Guide (#25384)
jianzhao-xu
2026-05-21 17:32:25 +08:00
-
e72e3145a0
[AMD] Upgrade AITER (#25896)

Bingxu ChenandCursor
2026-05-21 17:10:43 +08:00
-
baeac179f7
[Spec] Route seq_lens through FutureMap; drop verify_done.wait (#25879)
Liangsheng Yin
2026-05-21 01:51:40 -07:00
-
19f55c0e6d
[Refactor] major JIT kernel clean up for dsv4 (#25884)

DarkSharpnessandClaude
2026-05-21 16:14:31 +08:00
-
1b3d8da827
cap API quota for runner-utilization / amd-ci-job-monitor (#25965)
Liangsheng Yin
2026-05-21 01:13:37 -07:00
-
c3f9bc9818
Fix nixl mla key and backup skipping (#24376)
hxie
2026-05-21 00:48:28 -07:00
-
b9ae8353d2
[NPU] Support model DeepSeek-OCR and DeepSeek-OCR-2 (#25257)
看海的人
2026-05-21 15:21:20 +08:00
-
190488e9a8
[NPU] Support chunk prefill for Qwen3.5/Qwen3.6 models (#25839)
Liwansi
2026-05-21 14:44:25 +08:00
-
4ea8282cb7
[Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938)
Kangyan-Zhou
2026-05-21 14:36:56 +08:00
-
40faf44f7a
[auto-detect] match Ring-2.6/Ling XML kv tool-call format via vocab signature (#25366)
Xinyuan Tong
2026-05-21 07:34:52 +01:00
-
45cadc215f
[AMD][CI] Clean up AMD nightly + pr-test workflows (#25266)

Bingxu ChenandCursor Agent
2026-05-21 14:30:26 +08:00
-
b5b9c809e1
fix(model-gateway): rustfmt nightly in conversations/handlers.rs (#25947)
ybyang
2026-05-21 14:29:51 +08:00
-
c4f14650b9
fix act fun for xpu (#23809)
sushil Dubey
2026-05-21 11:32:21 +05:30
-
8fa56a0ab1
Fix FlashInfer A2A token cap sizing (#25907)

Lianmin ZhengandJaewon
2026-05-20 23:01:28 -07:00
-
e8608bdcb5
Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367)
xutizhou
2026-05-21 13:58:08 +08:00
-
847cbada9c
Support Gemma4 MoE NVFP4 (#25054)
Charles Chen
2026-05-20 22:45:15 -07:00
-
888a8794ef
[Fix] DSV4 cached_loc invalidated when SWA mapping is rebuilt (#25889)

Cheng WanandClaude Sonnet 4.6
2026-05-20 22:38:12 -07:00
-
3a6de13cd8
perf(dsv4): add MHC token-count prewarm (#25810)
YAMY
2026-05-20 22:22:41 -07:00
-
1ac3e33622
[diffusion] optimize: enable inference mode in pipeline executor (#25891)
Mick
2026-05-21 13:20:24 +08:00
-
e56db8bd24
fix: use base GPU ID CUDA device for multimodal processor (#21191)
Brilliant Hanabi
2026-05-21 13:18:37 +08:00
-
84ea47eb22
[CPU] Fix issues when running llama3.2-11B vision model with image tasks (#8666)



2026-05-21 13:09:18 +08:00
-
79b937aefb
[Refactor] Encapsulate SWA loc translation inside SWAKVPool with per-batch cache invalidation (#25824)

Cheng WanandClaude Sonnet 4.6
2026-05-20 21:26:32 -07:00
-
90efa9c83f
[AMD] Fix AMD stage-a-test-small-1-gpu (#25932)
YC Yen-Ching Tseng
2026-05-21 11:51:49 +08:00
-
791a2f057f
Add overridable hooks for custom chat serving implementations (#25807)

Randall LinandCursor
2026-05-20 20:21:25 -07:00
-
74c6294ba9
[BugFix][EPD]Fix Qwen3VLMoe encoder-only AttributeError (#25759)
Zheng Wengang
2026-05-21 11:07:21 +08:00
-
a449ee4822
[Deps] Use cu13 extra for nvidia cutlass dsl (#25576)
Mohammad Miadh Angkad
2026-05-21 10:31:27 +08:00
-
34479c19bd
[XPU] upgrade triton-xpu version to 3.7.1 (#25730)

jiayisunxandMa Mingfei
2026-05-21 10:29:20 +08:00
-
4868b92d47
[CI] Fix bot-cherry-pick auth: GITHUB_TOKEN for push, dedicated PAT for PR (#25926)

Kangyan-ZhouandClaude Opus 4.7
2026-05-21 10:28:42 +08:00
-
a528eb7564
fix: rustfmt service_discovery.rs warn! line length (#25927)

Cheng WanandClaude Sonnet 4.6
2026-05-20 19:25:11 -07:00
-
e603beab55
[NPU] Add Qwen3.5-397B-A17B best practice doc (#25594)
silencejade
2026-05-21 10:02:12 +08:00
-
ddf3817924
Revert "[AMD]fix: use CUDA event for targeted draft-to-verify sync in… (#25917)
Hanming Lu
2026-05-20 18:49:01 -07:00
-
cf1fd26d16
benchmark/lora: make number of LoRA adapters configurable (#25363)
Pai Liu
2026-05-21 11:23:13 +10:00
-
643d44d699
[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)
Kevin Flansburg
2026-05-20 19:20:19 -06:00
-
c4a7d12092
Enable breakable CUDA graph for eagle (#25795)
Lianmin Zheng
2026-05-20 18:02:04 -07:00
-
f9f82d238c
fix deepseek v4 hisparse (#25646)

huangtingweiandZhiqiang Xie
2026-05-21 08:28:38 +08:00
-
512d164916
Address overlap future token map by request-pool index (#25862)
Liangsheng Yin
2026-05-20 16:34:00 -07:00
-
b7d0df4b6f
[SMG] Support regular worker discovery alongside PD workers in IGW mode (#25294)

grunerandAmit Gruner
2026-05-21 02:23:55 +03:00
-
9f2bc24b35
Fix/dsv4 flash eagle dummy ima (#25892)
Kaixi
2026-05-21 00:41:28 +02:00
-
ce7141ef98
add git gemm warpper for dispatch_bf16_fp32_backend (#25860)
BingjiaWang
2026-05-21 06:24:10 +08:00
-
371b6c9ea0
[Scheduler] fix chunked prefill not always being full (#25741)
Hanming Lu
2026-05-20 15:03:11 -07:00
-
1a17d753f1
[perf] prepare_prefill_qkv hook + fp8 quantize jit kernel (#25460)
Qiaolin Yu
2026-05-20 14:20:49 -07:00
-
dac78768f0
[RL][TITO] Preserve whitespace in reasoning parser outputs (#24251)
Yuzhen Zhou
2026-05-20 12:45:09 -07:00
-
801d7e3eed
[DSA] Make MQA logits free memory ratio configurable (#25859)
YAMY
2026-05-20 12:27:16 -07:00
-
5e7bf73757
Fix bench_serving non-stream reasoning content (#25298)
Ratish P
2026-05-21 00:11:46 +05:30
-
1f209b4433
Add support for generic num_tokens_per_bs in TARGET_VERIFY (#25681)
jasonjk-park
2026-05-20 11:34:45 -07:00
-
61ac6792e6
Add DevashishLal-CB to CI_PERMISSIONS.json (#25908)
Lianmin Zheng
2026-05-20 11:19:43 -07:00
-
33c57b8716
[Bug][RadixTree] Fix LRU list reference cycle leak in radix_cache (#25770)

Mark Smithandzhangjiadong1@corp.netease.com
2026-05-21 01:06:05 +08:00
-
6e0b7f35ad
[radix cache] pluggable RadixCache factory (--radix-cache-backend) (#25101)
Jialin Ouyang
2026-05-20 10:05:04 -07:00