Commit Graph
13388 Commits
Author SHA1 Message Date
Ke Bao 693adabff7 Fix Mamba2Metadata dropping has_mamba_track_mask (#26877) 2026-06-01 22:03:59 +08:00
zhaozx-cn fd16e05252 [NPU] fix npu profiler (#24835) 2026-06-01 21:44:24 +08:00
Bi Xue 6965fe0eec [sgl] Window-aware LRU refresh for SWA prefix cache in unified cache (#26615) 2026-06-01 19:35:18 +08:00
Chi McIsaac 931765e23e Do not cap DeepSeek V4 PD prefill by SWA pool size (#26607) 2026-06-01 19:29:45 +08:00
yiheng 1f8d3c7a42 [Speculative] [NPU] Adaptive-SD NPU support (#25644)
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
2026-06-01 19:19:58 +08:00
Liangsheng Yin 1bff7a290f Refactor EAGLE infer tests: shared fixture + kits + overlap matrix (#26871) 2026-06-01 03:55:01 -07:00
Bingxu ChenandClaude Opus 4.8 89410b380b [AMD] Pin compressed-tensors==0.15.0 to fix ROCm nightly build (#26879)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-01 17:33:00 +08:00
giang_ng_tr 2394dede0e [EPD][Perf] Async image preprocessing and cross-request ViT batching for encode_server (#25669) 2026-06-01 16:52:12 +08:00
Yuan Luoandluoyuan.luo bc36231d65 [KDA] Support KDA packed decode (#26586)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-01 16:52:01 +08:00
amote-i d078cb72bd [NPU] [DOC] clarify Ascend NPU exclusive supported values for speculative args (#26903) 2026-06-01 16:40:11 +08:00
b14fba17d9 [AMD] make bypass-fastfail label also disable within-suite fast-fail (#26909)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-06-01 16:17:59 +08:00
Ke Bao cdd06011a1 Make unified tree SWA hicache tests faithful to write-through backup (#26870) 2026-06-01 16:08:57 +08:00
Mengxuan Xiong ff642ed936 [MoE] Extend kimi_k2_moe_fused_gate to support 256 experts (MiMo V2 Flash) (#26303) 2026-06-01 16:03:58 +08:00
YC Yen-Ching Tseng f60710a1d7 [AMD] Fix stage-b-test-large-8-gpu-mi35x-disaggregation-amd : switch CACHE_HOST to a fresh path to fix "No space left on device" (#26905) 2026-06-01 16:00:58 +08:00
ZeyuanChen2000 1d7e2f6fb8 [NPU] fix normal DeepEP mode num_tokens_per_rdma_rank error caused by none (#22972) 2026-06-01 15:32:14 +08:00
WingEdge777 20f47cfe8e fix : add sglang script as entry bin for runtime docker image (#26895) 2026-06-01 09:22:37 +02:00
Shangming Cai afd2d0b2f4 [PP][Bugfix] Handle input_ids assignment in prepare_for_extend (#26883) 2026-06-01 14:43:50 +08:00
Lianmin Zheng 53b8378307 Fix weights_checker checksum for 0-dim tensors and multi-GPU (#26863) 2026-05-31 21:27:03 -07:00
Mick 4b0453f814 [diffusion] CI: infer diffusion test sampling params from task type (#26530) 2026-06-01 11:57:41 +08:00
Lianmin ZhengandJaewon a779791b3f Add random-ids dataset, round-robin expert simulation, and kill_process_tree logging (#26862)
Co-authored-by: Jaewon <52840625+jaewonlee-fb@users.noreply.github.com>
2026-05-31 20:50:29 -07:00
Bruce Changlong Xu 11411aa49d [tokenizer] Surface scheduler load info (num_running_reqs / num_waiting_reqs) in meta_info (#24000) 2026-06-01 11:45:35 +08:00
liuxianglong17 3aaf8f115e fix test cases failed in nightly pipeline (#26714) 2026-06-01 11:33:47 +08:00
Qiaolin Yu 118465f5b5 [attn backend] Make spec_v2 seq_lens_cpu optional in trtllm_mla backend (#26824) 2026-05-31 20:29:50 -07:00
Chandrakant Khandelwal 61cc70e8aa Fixed incorrect indexing for slot 0 compatibility (#26481) 2026-06-01 10:46:21 +08:00
shadowxz109 4d20dc44fc 【NPU】add MiniMax2.5 best practice docs (#26725) 2026-06-01 10:09:12 +08:00
jundu 1ee189831f [CI] Bump xeon PR test unit tests timeout to 60 minutes (#26682) 2026-06-01 09:13:09 +08:00
huangtingwei 373cadc92e [bugfix] mooncake store double-tag bug fix (#26569) 2026-05-31 15:15:38 -07:00
shuwenn c06220159b [mem_cache][1/N] refactor: split allocator.py into allocator/ subpackage (#26675) 2026-05-31 20:31:29 +08:00
Ke Bao 972fbf7711 Skip flaky mamba extra_buffer disagg test (#26838) 2026-05-31 15:59:03 +08:00
Liangsheng Yin 585baa97f7 [core] Compute token_type_ids in ForwardBatch.init_new (#26797) 2026-05-31 00:54:49 -07:00
ybyang 1eadb7a173 Fix multi-tokenizer batch request output routing (health stuck at 503) (#26831) 2026-05-31 00:31:23 -07:00
Bruce Changlong Xu 376635c1e3 Fix routed-experts device buffer overflow under DP attention (#26123) 2026-05-30 19:11:06 -07:00
fzyzcjy f220c72929 Add periodic KV-canary stats logging and kernel-run-counter health check (#26821) 2026-05-31 10:00:19 +08:00
fzyzcjy 7dd19ae3d8 Add a sliding-window-attention divergence reporter for the KV-canary (#26820) 2026-05-31 09:59:28 +08:00
fzyzcjy ae9db7ff4b Add the KV-canary perturb modes and PD-disaggregation e2e tests (#26819) 2026-05-31 09:59:09 +08:00
fzyzcjy 6be4b32d8d Add token-id verification to the KV-canary (#26818) 2026-05-31 09:58:51 +08:00
fzyzcjy 0ca610a6df Add real-data KV verification to the KV-canary (#26817) 2026-05-31 09:58:32 +08:00
fzyzcjy cdee16e144 Add the KV-canary perturb framework for fault-injection self-tests (#26816) 2026-05-31 09:58:14 +08:00
fzyzcjy 678e73a9ee Add a deterministic token oracle and production write-input assertion (#26815) 2026-05-31 09:57:43 +08:00
fzyzcjy 268f4c82f1 Add rids/bootstrap-room int-hash plumbing for deterministic per-request identification (#26814) 2026-05-31 09:57:22 +08:00
fzyzcjy 9c43c3719f Support EAGLE speculative decoding in the KV-canary (#26813) 2026-05-31 09:57:01 +08:00
fzyzcjy 30a22cc360 Add a periodic full-radix-tree KV-canary sweep (#26812) 2026-05-31 09:56:42 +08:00
fzyzcjy 27eb139ef7 Add the KV-canary mock-model end-to-end test harness (#26811) 2026-05-31 09:56:00 +08:00
fzyzcjy e188745ee0 Add KV-canary SWA + DeepSeek-V4 pool support (#26810) 2026-05-31 09:55:34 +08:00
fzyzcjy 9ecf314970 Add the KV-canary install API and forward-path wiring (#26809) 2026-05-31 09:55:03 +08:00
fzyzcjy 11391b2a1c Add the KV-canary core: data layer, MHA KV-pool patcher, and per-forward runner (#26808) 2026-05-31 09:54:24 +08:00
fzyzcjy 736ad1f32a Add the KV-canary plan JIT kernels (#26807) 2026-05-31 09:53:56 +08:00
fzyzcjy 70e983a2da Add the KV-canary write JIT kernel and reference implementation (#26806) 2026-05-31 09:53:34 +08:00
fzyzcjy 16950954c6 Add the KV-canary verify JIT kernel and reference implementation (#26805) 2026-05-31 09:52:52 +08:00
fzyzcjy 8a20c58252 Pull test_utils server-launch boilerplate into reusable helpers (#26804) 2026-05-31 09:52:15 +08:00