c2eae96c56
MSCCL++ Integration ( #22734 )
...
Co-authored-by: Caio Rocha <caiorocha@microsof.com >
Co-authored-by: empyreus <rjsouza1995@gmail.com >
2026-06-08 21:13:13 -07:00
Jan Bernlöhr and XueLiang Yang
15c801f726
fix(server): clamp piecewise_cuda_graph_max_tokens to context_length ( #22516 )
...
Co-authored-by: XueLiang Yang <102161631+xueliangyang-oeuler@users.noreply.github.com >
2026-06-08 19:43:54 -07:00
jianan-gu and Ma Mingfei
db143e5212
[Intel GPU][Encoder] Add xpu_attn backend for encoder vision attention ( #26460 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-06-09 09:47:44 +08:00
ea66b2cca7
[XPU] Enable NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 on Intel XPU backend ( #24390 )
...
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Yao Matrix <matrix.yao@intel.com >
2026-06-09 09:46:12 +08:00
Cao E
71e8258783
Improve registration in cpu_graph_runner ( #26635 )
2026-06-09 09:35:33 +08:00
Polisetty V R K Jyothendra Varma
d7c8b9ab9f
[Intel GPU] Enable fused_experts in fp8.py for quantized models on XPU ( #27533 )
...
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com >
2026-06-09 09:22:30 +08:00
Estrella-xx
6abef38627
[NPU]adaptation to support deterministic inference ( #21197 )
2026-06-09 09:22:09 +08:00
Jianhong Zhang
ab70153b62
[XPU][NIXL] Use uint64 for XPU address arithmetic in prep handle builders ( #27415 )
2026-06-09 09:18:36 +08:00
Liangsheng Yin
3fe6bc390b
[Spec] Naming cleanup: contiguous draft-loc kernel + accepted->accept ( #27599 )
2026-06-08 15:04:58 -07:00
Khoa Pham
c95179bc85
[Spec] Fuse small kenrels under gather_spec_extras ( #27233 )
2026-06-08 15:02:04 -07:00
Liangsheng Yin
b5c64b94d5
[Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers ( #27552 )
2026-06-08 14:42:21 -07:00
YAMY and Yuwei An
ca66e6fb5e
[BCG] Support breakable CUDA graph for DeepSeek V4 DP attention ( #25195 )
...
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
2026-06-08 13:54:58 -07:00
Mohammad Miadh Angkad
dc24a26821
Fix GPT-OSS MXFP4 hidden size reshape on SM10X ( #27528 )
...
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
2026-06-08 13:26:54 -07:00
Liangsheng Yin
28c1a3cb45
[Spec] Deprecate Spec V1 ( #25464 )
2026-06-08 13:10:27 -07:00
ea1d190ed0
[ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode ( #27289 )
...
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com >
Co-authored-by: Thomas Wang <thomawan@amd.com >
2026-06-08 11:49:34 -07:00
Lianmin Zheng
fca4ef9d69
Fix SWA pool resolution for EAGLE draft workers ( #27491 )
2026-06-08 11:00:29 -07:00
Lianmin Zheng
bcb5645629
Fix TRTLLM target verify query metadata ( #27495 )
2026-06-08 10:58:48 -07:00
32bedbf88e
[diffusion] model: support SANA-WM with streaming support ( #27531 )
...
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com >
Co-authored-by: sjmshsh <88866917+sjmshsh@users.noreply.github.com >
Co-authored-by: Mick <mickjagger19@icloud.com >
2026-06-09 01:10:14 +08:00
MARATRIX
61e4132bc2
[MUSA] bump torchada version to 0.1.59 and workaround PCG limitation. ( #27537 )
...
Signed-off-by: yafeng.li <yafeng.li@mthreads.com >
2026-06-08 08:45:39 -07:00
Stella-17 and xinyue.fan
12de907bc2
[MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test ( #27242 )
...
Co-authored-by: xinyue.fan <xinyue.fan@mthreads.com >
2026-06-08 08:45:16 -07:00
Leon Gao
eb646c7b78
[srt] Add sglang:weight_load_duration_seconds gauge with source label ( #27363 )
2026-06-08 23:41:54 +08:00
40030d8af8
[NPU] Add GitHub test summary and deduplicate test code. Part 2 ( #24689 )
...
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com >
Co-authored-by: ronnie_zheng <zl19940307@163.com >
2026-06-08 18:08:45 +03:00
Vladislav Nosivskoy
62c505a196
[HiCache][Dsv4] Don't cache C128 State pool in L3 ( #27293 )
2026-06-08 21:23:26 +08:00
Brian Chao
b0cd533a96
[diffusion] feat: progressive resolution growing for image and video models ( #27524 )
2026-06-08 20:44:07 +08:00
Zhangheng
1ff7c627cd
[UnifiedTree]: Support hicache metrics ( #27554 )
2026-06-08 20:18:02 +08:00
Shangming Cai
6394a8b381
[EPD] Dynamic encoder registration cleanup ( #27542 )
2026-06-08 19:08:29 +08:00
Yaochen Han and ronnie_zheng
1f5dc2cdca
[GPTQ] Refactor CPU quantization schemes ( #26786 )
...
Co-authored-by: ronnie_zheng <zl19940307@163.com >
2026-06-08 13:14:40 +03:00
YC Yen-Ching Tseng
a26587dd4e
[AMD][diffusion] Add FlyDSL fused normalization kernels for ROCm diffusion models optimization ( #22786 )
2026-06-08 02:42:39 -07:00
Liangsheng Yin
57ea09badb
Fix NaN in triton EAGLE spec-v2 draft-extend CUDA graph at topk>1 (wrong qo_indptr stride) ( #27545 )
2026-06-08 02:28:48 -07:00
Shangming Cai
8ff0c9fef9
[PD] Downgrade propagated rank failure logs from error to debug ( #27534 )
...
Signed-off-by: Shangming Cai <csmthu@gmail.com >
2026-06-08 16:56:46 +08:00
Ke Bao
d03182cd2d
Fix TP deadlock in unified radix cache writing_check / loading_check ( #27489 )
2026-06-08 16:08:47 +08:00
siyu
13dda3b8de
[EPD] Support dynamic encoder register ( #22253 )
2026-06-08 16:05:16 +08:00
Niko Ma
18d728967a
[PD][MoRI] Drive KV transfers with a sharded synchronous worker pool ( #26922 )
2026-06-08 00:49:25 -07:00
Jan Bernlöhr and Claude Opus 4.6
0d0254c9de
Fix port overflow in DP attention path when base port is near 65535 ( #20260 )
...
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com >
2026-06-08 00:39:29 -07:00
fzyzcjy
71a0b10462
Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate ( #26938 )
2026-06-08 14:55:41 +08:00
fzyzcjy
f746e4a608
Fix fill_len asymmetric assignment statement in ignore-eos branch ( #26999 )
2026-06-08 14:53:21 +08:00
fzyzcjy
9034c2f9ae
Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics ( #26659 )
2026-06-08 14:52:48 +08:00
fzyzcjy
259a2da3e0
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence ( #26637 )
2026-06-08 14:52:18 +08:00
fzyzcjy
4201de11de
Extract release_req and retract_all as module-level free functions ( #26548 )
2026-06-08 14:51:45 +08:00
fzyzcjy
3197808283
Avoid calling filter_batch with chunked_req_to_exclude being things unrelated to chunked reqs ( #26547 )
2026-06-08 14:51:21 +08:00
fzyzcjy
f5fdf9c5d8
Speed up dump comparator percentile computation using numpy ( #26874 )
2026-06-08 14:50:31 +08:00
fzyzcjy
995e649190
Add parallel-rank dump filenames and pipeline-global layer remapping to dumper ( #26850 )
2026-06-08 14:49:22 +08:00
Han Yu
3d2165a286
Fix dual-chunk sparse fallback index overflow ( #27361 )
2026-06-07 23:15:37 -07:00
Liangsheng Yin
6365d6faee
[spec] Misc defensive guards for EAGLE draft KV indexing ( #27486 )
2026-06-07 21:27:46 -07:00
Xiaoyu Zhang and xiaoyu.zhang
6c2770149b
[diffusion] Fix native text-encoder loading for T5/UMT5 encoder-decoder models ( #27432 )
...
Co-authored-by: xiaoyu.zhang <xiaoyu.zhang@radixark.net >
2026-06-08 12:23:16 +08:00
Xiaoyu Zhang
5bf7dd8e4a
Update SGLang diffusion skills ( #27496 )
2026-06-08 12:22:45 +08:00
David Wang
bf7fb6b925
fix dflash rope config parsing for updated transformers ( #27477 )
2026-06-07 20:52:07 -07:00
kk and wunhuang
1c73ff8ad3
[AMD] Optimize gpt-oss-120B performance ( #27063 )
...
Co-authored-by: wunhuang <wunhuang@amd.com >
2026-06-07 20:06:30 -07:00
Cao E
2d1856bf45
Support encoder_decoder on cpu_graph_runner ( #10950 )
2026-06-08 10:30:11 +08:00
Liangsheng Yin
303757ccd8
[Attn] Fix aiter MLA verify kv_indices under-alloc + shared assert_buffer_fits guard ( #27485 )
2026-06-07 17:06:25 -07:00
