Estrella-xx
|
6abef38627
|
[NPU]adaptation to support deterministic inference (#21197)
|
2026-06-09 09:22:09 +08:00 |
|
Jianhong Zhang
|
ab70153b62
|
[XPU][NIXL] Use uint64 for XPU address arithmetic in prep handle builders (#27415)
|
2026-06-09 09:18:36 +08:00 |
|
Liangsheng Yin
|
3fe6bc390b
|
[Spec] Naming cleanup: contiguous draft-loc kernel + accepted->accept (#27599)
|
2026-06-08 15:04:58 -07:00 |
|
Khoa Pham
|
c95179bc85
|
[Spec] Fuse small kenrels under gather_spec_extras (#27233)
|
2026-06-08 15:02:04 -07:00 |
|
Liangsheng Yin
|
b5c64b94d5
|
[Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers (#27552)
|
2026-06-08 14:42:21 -07:00 |
|
 YAMYandYuwei An
|
ca66e6fb5e
|
[BCG] Support breakable CUDA graph for DeepSeek V4 DP attention (#25195)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-06-08 13:54:58 -07:00 |
|
Mohammad Miadh Angkad
|
dc24a26821
|
Fix GPT-OSS MXFP4 hidden size reshape on SM10X (#27528)
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-08 13:26:54 -07:00 |
|
Liangsheng Yin
|
28c1a3cb45
|
[Spec] Deprecate Spec V1 (#25464)
|
2026-06-08 13:10:27 -07:00 |
|
 
|
ea1d190ed0
|
[ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode (#27289)
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-06-08 11:49:34 -07:00 |
|
Lianmin Zheng
|
fca4ef9d69
|
Fix SWA pool resolution for EAGLE draft workers (#27491)
|
2026-06-08 11:00:29 -07:00 |
|
Lianmin Zheng
|
bcb5645629
|
Fix TRTLLM target verify query metadata (#27495)
|
2026-06-08 10:58:48 -07:00 |
|
  
|
32bedbf88e
|
[diffusion] model: support SANA-WM with streaming support (#27531)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: sjmshsh <88866917+sjmshsh@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-09 01:10:14 +08:00 |
|
MARATRIX
|
61e4132bc2
|
[MUSA] bump torchada version to 0.1.59 and workaround PCG limitation. (#27537)
Signed-off-by: yafeng.li <yafeng.li@mthreads.com>
|
2026-06-08 08:45:39 -07:00 |
|
 Stella-17andxinyue.fan
|
12de907bc2
|
[MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test (#27242)
Co-authored-by: xinyue.fan <xinyue.fan@mthreads.com>
|
2026-06-08 08:45:16 -07:00 |
|
Leon Gao
|
eb646c7b78
|
[srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363)
|
2026-06-08 23:41:54 +08:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
40030d8af8
|
[NPU] Add GitHub test summary and deduplicate test code. Part 2 (#24689)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-08 18:08:45 +03:00 |
|
Vladislav Nosivskoy
|
62c505a196
|
[HiCache][Dsv4] Don't cache C128 State pool in L3 (#27293)
|
2026-06-08 21:23:26 +08:00 |
|
Brian Chao
|
b0cd533a96
|
[diffusion] feat: progressive resolution growing for image and video models (#27524)
|
2026-06-08 20:44:07 +08:00 |
|
Zhangheng
|
1ff7c627cd
|
[UnifiedTree]: Support hicache metrics (#27554)
|
2026-06-08 20:18:02 +08:00 |
|
Shangming Cai
|
6394a8b381
|
[EPD] Dynamic encoder registration cleanup (#27542)
|
2026-06-08 19:08:29 +08:00 |
|
 Yaochen Hanandronnie_zheng
|
1f5dc2cdca
|
[GPTQ] Refactor CPU quantization schemes (#26786)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-08 13:14:40 +03:00 |
|
YC Yen-Ching Tseng
|
a26587dd4e
|
[AMD][diffusion] Add FlyDSL fused normalization kernels for ROCm diffusion models optimization (#22786)
|
2026-06-08 02:42:39 -07:00 |
|
Liangsheng Yin
|
57ea09badb
|
Fix NaN in triton EAGLE spec-v2 draft-extend CUDA graph at topk>1 (wrong qo_indptr stride) (#27545)
|
2026-06-08 02:28:48 -07:00 |
|
Shangming Cai
|
8ff0c9fef9
|
[PD] Downgrade propagated rank failure logs from error to debug (#27534)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-08 16:56:46 +08:00 |
|
Ke Bao
|
d03182cd2d
|
Fix TP deadlock in unified radix cache writing_check / loading_check (#27489)
|
2026-06-08 16:08:47 +08:00 |
|
siyu
|
13dda3b8de
|
[EPD] Support dynamic encoder register (#22253)
|
2026-06-08 16:05:16 +08:00 |
|
Niko Ma
|
18d728967a
|
[PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922)
|
2026-06-08 00:49:25 -07:00 |
|
 Jan BernlöhrandClaude Opus 4.6
|
0d0254c9de
|
Fix port overflow in DP attention path when base port is near 65535 (#20260)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-08 00:39:29 -07:00 |
|
fzyzcjy
|
71a0b10462
|
Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate (#26938)
|
2026-06-08 14:55:41 +08:00 |
|
fzyzcjy
|
f746e4a608
|
Fix fill_len asymmetric assignment statement in ignore-eos branch (#26999)
|
2026-06-08 14:53:21 +08:00 |
|
fzyzcjy
|
9034c2f9ae
|
Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659)
|
2026-06-08 14:52:48 +08:00 |
|
fzyzcjy
|
259a2da3e0
|
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)
|
2026-06-08 14:52:18 +08:00 |
|
fzyzcjy
|
4201de11de
|
Extract release_req and retract_all as module-level free functions (#26548)
|
2026-06-08 14:51:45 +08:00 |
|
fzyzcjy
|
3197808283
|
Avoid calling filter_batch with chunked_req_to_exclude being things unrelated to chunked reqs (#26547)
|
2026-06-08 14:51:21 +08:00 |
|
fzyzcjy
|
f5fdf9c5d8
|
Speed up dump comparator percentile computation using numpy (#26874)
|
2026-06-08 14:50:31 +08:00 |
|
fzyzcjy
|
995e649190
|
Add parallel-rank dump filenames and pipeline-global layer remapping to dumper (#26850)
|
2026-06-08 14:49:22 +08:00 |
|
Han Yu
|
3d2165a286
|
Fix dual-chunk sparse fallback index overflow (#27361)
|
2026-06-07 23:15:37 -07:00 |
|
Liangsheng Yin
|
6365d6faee
|
[spec] Misc defensive guards for EAGLE draft KV indexing (#27486)
|
2026-06-07 21:27:46 -07:00 |
|
 Xiaoyu Zhangandxiaoyu.zhang
|
6c2770149b
|
[diffusion] Fix native text-encoder loading for T5/UMT5 encoder-decoder models (#27432)
Co-authored-by: xiaoyu.zhang <xiaoyu.zhang@radixark.net>
|
2026-06-08 12:23:16 +08:00 |
|
Xiaoyu Zhang
|
5bf7dd8e4a
|
Update SGLang diffusion skills (#27496)
|
2026-06-08 12:22:45 +08:00 |
|
David Wang
|
bf7fb6b925
|
fix dflash rope config parsing for updated transformers (#27477)
|
2026-06-07 20:52:07 -07:00 |
|
 kkandwunhuang
|
1c73ff8ad3
|
[AMD] Optimize gpt-oss-120B performance (#27063)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-07 20:06:30 -07:00 |
|
Cao E
|
2d1856bf45
|
Support encoder_decoder on cpu_graph_runner (#10950)
|
2026-06-08 10:30:11 +08:00 |
|
Liangsheng Yin
|
303757ccd8
|
[Attn] Fix aiter MLA verify kv_indices under-alloc + shared assert_buffer_fits guard (#27485)
|
2026-06-07 17:06:25 -07:00 |
|
Liangsheng Yin
|
f68c79675f
|
Support topk > 1 tree drafting for mamba/hybrid-linear models on spec v2 (#27463)
|
2026-06-07 17:04:09 -07:00 |
|
Liangsheng Yin
|
70db73afce
|
[Spec] Clamp multimodal pad sentinels in spec-v2 draft prefill embedding (#27512)
|
2026-06-07 17:00:49 -07:00 |
|
Hubert Lu
|
10d33bd77e
|
[AMD] Enable Piecewise CUDA Graph for AMD GPUs (#22299)
|
2026-06-07 16:28:20 -07:00 |
|
Mick
|
02be2e7189
|
[diffusion] support tp for ideogram4 (#27393)
|
2026-06-07 23:14:58 +08:00 |
|
Lianmin Zheng
|
a07d813ec8
|
Revert "Fix TRTLLM target verify query metadata (#27473)" (#27494)
|
2026-06-07 02:48:52 -07:00 |
|
 Lianmin ZhengandMing Yang
|
db58e76c33
|
Add all_to_all_single to GroupCoordinator (#27492)
Co-authored-by: Ming Yang <minos.future@gmail.com>
|
2026-06-07 02:48:47 -07:00 |
|