 Cheng WanandClaude Fable 5
|
ceeaec2078
|
[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-10 16:07:58 -07:00 |
|
|
Cheng WanandClaude Fable 5
|
8a7c8a72d6
|
Fix NaN logits from deterministic Triton extend on the unified memory pool (#33517)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-10 16:05:04 -07:00 |
|
|
|
0661eb1c50
|
plugins: don't directly set quant class (#34252)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-10 16:01:31 -07:00 |
|
|
Zhiyao Jiang
|
2c72323d90
|
[AMD] Fix AITER custom reduce-scatter CUDA-graph capture crash under torch_memory_saver (#34203)
|
2026-08-10 15:36:15 -07:00 |
|
|
Liangsheng Yin
|
c80a38edcd
|
[Fix] Pin cuda-tile to 1.6.0rc5 to unblock Python 3.10 x86_64 installs (#34321)
|
2026-08-10 15:09:47 -07:00 |
|
|
AMD-yanfeiwang
|
ca0f8a0f4c
|
perf(hisparse): fuse the DSv4 value and scale swap-in copy on ROCm (#33484)
|
2026-08-10 14:30:15 -07:00 |
|
|
QIN2DIM
|
166c6f7181
|
[Kernel] cutedsl_bf16_gemm: trailing cluster barrier for 2-CTA TGV kernel exit (#32907) (#32954)
|
2026-08-10 20:31:18 +00:00 |
|
|
AMD-yanfeiwang
|
1a8e4876b6
|
perf(hisparse): 128-bit non-temporal swap-in copy on ROCm (#33085)
|
2026-08-10 13:27:15 -07:00 |
|
|
Qiaolin Yu
|
733c05c887
|
[spec decoding] support inkling dspark (#31847)
|
2026-08-10 13:21:35 -07:00 |
|
|
Lifan ShenandXinyuan Tong
|
a2161ce682
|
Support thinking budget for Inkling (#33146)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-08-11 02:01:08 +08:00 |
|
|
Tan Trinh
|
955aab8db1
|
[DCP] Reuse partial output in natural-log LSE merge (#34213)
|
2026-08-10 10:45:40 -07:00 |
|
|
Cheng Wan
|
7738062294
|
[unified memory] Support DSPARK speculative decoding + fix two NaN root causes (page hand-out zeroing, CuTe int32 slot-stride wrap) (#33974)
|
2026-08-10 10:35:06 -07:00 |
|
|
Mick
|
ec9babe36c
|
[diffusion] fix: fix h3 rank-local fsdp qkv loading (#34294)
|
2026-08-10 23:59:00 +08:00 |
|
|
|
d07ac32d05
|
[diffusion] feat: support --served-model-name in sglang serve (#34228)
Co-authored-by: TobyMint <tobymint@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-10 22:27:09 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
f5f0c3ee7a
|
[diffusion] Z-Image single-GPU BCG: fix the replay crash and make output bit-exact vs eager (#34183) (#34210)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-10 22:18:32 +08:00 |
|
|
|
fd3036523a
|
[diffusion] Clean up shared bitexact gates, helpers, and stale naming (#34180)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-10 22:14:09 +08:00 |
|
|
Mick
|
3e2a26708b
|
[diffusion] chore: expose architecture config at the dit runtime boundary (#34248)
|
2026-08-10 20:08:45 +08:00 |
|
|
Mick
|
8ba9385097
|
[diffusion] chore: optimize model weight loading (#34064)
|
2026-08-10 20:07:48 +08:00 |
|
|
|
14ffd447a4
|
[FEAT] Decouple multimodal global cache from Mooncake (#30392)
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
|
2026-08-10 19:23:19 +08:00 |
|
|
Mick
|
443b62db57
|
fix(vlm): stream-order cuda-ipc feature pool lifecycle and streamline multimodal transport module (#33949)
|
2026-08-10 18:47:19 +08:00 |
|
|
Thomas Wang
|
0977b22431
|
[AMD] Restore K3 MLA verify kernel path blocked by can_handle() guard (#34261)
|
2026-08-10 03:31:53 -07:00 |
|
|
Mick
|
955569a2dc
|
[diffusion] feat: expose cosmos3 policies through the Action API (#34243)
|
2026-08-10 18:16:20 +08:00 |
|
|
YAMYandShangming Cai
|
c971d7ac9c
|
Refactor staging registration metadata fields (#33910)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-08-10 17:53:32 +08:00 |
|
|
Jincong Chen
|
3c533acec6
|
[Hicache][2/2]Support Mamba branching in Unified Radix Cache with HiCache (#33639)
|
2026-08-10 17:16:42 +08:00 |
|
|
|
a76a167812
|
Fix/hisparse host backed max request length (#28753)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-08-10 16:58:13 +08:00 |
|
|
Liangsheng YinandBrayden Zhong
|
b51bf9ec9e
|
[Spec] Budget the DFLASH draft KV pool from its own attention geometry (#34234)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-10 01:28:49 -07:00 |
|
|
MichaelandHAI
|
f2a4c4c847
|
[AMD] [CI] Enable 3 nested unit tests needing harness stub fixes (#31843)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-08-10 16:09:00 +08:00 |
|
|
Feng Su
|
fb3d1419fd
|
[tracing] sglang tracing v2: support exporting tracing data asynchronously (#30023)
|
2026-08-10 15:23:05 +08:00 |
|
|
Yuwei AnandClaude Opus 5
|
06f32bab6b
|
[BCG][5/N] MLA Fully Support (#33661)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-09 23:52:14 -07:00 |
|
|
Liangsheng YinandBrayden Zhong
|
aea78d1e73
|
[misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-09 23:45:11 -07:00 |
|
|
Liangsheng YinandBrayden Zhong
|
d6a066131c
|
[Feature] Support NVFP4 token embedding in ModelOpt mixed-precision checkpoints (#34222)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-09 23:37:54 -07:00 |
|
|
Chunan Zeng
|
e226bb711c
|
enable TRT-LLM for MiniMax M3 by preserving SwiGLU params (#33962)
|
2026-08-09 23:30:05 -07:00 |
|
|
|
2969ab3d41
|
[MLX] Window-bounded SWA KV storage and in-graph sampling (#34166)
Co-authored-by: Siming Deng <siming_deng_stat@163.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Jiminator <Jiminator@users.noreply.github.com>
Co-authored-by: damahua <damahua@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-09 21:28:51 -07:00 |
|
|
Polisetty V R K Jyothendra Varma
|
449f0da78f
|
[Intel GPU] DeepSeek V4 15/N: Add silu_and_mul_clamp support to triton fused_moe for XPU (#33808)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-08-09 21:22:05 -07:00 |
|
|
YAMY
|
5a8e360e70
|
[PD] Skip speculative verify scratch on prefill servers (saves num_draft_tokens x mamba pool per rank) (#34191)
|
2026-08-09 20:56:00 -07:00 |
|
|
Jan BernlöhrandMohammad Miadh Angkad
|
5d85f25f75
|
fix(minimax): use routed TRT-LLM for NVFP4 MoE auto on SM100 (#32229)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-08-10 11:45:14 +08:00 |
|
|
|
410088c91e
|
[NPU] Increase the retry count to 3 for the GSM8K. (#34103)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-08-10 10:55:41 +08:00 |
|
|
|
7331287c1c
|
[JIT Kernel][DSv4] Optimize epilogue of c128 (#26671)
Co-authored-by: Yeu Jaung <jpppppppppppppppppppppppp@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-10 10:32:43 +08:00 |
|
|
DarkSharpnessandClaude Opus 5
|
accc51c6db
|
[DSA] Fix top-k v2 dropping non-primary ranks' output on CUDA 13.1+ (root cause for #33835) (#34167)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-10 10:31:47 +08:00 |
|
|
Mick
|
169783d42f
|
[diffusion] chore: make torch.compile opt-in for speed mode (#34173)
|
2026-08-10 10:22:16 +08:00 |
|
|
Khoa Pham
|
ee3ee8393c
|
fix: preserve GQA head mapping in Triton DCP prefill (#34161)
|
2026-08-09 18:52:18 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
441910f926
|
[diffusion] LTX-2 quality=high fused RMSNorm+modulate + FFN GELU epilogue (H200 ltx23-one-stage denoise 45.85->43.24 s, ~matches torch.compile) (#34172)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-10 09:46:17 +08:00 |
|
|
Mick
|
c20e99bd22
|
fix(vlm): preserve Kimi-K3 GPU JPEG accuracy (#34163)
|
2026-08-10 09:42:52 +08:00 |
|
|
|
553dc0f936
|
[MLX] Support gpt-oss: sliding-window attention, attention sinks, sm_scale (#30050)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-08-09 18:32:36 -07:00 |
|
|
Ke Bao
|
25b7015064
|
Fix stale track rows corrupting conv checkpoints under the prefill graph (#34184)
|
2026-08-10 08:57:23 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
56ef810cad
|
[diffusion] BCG: auto-capture the default warmup resolution instead of hard-requiring --warmup-resolutions (H200 SANA denoise 0.73->0.457 s with a single flag) (#34174)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-10 08:37:32 +08:00 |
|
|
Liangsheng Yin
|
7c90840bad
|
[CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs (#34186)
|
2026-08-09 16:44:53 -07:00 |
|
|
Liangsheng YinandDeleter-D
|
4a5d7d3c67
|
[DSV4] Fix silent KV corruption when speculative draft tokens > 4 (#34189)
Co-authored-by: Deleter-D <867909454@qq.com>
|
2026-08-09 15:54:41 -07:00 |
|
|
Cheng Wan
|
b4284f3eb7
|
config: the KV-cache configurator reads the bags (#34096)
|
2026-08-09 14:45:42 -07:00 |
|
|
Cheng Wan
|
e216c2bc59
|
config: the runner and scheduler read resolved config from the bags (#34095)
|
2026-08-09 14:45:11 -07:00 |
|