Commit Graph
16369 Commits
Author SHA1 Message Date
Brayden ZhongandBrayden Zhong d95e824a49 Muse Glimmer Cookbook: install from the PR branch (#34281)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-08-10 11:39:55 +00:00
14ffd447a4 [FEAT] Decouple multimodal global cache from Mooncake (#30392)
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
2026-08-10 19:23:19 +08:00
Brayden ZhongandBrayden Zhong d96b1533ea Muse Glimmer Cookbook: install from the PR branch (#34278)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-08-10 03:49:02 -07:00
Mick 443b62db57 fix(vlm): stream-order cuda-ipc feature pool lifecycle and streamline multimodal transport module (#33949) 2026-08-10 18:47:19 +08:00
Thomas Wang 0977b22431 [AMD] Restore K3 MLA verify kernel path blocked by can_handle() guard (#34261) 2026-08-10 03:31:53 -07:00
a6c34df044 Muse Glimmer Cookbook (#34271)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Jimmy Shong <jimmysh341@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-08-10 10:21:13 +00:00
Mick 955569a2dc [diffusion] feat: expose cosmos3 policies through the Action API (#34243) 2026-08-10 18:16:20 +08:00
YAMYandShangming Cai c971d7ac9c Refactor staging registration metadata fields (#33910)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-08-10 17:53:32 +08:00
Liangsheng Yin 0b6189d0e8 [CI] Add output_tag input to the Patch Docker Image workflow (#34253) 2026-08-10 02:48:03 -07:00
Jincong Chen 3c533acec6 [Hicache][2/2]Support Mamba branching in Unified Radix Cache with HiCache (#33639) 2026-08-10 17:16:42 +08:00
Ke Bao 430f38ea25 Update dspark draft path in Inkling small cookbook (#34250) 2026-08-10 17:12:51 +08:00
a76a167812 Fix/hisparse host backed max request length (#28753)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-08-10 16:58:13 +08:00
Liangsheng YinandBrayden Zhong b51bf9ec9e [Spec] Budget the DFLASH draft KV pool from its own attention geometry (#34234)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-10 01:28:49 -07:00
Liangsheng Yin 3bb72bc72a [CI] Keep the torch compilation cache instead of wiping it on install (#34231) 2026-08-10 01:21:20 -07:00
MichaelandHAI f2a4c4c847 [AMD] [CI] Enable 3 nested unit tests needing harness stub fixes (#31843)
Co-authored-by: HAI <hixiao@gmail.com>
2026-08-10 16:09:00 +08:00
Feng Su fb3d1419fd [tracing] sglang tracing v2: support exporting tracing data asynchronously (#30023) 2026-08-10 15:23:05 +08:00
Yuwei AnandClaude Opus 5 06f32bab6b [BCG][5/N] MLA Fully Support (#33661)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-09 23:52:14 -07:00
Liangsheng YinandBrayden Zhong aea78d1e73 [misc] Pass FP8 scales in FlashInfer SWA prefill, autotune fp8 on SM120, and tighten is_image_understandable_model (#34217)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-09 23:45:11 -07:00
Liangsheng YinandBrayden Zhong d6a066131c [Feature] Support NVFP4 token embedding in ModelOpt mixed-precision checkpoints (#34222)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-09 23:37:54 -07:00
Chunan Zeng e226bb711c enable TRT-LLM for MiniMax M3 by preserving SwiGLU params (#33962) 2026-08-09 23:30:05 -07:00
2969ab3d41 [MLX] Window-bounded SWA KV storage and in-graph sampling (#34166)
Co-authored-by: Siming Deng <siming_deng_stat@163.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Jiminator <Jiminator@users.noreply.github.com>
Co-authored-by: damahua <damahua@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-09 21:28:51 -07:00
Polisetty V R K Jyothendra Varma 449f0da78f [Intel GPU] DeepSeek V4 15/N: Add silu_and_mul_clamp support to triton fused_moe for XPU (#33808)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
2026-08-09 21:22:05 -07:00
YAMY 5a8e360e70 [PD] Skip speculative verify scratch on prefill servers (saves num_draft_tokens x mamba pool per rank) (#34191) 2026-08-09 20:56:00 -07:00
Jan BernlöhrandMohammad Miadh Angkad 5d85f25f75 fix(minimax): use routed TRT-LLM for NVFP4 MoE auto on SM100 (#32229)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-08-10 11:45:14 +08:00
410088c91e [NPU] Increase the retry count to 3 for the GSM8K. (#34103)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-08-10 10:55:41 +08:00
7331287c1c [JIT Kernel][DSv4] Optimize epilogue of c128 (#26671)
Co-authored-by: Yeu Jaung <jpppppppppppppppppppppppp@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-10 10:32:43 +08:00
DarkSharpnessandClaude Opus 5 accc51c6db [DSA] Fix top-k v2 dropping non-primary ranks' output on CUDA 13.1+ (root cause for #33835) (#34167)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-10 10:31:47 +08:00
Mick 169783d42f [diffusion] chore: make torch.compile opt-in for speed mode (#34173) 2026-08-10 10:22:16 +08:00
Khoa Pham ee3ee8393c fix: preserve GQA head mapping in Triton DCP prefill (#34161) 2026-08-09 18:52:18 -07:00
Xiaoyu ZhangandClaude Opus 4.8 441910f926 [diffusion] LTX-2 quality=high fused RMSNorm+modulate + FFN GELU epilogue (H200 ltx23-one-stage denoise 45.85->43.24 s, ~matches torch.compile) (#34172)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-10 09:46:17 +08:00
Mick c20e99bd22 fix(vlm): preserve Kimi-K3 GPU JPEG accuracy (#34163) 2026-08-10 09:42:52 +08:00
553dc0f936 [MLX] Support gpt-oss: sliding-window attention, attention sinks, sm_scale (#30050)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-09 18:32:36 -07:00
Ke Bao 68b961e9fb Add kda replayssm tests (#33630) 2026-08-10 09:11:20 +08:00
Ke Bao 25b7015064 Fix stale track rows corrupting conv checkpoints under the prefill graph (#34184) 2026-08-10 08:57:23 +08:00
Xiaoyu ZhangandClaude Opus 4.8 56ef810cad [diffusion] BCG: auto-capture the default warmup resolution instead of hard-requiring --warmup-resolutions (H200 SANA denoise 0.73->0.457 s with a single flag) (#34174)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-10 08:37:32 +08:00
Liangsheng Yin 7c90840bad [CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs (#34186) 2026-08-09 16:44:53 -07:00
Liangsheng YinandDeleter-D 4a5d7d3c67 [DSV4] Fix silent KV corruption when speculative draft tokens > 4 (#34189)
Co-authored-by: Deleter-D <867909454@qq.com>
2026-08-09 15:54:41 -07:00
Cheng Wan 57f2105118 docs(skill): record where config is read now that the seed is off limits (#34097) 2026-08-09 14:46:14 -07:00
Cheng Wan b4284f3eb7 config: the KV-cache configurator reads the bags (#34096) 2026-08-09 14:45:42 -07:00
Cheng Wan e216c2bc59 config: the runner and scheduler read resolved config from the bags (#34095) 2026-08-09 14:45:11 -07:00
Cheng WanandClaude Fable 5 a2199c1dee config: pin that resolution is reproducible from the raw input (#34094)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-09 14:44:39 -07:00
Cheng Wan 63833f8034 config: business code no longer reads the published ServerArgs (#34081) 2026-08-09 14:44:08 -07:00
Cheng Wan 110bf7e6a8 config: retire the hidden global fallbacks and the mamba-extra-buffer instance reads (#34080) 2026-08-09 14:43:28 -07:00
Michael 967cac801c [AMD] [CI] Register the DeepSeek-V4-Pro-DSpark MI35x nightly job so its suite actually runs (#34147) 2026-08-09 14:10:28 -07:00
bfeb9a8af2 [feat] Add language_model_only parameter support for Qwen35 (#22867)
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-08-10 02:47:36 +08:00
Ke Bao c2fbe2f6d8 Add skill for the logprob consistency tests (#34169) 2026-08-10 01:33:00 +08:00
Eric Zhang 168eba3257 [Fix] Speculative decoding crashes with DP-Attention (#33892) 2026-08-10 00:56:36 +08:00
Ke Bao 2ab96d0fe0 Fix mlx unit test batch mock (#34181) 2026-08-10 00:55:55 +08:00
Ke Bao fb72a37fde Add deterministic logprob-consistency test for inkling-small nvfp4 (#34168) 2026-08-09 22:22:27 +08:00
Kurt ShusterandClaude Fable 5 3fe65e0654 Deterministic gumbel sampling: clamp u=1 so masked tokens can't be sampled (#33423)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-09 21:43:27 +08:00