Commit Graph
15768 Commits
Author SHA1 Message Date
Brayden Zhong f01a0c7f97 Fixing MXFP8 online quantization pipeline (#31510) 2026-07-28 21:26:13 -07:00
YC Yen-Ching Tseng 68673fe6c5 [AMD] add Gemma3RMSNorm.forward_hip to unbreak ROCm (#32613) 2026-07-28 21:19:17 -07:00
Mick 9a03bebf13 docs(kimi-k3): clarify VLM compatibility (#32661) 2026-07-29 11:53:04 +08:00
Xiaojun(Robin) Zhang 1af0167493 [EPD][VLM] Fix Kimi-VL 2D encoder grids (#32104)
Signed-off-by: Xiaojun Zhang <zhangxiaojunhust@gmail.com>
2026-07-29 11:46:17 +08:00
Junlin Wu d6fcfe02d6 🐛 [llm][npu][quant] Fix ModelSlim MXFP4 packed weight loading (#32013) 2026-07-29 11:34:41 +08:00
Yihao Wang 9ea964a535 [diffusion] fix: per-shard FP8 scale shape for single-GPU fused linears (#32157) 2026-07-28 20:28:01 -07:00
Baizhou Zhang b21cc8eb9b [misc] Update CodeOwner (#32717) 2026-07-28 19:55:14 -07:00
Liangsheng Yin 14bd315d6e [Refactor] Remove dead allocator backup_state / restore_state (#32709) 2026-07-28 19:49:47 -07:00
monkeyLoveding dac4325c0e sgl-kernel-npu tag update to 2026.7.27 (#32596) 2026-07-29 10:22:13 +08:00
339bef7fad [MLX] Fix overlap-loop request bookkeeping and graceful shutdown (#32447)
Co-authored-by: xiaolin2004 <uwowmhdjwpwpwdhwkw@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
2026-07-28 19:04:53 -07:00
580b1acbe6 [MLX] Move fused swiglu tests to test/registered so CI collects them (#32448)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
2026-07-28 19:04:24 -07:00
Leon GaoandAndrew Gu ee678910f7 [Kernel] Skip KV writes to reserved padding slots (#32477)
Co-authored-by: Andrew Gu <andrew@thinkingmachines.ai>
2026-07-29 09:58:18 +08:00
gjsheu d86492fea0 [NPU] adapt dflash v2 on npu (#31739) 2026-07-29 09:39:19 +08:00
amote-i cb12a1547b [NPU] [DOC] update supported features on ascend npu (#32647) 2026-07-29 09:05:21 +08:00
Lianmin Zheng 16a52bff23 [Refactor] Move sampling tokenizer validation helper (#32694) 2026-07-28 16:48:03 -07:00
YAMYandLee Nau 86ee545388 docs(cookbook): update Kimi-K3 GB200 recipes from measured 4x4 runs (#32592)
Co-authored-by: Lee Nau <lnau@nvidia.com>
2026-07-28 16:26:40 -07:00
Lianmin Zheng 9ca4023b13 [Core] Clean up array-like msgspec structs (#32688) 2026-07-28 16:25:22 -07:00
Mick 70ea37e7e0 vlm: reject moss vision metadata mismatches (#31957) 2026-07-29 07:09:54 +08:00
Xiaoyu Zhang c9947b087b Enable multimodal prefill BCG for VL and audio models (#30872) 2026-07-29 06:47:40 +08:00
Liangsheng Yin 85618cc798 docs: update sglang cookbook (#32654) 2026-07-28 15:33:24 -07:00
Xiaoyu Zhang 7778dd23ea [diffusion] refactor: remove stale kernels and dead code (#32651) 2026-07-29 06:23:23 +08:00
Void 7f438a6031 feat: SM120 (Blackwell Desktop) support for GLM-5.1 inference (#26928) 2026-07-28 14:52:34 -07:00
Qiaolin YuandZijie Xia 9c0dbf508f [cookbook] add inkling dspark command (#32465)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
2026-07-28 14:33:38 -07:00
Ethan (Yusheng) Su 0a49226d19 [LoRA] 1/n Per-rank tensor serialization for load_lora_adapter_from_tensors under dp_size > 1 (#32580) 2026-07-28 14:28:56 -07:00
Rain Jiang d943636a48 support regex that compatible with python re lib however apply more l… (#32676) 2026-07-28 14:25:31 -07:00
YAMY dd67452b4f [Cleanup] Move mamba-max-states-per-path validation into _handle_mamba_backend (#32502) 2026-07-28 14:21:21 -07:00
Qiaolin Yu b8b9f3c8f5 [misc] update CI_PERMISSIONS.json (#32679) 2026-07-28 14:12:29 -07:00
paulzhang-tmandClaude Fable 5 4e5a05148a [FullCG] Support chunked cached-prefix prefill (#30825)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-28 11:20:25 -07:00
IvanShan177andClaude Opus 4.8 1eee8fbdcc [PD] Drain NIXL completion notifications before enforcing the WaitingForInput timeout (#32267)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-29 00:20:03 +08:00
Xinyuan TongandFAN YUCHEN ee236086db Fix invalid escape warnings in tool parsers (#28370)
Co-authored-by: FAN YUCHEN <2994114386@qq.com>
2026-07-28 23:31:47 +08:00
Mick 84cdfde5b2 [diffusion] fix: fix diffusion output stability on mps (#30017) 2026-07-28 21:55:03 +08:00
32c30c0f96 Return 400 instead of 500 for unfetchable or unparseable multimodal inputs (#31417)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-07-28 05:23:42 -07:00
Mick 161fffedfc docs: clarify diffusion stage reuse guidance (#32639) 2026-07-28 19:52:52 +08:00
Mick 75017c3fa0 [diffusion] fix: keep fused qk-norm-rope out of dynamo tracing (#31849) 2026-07-28 19:51:00 +08:00
Mick a24906a091 [diffusion] feat: add dynamic cuDNN SDPA attention backend (#30090) 2026-07-28 19:50:24 +08:00
Talantan1102 5558dbad00 [NPU] Optimize DeepSeek-V4 performance (#31931) 2026-07-28 19:45:46 +08:00
James LiuandClaude Opus 4.8 51397af885 Pack aux hidden states into a preallocated buffer (#28956)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-28 04:37:18 -07:00
4fe8f5218d [AMD] Add Kimi K3 ROCm 7.2 nightly image (#32643)
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-07-28 18:45:23 +08:00
Xiaoyu Zhang 9cffc2ba52 [Kernel] Remove unused implementations and stale registry entries (#32636) 2026-07-28 18:12:10 +08:00
hjzhangandhjzhang dde03d7c4a [JIT] Restore the previous division behavior in per-token group quantization (#32616)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
2026-07-28 17:56:36 +08:00
YC Yen-Ching Tsengandbingxche 2b6e01c673 [AMD] Run AITER Scout on Saturdays (#32632)
Co-authored-by: bingxche <bingxche@amd.com>
2026-07-28 16:56:51 +08:00
Zhangheng 60d6914f17 [UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484) 2026-07-28 16:28:21 +08:00
Xinyuan Tongandliyucheng09 fc8b328f5c [Model] Support standalone text-only Qwen3.5 checkpoints (#32401)
Co-authored-by: liyucheng09 <liyucheng09@gmail.com>
2026-07-28 14:08:39 +08:00
Alex Nails ec4a7fa2b7 codeowners update (#32608) 2026-07-27 21:21:20 -07:00
Yuan Luoandluoyuan.luo d9cf7b0a8b [MTP] Cut spec-v2 host-seam overhead in hybrid-linear MTP decode (#32219)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-07-28 11:38:33 +08:00
zijiexiaandClaude Opus 5 b79388f338 docs(cookbook): mark every Kimi-K3 cell in-progress; land Playground "Switch base" on the configurator (#32586)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-07-27 18:59:57 -07:00
longxin9715 356c11d5d9 [Fix] --mm-process-config crash when video config contains (#30260) 2026-07-28 09:24:40 +08:00
sglang-botandsglang-bot edc0e5489f docs: sync LMSYS SGLang blog cards (#32590)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-07-27 18:00:29 -07:00
Lianmin Zhengandcctry c19a333944 [mm] Handle per-item embeddings in cache misses (#32498)
Co-authored-by: cctry <cctry@meta.com>
2026-07-27 17:16:17 -07:00
Caio RochaandCheng Wan 5a46e16f01 [Fix] Enable graph capture and MSCCL++ for attention TP groups (#31629)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-07-27 15:56:41 -07:00