Commit Graph
18623 Commits
Author SHA1 Message Date
11e661fd45 [Fix] Don't free the multi-CTAs KV counter the decode graphs captured (#39175)
Co-authored-by: mmangkad <mohammad.angkad@radixark.ai>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 12:58:48 -07:00
Cheng Wan 44bdf225d8 Fix lint failure from MXFP8 reserved-slot test location (#40618) 2026-09-21 12:31:11 -07:00
Cheng Wan bccf691b22 Bringing the parallel runtime up becomes a phase, not a side effect (#40345) 2026-09-21 12:29:50 -07:00
Cheng Wan 1d3243d05f Take the parallel getters off the package's public surface (#40344) 2026-09-21 12:27:50 -07:00
Cheng Wan 970e946e4f Retire the per-runner parallel record (#40343) 2026-09-21 12:26:40 -07:00
Cheng Wan 73f071db52 Deprecate the parallel getters the context answers, and ratchet them shut (#40342) 2026-09-21 12:25:32 -07:00
Cheng Wan 65be3fa71a A runner and the objects it builds freeze the placement they describe (#40341) 2026-09-21 12:24:17 -07:00
Cheng Wan 2d0e94e3a3 Check the topology identities where the layout is written, and build at the published widths (#40340) 2026-09-21 12:22:59 -07:00
ishandhananiandKangyan-Zhou d5fdab7022 chore: add NIXL owners and CI access (#40602)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-09-21 12:21:30 -07:00
Cheng Wan 0db1a93adb State the draft's whole topology in its scope, and read the rest from the context (#40339) 2026-09-21 12:19:38 -07:00
ae7a516ba7 feat: use XGrammar V4.1 DSML parameter constraints (#39026)
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-21 12:12:28 -07:00
Faradawn Yang f0940fe3a6 Update DeepSeek-V4 Pro for B200 FP4 agentic PD disaggregation (#40610)
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
2026-09-21 12:10:03 -07:00
jacky.cheng 90b3f8544c [AMD] Use Triton softmax routing for Qwen3.5 on gfx950 (#39986) 2026-09-21 12:02:29 -07:00
ronnie_zheng f702a0be29 Revert "[Diffusion] migrate the whole _register_configs from registry.py to the model own config file" (#40611) 2026-09-21 21:05:19 +03:00
Bingxu Chen 632919e498 [AMD] Fix DeepSeek-R1-MXFP4 accuracy with AITER FP8 (#37762) 2026-09-21 10:51:37 -07:00
ronnie_zheng e6931ca889 [Diffusion] migrate the whole _register_configs from registry.py to the model own config file (#40475) 2026-09-21 20:45:53 +03:00
cctry 7a6191c4b9 Preallocate HiCache MHA staging before post-capture KV sizing (#40256) 2026-09-21 10:44:29 -07:00
cctry 7ad55e4386 [HiCache] TMA-staged host<->device KV transfer kernel (sm_90+) (#40278) 2026-09-21 10:38:23 -07:00
William Hu 0cb37c018c [KDA] Enable ReplaySSM for GLM-5.3 Flash (#40517) 2026-09-21 10:34:08 -07:00
Eric.Chin.AMDandThomas Wang 3c71bb018a [AMD] Enable GLM DSA prefill top-k to the v2 kernel (#37889)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-09-21 10:31:07 -07:00
5a6a1bb883 [mxfp8-kv] Skip writes to the reserved CUDA-graph padding slot (#35351)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
2026-09-22 01:21:25 +08:00
Kan WuandShangming Cai 008470abd8 [sgl-router] Bound streaming lifetimes and release guards on idle disconnect (#40391)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-09-21 10:07:07 -07:00
Liangsheng Yin 800613a74b [Test] Split the serving perf tests by topic into basic_perf/ and route their thresholds through a kit (#40505) 2026-09-21 10:05:57 -07:00
Sage 14e9c40a72 [Observability] Expose python/rust frontend identity in /server_info (#39993)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
2026-09-21 23:32:52 +08:00
50ec9702d0 [diffusion] docs: update ComfyUI sections, trimmed examples, and the RTX 5090 DiT-resident recipe (1.42x) for Qwen-Image-2.1 cookbook (#40573)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 21:23:11 +08:00
iridiumine 69d1e5cfe0 [Docs][NPU] Add MiMo-V2.5-Pro FP4 DFlash best practice on Ascend NPU (#40577) 2026-09-21 20:32:52 +08:00
amote-i b410010087 [NPU] [DOC] Add kimi k3 cookbook for 950PR/DT Series (#40575) 2026-09-21 20:18:03 +08:00
Kan Wu 0f6761b54f [sgl-router] Add SGLang-compatible DeepSeek V4.1 Flash rendering (#40532) 2026-09-21 18:35:09 +08:00
0abb251a20 [sgl-router] Match DeepSeek V4 rendering to SGLang (#40530)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-09-21 17:56:41 +08:00
Kan WuandClaude Fable 5.1 2016f5e7a1 [sgl-router] Add Kimi-K3 rendering with SGLang parity (#40390)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 17:38:49 +08:00
Zhaoyi Li b86a30afba [AMD][DI][CI] Add a SPUR cluster profile to AMD DI CI (#40113) 2026-09-21 01:56:46 -07:00
hanwlax 8faa2d6731 [NPU][Diffusion] Disable loading latency checks in Ascend fixtures (#40544) 2026-09-21 16:56:35 +08:00
630b1ef322 [sgl-router] Fix reorg admission proxy test build after BucketResolver::new (#40537)
Co-authored-by: Kan Wu <wukanustc@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 16:42:29 +08:00
Mohammad Miadh AngkadandMohammad Angkad 8d08dfdab7 [Fix] Add gigachat35 to the tool-call and reasoning parser name lists (#40554)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-21 16:34:43 +08:00
Kan WuandClaude Fable 5.1 a9871012ac [sgl-router] refactor - generalized admission policy definitions (#40271)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 16:26:30 +08:00
Shangming Cai 70b5b03e78 [NPU][CI] Fix paths-filter negation that makes every PR run the NPU tier (#40549) 2026-09-21 16:07:27 +08:00
ashwini rathi c2f860af1c [ci][xpu] Record device time in the multimodal_gen perf lane (#39956) 2026-09-21 15:39:29 +08:00
b63f8416b3 [Feature] Gigachat 3.5 support (#29189)
Co-authored-by: Stanislav Petrov <stapetrov@sberbank.ru>
Co-authored-by: Viacheslav Barinov <vvadbarinov@sberbank.ru>
Co-authored-by: Viacheslav <viacheslav.teh@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-09-21 14:37:55 +08:00
kpjeeja b54d5b7c7b disaggregation: Fix FakeKVSender queue accumulation (#28652)
Signed-off-by: KP, Jeeja <jeeja.kp@intel.com>
2026-09-21 14:27:05 +08:00
skyler-apdx f5f3c38aad [Fix] Preserve YaRN scaling when extending rotary caches (#38786) 2026-09-21 14:14:05 +08:00
AMRUTHA MandMa Mingfei d20cd9d77f [XPU]Enable HiSparse hierarchical sparse KV cache on Intel XPU (#32792)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-09-21 14:07:49 +08:00
Kan WuandClaude Fable 5.1 fcb080bd40 [sgl-router] refactor - cache-aware policy (#40366)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-21 13:53:57 +08:00
Lianmin Zheng 11ecdbf39f Clean up startup logging and streamline log audits (#40526) 2026-09-20 22:28:35 -07:00
ashwini rathi 292e3ccc0c [ci][xpu] Re-seed the wan2_1_t2v_1.3b perf baseline on Arc Pro B60 (#39955) 2026-09-21 13:04:35 +08:00
ZiruandNiu Ziru 1da8ac10e1 Update to the cookbook for XPU-supported models (#33649)
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
2026-09-20 20:26:09 -07:00
jianzhao-xu 62ba964848 Fix: post-load staging regression breaks offload meta/sharded_gpu modes (#38779) 2026-09-21 11:19:07 +08:00
Xueshen Liu ab03a8e7eb [Perf] Fork-safe import: no CUDA context at import time, lighter argument parsing (#40201) 2026-09-21 10:48:35 +08:00
zhaozx-cn 176dbcb85d [npu]add chunk gdn kernel and unify ssm state layout for ascend gdn backend (#36187) 2026-09-21 09:51:19 +08:00
MickandMick Qian 6ad78f2281 [diffusion] docs: add verified DGX Spark recipe for Qwen-Image 2.1 (#40487)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-21 08:49:35 +08:00
WenhaoZhang b912db67ea [diffusion] fix: keep Qwen-Image 2.1 prefix KV per layer under Cache-DiT (#40472) 2026-09-21 08:48:31 +08:00