Commit Graph
12771 Commits
Author SHA1 Message Date
54eb2904a4 minor: docs include mac installation (#25178)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-05-18 15:48:59 +08:00
billishyahaoandBingxu Chen 7adb37bb52 [AMD] fix moriep unittest oom on mi300x ci (#25301)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-05-18 00:42:11 -07:00
Xia WeiwenandMa Mingfei 8d5ed330cc [XPU] Enable qwen3.5 on XPU (#21668)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 14:59:19 +08:00
YAMY 1f9eda4ea1 Use DeepGEMM BF16 for unquantized DeepEP LL MoE (#25540) 2026-05-17 23:33:23 -07:00
xutizhou 6a21dd20b1 Fix EPLB mapping for TopK paths (#25285) 2026-05-17 23:26:04 -07:00
maocheng23 6ccc5b807d Optimize detokenization without HF decode kwargs (#25309) 2026-05-17 20:37:36 -07:00
Zhonghua Deng 784fe7e99b feat(mimo-v2): add EPD disaggregation support (#24931) 2026-05-18 10:33:16 +08:00
Liangsheng Yin 43e133208a Quiet test_bs_1_speed CI log (#25548) 2026-05-17 19:29:44 -07:00
a080358cac [Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-18 04:36:42 +03:00
miamiaoxyzandMa Mingfei 5147de26e4 Fix AMX GQA extend attention (#25180)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-05-18 09:30:02 +08:00
chenxu214 2a357071ec [NPU]fix:NPUMLATokenToKVPool object has no attribute "kv_buffer" (#25249) 2026-05-18 09:09:28 +08:00
Liangsheng Yin 58ece60703 refactor: remove ModelWorkerBatch indirection (#25516) 2026-05-17 18:05:39 -07:00
jy-song-hub b3803164cb [diffusion] fix: fix unipc device placement + flowunipc sigma_min crash (#23294) 2026-05-18 09:01:07 +08:00
Shu WangandKhoa Pham c67b287056 Enable trtllm_mha as gemma4 default attn backend. (#25006)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-05-17 14:58:12 -07:00
Cheng WanandClaude Opus 4.7 7158a255eb [MoE Refactor] Migrate flashinfer_cutedsl + DeepEP to MoeRunner (#25525)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-17 14:48:17 -07:00
Mick 89e501c5a8 [diffusion] CI: tighten selected perf baselines (#25510) 2026-05-17 23:35:59 +08:00
Qingfu WenandR0CKSTAR 3bf7e346fc [MUSA][Diffusion] Improve wan model inference speed using torch.compile (#25256)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
2026-05-17 22:10:24 +08:00
Mick eccfd6dea7 [diffusion] feat: configure encoder as layerwise-offload by default (#25517) 2026-05-17 20:47:48 +08:00
Cheng WanandClaude Opus 4.7 be3c425788 [MoE] Unify DeepEPMoE+MoriEPMoE through AITER MoeRunner pre/post-permute (#23760)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-17 02:25:52 -07:00
Cheng Wan 568ba7216a Fix logging for inplace setting in the flashInfer-trtllm backend (#25522) 2026-05-17 02:20:14 -07:00
Yongji WuandZhangheng e547f3f804 fix(unified radix cache w/ hicache): backup ancestor nodes before leaf in write_back eviction (#24585)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-05-17 15:58:46 +08:00
Bishwo Adhikari 46e0f5007d Fix image (random multimodal) dataset token statistics (#22371) 2026-05-16 23:12:03 -07:00
52875ab6f4 [AMD][CI] Register Eagle constrained decoding test (#25260)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 23:02:35 -07:00
MichaelandHAI 4ef9bad223 [AMD] ci: register 5 framework tests to run on AMD CI (#25208)
Co-authored-by: HAI <hixiao@gmail.com>
2026-05-16 22:56:57 -07:00
Mick c1d9e37a52 [diffusion] feat: add memory-aware component load order (#25457) 2026-05-17 13:22:55 +08:00
Baizhou Zhang 6dcacb1159 [Doc] Fix several places for dpsk v4 cookbook (#25506) 2026-05-16 21:54:15 -07:00
Cheng Wan 229cadec04 Update logging for inplace setting in MoE layer (#25499) 2026-05-16 17:12:11 -07:00
Cheng Wan 0c017db916 Update kl_div_thres to 0.02 in swa_radix_cache (#25497) 2026-05-16 16:43:12 -07:00
Qiaolin Yu 9869ef0849 Revert "[attn backend] avoid initing parent class's workspace buffer" (#25488) 2026-05-16 13:05:42 -07:00
Yuhao Yang 57eb5bdaf6 [Doc] DSV4 cookbook: clean up env vars, add MegaMoE toggle, unify docker image (#25412) 2026-05-16 11:28:05 -07:00
zijiexia 9f26697d6a [Docs] Update DeepSeek V4 cookbook to use the latest docker image (#25410) 2026-05-16 11:17:51 -07:00
Zheng Luo 435ea41cf0 Delegate ModelExpress loading to package (#24723)
Signed-off-by: Zheng Luo <zheluo@nvidia.com>
2026-05-16 11:16:44 -07:00
Zhangheng 0be539024f [BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477) 2026-05-16 23:50:01 +08:00
Xiaoyu ZhangandCodex 2fc217df4d [codex] Split diffusion quant CI coverage (#24599)
Co-authored-by: Codex <codex@example.com>
2026-05-16 22:05:02 +08:00
Chi McIsaac 596b45b373 [diffusion] fix: change default qwen-image vae precision to bf16 (#25411) 2026-05-16 21:55:31 +08:00
Xiaoyu Zhang 93bacc25ed [codex] Optimize LTX2 split rotary kernel (#24732) 2026-05-16 20:58:38 +08:00
ybyang 0f50ed86c9 fix(pd): fix kv pools without end_layer (#25476) 2026-05-16 19:49:26 +08:00
Liangsheng Yin 90d3d42ac1 pr-states: workflow_dispatch refresh on slash cmds (#25475) 2026-05-16 03:34:52 -07:00
Qiaolin Yu 2f81718773 [attn backend] avoid initing parent class's workspace buffer (#25321) 2026-05-16 03:30:33 -07:00
Liangsheng Yin aec4022e58 [Spec] Clean up draft-window-size handling; extract spec arg setup to arg_groups (#25424) 2026-05-16 03:23:48 -07:00
Liangsheng Yin d1eb472a7a fix(overlap): skip empty future interval for dp attention idle ranks (#25473) 2026-05-16 02:08:01 -07:00
Mick 7f37ffae9d [diffusion] CI: fix nightly CI (#25241) 2026-05-16 16:55:30 +08:00
Baizhou Zhang af26b71ae8 [Misc] Update release branch cut script (#25468) 2026-05-16 00:51:48 -07:00
Yuhao Yang b2c6db0cc4 [MoE] Decouple Mega MoE from DeepEP backend (#25406) 2026-05-16 00:18:43 -07:00
162540e0a8 feat: add Pipeline Parallelism (PP) and PD support for DeepSeek-V4 (#24704)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: xuyongfei <xuyongfei.xyf@antgroup.com>
2026-05-15 22:54:32 -07:00
JoeLee314andJoeLee314 bda01d2435 [Disagg] Fix MegaMoE topk_ids dtype mismatch and FakeKVManager missing kv_args (#25380)
Co-authored-by: JoeLee314 <liqichao@baidu.com>
2026-05-15 22:46:44 -07:00
Jimmy Shong daade9cc00 [Fix] Probe speculative draft config via sglang get_config (#25428) 2026-05-15 22:01:44 -07:00
Mick 416fdbbb3d [diffusion] feat: generalize layerwise offload residency mixin to all components (#24593) 2026-05-16 11:44:46 +08:00
Jimmy Shong a741d0cc56 [CI] Lower mem-fraction-static for GLM-5.1 FP8 8-GPU test to 0.85 (#25453) 2026-05-15 20:14:47 -07:00
Sam Shleifer ce2506e1c6 Deprecate record_nolora_graph dual MoE CUDA graph capture (#24314) 2026-05-15 19:20:58 -07:00