Commit Graph
15 Commits
Author SHA1 Message Date
xutizhou eb31b5310c Support Waterfill with MegaMoE backend (#27350) 2026-07-13 03:56:46 -07:00
xutizhou d364cd8ead Support DSV4 shared expert fusion for DeepEP and MegaMOE (#27349) 2026-07-02 23:18:25 -07:00
xutizhou 29591594f5 Support Waterfill with dynamic EPLB (#27150) 2026-06-05 16:01:16 -07:00
xutizhou ac16dbf412 docs: add DeepSeek-V4 EPLB Waterfill tips (#27049) 2026-06-03 00:37:45 -07:00
xutizhou 59cad671e2 Support DeepSeek V4 DeepEP Waterfill (#25391) 2026-05-25 21:04:26 -07:00
xutizhou e8608bdcb5 Fix EPLB redundant experts with shared expert fusion and Waterfill (#25367) 2026-05-20 22:58:08 -07:00
xutizhou 6a21dd20b1 Fix EPLB mapping for TopK paths (#25285) 2026-05-17 23:26:04 -07:00
c701a08765 feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Co-authored-by: root <aichenf@nvidia.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-13 19:23:41 -07:00
xutizhou 3cb3f7c018 fix: EPLB dispatch OOB when shared experts fusion enabled under DeepEP (#22525) 2026-04-14 02:33:27 -07:00
57ffc55fb6 feat: [1/2] [DeepEP] Fuse shared expert into MoE dispatch under EP (#20089)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: AichenF <aichenf@nvidia.com>
2026-04-09 01:48:28 -07:00
c6377bbbca feat(gdn): add FlashInfer K-last SSM layout support for GDN prefill and decode for Hopper (#18361)
Co-authored-by: HongliMi <106042350+HongliMi@users.noreply.github.com>
Co-authored-by: xiaozhoupy <181108106+zhou9402@users.noreply.github.com>
Co-authored-by: Jinyan Chen <93358689+liz-badada@users.noreply.github.com>
Co-authored-by: Avery Yingyi Huang <averyh@nvidia.com>
Co-authored-by: eigen <52445717+yyihuang@users.noreply.github.com>
2026-03-03 20:30:48 +08:00
xutizhou a1b39c1c26 Perf/fuse mamba state scatter mtp verify (#18088) 2026-02-25 15:40:55 +08:00
506c4928f5 feat: integrate deepgemm into EPMoE (#6821)
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2025-06-23 01:38:58 -07:00
xutizhou e3b8a72291 [fix] illegal memory in _fwd_kernel_ep_scatter_2 and _fwd_kernel_ep_gather (#6348) 2025-05-17 17:01:42 -07:00
xutizhouandCheng Wan c2bd094d6e Optimize Permute Kernel in DeepEP (#4643)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2025-03-22 14:30:34 -07:00