Colin Z
|
875dd41e6f
|
[AMD] Fix Load and Inference of MLA models with Quark PTPC FP8 attention on ROCm (#28734)
|
2026-09-29 11:20:10 -07:00 |
|
 Carrie ChenandBrayden Zhong
|
0e586fd12d
|
fuse shared experts with routed experts in MegaMoE's DeepGEMM (#39313)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-09-29 17:25:10 +08:00 |
|
Cheng Wan
|
49e7bd179d
|
[Refactor] Group layer boundary unit tests (#41556)
|
2026-09-28 20:18:08 -07:00 |
|
Cheng Wan
|
de9f850b36
|
[Refactor] Rename the module to layer_boundary (#41555)
|
2026-09-28 20:17:50 -07:00 |
|
Cheng Wan
|
701213c867
|
[Refactor] Retire the layer facade and simplify boundary internals (#41554)
|
2026-09-28 20:17:33 -07:00 |
|
Cheng Wan
|
9b89b96230
|
[Refactor] Migrate specialized decoder and overlap boundaries (#41553)
|
2026-09-28 20:17:17 -07:00 |
|
Cheng Wan
|
49b5e76e45
|
[Refactor] Construct independent decoder stage boundaries (#41552)
|
2026-09-28 20:17:00 -07:00 |
|
Cheng Wan
|
acffb0d20d
|
[Refactor] Select reduction fusion at the consumer (#41551)
|
2026-09-28 20:16:44 -07:00 |
|
Cheng Wan
|
cb1fa3c399
|
[Refactor] Capture auxiliary states at residual reads (#41550)
|
2026-09-28 20:16:26 -07:00 |
|
Cheng Wan
|
42f58b4da7
|
[Refactor] Carry residual state across stage boundaries (#41549)
|
2026-09-28 20:15:03 -07:00 |
|
Cheng Wan
|
6f72cc3b64
|
[Refactor] Centralize decoder output access (#41548)
|
2026-09-28 20:14:04 -07:00 |
|
Cheng Wan
|
0a8ca85565
|
[Refactor] Group communicator fusion and CP adapters (#41547)
|
2026-09-28 20:10:50 -07:00 |
|
   
|
79cafec013
|
[Model] Add IQuest Q1 support and MTP draft (#41590)
Co-authored-by: zelong huang <yzhu@ubiquant.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zelong518 <zelonghuang05@gmail.com>
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com>
|
2026-09-28 17:21:31 -07:00 |
|
  
|
7889fbab9a
|
[PD] Keep EAGLE DP graph and token metadata consistent (#32196)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-09-28 17:15:51 -07:00 |
|
 Raiden MakotoandRaiden-Makoto
|
fa443412c5
|
[AMD] [GLM5] Fuse shared expert into AITER MoE on gfx950 (#41161)
Signed-off-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
|
2026-09-28 03:40:09 -07:00 |
|
Cheng Wan
|
81f27fb3a7
|
[Refactor] Replace LayerScatterModes with LayerFacts and remove ScatterMode (#41443)
|
2026-09-27 16:56:11 -07:00 |
|
Cheng Wan
|
06d012eaca
|
[Refactor] Give a layer its CuTe DSL kernels at construction instead of a subclass (#41442)
|
2026-09-27 16:55:47 -07:00 |
|
Cheng Wan
|
341d5273bd
|
[Refactor] Build the boundary into any stage with one construction (#41441)
|
2026-09-27 16:55:25 -07:00 |
|
Cheng Wan
|
644014bc98
|
[Refactor] Declare each stage's residual read and update, and give each stage its own entry (#41440)
|
2026-09-27 16:55:04 -07:00 |
|
Cheng Wan
|
0e907b755d
|
[Refactor] Split the layer communicator into a package (move only) (#41439)
|
2026-09-27 16:54:41 -07:00 |
|
Cheng Wan
|
427c9e05c1
|
[Refactor] Choose every layer's boundaries from declarations and remove the scatter-mode selection (#41438)
|
2026-09-27 16:54:18 -07:00 |
|
Cheng Wan
|
0971450c16
|
[Fix] LongCat-Flash under attention DP: branch and merge the dense FFNs through the communicators (#41436)
|
2026-09-27 16:53:36 -07:00 |
|
Cheng Wan
|
4fac02fe5d
|
[Refactor] Choose MoE layers' boundaries from declarations when moe_dp_size equals attn_cp_size (#41435)
|
2026-09-27 16:53:15 -07:00 |
|
Cheng Wan
|
ecb8e9fc8f
|
[Refactor] Falcon-H1: complete the FFN's sum through ffn_exit (#41434)
|
2026-09-27 16:52:53 -07:00 |
|
Cheng Wan
|
31329c222c
|
[Fix] Run MoE layers under attention DP and GQA prefill CP on the declared DP × CP gather (#41432)
|
2026-09-27 16:52:10 -07:00 |
|
Cheng Wan
|
f0ecf15c84
|
[Refactor] Move CuTe DSL-fused layers onto the declared boundaries and FFN-exit kernel entries (#41431)
|
2026-09-27 16:51:48 -07:00 |
|
Cheng Wan
|
8c43c667cb
|
[Refactor] Nemotron-H: build each layer's boundaries from its stage and the previous one (#41430)
|
2026-09-27 16:51:27 -07:00 |
|
Cheng Wan
|
6f370c3bcd
|
[Refactor] Build each decoder boundary from the declarations of its two sides (#41429)
|
2026-09-27 16:51:05 -07:00 |
|
Cheng Wan
|
2e7f0bb28c
|
[Refactor] Publish the LoRA token layout from the batch's FFN input rows (#41428)
|
2026-09-27 16:50:43 -07:00 |
|
Cheng Wan
|
c289656434
|
[Refactor] Let the MoE declare whether its skipped reduction is one TP all-reduce (#41427)
|
2026-09-27 16:50:23 -07:00 |
|
Cheng Wan
|
deaa7f1463
|
[Refactor] Run two-batch-overlap layers on the declared boundaries (#41426)
|
2026-09-27 16:50:03 -07:00 |
|
Cheng Wan
|
6f2d2437b6
|
[Refactor] Run MHC layers on the shared boundary steps with MHC's residual operations (#41425)
|
2026-09-27 16:49:42 -07:00 |
|
Cheng Wan
|
f5ae989a0e
|
[Refactor] Choose fully-DP dense and DSA / MLA prefill CP layers' steps from declarations (#41424)
|
2026-09-27 16:49:21 -07:00 |
|
Cheng Wan
|
cad9eaf27d
|
[Fix] Gather a dense FFN's input across attention DP and CP in one DP sum (#41423)
|
2026-09-27 16:48:59 -07:00 |
|
Cheng Wan
|
1c919e401d
|
[Fix] Keep one copy of CP-replicated rows in the DP gather (#41422)
|
2026-09-27 16:48:39 -07:00 |
|
Cheng Wan
|
7a833ad0a2
|
[Refactor] Choose a GQA prefill CP extend's steps from declarations (#41421)
|
2026-09-27 16:48:17 -07:00 |
|
Cheng Wan
|
380a4d0332
|
[Refactor] Run every batch of a layer from one BoundarySteps (#41420)
|
2026-09-27 16:47:55 -07:00 |
|
Cheng Wan
|
9f87d28db6
|
[Refactor] Choose the LayerNorm SP region's and input-scattered batches' steps from declarations (#41419)
|
2026-09-27 16:47:32 -07:00 |
|
Cheng Wan
|
846181f1c4
|
[Refactor] Give the fused prepare_mlp kernels an explicit contract (#41418)
|
2026-09-27 16:47:11 -07:00 |
|
Cheng Wan
|
446d181e23
|
[Refactor] Choose the boundaries of plain-TP dense layers and MoE layers from declarations (#41417)
|
2026-09-27 16:46:50 -07:00 |
|
 Yuan Luoandluoyuan.luo
|
c311bc9611
|
[VLM] Introduce FA4 into ViT for SM100/SM103 (#41344)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-27 23:04:21 +08:00 |
|
Cheng Wan
|
bd37e7f513
|
[Refactor] Choose a dense layer's boundaries under attention DP from both sides' declarations (#41257)
|
2026-09-26 02:41:43 -07:00 |
|
Cheng Wan
|
d3fcf8997c
|
[Refactor] Run the LayerNorm SP region's boundary steps in the communicator itself (#41255)
|
2026-09-26 02:40:34 -07:00 |
|
Cheng Wan
|
35b369ebba
|
[Refactor] Declare at construction the layers whose FFN completes its own reduction (#41254)
|
2026-09-26 02:39:58 -07:00 |
|
Cheng Wan
|
c081d4aacc
|
[Refactor] Drive an FFN exit's flags and its completion from one selection (#41253)
|
2026-09-26 02:39:25 -07:00 |
|
Cheng Wan
|
8fc3ce48da
|
[Refactor] Choose prepare_attn / prepare_mlp steps and fused kernels at construction (#41252)
|
2026-09-26 02:38:03 -07:00 |
|
 
|
8772916e06
|
[DSv4.1] Move the low-ratio index top-k into dsv4/low_ratio_indexer (#41125)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-25 22:22:57 -07:00 |
|
Xiaoyu Zhang
|
38ec649048
|
[Refactor] Restore logical kernel groups and test organization (#41243)
|
2026-09-26 12:30:44 +08:00 |
|
Liangsheng Yin
|
f35ec18d8b
|
[Test] Remove more unit tests that mirror implementation or never run in CI (#41297)
|
2026-09-25 19:22:14 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
63d320c723
|
[DSA] Chunk the kpool indexer MQA logits by query rows under a free-memory budget (#40854)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-25 19:13:13 -07:00 |
|