Jiacong Fang
|
bd78095030
|
[Fix] Add name mapping in load_weights of nvidia/LocateAnything-3B (#41059)
|
2026-09-29 00:38:58 -07:00 |
|
Cheng Wan
|
49e7bd179d
|
[Refactor] Group layer boundary unit tests (#41556)
|
2026-09-28 20:18:08 -07:00 |
|
Cheng Wan
|
de9f850b36
|
[Refactor] Rename the module to layer_boundary (#41555)
|
2026-09-28 20:17:50 -07:00 |
|
Cheng Wan
|
701213c867
|
[Refactor] Retire the layer facade and simplify boundary internals (#41554)
|
2026-09-28 20:17:33 -07:00 |
|
Cheng Wan
|
9b89b96230
|
[Refactor] Migrate specialized decoder and overlap boundaries (#41553)
|
2026-09-28 20:17:17 -07:00 |
|
Cheng Wan
|
49b5e76e45
|
[Refactor] Construct independent decoder stage boundaries (#41552)
|
2026-09-28 20:17:00 -07:00 |
|
Cheng Wan
|
acffb0d20d
|
[Refactor] Select reduction fusion at the consumer (#41551)
|
2026-09-28 20:16:44 -07:00 |
|
Cheng Wan
|
cb1fa3c399
|
[Refactor] Capture auxiliary states at residual reads (#41550)
|
2026-09-28 20:16:26 -07:00 |
|
Cheng Wan
|
42f58b4da7
|
[Refactor] Carry residual state across stage boundaries (#41549)
|
2026-09-28 20:15:03 -07:00 |
|
Cheng Wan
|
6f72cc3b64
|
[Refactor] Centralize decoder output access (#41548)
|
2026-09-28 20:14:04 -07:00 |
|
   
|
79cafec013
|
[Model] Add IQuest Q1 support and MTP draft (#41590)
Co-authored-by: zelong huang <yzhu@ubiquant.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zelong518 <zelonghuang05@gmail.com>
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com>
|
2026-09-28 17:21:31 -07:00 |
|
 Raiden MakotoandRaiden-Makoto
|
fa443412c5
|
[AMD] [GLM5] Fuse shared expert into AITER MoE on gfx950 (#41161)
Signed-off-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
|
2026-09-28 03:40:09 -07:00 |
|
Peng Wu
|
546bfa7221
|
[Kimi-K3] Merge fused_qkvg_proj into the loader-seeded packed_modules_mapping (#41164)
|
2026-09-28 16:46:11 +08:00 |
|
Cheng Wan
|
81f27fb3a7
|
[Refactor] Replace LayerScatterModes with LayerFacts and remove ScatterMode (#41443)
|
2026-09-27 16:56:11 -07:00 |
|
Cheng Wan
|
341d5273bd
|
[Refactor] Build the boundary into any stage with one construction (#41441)
|
2026-09-27 16:55:25 -07:00 |
|
Cheng Wan
|
644014bc98
|
[Refactor] Declare each stage's residual read and update, and give each stage its own entry (#41440)
|
2026-09-27 16:55:04 -07:00 |
|
Cheng Wan
|
0e907b755d
|
[Refactor] Split the layer communicator into a package (move only) (#41439)
|
2026-09-27 16:54:41 -07:00 |
|
Cheng Wan
|
55d2ee5546
|
[Refactor] Step-3.5: complete the dense MLP's sum through ffn_exit (#41437)
|
2026-09-27 16:53:57 -07:00 |
|
Cheng Wan
|
0971450c16
|
[Fix] LongCat-Flash under attention DP: branch and merge the dense FFNs through the communicators (#41436)
|
2026-09-27 16:53:36 -07:00 |
|
Cheng Wan
|
19eb56fa57
|
[Fix] Falcon-H1: count the Mamba mixer's output once under tensor parallelism (#41433)
|
2026-09-27 16:52:31 -07:00 |
|
Cheng Wan
|
8c43c667cb
|
[Refactor] Nemotron-H: build each layer's boundaries from its stage and the previous one (#41430)
|
2026-09-27 16:51:27 -07:00 |
|
Cheng Wan
|
6f370c3bcd
|
[Refactor] Build each decoder boundary from the declarations of its two sides (#41429)
|
2026-09-27 16:51:05 -07:00 |
|
Cheng Wan
|
2e7f0bb28c
|
[Refactor] Publish the LoRA token layout from the batch's FFN input rows (#41428)
|
2026-09-27 16:50:43 -07:00 |
|
Cheng Wan
|
6f2d2437b6
|
[Refactor] Run MHC layers on the shared boundary steps with MHC's residual operations (#41425)
|
2026-09-27 16:49:42 -07:00 |
|
Cheng Wan
|
7a833ad0a2
|
[Refactor] Choose a GQA prefill CP extend's steps from declarations (#41421)
|
2026-09-27 16:48:17 -07:00 |
|
Cheng Wan
|
380a4d0332
|
[Refactor] Run every batch of a layer from one BoundarySteps (#41420)
|
2026-09-27 16:47:55 -07:00 |
|
Cheng Wan
|
9f87d28db6
|
[Refactor] Choose the LayerNorm SP region's and input-scattered batches' steps from declarations (#41419)
|
2026-09-27 16:47:32 -07:00 |
|
Cheng Wan
|
bd37e7f513
|
[Refactor] Choose a dense layer's boundaries under attention DP from both sides' declarations (#41257)
|
2026-09-26 02:41:43 -07:00 |
|
Cheng Wan
|
35b369ebba
|
[Refactor] Declare at construction the layers whose FFN completes its own reduction (#41254)
|
2026-09-26 02:39:58 -07:00 |
|
Cheng Wan
|
c081d4aacc
|
[Refactor] Drive an FFN exit's flags and its completion from one selection (#41253)
|
2026-09-26 02:39:25 -07:00 |
|
Liangsheng Yin
|
f35ec18d8b
|
[Test] Remove more unit tests that mirror implementation or never run in CI (#41297)
|
2026-09-25 19:22:14 -07:00 |
|
Liangsheng Yin
|
1f6ce4b068
|
[Test] Remove unit tests that only mirror implementation or never run in CI (#41286)
|
2026-09-25 16:15:02 -07:00 |
|
 Erik WijmansandEthan Su
|
c421d16563
|
[sglang][lora] Support DP attention in LoRA backends (#36389)
Co-authored-by: Ethan (Yusheng) Su <yushengsu@radixark.ai>
|
2026-09-25 12:03:47 -10:00 |
|
 
|
0154f72b48
|
[ROCm][Bugfix] Keep quantization for mixed Quark Qwen3.5 MTP checkpoints (#39064)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-09-25 10:31:29 -07:00 |
|
Cheng Wan
|
3450d68d4e
|
[Refactor] Decide an FFN exit's completion once and declare the group it owes (#41200)
|
2026-09-25 01:50:35 -07:00 |
|
Cheng Wan
|
26a3214cda
|
[Refactor] Take a layer's last-layer fact from its scatter-mode plan (#41199)
|
2026-09-25 01:49:33 -07:00 |
|
Cheng Wan
|
b7f6d04a9a
|
[Refactor] Move Step-3.5, GLM5-Next, Dots3, MiniMax-M3 and Qwen3.5 onto ffn_exit (#41198)
|
2026-09-25 01:47:43 -07:00 |
|
Cheng Wan
|
963e9fb42d
|
[Refactor] Leave the FFN reduction to the next layer under attention DP (#41197)
|
2026-09-25 01:47:03 -07:00 |
|
Cheng Wan
|
9d7f44bdbb
|
[Refactor] Carry a deferred FFN all-reduce as UnreducedOutput and complete it in the next layer without the fused kernel (#41196)
|
2026-09-25 01:46:03 -07:00 |
|
Cheng Wan
|
1409f469be
|
[Fix] Plan NextN / MTP draft layers as one-layer models and fix the Bailing V2 NextN draft (#41194)
|
2026-09-25 01:43:55 -07:00 |
|
 
|
e0b4d66733
|
[Perf] Lazy-load built-in model definitions and nixl_ep at startup (#41061)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-09-24 20:29:33 -07:00 |
|
Cheng Wan
|
7c9f74c6e1
|
[Fix] Step-3.5: stop dense layers from summing their output twice under DP attention (#41082)
|
2026-09-24 12:15:58 -07:00 |
|
Cheng Wan
|
5df1667077
|
[Refactor] Pass each layer stack's output through a communicator exit (#41081)
|
2026-09-24 12:15:07 -07:00 |
|
 Cheng WanandMick Qian
|
07a3735e94
|
[Fix] Complete the deferred FFN all-reduce before deepstack addition and aux hidden-state capture (#41080)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-24 12:14:39 -07:00 |
|
Cheng Wan
|
928e683f94
|
[Fix] Complete the deferred FFN all-reduce before a pipeline-parallel send (#41079)
|
2026-09-24 12:13:57 -07:00 |
|
Cheng Wan
|
e31cbc01a2
|
[Fix] Stop deferring the last layer's FFN all-reduce in five models (#40868)
|
2026-09-23 14:41:14 -07:00 |
|
Cheng Wan
|
701cf7e47e
|
[Refactor] Run Nemotron-H DP attention through the standard layer communicator (#40867)
|
2026-09-23 14:40:33 -07:00 |
|
Cheng Wan
|
379e8f916b
|
[Fix] Capture complete Nemotron auxiliary hidden states (#40801)
|
2026-09-23 14:39:50 -07:00 |
|
Cheng Wan
|
9ebe42238b
|
[Fix] Reduce Nemotron MTP attention outputs once (#40800)
|
2026-09-23 14:39:04 -07:00 |
|
Cheng Wan
|
0e80c73c92
|
[Fix] Avoid duplicate residual in LongCat MoE shortcut (#40799)
|
2026-09-23 14:37:39 -07:00 |
|