Cheng Wan
|
855c092deb
|
[Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335)
|
2026-10-23 15:51:44 -07:00 |
|
Cheng Wan
|
d0022e1df3
|
[Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681)
|
2026-10-23 12:32:55 -07:00 |
|
Cheng Wan
|
ac3db731b3
|
[Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917)
|
2026-10-23 12:32:05 -07:00 |
|
Cheng Wan
|
8b9b992e41
|
[Perf] moe: Preserve Marlin workspace and route-count budgets (#45462)
|
2026-10-23 12:31:17 -07:00 |
|
Cheng Wan
|
e6451c1a95
|
[Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916)
|
2026-10-23 12:29:51 -07:00 |
|
Cheng Wan
|
1340044e97
|
[Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915)
|
2026-10-23 12:28:43 -07:00 |
|
Cheng Wan
|
027208ae02
|
[Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896)
|
2026-10-20 16:26:40 -07:00 |
|
 Cheng WanandAditya Suresh
|
299a75ac5d
|
[Refactor] moe: Derive routing inputs from the layer and active forward (#44994)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
|
2026-10-20 16:26:15 -07:00 |
|
 Cheng WanandAditya Suresh
|
4f8f06faf3
|
[Refactor] moe: Derive layer contracts from the selected quant method (#44993)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
|
2026-10-20 16:18:45 -07:00 |
|
 Cheng WanandAditya Suresh
|
f1eec1232d
|
[Fix] config: Preserve ServerArgs positional constructor slots (#44991)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
|
2026-10-20 16:08:28 -07:00 |
|
Cheng Wan
|
6b90e5716d
|
[Refactor] moe: Scope shared-expert configuration to each model (#44913)
|
2026-10-19 16:59:37 -07:00 |
|
Cheng Wan
|
964ab2b280
|
[Refactor] moe: Split the two meanings of num_fused_shared_experts (#44912)
|
2026-10-19 16:57:15 -07:00 |
|
Cheng Wan
|
48ea486928
|
[Fix] moe: Renormalize per-rank shared-slot routing over routed experts only (#44904)
|
2026-10-19 16:56:21 -07:00 |
|
Cheng Wan
|
3a059de94c
|
[Fix] moe: Count routed_scaling_factor once when top-k folds it (#44901)
|
2026-10-19 16:54:27 -07:00 |
|
Cheng Wan
|
57db5089c2
|
[Perf] attention: Capture translated FA4 verify metadata for DSPARK (#44973)
|
2026-10-18 05:42:16 -07:00 |
|
Cheng Wan
|
2e9b2cacda
|
[Perf] speculative: Fuse draft write-window gathering and KV translation (#44972)
|
2026-10-18 05:41:34 -07:00 |
|
Cheng Wan
|
2a83471676
|
[Perf] mamba: Fuse strided state updates and replay index translation (#44971)
|
2026-10-18 05:40:57 -07:00 |
|
Cheng Wan
|
d318a546da
|
[Perf] unified-memory: Reduce allocation and SWA retirement overhead (#44970)
|
2026-10-18 05:40:25 -07:00 |
|
Cheng Wan
|
a5b21145e1
|
[Refactor] attention: Separate decode metadata from pool ownership (#44969)
|
2026-10-18 05:39:44 -07:00 |
|
Cheng Wan
|
f7ad4345b8
|
[Refactor] deepseek-v4: Use explicit stage boundaries and row transport (#43607)
|
2026-10-15 02:05:28 -07:00 |
|
Cheng Wan
|
3a835cf417
|
[Refactor] inkling: Use short-convolution stage boundaries (#43606)
|
2026-10-15 02:04:46 -07:00 |
|
Cheng Wan
|
e1f9fce7b3
|
[Refactor] layer-boundary: Bind residual completion to producer updates (#43605)
|
2026-10-15 02:04:02 -07:00 |
|
Cheng Wan
|
d59c3448b0
|
[Fix] kimi-k3: Preserve pipeline graph bank inputs and bound chunk profiling (#43604)
|
2026-10-15 02:03:27 -07:00 |
|
Cheng Wan
|
c053fc71d3
|
[CI] pr-title: Validate pull request title format (#44165)
|
2026-10-13 19:53:52 -07:00 |
|
Cheng Wan
|
234ccba7f6
|
[Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460)
|
2026-10-10 12:43:09 -07:00 |
|
Cheng Wan
|
3b16eeedce
|
[Refactor] Declare pipeline neighbours from a shared declaration function (#43459)
|
2026-10-10 12:42:46 -07:00 |
|
Cheng Wan
|
3b717c0f13
|
[Refactor] Decide an exit's fixed facts when the stage is built (#43458)
|
2026-10-10 12:42:23 -07:00 |
|
Cheng Wan
|
a956aa192a
|
[Refactor] Bind a layer stack in one pass over each stage's data flow (#43457)
|
2026-10-10 12:42:00 -07:00 |
|
Cheng Wan
|
d2c597c8db
|
[Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456)
|
2026-10-10 12:41:38 -07:00 |
|
Cheng Wan
|
b0dde87de2
|
[Refactor] Make residual read and update capabilities explicit and checked (#43455)
|
2026-10-10 12:41:16 -07:00 |
|
Cheng Wan
|
514feb1afc
|
[Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454)
|
2026-10-10 12:40:53 -07:00 |
|
Cheng Wan
|
8bd7f2d178
|
[Refactor] Record what a bound stage path does instead of reading it back (#43453)
|
2026-10-10 12:40:30 -07:00 |
|
Cheng Wan
|
58f6976ce7
|
[Fix] Unblock CUDA graph startup for hybrid parallelism (#43211)
|
2026-10-09 15:39:59 -07:00 |
|
Cheng Wan
|
dc0b394471
|
[Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936)
|
2026-10-09 01:27:46 -07:00 |
|
Cheng Wan
|
305ad5503d
|
[Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898)
|
2026-10-09 01:27:23 -07:00 |
|
Cheng Wan
|
2b469040d2
|
[Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897)
|
2026-10-09 01:27:00 -07:00 |
|
Cheng Wan
|
b9ae3d1a65
|
[Fix] Run attention on a padded extend batch's real rows (#42896)
|
2026-10-09 01:26:38 -07:00 |
|
Cheng Wan
|
7203747cc8
|
[Fix] Shard Kimi K3's shared experts over the TP group they sum over (#42895)
|
2026-10-09 01:26:15 -07:00 |
|
Cheng Wan
|
125f88cb75
|
[Refactor] Run Kimi K3 through stage boundaries (#42894)
|
2026-10-09 01:25:51 -07:00 |
|
Cheng Wan
|
666da4f56b
|
[Fix] Kimi K3 KDA value head size and SiTU input alignment (#42893)
|
2026-10-09 01:25:28 -07:00 |
|
Cheng Wan
|
48a6c0a5d0
|
[Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892)
|
2026-10-09 01:25:05 -07:00 |
|
Cheng Wan
|
b2402ccad6
|
[Fix] Merge DeepSeek-V4 two-batch-overlap microbatches without a residual (#42891)
|
2026-10-09 01:24:42 -07:00 |
|
Cheng Wan
|
b3e6c87be3
|
[Refactor] Translate each KV loc once per iteration (#42753)
|
2026-10-08 00:58:28 -07:00 |
|
Cheng Wan
|
7760d5264a
|
[Refactor] Use destination layouts for model checkpoint mappings (#42590)
|
2026-10-07 16:24:22 -07:00 |
|
Cheng Wan
|
5e12831cec
|
[Refactor] Load auxiliary and expert checkpoints using owner partitions (#42589)
|
2026-10-07 16:24:03 -07:00 |
|
Cheng Wan
|
64c7f65eac
|
[Refactor] Retain process groups in parallel linear layers (#42588)
|
2026-10-07 16:23:40 -07:00 |
|
Cheng Wan
|
267e34516c
|
[Refactor] Select parallel groups for remaining model projections (#42587)
|
2026-10-07 16:22:57 -07:00 |
|
Cheng Wan
|
dec5d9d6fc
|
[Refactor] Let vision encoders select their parallel group (#42586)
|
2026-10-07 16:22:32 -07:00 |
|
Cheng Wan
|
b83827ea02
|
[Fix] Quantize reloaded FP8 weights after native sharding (#42585)
|
2026-10-07 16:20:47 -07:00 |
|
Cheng Wan
|
59740a728f
|
[Refactor] Let MLA projections select their parallel group (#42484)
|
2026-10-07 16:19:33 -07:00 |
|
Cheng Wan
|
961d7290fe
|
[Refactor] Let model MLPs select their parallel group (#42468)
|
2026-10-07 16:18:14 -07:00 |
|
Cheng Wan
|
4c5130ac5a
|
[Refactor] Let linear layers select their parallel group (#42426)
|
2026-10-07 16:15:26 -07:00 |
|
Cheng Wan
|
1f299e9f2f
|
[Refactor] Build layer stacks in order with append_stages (#42481)
|
2026-10-04 16:40:24 -07:00 |
|
Cheng Wan
|
a99567ab74
|
[Fix] GigaChat 3.5: build the stage boundaries once (#42480)
|
2026-10-04 16:39:34 -07:00 |
|
Cheng Wan
|
5c8fb9e938
|
[Fix] Offer the fused MoE finalize all-reduce only to a block that owes the sum (#42479)
|
2026-10-04 16:39:06 -07:00 |
|
Cheng Wan
|
f07c1a398e
|
[Refactor] Build the Qwen4 experimental decoders from stage boundaries (#42478)
|
2026-10-04 16:38:36 -07:00 |
|
Cheng Wan
|
92d60351e2
|
[Refactor] Build the Hunyuan V4 decoder from stage boundaries (#42477)
|
2026-10-04 16:38:03 -07:00 |
|
Cheng Wan
|
10edb05e72
|
[Refactor] Let the remaining placement consumers read the parallel context (#42348)
|
2026-10-03 14:59:32 -07:00 |
|
Cheng Wan
|
b2aa993cb8
|
[Fix] Skip a draft's decode recapture when it owns no decode graph (#42347)
|
2026-10-03 14:54:12 -07:00 |
|
Cheng Wan
|
1a18de4b29
|
[Fix] Load a draft's tensor weight update from its deployment TP rank (#42346)
|
2026-10-03 14:52:25 -07:00 |
|
Cheng Wan
|
7be5e3473c
|
[Refactor] Drop the reduction-skip mechanisms stage boundaries no longer use (#42312)
|
2026-10-03 02:21:55 -07:00 |
|
Cheng Wan
|
71b04e02cf
|
[Refactor] Build the ZAYA1, IQuest-Q1 and Gemma 4 decoders from stage boundaries (#42311)
|
2026-10-03 02:21:34 -07:00 |
|
Cheng Wan
|
f85c2c4923
|
[Fix] GigaChat 3.5: apply the sandwich norms to the complete sums (#42310)
|
2026-10-03 02:21:10 -07:00 |
|
Cheng Wan
|
6faccf3e84
|
[Refactor] Build the GLM-4, GLM-Image and Granite MoE hybrid decoders from stage boundaries (#42309)
|
2026-10-03 02:20:40 -07:00 |
|
Cheng Wan
|
e4554fd5e5
|
[Refactor] Build the Llama and Nemotron-NAS decoders from stage boundaries (#42308)
|
2026-10-03 02:20:18 -07:00 |
|
Cheng Wan
|
740a4d5955
|
[Refactor] Build the Qwen2 decoders from stage boundaries (#42307)
|
2026-10-03 02:19:56 -07:00 |
|
Cheng Wan
|
2c739b225b
|
[Fix] Jet-Nemotron build and Granite MoE hybrid final norm (#42306)
|
2026-10-03 02:19:33 -07:00 |
|
Cheng Wan
|
b7fc516986
|
[Fix] EXAONE MoE under DP attention and DeepEP (#42305)
|
2026-10-03 02:19:19 -07:00 |
|
Cheng Wan
|
2fa17a6467
|
[Refactor] Build the ERNIE 4.5 VL MoE and EXAONE MoE decoders from stage boundaries (#42304)
|
2026-10-03 02:18:56 -07:00 |
|
Cheng Wan
|
f89ead192f
|
[Fix] EXAONE and ERNIE 4.5 VL MoE architecture, backend and PP issues (#42303)
|
2026-10-03 02:18:33 -07:00 |
|
Cheng Wan
|
be20e7453c
|
[Fix] Step-3.5 DeepEP routed scaling and Sarvam shared expert under dense TP1 (#42302)
|
2026-10-03 02:18:11 -07:00 |
|
Cheng Wan
|
b157d548bb
|
[Refactor] Let stage boundaries complete every stage-output sum (#42301)
|
2026-10-03 02:17:48 -07:00 |
|
Cheng Wan
|
d5a8d76bf5
|
[Refactor] Drop TBO op methods that no strategy ever schedules (#42300)
|
2026-10-03 02:17:26 -07:00 |
|
Cheng Wan
|
5fab1f0f51
|
[Fix] Let the aiter DCP ASM decode test run without aiter (#42018)
|
2026-10-01 16:55:15 +08:00 |
|
Cheng Wan
|
a9c97c9f69
|
[Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818)
|
2026-09-30 13:34:18 -07:00 |
|
Cheng Wan
|
986cb8268b
|
[Refactor] Enter draft TP scopes by attention ownership and drop ModelRunner.tp_group (#41817)
|
2026-09-30 13:28:50 -07:00 |
|
Cheng Wan
|
e7f6a99313
|
[Refactor] Add make_pp_layers so models stop handing their PP position down (#41816)
|
2026-09-30 13:28:34 -07:00 |
|
Cheng Wan
|
00659ac099
|
[Refactor] Stop passing models' layers the placement they already read (#41815)
|
2026-09-30 13:28:17 -07:00 |
|
Cheng Wan
|
c7fa37a5ca
|
[Refactor] Let FusedMoE's weight-loading helpers read the layer's MoE-TP rank (#41814)
|
2026-09-30 13:27:58 -07:00 |
|
Cheng Wan
|
499e86db98
|
[Refactor] Keep only the TP and PP groups on the model runner (#41813)
|
2026-09-30 13:27:31 -07:00 |
|
Cheng Wan
|
a09aedf1ca
|
[Refactor] Drop model placement attributes and parameters nothing reads (#41812)
|
2026-09-30 13:27:11 -07:00 |
|
Cheng Wan
|
b0cc246ff8
|
[Refactor] Drop placement values nothing reads (#41811)
|
2026-09-30 13:26:51 -07:00 |
|
Cheng Wan
|
4f3ee94d25
|
[Fix] Make the Solar model constructible and runnable (#41810)
|
2026-09-30 13:26:32 -07:00 |
|
Cheng Wan
|
a659e6461f
|
[Fix] Size the prefill delayer's gather buffer to its TP group (#41809)
|
2026-09-30 13:26:12 -07:00 |
|
Cheng Wan
|
ecc0f0dec2
|
[Fix] Pass the draft's attention ownership to DFLASH's eager LiLiCorr scope (#41808)
|
2026-09-30 13:25:54 -07:00 |
|
Cheng Wan
|
e289989933
|
[Fix] Shard MoE WNA16 and Quark INT4-FP8 weights by the MoE placement (#41807)
|
2026-09-30 13:25:38 -07:00 |
|
Cheng Wan
|
3f20738846
|
[Fix] State the configured MoE-DP width in the weight-cache fingerprint (#41806)
|
2026-09-30 13:25:19 -07:00 |
|
Cheng Wan
|
e27b6e0971
|
[Fix] Read TensorCast's WORLD placement under its current names (#41805)
|
2026-09-30 13:25:03 -07:00 |
|
Cheng Wan
|
53225fadf4
|
[Fix] Stop the namespace census at the leaf a read names (#41838)
|
2026-09-30 03:27:51 -07:00 |
|
Cheng Wan
|
d41904f05e
|
[Refactor] Build seven more decoders from stage boundaries (#41779)
|
2026-09-29 21:16:45 -07:00 |
|
Cheng Wan
|
113e6a1496
|
[Refactor] Simplify layer boundary internals (#41778)
|
2026-09-29 21:15:58 -07:00 |
|
Cheng Wan
|
9ee065e49a
|
[Fix] Step-3.5: build the shared expert without TP under all-to-all MoE backends (#41754)
|
2026-09-29 21:11:37 -07:00 |
|
Cheng Wan
|
faa5064f6e
|
[Refactor] Send producer-written residual streams through to_pp (#41753)
|
2026-09-29 21:11:02 -07:00 |
|
Cheng Wan
|
843f50f5c1
|
[Fix] Reduce the Sarvam dense MLP through its row-parallel projection (#41752)
|
2026-09-29 21:10:17 -07:00 |
|
Cheng Wan
|
ea855f0daf
|
[Refactor] Leave decoder stacks through final_norm(skip_empty=True) (#41751)
|
2026-09-29 21:08:19 -07:00 |
|
Cheng Wan
|
01b5f572b7
|
[Refactor] Rename layer boundary protocols, contracts and helpers (#41750)
|
2026-09-29 21:05:48 -07:00 |
|
Cheng Wan
|
8d2d874758
|
[Fix] Release consumed residual contributions (#41749)
|
2026-09-29 16:38:05 -07:00 |
|
Cheng Wan
|
5781206833
|
[PD] Give FakeKVReceiver ensure_abort_notified (#41618)
|
2026-09-28 21:59:17 -07:00 |
|
Cheng Wan
|
6dad152490
|
[Refactor] Document layer boundary contracts and integration (#41557)
|
2026-09-28 20:18:27 -07:00 |
|
Cheng Wan
|
49e7bd179d
|
[Refactor] Group layer boundary unit tests (#41556)
|
2026-09-28 20:18:08 -07:00 |
|