100 Commits
Author SHA1 Message Date
Cheng Wan 855c092deb [Fix] inkling: Keep BF16 LM-head operands with FP32 output (#45335) 2026-10-23 15:51:44 -07:00
Cheng Wan d0022e1df3 [Fix] lora: Preserve MoE projection identity and routing lifetimes (#45681) 2026-10-23 12:32:55 -07:00
Cheng Wan ac3db731b3 [Fix] moe: Preserve CUTLASS routing metadata and execution budgets (#45917) 2026-10-23 12:32:05 -07:00
Cheng Wan 8b9b992e41 [Perf] moe: Preserve Marlin workspace and route-count budgets (#45462) 2026-10-23 12:31:17 -07:00
Cheng Wan e6451c1a95 [Fix] gguf: Preserve MoE routing, weighting and allocation budgets (#45916) 2026-10-23 12:29:51 -07:00
Cheng Wan 1340044e97 [Fix] deepseek-v4: Preserve decoder-tail token-count ownership (#45915) 2026-10-23 12:28:43 -07:00
Cheng Wan 027208ae02 [Doc] layer-boundary/moe: Correct guides and comments that drifted from the code (#44896) 2026-10-20 16:26:40 -07:00
Cheng WanandAditya Suresh 299a75ac5d [Refactor] moe: Derive routing inputs from the layer and active forward (#44994)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
2026-10-20 16:26:15 -07:00
Cheng WanandAditya Suresh 4f8f06faf3 [Refactor] moe: Derive layer contracts from the selected quant method (#44993)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
2026-10-20 16:18:45 -07:00
Cheng WanandAditya Suresh f1eec1232d [Fix] config: Preserve ServerArgs positional constructor slots (#44991)
Co-authored-by: Aditya Suresh <152752311+adi-suresh01@users.noreply.github.com>
2026-10-20 16:08:28 -07:00
Cheng Wan 6b90e5716d [Refactor] moe: Scope shared-expert configuration to each model (#44913) 2026-10-19 16:59:37 -07:00
Cheng Wan 964ab2b280 [Refactor] moe: Split the two meanings of num_fused_shared_experts (#44912) 2026-10-19 16:57:15 -07:00
Cheng Wan 48ea486928 [Fix] moe: Renormalize per-rank shared-slot routing over routed experts only (#44904) 2026-10-19 16:56:21 -07:00
Cheng Wan 3a059de94c [Fix] moe: Count routed_scaling_factor once when top-k folds it (#44901) 2026-10-19 16:54:27 -07:00
Cheng Wan 57db5089c2 [Perf] attention: Capture translated FA4 verify metadata for DSPARK (#44973) 2026-10-18 05:42:16 -07:00
Cheng Wan 2e9b2cacda [Perf] speculative: Fuse draft write-window gathering and KV translation (#44972) 2026-10-18 05:41:34 -07:00
Cheng Wan 2a83471676 [Perf] mamba: Fuse strided state updates and replay index translation (#44971) 2026-10-18 05:40:57 -07:00
Cheng Wan d318a546da [Perf] unified-memory: Reduce allocation and SWA retirement overhead (#44970) 2026-10-18 05:40:25 -07:00
Cheng Wan a5b21145e1 [Refactor] attention: Separate decode metadata from pool ownership (#44969) 2026-10-18 05:39:44 -07:00
Cheng Wan f7ad4345b8 [Refactor] deepseek-v4: Use explicit stage boundaries and row transport (#43607) 2026-10-15 02:05:28 -07:00
Cheng Wan 3a835cf417 [Refactor] inkling: Use short-convolution stage boundaries (#43606) 2026-10-15 02:04:46 -07:00
Cheng Wan e1f9fce7b3 [Refactor] layer-boundary: Bind residual completion to producer updates (#43605) 2026-10-15 02:04:02 -07:00
Cheng Wan d59c3448b0 [Fix] kimi-k3: Preserve pipeline graph bank inputs and bound chunk profiling (#43604) 2026-10-15 02:03:27 -07:00
Cheng Wan c053fc71d3 [CI] pr-title: Validate pull request title format (#44165) 2026-10-13 19:53:52 -07:00
Cheng Wan 234ccba7f6 [Refactor] Declare every model's stages from a shared function and drop the meta-device neighbour build (#43460) 2026-10-10 12:43:09 -07:00
Cheng Wan 3b16eeedce [Refactor] Declare pipeline neighbours from a shared declaration function (#43459) 2026-10-10 12:42:46 -07:00
Cheng Wan 3b717c0f13 [Refactor] Decide an exit's fixed facts when the stage is built (#43458) 2026-10-10 12:42:23 -07:00
Cheng Wan a956aa192a [Refactor] Bind a layer stack in one pass over each stage's data flow (#43457) 2026-10-10 12:42:00 -07:00
Cheng Wan d2c597c8db [Refactor] Decide input-scattered eligibility and stage rejections in one place (#43456) 2026-10-10 12:41:38 -07:00
Cheng Wan b0dde87de2 [Refactor] Make residual read and update capabilities explicit and checked (#43455) 2026-10-10 12:41:16 -07:00
Cheng Wan 514feb1afc [Fix] Keep residual rows and sums consistent across appends and pipeline handoffs (#43454) 2026-10-10 12:40:53 -07:00
Cheng Wan 8bd7f2d178 [Refactor] Record what a bound stage path does instead of reading it back (#43453) 2026-10-10 12:40:30 -07:00
Cheng Wan 58f6976ce7 [Fix] Unblock CUDA graph startup for hybrid parallelism (#43211) 2026-10-09 15:39:59 -07:00
Cheng Wan dc0b394471 [Refactor] Remove Kimi K3's own layer communication and let the consumer set an FFN's exit (#42936) 2026-10-09 01:27:46 -07:00
Cheng Wan 305ad5503d [Refactor] Run Kimi K3's fused collectives through stage boundaries (#42898) 2026-10-09 01:27:23 -07:00
Cheng Wan 2b469040d2 [Refactor] Support attention-TP dense FFNs and unpadded batches on stage boundaries (#42897) 2026-10-09 01:27:00 -07:00
Cheng Wan b9ae3d1a65 [Fix] Run attention on a padded extend batch's real rows (#42896) 2026-10-09 01:26:38 -07:00
Cheng Wan 7203747cc8 [Fix] Shard Kimi K3's shared experts over the TP group they sum over (#42895) 2026-10-09 01:26:15 -07:00
Cheng Wan 125f88cb75 [Refactor] Run Kimi K3 through stage boundaries (#42894) 2026-10-09 01:25:51 -07:00
Cheng Wan 666da4f56b [Fix] Kimi K3 KDA value head size and SiTU input alignment (#42893) 2026-10-09 01:25:28 -07:00
Cheng Wan 48a6c0a5d0 [Fix] Return an FFN's output to the attention rows at a pipeline handoff (#42892) 2026-10-09 01:25:05 -07:00
Cheng Wan b2402ccad6 [Fix] Merge DeepSeek-V4 two-batch-overlap microbatches without a residual (#42891) 2026-10-09 01:24:42 -07:00
Cheng Wan b3e6c87be3 [Refactor] Translate each KV loc once per iteration (#42753) 2026-10-08 00:58:28 -07:00
Cheng Wan 7760d5264a [Refactor] Use destination layouts for model checkpoint mappings (#42590) 2026-10-07 16:24:22 -07:00
Cheng Wan 5e12831cec [Refactor] Load auxiliary and expert checkpoints using owner partitions (#42589) 2026-10-07 16:24:03 -07:00
Cheng Wan 64c7f65eac [Refactor] Retain process groups in parallel linear layers (#42588) 2026-10-07 16:23:40 -07:00
Cheng Wan 267e34516c [Refactor] Select parallel groups for remaining model projections (#42587) 2026-10-07 16:22:57 -07:00
Cheng Wan dec5d9d6fc [Refactor] Let vision encoders select their parallel group (#42586) 2026-10-07 16:22:32 -07:00
Cheng Wan b83827ea02 [Fix] Quantize reloaded FP8 weights after native sharding (#42585) 2026-10-07 16:20:47 -07:00
Cheng Wan 59740a728f [Refactor] Let MLA projections select their parallel group (#42484) 2026-10-07 16:19:33 -07:00
Cheng Wan 961d7290fe [Refactor] Let model MLPs select their parallel group (#42468) 2026-10-07 16:18:14 -07:00
Cheng Wan 4c5130ac5a [Refactor] Let linear layers select their parallel group (#42426) 2026-10-07 16:15:26 -07:00
Cheng Wan 1f299e9f2f [Refactor] Build layer stacks in order with append_stages (#42481) 2026-10-04 16:40:24 -07:00
Cheng Wan a99567ab74 [Fix] GigaChat 3.5: build the stage boundaries once (#42480) 2026-10-04 16:39:34 -07:00
Cheng Wan 5c8fb9e938 [Fix] Offer the fused MoE finalize all-reduce only to a block that owes the sum (#42479) 2026-10-04 16:39:06 -07:00
Cheng Wan f07c1a398e [Refactor] Build the Qwen4 experimental decoders from stage boundaries (#42478) 2026-10-04 16:38:36 -07:00
Cheng Wan 92d60351e2 [Refactor] Build the Hunyuan V4 decoder from stage boundaries (#42477) 2026-10-04 16:38:03 -07:00
Cheng Wan 10edb05e72 [Refactor] Let the remaining placement consumers read the parallel context (#42348) 2026-10-03 14:59:32 -07:00
Cheng Wan b2aa993cb8 [Fix] Skip a draft's decode recapture when it owns no decode graph (#42347) 2026-10-03 14:54:12 -07:00
Cheng Wan 1a18de4b29 [Fix] Load a draft's tensor weight update from its deployment TP rank (#42346) 2026-10-03 14:52:25 -07:00
Cheng Wan 7be5e3473c [Refactor] Drop the reduction-skip mechanisms stage boundaries no longer use (#42312) 2026-10-03 02:21:55 -07:00
Cheng Wan 71b04e02cf [Refactor] Build the ZAYA1, IQuest-Q1 and Gemma 4 decoders from stage boundaries (#42311) 2026-10-03 02:21:34 -07:00
Cheng Wan f85c2c4923 [Fix] GigaChat 3.5: apply the sandwich norms to the complete sums (#42310) 2026-10-03 02:21:10 -07:00
Cheng Wan 6faccf3e84 [Refactor] Build the GLM-4, GLM-Image and Granite MoE hybrid decoders from stage boundaries (#42309) 2026-10-03 02:20:40 -07:00
Cheng Wan e4554fd5e5 [Refactor] Build the Llama and Nemotron-NAS decoders from stage boundaries (#42308) 2026-10-03 02:20:18 -07:00
Cheng Wan 740a4d5955 [Refactor] Build the Qwen2 decoders from stage boundaries (#42307) 2026-10-03 02:19:56 -07:00
Cheng Wan 2c739b225b [Fix] Jet-Nemotron build and Granite MoE hybrid final norm (#42306) 2026-10-03 02:19:33 -07:00
Cheng Wan b7fc516986 [Fix] EXAONE MoE under DP attention and DeepEP (#42305) 2026-10-03 02:19:19 -07:00
Cheng Wan 2fa17a6467 [Refactor] Build the ERNIE 4.5 VL MoE and EXAONE MoE decoders from stage boundaries (#42304) 2026-10-03 02:18:56 -07:00
Cheng Wan f89ead192f [Fix] EXAONE and ERNIE 4.5 VL MoE architecture, backend and PP issues (#42303) 2026-10-03 02:18:33 -07:00
Cheng Wan be20e7453c [Fix] Step-3.5 DeepEP routed scaling and Sarvam shared expert under dense TP1 (#42302) 2026-10-03 02:18:11 -07:00
Cheng Wan b157d548bb [Refactor] Let stage boundaries complete every stage-output sum (#42301) 2026-10-03 02:17:48 -07:00
Cheng Wan d5a8d76bf5 [Refactor] Drop TBO op methods that no strategy ever schedules (#42300) 2026-10-03 02:17:26 -07:00
Cheng Wan 5fab1f0f51 [Fix] Let the aiter DCP ASM decode test run without aiter (#42018) 2026-10-01 16:55:15 +08:00
Cheng Wan a9c97c9f69 [Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818) 2026-09-30 13:34:18 -07:00
Cheng Wan 986cb8268b [Refactor] Enter draft TP scopes by attention ownership and drop ModelRunner.tp_group (#41817) 2026-09-30 13:28:50 -07:00
Cheng Wan e7f6a99313 [Refactor] Add make_pp_layers so models stop handing their PP position down (#41816) 2026-09-30 13:28:34 -07:00
Cheng Wan 00659ac099 [Refactor] Stop passing models' layers the placement they already read (#41815) 2026-09-30 13:28:17 -07:00
Cheng Wan c7fa37a5ca [Refactor] Let FusedMoE's weight-loading helpers read the layer's MoE-TP rank (#41814) 2026-09-30 13:27:58 -07:00
Cheng Wan 499e86db98 [Refactor] Keep only the TP and PP groups on the model runner (#41813) 2026-09-30 13:27:31 -07:00
Cheng Wan a09aedf1ca [Refactor] Drop model placement attributes and parameters nothing reads (#41812) 2026-09-30 13:27:11 -07:00
Cheng Wan b0cc246ff8 [Refactor] Drop placement values nothing reads (#41811) 2026-09-30 13:26:51 -07:00
Cheng Wan 4f3ee94d25 [Fix] Make the Solar model constructible and runnable (#41810) 2026-09-30 13:26:32 -07:00
Cheng Wan a659e6461f [Fix] Size the prefill delayer's gather buffer to its TP group (#41809) 2026-09-30 13:26:12 -07:00
Cheng Wan ecc0f0dec2 [Fix] Pass the draft's attention ownership to DFLASH's eager LiLiCorr scope (#41808) 2026-09-30 13:25:54 -07:00
Cheng Wan e289989933 [Fix] Shard MoE WNA16 and Quark INT4-FP8 weights by the MoE placement (#41807) 2026-09-30 13:25:38 -07:00
Cheng Wan 3f20738846 [Fix] State the configured MoE-DP width in the weight-cache fingerprint (#41806) 2026-09-30 13:25:19 -07:00
Cheng Wan e27b6e0971 [Fix] Read TensorCast's WORLD placement under its current names (#41805) 2026-09-30 13:25:03 -07:00
Cheng Wan 53225fadf4 [Fix] Stop the namespace census at the leaf a read names (#41838) 2026-09-30 03:27:51 -07:00
Cheng Wan d41904f05e [Refactor] Build seven more decoders from stage boundaries (#41779) 2026-09-29 21:16:45 -07:00
Cheng Wan 113e6a1496 [Refactor] Simplify layer boundary internals (#41778) 2026-09-29 21:15:58 -07:00
Cheng Wan 9ee065e49a [Fix] Step-3.5: build the shared expert without TP under all-to-all MoE backends (#41754) 2026-09-29 21:11:37 -07:00
Cheng Wan faa5064f6e [Refactor] Send producer-written residual streams through to_pp (#41753) 2026-09-29 21:11:02 -07:00
Cheng Wan 843f50f5c1 [Fix] Reduce the Sarvam dense MLP through its row-parallel projection (#41752) 2026-09-29 21:10:17 -07:00
Cheng Wan ea855f0daf [Refactor] Leave decoder stacks through final_norm(skip_empty=True) (#41751) 2026-09-29 21:08:19 -07:00
Cheng Wan 01b5f572b7 [Refactor] Rename layer boundary protocols, contracts and helpers (#41750) 2026-09-29 21:05:48 -07:00
Cheng Wan 8d2d874758 [Fix] Release consumed residual contributions (#41749) 2026-09-29 16:38:05 -07:00
Cheng Wan 5781206833 [PD] Give FakeKVReceiver ensure_abort_notified (#41618) 2026-09-28 21:59:17 -07:00
Cheng Wan 6dad152490 [Refactor] Document layer boundary contracts and integration (#41557) 2026-09-28 20:18:27 -07:00
Cheng Wan 49e7bd179d [Refactor] Group layer boundary unit tests (#41556) 2026-09-28 20:18:08 -07:00