Cheng Wan and Claude Opus 5
ef20fab38a
config: the forwarding slots go; the dispatcher calls the family directly ( #36792 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-28 10:26:29 -07:00
Cheng Wan and Claude Opus 5
c2928e86d7
config: the resolution pipeline moves out of the record ( #36789 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-28 10:17:24 -07:00
Cheng Wan and Claude Opus 5
6ff2a20ccf
config: the record is not an object that gets passed around ( #36622 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-27 12:57:10 -07:00
Cheng Wan and Claude Opus 5
fd40a331bf
config: a parallel size has one spelling; a patched scope declares its own ( #36621 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-27 12:56:42 -07:00
Cheng Wan and Claude Opus 5
ca1d7ed8e6
config: a parallel leaf with no live counterpart is read bare ( #36620 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-27 12:56:11 -07:00
Cheng Wan and Claude Opus 5
7c3b5a6732
config: every handler declares its cuda-graph decisions ( #36725 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-27 12:55:34 -07:00
Cheng Wan and Claude Opus 5
bd4bb1781a
config: resolution declares, and nothing writes a field ( #36618 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-27 12:53:17 -07:00
Lianmin Zheng
94183a8d2b
Move server args config parser under utils ( #36681 )
2026-08-27 03:34:50 -07:00
Lianmin Zheng
3402265989
[Core] Refactor server argument choices ( #36586 )
2026-08-27 01:56:03 -07:00
Xun Sun
adcf73d7f7
[Weight Cache] Enhance test and support EPLB ( #36198 )
2026-08-26 23:11:53 -07:00
a3ae667d67
[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend ( #35634 )
...
Co-authored-by: menyu <menyu@nvidia.com >
Co-authored-by: Jinyan Chen <93358689+liz-badada@users.noreply.github.com >
Co-authored-by: Han Yu <helloyu0903@gmail.com >
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai >
2026-08-26 19:54:33 -07:00
Cheng Wan
413df1f8db
config: ServerArgs holds the raw input ( #36255 )
2026-08-26 05:14:05 -07:00
Cheng Wan
937af8538b
config: the runtime readers take the published bags ( #36254 )
2026-08-26 05:08:25 -07:00
Cheng Wan
5b7fc61306
config: resolution reads the declarations, not the fields ( #36253 )
2026-08-26 05:05:28 -07:00
Cheng Wan
d7b144f64e
config: publishing is the process entry's job ( #36251 )
2026-08-26 04:58:41 -07:00
Cheng Wan
8005df61d3
config: spell the parallel config tier at the call site ( #36250 )
2026-08-26 03:00:28 -07:00
Cheng Wan
443527af0c
config: the model-config cache keys on the path the record carried ( #36300 )
2026-08-25 03:18:28 -07:00
Alex Nails and Claude Opus 5
68575b23d0
[CI] Stop the config ratchets re-parsing the package on every scan ( #36240 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 18:22:32 -07:00
Alex Nails and Claude Opus 5
1ec20fd25d
[CI] Stop the resolution ratchets re-parsing the whole package ( #36235 )
...
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-08-24 16:55:35 -07:00
514b997e6c
Register CPU CI for 17 e2e tests and partition xeon base-c suite ( #35227 )
...
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com >
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: Claude <noreply@anthropic.com >
2026-08-24 10:49:38 +08:00
Cheng Wan and Claude Opus 5
340391a297
config: publish before the launcher reads effective configuration ( #35910 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:20:20 -07:00
Cheng Wan and Claude Opus 5
a43592dce5
config: pin two orderings resolution relies on ( #35909 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:19:44 -07:00
Cheng Wan and Claude Opus 5
362c2ee849
config: borrowed-record reads follow the config bags ( #35908 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:19:20 -07:00
Cheng Wan and Claude Opus 5
64aa859da2
config: constructing a config no longer resolves it ( #35907 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:18:53 -07:00
Cheng Wan and Claude Opus 5
4bc79a1b49
config: project the config bags from the resolution result ( #35906 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:18:24 -07:00
Cheng Wan and Claude Opus 5
0e22777572
config: record resolution writes in a declaration stash ( #35905 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:17:27 -07:00
Baizhou Zhang
3b5909de0e
[DeepSeek V4] Add W4A4 MegaMoE server flag ( #35918 )
2026-08-21 18:44:18 -07:00
9db4ba8da1
[DeepSeek-V4] Add Q8KV8 sparse MLA prefill runtime backend ( #32327 )
...
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com >
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com >
2026-08-20 10:23:49 +08:00
Liangsheng Yin
1270204d2c
Revert "[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend" ( #35568 )
2026-08-19 14:14:38 -07:00
milesial
ed12d6827d
fix(disagg): allow fake transfer with decode DCP ( #35409 )
...
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com >
2026-08-19 13:54:37 -07:00
Po-Han Huang (NVIDIA)
6f69f927da
[Scheduler] Add configurable decode interval after prefill ( #35017 )
2026-08-19 12:01:36 -07:00
MengYu and menyu
4f8ecf6ae9
[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend ( #29525 )
...
Co-authored-by: menyu <menyu@nvidia.com >
2026-08-19 11:52:45 -07:00
Jimmy Shong and Claude Fable 5
c863760ae1
[Fix] DCP: advertise the logical KV-event block size ( #35298 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-18 20:55:11 -07:00
Xingyu Liu and xingyuliu
7dcaf11987
[Fix] Select custom all-reduce v2 by topology capability ( #35061 )
...
Co-authored-by: xingyuliu <xingyuliu@fb.com >
2026-08-18 10:30:10 -07:00
Cheng Wan
cba3c5d5ac
config: the per-instance families read the bags ( #35026 )
2026-08-17 16:17:53 -07:00
cctry and cctry
2e7c85da68
[PD] Preserve decode KV across retraction in HiCache ( #34801 )
...
Co-authored-by: cctry <cctry@fb.com >
2026-08-17 08:49:11 -07:00
Lianmin Zheng
67e12131df
Build Rust extensions on demand in source checkouts ( #34994 )
2026-08-16 14:58:06 -07:00
Cheng Wan
61908870f6
config: spell out the one dynamic config read the census could not see
...
`_is_dsa_active` asked `getattr(server_args, "_is_dsa_model_arch", False)`, and
that name has never existed on `ServerArgs` -- it arrived as a placeholder with
the CP strategy abstractions (#27313 ), so the getattr default has always decided
the predicate. A dynamic read of a name nothing sets is the one shape the config
census cannot follow, and it looked like a live decision while being dead.
Spelled as the constant it evaluates to, with the placeholder written down: what
it should ask (whether this process runs a DSA model arch) is the CP path's
call, and its only consumer, `ContextParallelStrategy.per_layer_attn_cp_comm`,
has no readers yet.
That was the sole entry in the read ratchet's `_INERT_DYNAMIC_READS`, so the
exemption list is gone with it -- there is no way to exempt a read from the
baselines any more, which is the invariant worth having. The `counted()`
indirection it existed for goes too (verified the three shapes it guarded still
report: direct, `getattr`, and an attribute-parked alias).
2026-08-15 00:38:30 -07:00
ethche and Ethan Che
aeee1562e6
[Kernel] Enable Helion backend for Kimi Delta-Attention ( #32593 )
...
Co-authored-by: Ethan Che <eche@meta.com >
2026-08-14 22:22:46 -07:00
Mohammad Miadh Angkad
96db53ec70
[CI] Fix test_resolution_is_reproducible after cuda_ipc became opt-in ( #34746 )
2026-08-13 12:47:03 -07:00
Mick
69bf601e3c
fix: restore VLM nightly regression coverage ( #34662 )
2026-08-12 21:47:16 -07:00
gongwei1027
2c07ca5e8d
[Fix] Allow flashinfer_sparse_mla DSA backend for HiSparse on SM120 FP8 KV ( #33075 )
2026-08-11 15:05:04 -07:00
Mick
8267d76c2c
[VLM] replace deprecated image processor use_fast ( #34175 )
2026-08-12 00:14:07 +08:00
Cheng Wan and Claude Fable 5
a2199c1dee
config: pin that resolution is reproducible from the raw input ( #34094 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-09 14:44:39 -07:00
Mick
d747bd052e
feat(vlm): auto-select cuda vmm on multi-node mnnvl ( #33936 )
2026-08-08 16:00:58 +08:00
Oguz Ulgen and Yinghai Lu
7f6b4cb94b
Add CUDA VMM multimodal feature transport ( #33899 )
...
Co-authored-by: Yinghai Lu <yinghai@meta.com >
2026-08-07 13:39:54 -07:00
Ziang Li and Brayden Zhong
4ad990ba7d
[ModelOpt FP4] Support online MoE weight quantization ( #33115 )
...
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca >
2026-08-06 11:01:55 -07:00
Mohammad Miadh Angkad
1a15cf1536
Gate multimodal feature transport by model capability ( #33653 )
2026-08-06 06:48:32 -07:00
+26
abddb1c7e9
[Kimi] Support kimi-k3 ( #32541 )
...
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com >
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com >
Co-authored-by: Mick <mickjagger19@icloud.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
Co-authored-by: Chunan Zeng <zcnrex@gmail.com >
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai >
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai >
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com >
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
Co-authored-by: zhangxiaohao <1024393531@qq.com >
Co-authored-by: Yangmin Li <yangminl@nvidia.com >
Co-authored-by: Julien Lin <jullin@nvidia.com >
Co-authored-by: Hao Phan <htphan@nvidia.com >
Co-authored-by: Thomas Wang <1am9trash@gmail.com >
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com >
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com >
Co-authored-by: HaiShaw <hixiao@gmail.com >
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com >
Co-authored-by: Lee Nau <lee.nau@gmail.com >
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com >
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com >
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com >
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
Co-authored-by: Thomas Wang <thomawan@amd.com >
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com >
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai >
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai >
Co-authored-by: Hanming Lu <hanminglu@meta.com >
Co-authored-by: Xinyi Song <xinyis10@illinois.edu >
2026-08-04 13:22:49 -07:00
Tao Li and litao.dream
a0b7bcf592
[Feature] Support return_hidden_states="last" ( #30177 )
...
Co-authored-by: litao.dream <litao.dream@bytedance.com >
2026-08-02 15:09:33 +08:00
