 Pranjal Shankhdharandpranjalssh
|
35df2fecde
|
[Fix] Stamp sequence-parallel state on dummy forward batches (#38564)
Co-authored-by: pranjalssh <pranjalssh@fb.com>
|
2026-09-09 01:03:03 -07:00 |
|
|
Yuhao Yang
|
13469c16d3
|
Store mamba prefix-cache checkpoints at the configured SSM state dtype (#34820)
|
2026-09-09 15:25:57 +08:00 |
|
|
|
daf66f6670
|
[Diffusion][SenseNova] support SenseNova-U1.5-8B-MoT (#36606)
Co-authored-by: wuyuefeng <wuyuefeng@noreply.gitcode.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-09-09 10:12:38 +03:00 |
|
|
Liwansi
|
78da625190
|
[mem_cache] skip duplicates host evict via environ (#38462)
|
2026-09-09 14:31:34 +08:00 |
|
|
Xiaoyu Zhang
|
a27be5ff62
|
[Diffusion] Enable lossless BCG for FLUX.1-dev (#38591)
|
2026-09-09 14:09:21 +08:00 |
|
|
sogalin_codegen
|
5998e9321c
|
[AMD][Fix] Fix regression in jit build error with FLUX.2-dev on gfx1250 (#38329)
|
2026-09-08 22:55:13 -07:00 |
|
|
MickandMick Qian
|
00a9028e87
|
[diffusion] feat: add explicit snapshot-offload component residency (#38535)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-09 13:44:54 +08:00 |
|
|
MickandMick Qian
|
0ee8e41a4e
|
[diffusion] CI: don't fail the nightly when a perf dump is unreadable (#38629)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-09 13:39:10 +08:00 |
|
|
Ankith AverineniandHaiShaw
|
eb42598bdd
|
[AMD][DSV4] Skip the paged SWA page return under the per-request ring (#38571)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2026-09-08 21:15:30 -07:00 |
|
|
Xiaoyu Zhang
|
03d06a764e
|
[Docs] Add measured JoyEcho H200 residency and BCG recipe (#38534)
|
2026-09-09 11:19:27 +08:00 |
|
|
Xiaoyu Zhang
|
2952c8d5ea
|
[Diffusion] Fuse LongCat Image normalization and modulation (#38530)
|
2026-09-09 11:12:17 +08:00 |
|
|
Alison Shao
|
76eea36e38
|
Cast fp32 routing weights to bf16 in the Kimi-K3 fused finalize (#38588)
|
2026-09-09 10:48:21 +08:00 |
|
|
Jialin Ouyang
|
7a464a7014
|
[Rust TreeCore] Harden runtime and CI parity (#37303)
|
2026-09-09 10:40:22 +08:00 |
|
|
Baizhou Zhang
|
e54ff1efb9
|
[CP V1 Deprecation 5/5] Update prefill CP documentation (#36230)
|
2026-09-08 19:27:49 -07:00 |
|
|
James
|
8ab9982851
|
[NPU]support mf device urma and host rdma trans type (#38174)
|
2026-09-09 09:44:19 +08:00 |
|
|
DayuxiaoshuiandXiaoyu Zhang
|
db1de6ff4c
|
[Diffusion] Keep the Wan VAE decoder channels_last and add a Triton NHWC nearest upsample (#38182)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-09 09:31:35 +08:00 |
|
|
YanbingJiang
|
a67a31aa81
|
[CPU] Support Qwen3.8 text+video: adding torchcodec, ffmpeg and removing pin_memory (#35492)
|
2026-09-09 09:22:58 +08:00 |
|
|
jianan-gu
|
da821aad11
|
[XPU][Diffusion] Enable MiniMax H3 on XPU platforms (#33366)
|
2026-09-09 09:20:04 +08:00 |
|
|
|
295132c4a5
|
[NPU] Add sparsity-driven KV offload for DeepSeek DSA on Ascend (#33089)
Co-authored-by: itcj <itcj@foxmail.com>
Co-authored-by: chenyh <chenyh18@mail.ustc.edu.cn>
Co-authored-by: hibikid <7514545+hibikid@user.noreply.gitee.com>
Co-authored-by: Chengjie Tang <tangcj@sxu.edu.cn>
Co-authored-by: wangbiao0814 <wangbiao0814@outlook.com>
|
2026-09-09 09:13:22 +08:00 |
|
|
MickandMick Qian
|
a8e45f16cc
|
[diffusion] feat: support mixed INT8 embeddings and Comfy NVFP4 encoders for minimax-h3 (#38506)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-09 08:36:43 +08:00 |
|
|
MickandMick Qian
|
65400bb420
|
[diffusion] model: support MiniMax-H3 singularity hybrid checkpoints (#38455)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-09 08:35:39 +08:00 |
|
|
Cheng Wan
|
db272201a2
|
[Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375)
|
2026-09-08 16:42:12 -07:00 |
|
|
Chunan ZengandKevin Mi
|
5177a3ec08
|
MiniMax-M3: Triton split-K router GEMV with in-kernel fixup (#36557)
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
|
2026-09-08 16:39:41 -07:00 |
|
|
Chunan ZengandKevin Mi
|
a25bbca8ed
|
MiniMax-M3: share the sparse index top-k across layers and reuse the decode top-k buffer (#36527)
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
|
2026-09-08 16:39:01 -07:00 |
|
|
Baizhou Zhang
|
ed183d45ac
|
[CP V1 Deprecation 4/5] Canonicalize prefill CP API names (#36229)
|
2026-09-08 16:03:36 -07:00 |
|
|
Qiaolin Yu
|
559c7fa75b
|
Revert "PD disaggregation, isolated transfer, prefill OOM fixed." (#38572)
|
2026-09-08 15:57:44 -07:00 |
|
|
+3
|
52fecfdf09
|
support qwen 3.8 flash next (#37500)
Co-authored-by: ch-wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ispobock <26454835+ispobock@users.noreply.github.com>
Co-authored-by: JustinTong0323 <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: samuellees <26428561+samuellees@users.noreply.github.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yizhang2077 <25844240+yizhang2077@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Shinto C V <cshintov@gmail.com>
Co-authored-by: Julian Huang <huangzhilin.hzl@antgroup.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
|
2026-09-08 13:56:21 -07:00 |
|
|
Xinyuan Tong
|
afe90a8bc9
|
Point Ling-3.0-flash-VL cookbook install section at the model image (#38539)
|
2026-09-08 10:51:33 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
30e7a3072d
|
Keep fp32 routing weights in the fp8 block-scale and bf16 trtllm MoE (#33631)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-09-08 08:56:40 -07:00 |
|
|
HZYandZhangheng
|
8a0863c728
|
[HiCache] Add MLA host-dedup primitives (#36800)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-09-08 23:40:21 +08:00 |
|
|
Xinyuan Tong
|
482e9f257b
|
Add Ling-3.0-flash-VL cookbook (#38434)
|
2026-09-08 23:00:24 +08:00 |
|
|
|
325ab245a1
|
[DCP] Allow fi_a2a on single-node systems Blackwell without MNNVL fabric ( ex B200 B300) (#37767)
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-09-08 07:55:36 -07:00 |
|
|
Liu Ziming
|
beecfda314
|
[observability] Fix missing e2e/decode/inference latency span attributes (#37789)
|
2026-09-08 22:50:55 +08:00 |
|
|
|
15ff470472
|
[diffusion] chore: key the VAE decode-dtype store by module layout (#38496)
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-08 22:37:21 +08:00 |
|
|
HZY
|
a6b542813f
|
fix(glm-5.2-nvfp4): bound Mooncake synchronous transfer batches (#32758)
|
2026-09-08 22:14:33 +08:00 |
|
|
SovietPowerandXiaoyu Zhang
|
4df5df911b
|
[Scheduler] Add HRRN schedule policy to significantly reduce TTFT (#32911)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-08 22:14:03 +08:00 |
|
|
Po-Han Huang (NVIDIA)
|
5097f9ac95
|
Disable Hopper GLM shared-expert fusion for modelopt_fp4 Marlin (#37325)
|
2026-09-08 06:16:36 -07:00 |
|
|
pllimax
|
2d339ddef1
|
[NPU] Phase A calibration: full GSM8K eval for dp_attention mixed-chunk (#38422)
|
2026-09-08 21:14:48 +08:00 |
|
|
Xiaoyu Zhang
|
554f817948
|
[Diffusion] Optimize LTX-2 QKNorm and split RoPE on Hopper (#38396)
|
2026-09-08 19:05:02 +08:00 |
|
|
|
88a9bfd1ff
|
[diffusion] CI: add per-case timing tolerance for host-I/O-bound perf guards (#38457)
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-08 18:40:17 +08:00 |
|
|
zijiecandZijie Chen
|
e634ba78a4
|
[AMD] gfx950 assembly attention for EAGLE verify, draft extend and decode (#37465)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
|
2026-09-08 03:10:09 -07:00 |
|
|
amd-danli103
|
141febf329
|
[AMD] fix: use the hardware fp8 e4m3 convert on gfx950 (#37140)
Signed-off-by: amd-danli103 <danli103@amd.com>
|
2026-09-08 03:01:53 -07:00 |
|
|
|
775f17b07c
|
[diffusion] optimization: stream mapped weights on a shared host/device pool (#38441)
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-08 17:52:52 +08:00 |
|
|
vorapolsiloai
|
7edcdd5ae6
|
[AMD] Skip AITER FP8 ASM prefill when GQA is unsupported (#38467)
|
2026-09-08 02:49:47 -07:00 |
|
|
Hank Han
|
ccfa120dae
|
Fix DSA compression tail capacity for PD decode request slots (#38417)
|
2026-09-08 01:50:07 -07:00 |
|
|
DavidLiandClaude Opus 5
|
5ae4ccb0fd
|
[Bench] Amortize the GDN ReplaySSM decode latency over the flush cycle (#38399)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-09-08 16:38:01 +08:00 |
|
|
YC Yen-Ching TsengandChen
|
4c3d47f1df
|
[AMD] Copy MoE weight views before H2D in slow-loading nightlies (#38456)
Co-authored-by: Chen <bingxche@amd.com>
|
2026-09-08 16:19:28 +08:00 |
|
|
cen121212
|
f8f03910f2
|
【NPU】Support EAGLE when PP enabled in prefill nodes (#32207)
|
2026-09-08 15:45:36 +08:00 |
|
|
Rain Jiang
|
b83a59835d
|
sglang-server remove opaque type (#38095)
|
2026-09-08 00:41:31 -07:00 |
|
|
Sage
|
5aab054ec8
|
[rust-server] fix p/d bootstrap across dp listeners (#36234)
|
2026-09-08 13:22:32 +08:00 |
|