Liangsheng Yin
|
1270204d2c
|
Revert "[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend" (#35568)
|
2026-08-19 14:14:38 -07:00 |
|
 elvischenvandBrayden Zhong
|
a6bc0532c9
|
[Fix] Fix Nemotron-H Mamba illegal memory access under DP attention with CUDA graph (#34561)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-19 14:13:40 -07:00 |
|
milesial
|
ed12d6827d
|
fix(disagg): allow fake transfer with decode DCP (#35409)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2026-08-19 13:54:37 -07:00 |
|
Jason Wiemels
|
defb2a3100
|
feat(openai): Accept the input_audio content part in chat completions (#33606)
|
2026-08-19 13:37:50 -07:00 |
|
 DarkSharpnessandClaude Opus 5
|
746418a1ec
|
[DSA] Trim top-k v2 output modes and tighten its PDL waits (#35041)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-19 13:09:21 -07:00 |
|
cctry
|
1c82955861
|
[HiCache] Split the host-memory budget across co-located ranks (#35540)
|
2026-08-19 13:01:58 -07:00 |
|
Ayushman Singh
|
b1707996e8
|
fix(gemma4): quantize MTP bridge projections (#32440)
|
2026-08-19 12:41:52 -07:00 |
|
Po-Han Huang (NVIDIA)
|
6f69f927da
|
[Scheduler] Add configurable decode interval after prefill (#35017)
|
2026-08-19 12:01:36 -07:00 |
|
 MengYuandmenyu
|
4f8ecf6ae9
|
[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#29525)
Co-authored-by: menyu <menyu@nvidia.com>
|
2026-08-19 11:52:45 -07:00 |
|
YAMY
|
03cf2de2e3
|
[Qwen3.5][MTP] Preserve online NVFP4 draft quantization for mixed checkpoints (#35545)
|
2026-08-19 11:12:32 -07:00 |
|
Xinyuan Tong
|
157d8ad27a
|
Support Intern-S2-Mobius FP8 (#34908)
|
2026-08-19 10:58:01 -07:00 |
|
YAMY
|
5f12839591
|
[Fix] Support Kimi-K3 ModelOpt mixed NVFP4/FP8 checkpoint (#35077)
|
2026-08-19 08:13:45 -07:00 |
|
 Shuwen Wangandhzh0425
|
41c018a9ec
|
[UnifiedTree] feat: support runtime attach/detach (#35269)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-08-19 22:49:08 +08:00 |
|
Yoray Zack
|
1ef7882a5b
|
[NIXL] Query EP top-k index dtype (#35294)
|
2026-08-19 22:31:05 +08:00 |
|
Mick
|
e3445ed2bd
|
[diffusion] fix: route quantized vae component repos safely (#35184)
|
2026-08-19 21:02:46 +08:00 |
|
Mick
|
29f5d1c7c3
|
[diffusion] fix: fix multi-group layerwise offload startup memory (#35509)
|
2026-08-19 20:32:31 +08:00 |
|
 Arseniy Mironovandronnie_zheng
|
c57ada81e1
|
[Diffusion] Use current_platform instead of hardcoded "cuda" in cosmos3 guardrails (#34612)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-08-19 15:26:28 +03:00 |
|
 Rohit Kumar SinghandSingh
|
3e5ce26c2d
|
fix: fix transcription & audio-understanding for ASR/audio/speech models (#32611)
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
|
2026-08-19 18:44:23 +08:00 |
|
 
|
f446e853e7
|
[AMD] DeepSeek-V4: route decode wo_a bf16 batched matmul to aiter batched_gemm_bf16 (#33313)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-19 03:04:48 -07:00 |
|
karverma-amd
|
ce1830c59b
|
[AMD] DeepSeek-V4 MI355X: eliminate bpreshuffle fp8-scale relayout copy in dense w8a8 linear (#33165)
|
2026-08-19 03:02:40 -07:00 |
|
 HeYaoandHeYao
|
f22442d3a4
|
Add three new test cases (#35502)
Co-authored-by: HeYao <heyao@example.com>
|
2026-08-19 17:59:45 +08:00 |
|
Shangming Cai
|
adca19c497
|
[PD] Deferred decode-side KV release for the NIXL backend (#35360)
|
2026-08-19 17:29:45 +08:00 |
|
YAMY
|
aa215e5523
|
[PD] Overlap prefill DP-rank bootstrap queries (#35071)
|
2026-08-19 17:25:52 +08:00 |
|
 Khoa PhamandCursor
|
0e4a09480c
|
[HiCache] Support DCP with DSpark (#35221)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-08-19 01:42:19 -07:00 |
|
     
|
8a1e6e4e46
|
Qwen3.8-27B Model Support (#34859)
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-08-19 16:31:43 +08:00 |
|
 MickandYiqi Yang
|
73e5fa4724
|
[diffusion] refactor: gate native encoder quantized checkpoints (#35183)
Co-authored-by: Yiqi Yang <yangyiqi8787@gmail.com>
|
2026-08-19 16:18:36 +08:00 |
|
Liangsheng Yin
|
ccbe380028
|
[CI] Trim the base-c 4-gpu-h100 stage from 5 shards to 4 (#35407)
|
2026-08-19 00:48:07 -07:00 |
|
Liangsheng Yin
|
e614121866
|
[Fix] Scale the req_to_token row headroom by attn_dcp_size (#35424)
|
2026-08-19 00:37:26 -07:00 |
|
 
|
f4158719d1
|
[AMD] Let the diffusion AITer backend take grouped-query K/V (fix Cosmos3-Nano startup) (#34485)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
|
2026-08-19 00:17:40 -07:00 |
|
 MickandClaude Opus 5
|
c0c87e0547
|
VLM: feed the packed qkv projection output to vision backends uncopied (#35336)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-19 14:39:52 +08:00 |
|
Mick
|
a5c96362b6
|
[diffusion] chore: reuse shared checkpoint quant metadata resolver (#35174)
|
2026-08-19 13:36:55 +08:00 |
|
Mick
|
593b1a9b8a
|
[diffusion] optimization: reduce minimax h3 mps memory pressure (#33880)
|
2026-08-19 13:35:01 +08:00 |
|
 Alison ShaoandXinyuan Tong
|
3391ab3712
|
[Constrained] Support MistralCommon tokenizers in the XGrammar backend (#35215)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-08-19 12:34:48 +08:00 |
|
 Jimmy ShongandClaude Fable 5
|
c863760ae1
|
[Fix] DCP: advertise the logical KV-event block size (#35298)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-18 20:55:11 -07:00 |
|
 Muqi LiandCodex
|
88f6074392
|
feat(api): add sglext_spec (#33518)
Signed-off-by: Muqi Li <muqi1029@gmail.com>
Co-authored-by: Codex <noreply@openai.com>
|
2026-08-19 11:54:18 +08:00 |
|
luoroger37
|
3b065a56b0
|
[HiCache] Batch PP write and load completion sync (#33473)
|
2026-08-19 11:27:27 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
1beb805356
|
[Perf] Restore the 16-token router GEMM threshold on SM10X (#34953)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-08-18 19:53:52 -07:00 |
|
HuangJi
|
ee1f2e8dfd
|
[diffusion][Minimax H3]support subblock sparse attention on SM90 (#34680)
|
2026-08-19 10:31:45 +08:00 |
|
 DayuxiaoshuiandMick
|
eb085524c8
|
[diffusion] fix: make MiniMax-H3 AdaLN cache rebuild transactional (#34993)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-19 10:27:38 +08:00 |
|
Zhiqiang Xie
|
977412ae61
|
[HiCache] Buffer-only mode for HiCache host memory layer (#34798)
|
2026-08-18 19:21:24 -07:00 |
|
Mick
|
4cef72faee
|
[diffusion] refactor: reuse srt qwen vision and text modules (#35006)
|
2026-08-19 10:12:44 +08:00 |
|
Chunyuan WU
|
58c5bee3ac
|
Fix DP attention on CPU (#12961)
|
2026-08-19 09:56:21 +08:00 |
|
 akhilg-nvandYangmin Li
|
5d12280ae7
|
Add fmha_v2 attention backend for SM90/120 (#23112)
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
|
2026-08-18 18:41:03 -07:00 |
|
Mick
|
baa2251847
|
[diffusion] chore: make --vae-tiling honest, fix the decode oom advice, gate nvfp4 on blackwell (#35353)
|
2026-08-19 09:27:54 +08:00 |
|
Mick
|
ef490853bb
|
quant: extract shared checkpoint quant metadata resolver (#35172)
|
2026-08-19 08:26:41 +08:00 |
|
 MickandClaude Fable 5
|
e73201e462
|
[diffusion] feat: support cache-dit, cfg gating, attention backend override as per-request param (#35339)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-19 08:24:03 +08:00 |
|
 MickandClaude Opus 5
|
77fc5c128e
|
[perf] overlap page preprocessing, pack the vit, enable prefill CUDA graph for paddle-ocr (#35318)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-08-19 08:20:55 +08:00 |
|
 
|
64e404263e
|
[Doc] Fix TP and attention-TP group layout in initialize_model_parallel docstring (#34862)
Co-authored-by: NanoByte0513 <167996578+NanoByte0513@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-19 08:15:03 +08:00 |
|
  
|
c14312a664
|
[Spec] DFlash2: local convolution + candidate selector (#35371)
Co-authored-by: Jian Chen <jianchen0311@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-08-18 17:07:28 -07:00 |
|
Baizhou Zhang
|
cfc6dfb364
|
Apply latest DeepEP branch (#34923)
|
2026-08-18 16:24:50 -07:00 |
|