![gemini-code-assist[bot]](/assets/img/avatar_default.png) Zaili Wangandgemini-code-assist[bot]
|
caeb449cd6
|
[Doc][CPU]Update Cookbook with Xeon support info (#27248)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-06-05 22:39:40 -07:00 |
|
 Brayden ZhongandBrayden Zhong
|
38ae22e08c
|
Nemotron perf changes (#26733)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-05 22:31:46 -07:00 |
|
Yuxuan Zhang
|
393d0e169e
|
[Bugfix] Restore overridden HF config fields and support index_skip_topk_offset for DSA topk sharing (#27114)
|
2026-06-06 13:26:04 +08:00 |
|
 kkandwunhuang
|
aa55657e9e
|
[AMD][WA] force to use gate_mode interleaved to fix tp2/tp4/tp8 acc issue (#27201)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-05 20:18:11 -07:00 |
|
Mick
|
bf66b7b6da
|
[diffusion] model: support Ideogram4 NVFP4 (#27379)
|
2026-06-06 11:14:28 +08:00 |
|
Mick
|
e8668508d1
|
[diffusion] optimize: optimize LingBot realtime sp cache path (#27383)
|
2026-06-06 09:37:29 +08:00 |
|
Liangsheng Yin
|
58a05d3dd2
|
[CI] Isolate CUDA coredump dir per run to fix tracker mis-attribution (#27344)
|
2026-06-05 21:31:22 -04:00 |
|
 Xinyi SongandHaiShaw
|
3030119ef7
|
[bugfix][AMD] AttributeError and warp mask bugs in DeepSeek V4 FP4 indexer (#27152)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2026-06-05 18:26:38 -07:00 |
|
Chi McIsaac
|
25d8f431d1
|
[diffusion] optimize: cosmos3 fused qknorm rope (#27096)
|
2026-06-06 09:15:42 +08:00 |
|
fzyzcjy
|
bf4f2ccc78
|
Add scripted-runtime unit, core integration, and chunked-prefill tests (#27413)
|
2026-06-06 09:08:35 +08:00 |
|
fzyzcjy
|
5a82db85f0
|
Add scripted-runtime KV-pool and lock-ref exhauster primitives (#27412)
|
2026-06-06 09:07:40 +08:00 |
|
fzyzcjy
|
dd176387c6
|
Add scripted-runtime harness core and wire scheduler/IPC hooks (#27411)
|
2026-06-06 09:07:01 +08:00 |
|
fzyzcjy
|
21201ef718
|
Add kv_canary PP self-test fixture and SWA divergence coverage (#27410)
|
2026-06-06 09:06:19 +08:00 |
|
cctry
|
b3e4c204fd
|
Don't write crash dump on graceful exit (#27405)
|
2026-06-05 17:06:39 -07:00 |
|
 DevashishLal-CBandDevashish Lal
|
6a3316dd1e
|
[plugin] default device detection fixes for OOT platform plugins (#25337)
Signed-off-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
|
2026-06-06 07:55:50 +08:00 |
|
Baizhou Zhang
|
e69cc07a60
|
Remove DeepSeek V4 release Docker workflow (#27404)
|
2026-06-05 16:49:05 -07:00 |
|
 ThanhhaoandHao Phan
|
2e7523ddbe
|
fix(spec-dec): treat num_nextn_predict_layers=0 the same as absent for EAGLE3 drafts (#26726)
Co-authored-by: Hao Phan <htphan@nvidia.com>
|
2026-06-05 16:08:07 -07:00 |
|
xutizhou
|
29591594f5
|
Support Waterfill with dynamic EPLB (#27150)
|
2026-06-05 16:01:16 -07:00 |
|
    
|
6b180959a8
|
[SPEC][5/N] feat: batchsize-aware support for adaptive speculative_num_steps (#24055)
Co-authored-by: 坤钧 <maoyuhan.myh@antgroup.co>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
Co-authored-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: shuwenn <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: shuwenn <2508695655@qq.com>
|
2026-06-05 15:43:02 -07:00 |
|
  
|
c9f582a272
|
[LoRA] Experimental fast LoRA path with experimental_sgl_trtllm MoE backend for FP8 and NVFP4 models (#27329)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
|
2026-06-05 14:45:59 -07:00 |
|
 Brayden ZhongandBrayden Zhong
|
d381ec7997
|
[CI] Fix Nemotron nightly mixed precision checkpoints test (#27284)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-06-05 13:51:26 -07:00 |
|
 Brayden ZhongandBrayden Zhong
|
3b62286fca
|
Reland "Support NextN = 2/4 in DSV32" (#27166)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-05 13:43:28 -07:00 |
|
Liangsheng Yin
|
2c2a4f243a
|
[Bug] Fix EAGLE draft CUDA-graph kv_indices under-allocation for topk > 1 (#27338)
|
2026-06-05 16:22:04 -04:00 |
|
 zijiexiaandClaude Opus 4.8
|
632a3d480e
|
docs: add Tencent Hunyuan and Poolside cards to autoregressive cookbook (#27400)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-05 13:17:13 -07:00 |
|
 Khoa PhamandClaude Opus 4.8
|
bf172c492a
|
Cookbook for QAT (#27396)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-05 11:18:11 -07:00 |
|
Shangming Cai
|
57909f731b
|
[PD] Fix KV cache corruption on abort by notifying ongoing prefill (#27372)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-06 00:56:13 +08:00 |
|
Zhangheng
|
86b9bf5812
|
[CI]: Fix CI Stage for 3fs backend test (#27388)
|
2026-06-06 00:38:03 +08:00 |
|
Zhangheng
|
e4a7388187
|
feat(agentic router, 1/N): Add LoadBasedPolicy (#26480)
|
2026-06-06 00:13:27 +08:00 |
|
 xlyandMick
|
d01cf27b7d
|
[diffusion] model: support Ideogram 4 FP8 (#27279)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-05 23:54:48 +08:00 |
|
 Michael_miaoande01448
|
e7f94d0d40
|
[Bug Fix] Fix activation.cuh JIT compilation failure on CUDA 13 due to template type/value mismatch (#26444)
Co-authored-by: e01448 <jwmao@birentech.com>
|
2026-06-05 22:59:24 +08:00 |
|
Zhangheng
|
6cfdc18585
|
HiCache: Fix Flaky CI For 3FS Backend (#27358)
|
2026-06-05 22:00:19 +08:00 |
|
Aurick Qiao
|
c06802dc16
|
Fix customized_info incremental streaming (#27205)
|
2026-06-05 21:55:01 +08:00 |
|
Zhangheng
|
faa6286946
|
[BugFix]: Fix HiMamba HiCache prefetch hang after L3 sidecar transfer (#27366)
|
2026-06-05 20:37:40 +08:00 |
|
 XiaoTianandgongxiaotian
|
e1955bf57a
|
fix(pd): clear stale bootstrap_room when freeing metadata buffer slot (#27374)
Co-authored-by: gongxiaotian <gongxiaotian@didiglobal.com>
|
2026-06-05 19:46:35 +08:00 |
|
Wang, FangYuan
|
7f919edf00
|
[AMD] Support alt stream for Qwen3.5 on AMD platform (#25885)
|
2026-06-05 04:38:25 -07:00 |
|
R0CKSTAR
|
5d691a44f4
|
[diffusion] fix: fix LingBot World timestep error on MUSA (#27341)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-06-05 19:15:08 +08:00 |
|
Bingxu Chen
|
8c8281801d
|
[AMD] update ROCm AITER commit (#27376)
|
2026-06-05 03:42:16 -07:00 |
|
McZyWu
|
d8487bad06
|
Update best practice for qwen3-next-80b-a3b-instruct (#27353)
|
2026-06-05 17:02:38 +08:00 |
|
Mick
|
4ef081b903
|
[diffusion] optimize: optimize LingBot realtime transport and camera conditioning (#27297)
|
2026-06-05 16:00:48 +08:00 |
|
huangtingwei
|
00fefef16b
|
[PD & HiSparse] Add DeepSeek V4 support for HiSparse direct Prefill-to-Decode DRAM (#24880)
|
2026-06-05 15:39:48 +08:00 |
|
 
|
66b932154f
|
[AMD] fix(ci): run partition 3 of stage-c-test-large-8-gpu-amd (#27352)
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-05 15:06:36 +08:00 |
|
jianzhao-xu
|
4248695b07
|
[NPU] add GLM model best practice docs (#27032)
|
2026-06-05 14:27:19 +08:00 |
|
Zhangheng
|
4df1ccdadc
|
[UnifiedTree]: Fix CP Reduce For L3 HiCache (#27330)
|
2026-06-05 14:03:54 +08:00 |
|
Qiaolin Yu
|
bd47869ba4
|
[perf] parallelize create_flashmla_kv_indices over page-blocks (#27320)
|
2026-06-04 22:11:43 -07:00 |
|
 ![github-actions[bot]](/assets/img/avatar_default.png)
|
6cbc035dc9
|
FrozenKVMTPVerifyInput: add _draft_preprocess_idle call for when all requests in the verify batch finish in the same iteration (#26859)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Harmya Bhatt <harmyacs@gmail.com>
|
2026-06-04 21:47:32 -07:00 |
|
liuxianglong17
|
aed0808e18
|
6-5 nightly failed test case fix (#27335)
|
2026-06-05 11:39:23 +08:00 |
|
 zijiexiaandClaude Opus 4.8
|
c6c1f1a29a
|
docs: sync legacy docs/-only updates into docs_new (Mintlify) (#27308)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-04 19:45:13 -07:00 |
|
Yuhao Yang
|
46c58b5c70
|
bench: fix MMMU VLM eval max_tokens for CoT prompt (#27327)
|
2026-06-05 10:28:16 +08:00 |
|
   
|
2c8357f794
|
[XPU] Enable Gemma 4 E2B / E4B / 31B/ 26B-A4B on Intel XPU (#23280)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: jmunetong <jmunetong@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
Co-authored-by: ckvermaAI <ckverma@habana.ai>
|
2026-06-05 10:05:07 +08:00 |
|
 Kangyan-ZhouandClaude Opus 4.8
|
bcf89928b4
|
[router] Configure experimental sgl-router via CLI flags instead of a config file (#27073)
Signed-off-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-05 10:02:10 +08:00 |
|