 zijiexia
|
b89686710d
|
[Docs] re-organize nemotron cookbook (#27240)
|
2026-06-04 00:40:13 -07:00 |
|
|
|
1463e5fbdd
|
docs: add Nemotron 3 Ultra cookbook entry (#26969)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
|
2026-06-04 00:14:19 -07:00 |
|
|
shuwenn
|
1af53f67b2
|
[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676)
|
2026-06-04 15:10:37 +08:00 |
|
|
Leon Gao
|
a10bd785be
|
Reduce mamba prefill allocation overhead (#25000)
|
2026-06-04 15:10:16 +08:00 |
|
|
|
04c16fc1e5
|
[AMD][CI] Remove transformers pin from GLM-5.x nightly jobs (#27232)
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-04 14:34:07 +08:00 |
|
|
Shangming Cai
|
f3acb6d4de
|
[CI] Fix multimodal-gen path filter for shared trace code (#27222)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-04 14:20:27 +08:00 |
|
|
Alex SunandHaiShaw
|
e4191708c9
|
[Qwen3.5][AMD] Fix shared-expert ×ep_size over-count under allreduce-EP (#26845)
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2026-06-03 23:04:39 -07:00 |
|
|
Baizhou Zhang
|
cc67f922cd
|
[misc] Update Codeowner for Lora (#27224)
|
2026-06-03 22:50:15 -07:00 |
|
|
Heyang Huang
|
858e5a5109
|
[diffusion] chore: disagg server args, launch helpers, and warmup utils (#26119)
|
2026-06-04 13:40:39 +08:00 |
|
|
Jitendra PatilandMa Mingfei
|
0e0ecc11ff
|
Add nightly Intel XPU Docker release workflow (#27182)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-06-04 13:39:57 +08:00 |
|
|
YC Yen-Ching Tseng
|
6dcd78a37f
|
[AMD] Add MiniMax-M2.5 TP=4 nightly accuracy test for MI355X (#27126)
|
2026-06-03 22:17:40 -07:00 |
|
|
Lianmin Zheng
|
ff5c4d7b57
|
Add zx3xyy to CI_PERMISSIONS.json (#27213)
|
2026-06-03 22:12:00 -07:00 |
|
|
Zhonghua Deng
|
e541bc3881
|
[EPD] feat: encoder DP mode with per-rank subprocess workers (#26576)
|
2026-06-04 12:37:41 +08:00 |
|
|
Yinghai Lu
|
71c759ebb7
|
[loader] Reduce transient allocations in NVFP4 MoE setup (#26861)
|
2026-06-03 21:13:25 -07:00 |
|
|
|
5c8a04ac4e
|
[XPU CI] Expand stage-a and consolidate stage-b tests into stage-a (#27156)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-06-04 12:00:25 +08:00 |
|
|
Cheng WanandClaude Opus 4.8
|
10ab7c919f
|
[refactor] Retire DecodeInputBuffers / PrefillInputBuffers in favor of CudaGraphBufferRegistry (#27192)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-03 20:52:56 -07:00 |
|
|
Zaili WangandMa Mingfei
|
3b7a258f63
|
[CPU] upgrade dependent torch ver to PT2.12 (#21456)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-06-04 11:04:11 +08:00 |
|
|
王鹤男
|
29d23e198f
|
[diffusion] fix: preserve _explicit_fields across dataclasses.replace in DiffGenerator (#25308)
|
2026-06-04 11:02:23 +08:00 |
|
|
Mick
|
11605767e0
|
[diffusion] optimize: skip unused wanvae halo send copies (#27151)
|
2026-06-04 10:23:01 +08:00 |
|
|
Zhanghengand晟海
|
736263f3dc
|
[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-04 10:17:34 +08:00 |
|
|
shuwenn
|
1a57145975
|
[codex] Fix adaptive metrics test flake (#27135)
|
2026-06-03 19:07:17 -07:00 |
|
|
Yuzhen ZhouandJiajun Li
|
e03dfa8182
|
[3/N][Sync sglang-miles] TITO Support (#23751)
Co-authored-by: Jiajun Li <48857426+guapisolo@users.noreply.github.com>
|
2026-06-03 21:45:33 -04:00 |
|
|
Jonny Kong
|
084c6a7e2a
|
Refactor simulated acceptance length generation (#26768)
|
2026-06-03 18:31:32 -07:00 |
|
|
|
f6cd1a9822
|
Add num_waiting_uncached_tokens load metric (#27174)
Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-03 18:29:49 -07:00 |
|
|
ybyangandLianmin Zheng
|
687baf9471
|
fix(load-snapshot): avoid duplicate zmq bind in multi-tokenizer mode (#27145)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-03 18:24:56 -07:00 |
|
|
|
14ed9b448e
|
Add ZMQ IPv6 support, bench_serving sampling params, and reduce routed_dp_rank log noise (#27180)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Grigory Sizov <grisha.sizov@gmail.com>
|
2026-06-03 17:49:34 -07:00 |
|
|
Mick
|
5dbc52c2b7
|
[diffusion] doc: add ernie Image diffusion (#27195)
|
2026-06-04 08:45:56 +08:00 |
|
|
Yinghai Lu
|
7bb5c96685
|
Trigger scheduler diagnostics on health failure (#26757)
|
2026-06-03 17:19:55 -07:00 |
|
|
Baizhou Zhang
|
d097cd2212
|
[GLM-5] Apply trtllm MHA kernel for GLM-5 on Blackwell (#21332)
|
2026-06-03 17:16:54 -07:00 |
|
|
Mick
|
3790173b3b
|
[diffusion] fix: avoid flashattention forward context lookup (#27153)
|
2026-06-04 08:11:50 +08:00 |
|
|
Clintandclintg6
|
cfb7fb4fad
|
[AMD] Fix TP2 DeepSeek-R1 nhead=64 MLA decode crash and add nightly coverage (#27188)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
|
2026-06-03 16:56:05 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
c9ca56da8c
|
Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-03 16:12:27 -07:00 |
|
|
Yihao Wang
|
8980eb82de
|
[Docs] Update Nemotron3-Nano-Omni cookbook to reflect new model paths (#25198)
|
2026-06-03 14:55:30 -07:00 |
|
|
Cheng Wan
|
61aa3293d3
|
Revert "Fix TokenizerManager crash on top_logprobs with tensor values" (#27187)
|
2026-06-03 14:53:28 -07:00 |
|
|
Jiajun Liandzijiexia
|
90985117a5
|
docs: fix Nemotron Super MTP deployment command (spec-v2 + B200) (#27184)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-06-03 14:52:47 -07:00 |
|
|
ishandhanani
|
978fb6ed1a
|
hicache kv events: publish split write-through fragments (#27072)
|
2026-06-03 14:52:25 -07:00 |
|
|
jacky.cheng
|
1dd9432889
|
[AMD] Fuse compress norm+rope+hadamard into single Triton kernel (#26894)
|
2026-06-03 14:20:40 -07:00 |
|
|
|
c670609ac5
|
[NPU] Diffusion CI Ground Truth Generation (NPU) (#24630)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <you@example.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-04 00:14:37 +03:00 |
|
|
Cheng WanandClaude Opus 4.8
|
e485ad6ac1
|
Fix hybrid linear attention dispatch by layer id with draft-worker awareness (#27120)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-03 14:11:14 -07:00 |
|
|
Kevin Flansburg
|
7716fa00e0
|
Fix TokenizerManager crash on top_logprobs with tensor values (#26825)
|
2026-06-03 13:55:02 -07:00 |
|
|
YC Yen-Ching Tseng
|
d1bc06b63b
|
[AMD] Disable AITER custom all-gather in DeepSeek-R1-MXFP4 8-GPU test (#27163)
|
2026-06-03 13:38:34 -07:00 |
|
|
|
293816ab14
|
[AMD][MXFP4] Online MXFP4 quantization 1/N - dense and MOE models w. original BF16 weight (#18005)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Colin Zeng <Colin.Zeng@amd.com>
|
2026-06-03 12:55:24 -07:00 |
|
|
Hanming LuandYAMY
|
e0b692600f
|
[Mamba] extra buffer lazy support (#27118)
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-06-03 12:42:11 -07:00 |
|
|
Liangsheng YinandAlison Shao
|
ac99794e64
|
Reland spec v2 tree drafting (eagle topk>1) with page_size==1 (#26866) (#26997)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
|
2026-06-03 15:40:05 -04:00 |
|
|
Mohammad Miadh Angkad
|
7f706f4cfb
|
[Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854)
|
2026-06-03 12:09:18 -07:00 |
|
|
Liangsheng Yin
|
578f232e5e
|
Fix trace_modules gate disabling default trace contexts (#27173)
|
2026-06-03 14:03:42 -04:00 |
|
|
Cheng WanandClaude Opus 4.8
|
45604a0f4a
|
[refactor] Unify CUDA graph runner input buffers behind CudaGraphBufferRegistry (#26742)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-03 10:54:10 -07:00 |
|
|
Mick
|
b0f78bef97
|
[diffusion] improve: improve realtime webui playback pacing (#27148)
|
2026-06-04 00:33:56 +08:00 |
|
|
Xinyuan Tong
|
45a66f4088
|
[Docs] Update unified Text/Vision/Audio model cookbook: install + sgl-eval accuracy (#27171)
|
2026-06-03 09:32:08 -07:00 |
|
|
Lijuan TangandXiaodong Ye
|
9d0e6a2df4
|
fix(mlx): set canary_manager and materialize overlap-loop inputs on Apple Silicon (#26882)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Signed-off-by: LijuanTang94 <tang.lij@northeastern.edu>
Co-authored-by: Xiaodong Ye <yeahdongcn@gmail.com>
|
2026-06-04 00:03:46 +08:00 |
|