Commit Graph
11648 Commits
Author SHA1 Message Date
YC Yen-Ching Tseng 7ba3430365 Fix Grok-2 nightly: derive image-understanding capability from is_multimodal (#33730) 2026-08-19 23:56:51 -07:00
Baizhou Zhang d287880a7a Update deepep for SBO feature (#35450) 2026-08-19 23:37:13 -07:00
0bda0b168a [Fix]: exclude SM120 from attn-res TMA dispatch (#35361)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
2026-08-20 14:32:31 +08:00
cctryandcctry 32d98aad13 [HiCache] Allow a retraction host pool smaller than the device pool (#35543)
Co-authored-by: cctry <cctry@fb.com>
2026-08-19 22:59:57 -07:00
50dae2d99d Amd/dsv4 shared experts fusion top6 (#32340)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-19 22:57:58 -07:00
Alex NailsandClaude Opus 5 b6dcd393d6 [Fix] Support 128-aligned hidden sizes in the W4AFP8 DeepEP low-latency requant kernel (#35593)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-19 22:18:17 -07:00
Mick f744607567 [diffusion] UX: report where a component's weights are (#35618) 2026-08-20 13:05:14 +08:00
a5a9d66baf [XPU] Fix/kimi linear xpu (#34546)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap02.iind.intel.com>
2026-08-20 12:43:41 +08:00
Mick db2eb47500 [diffusion] fix: keep cosmos3 T=1 fusion on blackwell only (#35612) 2026-08-20 12:13:04 +08:00
Mick 3b22f4f000 [diffusion] UX: reduce per-request log noise (#35614) 2026-08-20 10:49:54 +08:00
ashwini rathi 238ba40c27 [XPU][CI] key persistent JIT kernel cache by image content ID (#35337) 2026-08-20 10:27:59 +08:00
9db4ba8da1 [DeepSeek-V4] Add Q8KV8 sparse MLA prefill runtime backend (#32327)
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-20 10:23:49 +08:00
Liangsheng Yin a49560ce50 [misc] Add a comment style rule to .claude/rules (#35597) 2026-08-19 18:52:48 -07:00
chuyehandChen c7478228dd [AMD] [Docker] Upgrade Python 3.12 + torch 2.11 + triton 3.7 in ROCm 7.2.4 (#30984)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-19 18:18:31 -07:00
Mick ab203663c4 [diffusion] fix: reject unsupported modelopt checkpoint algorithms (#35182) 2026-08-20 09:13:24 +08:00
Jimmy ShongandLING ZHI 1cf2b8c54d [Spec] Support quantized target lm_head in the DFlash2 selector (#35496)
Co-authored-by: LING ZHI <1747985437lz@gmail.com>
2026-08-19 18:06:41 -07:00
Mick 1f87d8f512 [diffusion] fix: stop reserving nccl device buffers for single-rank groups (#35538) 2026-08-20 09:04:35 +08:00
MichaelandCursor Agent e805a8f98e [AMD] Keep the PTX-inline-asm diffusion norm fusions off on ROCm (fix FLUX warmup crash) (#34481)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-08-20 08:55:28 +08:00
Lianmin ZhengandYichao Fu 99c12218c3 Support custom draft worker classes in DSpark (#35397)
Co-authored-by: Yichao Fu <yichaofu@meta.com>
2026-08-19 17:48:17 -07:00
Lianmin ZhengandXiaozhu Meng 9234e40aed [sampling] Fix int32 offset overflow in top-k renorm Triton kernels (#35571)
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
2026-08-19 17:48:03 -07:00
Shiyan Deng d216737e47 [Kernel] Support wider rows in mega_moe_pre_dispatch (#35372) 2026-08-19 17:47:04 -07:00
elvischenvandClaude Opus 4.8 1df78c2cf1 chore: bump tilelang to 0.1.12 (#30874)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-08-19 17:01:19 -07:00
Jimmy Shong 5375babbac [Quant] Load compressed-tensors quantized lm_head instead of value-casting it (#35228) 2026-08-19 15:37:45 -07:00
c7e2c08d14 fix(constrained): reject NUL bytes in grammar specs to stop an xgrammar segfault (#34679)
Signed-off-by: Junhao Shen <junshen@nvidia.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
2026-08-19 15:31:14 -07:00
milesial 082aac8fce [Bugfix] Fix min-new-token EOS handling (#31378)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
2026-08-19 15:29:22 -07:00
Zhiqiang Xie 01814e110d [HiCache] Simple style change for buffer mode (#35574) 2026-08-19 15:23:21 -07:00
Liangsheng Yin 1270204d2c Revert "[Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend" (#35568) 2026-08-19 14:14:38 -07:00
elvischenvandBrayden Zhong a6bc0532c9 [Fix] Fix Nemotron-H Mamba illegal memory access under DP attention with CUDA graph (#34561)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-08-19 14:13:40 -07:00
milesial ed12d6827d fix(disagg): allow fake transfer with decode DCP (#35409)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
2026-08-19 13:54:37 -07:00
Jason Wiemels defb2a3100 feat(openai): Accept the input_audio content part in chat completions (#33606) 2026-08-19 13:37:50 -07:00
DarkSharpnessandClaude Opus 5 746418a1ec [DSA] Trim top-k v2 output modes and tighten its PDL waits (#35041)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-19 13:09:21 -07:00
cctry 1c82955861 [HiCache] Split the host-memory budget across co-located ranks (#35540) 2026-08-19 13:01:58 -07:00
Ayushman Singh b1707996e8 fix(gemma4): quantize MTP bridge projections (#32440) 2026-08-19 12:41:52 -07:00
Po-Han Huang (NVIDIA) 6f69f927da [Scheduler] Add configurable decode interval after prefill (#35017) 2026-08-19 12:01:36 -07:00
MengYuandmenyu 4f8ecf6ae9 [Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#29525)
Co-authored-by: menyu <menyu@nvidia.com>
2026-08-19 11:52:45 -07:00
YAMY 03cf2de2e3 [Qwen3.5][MTP] Preserve online NVFP4 draft quantization for mixed checkpoints (#35545) 2026-08-19 11:12:32 -07:00
Xinyuan Tong 157d8ad27a Support Intern-S2-Mobius FP8 (#34908) 2026-08-19 10:58:01 -07:00
YAMY 5f12839591 [Fix] Support Kimi-K3 ModelOpt mixed NVFP4/FP8 checkpoint (#35077) 2026-08-19 08:13:45 -07:00
Shuwen Wangandhzh0425 41c018a9ec [UnifiedTree] feat: support runtime attach/detach (#35269)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-08-19 22:49:08 +08:00
Yoray Zack 1ef7882a5b [NIXL] Query EP top-k index dtype (#35294) 2026-08-19 22:31:05 +08:00
Mick e3445ed2bd [diffusion] fix: route quantized vae component repos safely (#35184) 2026-08-19 21:02:46 +08:00
Mick 29f5d1c7c3 [diffusion] fix: fix multi-group layerwise offload startup memory (#35509) 2026-08-19 20:32:31 +08:00
Arseniy Mironovandronnie_zheng c57ada81e1 [Diffusion] Use current_platform instead of hardcoded "cuda" in cosmos3 guardrails (#34612)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-08-19 15:26:28 +03:00
Rohit Kumar SinghandSingh 3e5ce26c2d fix: fix transcription & audio-understanding for ASR/audio/speech models (#32611)
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
2026-08-19 18:44:23 +08:00
f446e853e7 [AMD] DeepSeek-V4: route decode wo_a bf16 batched matmul to aiter batched_gemm_bf16 (#33313)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-19 03:04:48 -07:00
karverma-amd ce1830c59b [AMD] DeepSeek-V4 MI355X: eliminate bpreshuffle fp8-scale relayout copy in dense w8a8 linear (#33165) 2026-08-19 03:02:40 -07:00
HeYaoandHeYao f22442d3a4 Add three new test cases (#35502)
Co-authored-by: HeYao <heyao@example.com>
2026-08-19 17:59:45 +08:00
Shangming Cai adca19c497 [PD] Deferred decode-side KV release for the NIXL backend (#35360) 2026-08-19 17:29:45 +08:00
YAMY aa215e5523 [PD] Overlap prefill DP-rank bootstrap queries (#35071) 2026-08-19 17:25:52 +08:00
Khoa PhamandCursor 0e4a09480c [HiCache] Support DCP with DSpark (#35221)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-19 01:42:19 -07:00