Commit Graph
16924 Commits
Author SHA1 Message Date
Shangming Cai 23cb04093c fix(multimodal): keep LLaVA image fetch off the CPU-preprocess timeout budget (flaky test_mixed_batch) (#35700) 2026-08-21 01:26:30 +08:00
Ke Bao ba97cc6397 Skip empty linear-attention state buffers in PD transfer (#35689) 2026-08-21 01:00:50 +08:00
R0CKSTAR 81df6f2c57 [MUSA] Harden CI dependencies and diffusion warmup (#35610) 2026-08-20 09:40:24 -07:00
Mick be373395b4 [diffusion] feat: support out-of-tree models and pipelines (#35713) 2026-08-21 00:33:34 +08:00
Mick 7f8f030000 [diffusion] feat: let every layerwise component be configurable (#35688) 2026-08-20 22:38:05 +08:00
Xiaoyu Zhang 04444ee352 [diffusion] Refresh eager optimization skills and benchmark safeguards (#35679) 2026-08-20 22:03:57 +08:00
Shuwen Wang 9b249a25a1 test: switch the Inkling-Small NVFP4 deterministic suite to DSPARK (#35293) 2026-08-20 21:54:52 +08:00
silencejade b03ac355e7 [NPU] [FIX] Fix non-contiguous parameter issue in FIA operator (#34936) 2026-08-20 20:43:40 +08:00
Estrella-xx c98f1ccedb [NPU]Ensure tensors allocated by empty_like are contiguous (#34935) 2026-08-20 20:40:57 +08:00
Mohammad Miadh Angkad a4ffb996db [Fix] Keep deterministic GDN prefill on Triton (#35632) 2026-08-20 19:38:53 +08:00
Mick 82c6fc2db9 [diffusion] quant: support pruned safetensors checkpoints for minimax-h3 (#35418) 2026-08-20 19:34:14 +08:00
Mick 97efc0507c [diffusion] feat: plan pinned host memory against the cgroup cap not the machine (#35641) 2026-08-20 19:32:29 +08:00
Jimmy Shong 710267dc4c [Quant] Load compressed-tensors kv_cache_scheme scales (#35455) 2026-08-20 19:17:59 +08:00
Mick cf3813f4ce [diffusion] feat: add weight source reader (#35668) 2026-08-20 18:37:29 +08:00
Mick 17313cf4b2 [diffusion] CI: add minimax-h3 ref2va audio consistency coverage and guard peak vram (#35511) 2026-08-20 17:22:05 +08:00
Mick f1b9a1f42a [diffusion] feat: support unverified short edge instead of rejecting it for minimax-h3 (#35664) 2026-08-20 16:52:44 +08:00
Bingxu ChenandCursor 06ad7b2b0d [AMD][CI] Run Both ROCm 7.2.4 and ROCm 7.2.0 Images on Nightly Test AMD (#35603)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-20 01:37:23 -07:00
Bingxu Chen f386e2a471 [AMD][CI] Default the ROCm 7.2 PR gate to ROCm 7.2.4 Image (#35602) 2026-08-20 01:36:26 -07:00
21c88f8625 [diffusion] quant: support gguf (#35370)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-08-20 15:46:34 +08:00
YAMY ae23423b46 Split TRTLLM MHA decode batches by KV sequence length (#34888) 2026-08-20 00:44:26 -07:00
Mick b8996a5ab2 [diffusion] fix: keep large vocab tables in host memory under layerwise offload (#35626) 2026-08-20 15:20:06 +08:00
YC Yen-Ching Tseng 7ba3430365 Fix Grok-2 nightly: derive image-understanding capability from is_multimodal (#33730) 2026-08-19 23:56:51 -07:00
Baizhou Zhang d287880a7a Update deepep for SBO feature (#35450) 2026-08-19 23:37:13 -07:00
0bda0b168a [Fix]: exclude SM120 from attn-res TMA dispatch (#35361)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
2026-08-20 14:32:31 +08:00
Shangming Cai 628674a5c7 Remove unused MOONCAKE_COMPILE_ARG argument from Dockerfile (#35649) 2026-08-20 14:19:52 +08:00
cctryandcctry 32d98aad13 [HiCache] Allow a retraction host pool smaller than the device pool (#35543)
Co-authored-by: cctry <cctry@fb.com>
2026-08-19 22:59:57 -07:00
50dae2d99d Amd/dsv4 shared experts fusion top6 (#32340)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-19 22:57:58 -07:00
Michael 02b93e7e01 [AMD] Add GLM-5.2 MI35x nightly accuracy and perf benchmark (#32570) 2026-08-19 22:49:43 -07:00
siyuandliusy58 58e327480a update codeowner (#34802)
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
2026-08-19 22:43:15 -07:00
Mohammad Miadh Angkad ba433bb462 [Docs] Update contribution guide (#35419) 2026-08-19 22:31:24 -07:00
09b7af1371 [CI] Surface AMD ROCm 7.2 state in the PR CI-states block (#34813)
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: Chen <bingxche@amd.com>
2026-08-20 13:18:30 +08:00
Alex NailsandClaude Opus 5 b6dcd393d6 [Fix] Support 128-aligned hidden sizes in the W4AFP8 DeepEP low-latency requant kernel (#35593)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-19 22:18:17 -07:00
Mick f744607567 [diffusion] UX: report where a component's weights are (#35618) 2026-08-20 13:05:14 +08:00
a5a9d66baf [XPU] Fix/kimi linear xpu (#34546)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap02.iind.intel.com>
2026-08-20 12:43:41 +08:00
Mick db2eb47500 [diffusion] fix: keep cosmos3 T=1 fusion on blackwell only (#35612) 2026-08-20 12:13:04 +08:00
Mick a3e4592f89 [diffusion] CI: use canonical residency selector in nightly (#35615) 2026-08-20 10:50:29 +08:00
Mick 3b22f4f000 [diffusion] UX: reduce per-request log noise (#35614) 2026-08-20 10:49:54 +08:00
360d10d6bc [Feature] Add process-local in-memory KV indexer and Router integration (#33370)
Co-authored-by: Wu, Yutong <yutong.wu@amd.com>
Co-authored-by: TianDi101 <ditian12@amd.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-08-20 10:45:35 +08:00
ashwini rathi 238ba40c27 [XPU][CI] key persistent JIT kernel cache by image content ID (#35337) 2026-08-20 10:27:59 +08:00
9db4ba8da1 [DeepSeek-V4] Add Q8KV8 sparse MLA prefill runtime backend (#32327)
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-08-20 10:23:49 +08:00
Liangsheng Yin a49560ce50 [misc] Add a comment style rule to .claude/rules (#35597) 2026-08-19 18:52:48 -07:00
datdo-msft f65961844a docker: fix CUDA-13 build — rename NCCL_VERSION ARG to avoid base image ENV collision (#35587) 2026-08-19 18:41:53 -07:00
dc175b3ad2 [CI][AMD] Run the profiling suite without CUDA graphs on ROCm (#34452)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
2026-08-20 09:41:28 +08:00
chuyehandChen c7478228dd [AMD] [Docker] Upgrade Python 3.12 + torch 2.11 + triton 3.7 in ROCm 7.2.4 (#30984)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-19 18:18:31 -07:00
Mick ab203663c4 [diffusion] fix: reject unsupported modelopt checkpoint algorithms (#35182) 2026-08-20 09:13:24 +08:00
Jimmy ShongandLING ZHI 1cf2b8c54d [Spec] Support quantized target lm_head in the DFlash2 selector (#35496)
Co-authored-by: LING ZHI <1747985437lz@gmail.com>
2026-08-19 18:06:41 -07:00
Mick 1f87d8f512 [diffusion] fix: stop reserving nccl device buffers for single-rank groups (#35538) 2026-08-20 09:04:35 +08:00
MichaelandCursor Agent e805a8f98e [AMD] Keep the PTX-inline-asm diffusion norm fusions off on ROCm (fix FLUX warmup crash) (#34481)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-08-20 08:55:28 +08:00
Lianmin Zheng f736895ce9 Make PR babysitter launcher fork-safe (#35575) 2026-08-19 17:48:34 -07:00
Lianmin ZhengandYichao Fu 99c12218c3 Support custom draft worker classes in DSpark (#35397)
Co-authored-by: Yichao Fu <yichaofu@meta.com>
2026-08-19 17:48:17 -07:00