Commit Graph
15306 Commits
Author SHA1 Message Date
kangwangamd f8eac995aa [diffusion] test: fix GLM-Image AR model-path to resolve local snapshot subfolder (#31313) 2026-07-15 23:57:34 -07:00
amote-i 6275114548 [NPU] [DOC] Update model names supported on Ascend NPU (#31316) 2026-07-16 14:45:59 +08:00
Xiaoyu Zhang e73f323464 [JIT] Reduce MoE fused gate CI test sweep (#31400) 2026-07-16 14:42:45 +08:00
YC Yen-Ching Tseng 8c5e0cee18 [AMD] Bump MoRI to f7e6ac6 to fix ROCm install_dependency build break (#31406) 2026-07-15 23:40:18 -07:00
0a64139c94 Fix --moe-a2a-backend silently ignored for LongCat-2.0 (moe_topk missing from gate) (#30975)
Co-authored-by: whn09 <whn09@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-16 14:40:01 +08:00
Ryan Zzzandzhujunyu 5af65d8542 [DeepSeek-V4] Support BF16 Compress State for Online C128 (#29609)
Co-authored-by: zhujunyu <zhujunyu.666@bytedance.com>
2026-07-15 23:17:29 -07:00
Khoa PhamandClaude Fable 5 dc60f65661 chore: bump tokenspeed_mla to 0.1.8 (#31385)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:37:54 -07:00
weireweireandweireweire ac4fa6496c Skip no-op EAGLE sampling renormalization (#31294)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-07-15 22:37:10 -07:00
Yanbin Jiang 40517b593b [docs] Inkling cookbook: LoRA cells require --disable-prefill-cuda-graph (#31418) 2026-07-16 05:19:49 +00:00
Liangsheng Yin 0b372d03de [CI] Guard partition consumers against failed check-changes and degenerate fits (#31416) 2026-07-15 22:09:40 -07:00
Alison Shao 238448f4c8 ci: fix runner utilization report undercounting busy time ~25x (#31396) 2026-07-15 22:02:38 -07:00
Liangsheng Yin b871a509e6 [Fix] Wire the detokenizer soft watchdog into the multi-http-worker event loop (#31392) 2026-07-15 21:55:46 -07:00
Zaili Wangandzijiexia bc525dcf90 [Cookbook][CPU]Update CPU model support info in Cookbook (#30520)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
2026-07-16 03:42:09 +00:00
guzekai01 dee91c51cf perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983) 2026-07-16 11:16:32 +08:00
guzekai01 7f9a902cd9 fix(humming): handle missing quant_method (#31185) 2026-07-16 11:15:52 +08:00
Xiaoyu ZhangandClaude Fable 5 22453ca63c docker: build HPC-Ops into the GPU image (#31390)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 11:07:01 +08:00
Swift.Sun f28ce5c420 [XPU]REPO cache dtype xpu align with cuda (#31140) 2026-07-16 10:30:01 +08:00
3a8ddd3fd0 [XPU] Route topk_sigmoid and topk_softmax to AOT sgl-kernel-xpu symbols (#31038)
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-07-16 10:29:19 +08:00
YC Yen-Ching Tseng 14095ef78a [AMD] Disable CUDA IPC multimodal transport on ROCm in MMMU VLM tests (#31342) 2026-07-15 18:42:30 -07:00
Mick d9003dd452 fix: skip unsafe automatic prefill graph capture (#31204) 2026-07-16 09:27:38 +08:00
Serge Panev 1c4892d7bb [Mamba] Fix spec-v2 + extra_buffer crash (guard None mamba_next_track_idx) (#27998) 2026-07-15 18:23:14 -07:00
Brayden ZhongandBrayden Zhong 7647a9d260 Fuse the preprocess kernels of trtllm-gen attention (#29690)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-07-15 18:21:34 -07:00
McZyWu 871c648203 [NPU]revert add scoring func for GLM 4.7 Flash (#31388) 2026-07-16 09:16:57 +08:00
Brayden ZhongandBrayden Zhong edb2059139 Support Flashinfer one-sided A2A + CuteDSL MoE for Nemotron Ultra (#28309)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-07-15 18:14:20 -07:00
Brayden ZhongandBrayden Zhong ac23be8d09 Skip MXFP8 autotune on dense GEMM, which causes IMA (#29669)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
2026-07-15 18:06:55 -07:00
Brayden ZhongandBrayden Zhong 0b04e9da83 Use fused A GEMM for fc1_latent_proj in NemotronH (#29692)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-07-15 18:05:22 -07:00
Liangsheng Yin 1cc9493747 [Spec] Converge DP-attention spec width scaling onto num_tokens_per_req (#31244) 2026-07-15 17:57:08 -07:00
Po-Han Huang (NVIDIA) 5d004a20c5 Fix FlashInfer A2A top-k ID dtype (#29929) 2026-07-15 17:56:11 -07:00
sglang-botandsglang-bot 34f5691ea1 docs: sync LMSYS SGLang blog cards (#31386)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-07-16 00:53:19 +00:00
Liangsheng Yin b0b2dfbda1 [Spec] Extract the shared draft() tail into build_eagle_verify_input (#31375) 2026-07-15 15:59:31 -07:00
7a973c03a0 [Bugfix] Stamp capture-time num_tokens_per_req in multi-layer EAGLE; close jit_kernel CI filter gaps (#31367)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-07-15 15:24:32 -07:00
Lewisand百麒 3101c1258c [DSv4] Use BF16 instead of FP32 for indexer score computation (#30012)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
2026-07-15 15:06:55 -07:00
Jorge António 26cb0fcdda Empty _REQ_TYPES_WITH_OPAQUE_FIELDS on the msgpack IPC path (#29465 Task 4) (#30182) 2026-07-15 14:55:06 -07:00
Michael 67148447a6 [AMD] Register 3 CPU-bound / triton unit + light-integration tests for AMD 1-GPU PR CI (#31088) 2026-07-15 14:36:05 -07:00
karverma-amd ec32590025 feat(moriep): add fp4 combine dtype (SGLANG_MORI_COMBINE_DTYPE=fp4) (#30706) 2026-07-15 14:21:41 -07:00
jacky.cheng e78051a419 [AMD] [Fix] Fix --attention-backend triton work for DeepSeek MLA on MI355 (null-K + decode dispatch + RoPE) (#30355) 2026-07-15 14:19:23 -07:00
Liangsheng Yin e76cc75cfa [CI] Remove nightly registrations redundant with scheduled stage runs (#31371) 2026-07-15 14:12:07 -07:00
Yuhao Yang 5abec3fbf8 Fix MiMo-V2 on Blackwell: FA3 fallback and TP-aware audio weight loading (#31343) 2026-07-15 13:26:27 -07:00
Mohammad Miadh Angkad 18043aec20 [CI] Fix TRTLLM MHA graph metadata test fixture (#31332) 2026-07-15 12:44:51 -07:00
Shaun Kotek ab627e5d75 fix: load the right mtp lm head quantization (#30976) 2026-07-15 12:12:04 -07:00
Xuwei 7e7129acd7 [Bugfix] Release Mamba cache after PP dynamic chunk profiling (#31321) 2026-07-16 02:32:07 +08:00
YAMYandXuwei Li 2d00e20a52 [Disagg][Qwen3.5] Fix heterogeneous attn-TP scatter transfer: GDN conv sub-block slice + GQA replicated-KV head map (#30997)
Co-authored-by: Xuwei Li <lixuwei.xy@gmail.com>
2026-07-16 02:31:37 +08:00
Yuhao Yang dd2e4cdc99 Add Inkling cookbook (#31360) 2026-07-16 02:24:31 +08:00
AuFlowandAuFlow 9d147fdca1 [Multimodal] Support n>1 outputs for GLM-Image generation (#31027)
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
2026-07-15 20:55:19 +03:00
Liangsheng Yin dc078ddd2a [Spec] Extract stateless draft prepare helpers into eagle_worker_common (#31257) 2026-07-15 10:54:31 -07:00
Bingxu Chenandntgiang71096 d36e96ce23 [AMD] Enable mamba-extra-buffer for Qwen3.5 on ROCm (#30359)
Co-authored-by: ntgiang71096 <nguyentruonggiang71096@gmail.com>
2026-07-15 10:18:12 -07:00
YC Yen-Ching Tsengandkangwangamd a8b60433c2 [AMD] Fix DSV4 JIT build on rocm (#31131)
Co-authored-by: kangwangamd <kangwang@amd.com>
2026-07-15 09:58:12 -07:00
Andy YeandClaude Fable 5 c879f3da5c [diffusion] rl: support rl rollout for the wan pipeline via a per-request scheduler switch (#30036)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:30:51 +08:00
Jun LiuandXinyuan Tong d2b1243be0 docs: document CUDA crash dump output (#31333)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-07-15 22:18:36 +08:00
495ae9aaa6 Fix Ministral3 accuracy issue by aligning YaRN RoPE scaling with Transformers implementation (#31232)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-07-15 15:23:04 +03:00