Commit Graph
9835 Commits
Author SHA1 Message Date
da0f4f6f92 [HiCache] remove large host mem constraint (#28614)
Co-authored-by: Teng Ma <stmatengss@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
2026-06-26 16:20:48 -07:00
Lianmin Zheng 9c3227b689 Fix IPv6 wildcard bootstrap address resolution in disagg (#29459) 2026-06-26 16:05:36 -07:00
Po-Han Huang (NVIDIA) 72812db138 Avoid dynamic Q quantization in trtllm_mha (#29423) 2026-06-26 15:51:15 -07:00
Baizhou Zhang 73741f7074 Bypass legacy GLM DSA layer types validation (#29454) 2026-06-26 15:24:16 -07:00
267d165ad0 shm_broadcast: retry bind on EADDRINUSE (fix dp-attention port race) (#29455)
Co-authored-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: xingyuliu <xingyuliu@fb.com>
2026-06-26 14:49:39 -07:00
Jimmy Shong e745b3af22 [Fix] compressed-tensors block FP8: requantize weight scales to UE8M0 for DeepGEMM on Blackwell (#28662) 2026-06-26 21:41:18 +00:00
Cheng Wan 7b02eab7a6 Revert "[DeepSeek V3] Run routed experts on main stream in dual-stream MoE" (#29452) 2026-06-26 13:59:36 -07:00
Jackey HuaandClaude Opus 4.8 ee77a7d330 [Fix] DSA: size cudagraph page_table to req_to_token width (#29379)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 12:17:34 -07:00
Rain JiangandLianmin Zheng be1930133a Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-26 12:04:03 -07:00
714011a40f [JIT Kernel] Migrate dsv3_router_gemm from AOT sgl-kernel to JIT kernel (#21531)
Co-authored-by: Guohao Shao <shao.gh.98@gmail.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-26 11:52:18 -07:00
Xiaoyu Zhang 8524678889 Fix MiniMax MSA fallback when fmha plan is unavailable (#29250) 2026-06-26 23:14:31 +08:00
Xiaoyu Zhang 18b0e5757e [Diffusion] Fuse LTX2 Ada values (#29390) 2026-06-26 23:13:15 +08:00
Aleksi Vesanto b91348071e [diffusion] optimize: shard qwen text embed in sp (#29147) 2026-06-26 21:44:45 +08:00
syy-hw f5708c3f91 [NPU] Fix mllama cross-attention crash in ascend extend SDPA (#29374) 2026-06-26 17:13:17 +08:00
Yan Ru Pei c0d4d1897c fix: batch BlockRemoved events per radix node (#29265) 2026-06-26 16:13:40 +08:00
999199f9ff [DeepSeek V3] Run routed experts on main stream in dual-stream MoE (#29142)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-26 00:48:59 -07:00
aeb4e98108 [diffusion] model: support JoyEcho multi-shot A/V generation support (#27420)
Co-authored-by: niehen6174 <niehen6174@users.noreply.github.com>
Co-authored-by: 1639206518@qq.com <niehen6174>
2026-06-26 15:46:31 +08:00
Xiaoyu ZhangandClaude Opus 4.8 5996b54bd3 [KDA-Pilot] Add diffusion causal Conv3D cat-pad CUDA fast path for Cosmos3 (#29281)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-26 15:06:49 +08:00
Yuan Luoandluoyuan.luo a10a24e9a7 [GDN][KDA] ReplaySSM buffered output-only decode for Linear Attention (#28451)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-26 14:17:02 +08:00
Polisetty V R K Jyothendra VarmaandMa Mingfei dc113e8804 [Intel GPU] DeepSeek V4 3/N: Support hc_split_sinkhorn on XPU using sgl_kernel (#27783)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-06-26 13:57:13 +08:00
Khoa PhamandCursor eeee3abbbf [CI] Fix false spec accept length failure after profiling phase (#29329)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-25 22:19:30 -07:00
ziang663 ff89e0fe9a Fix KV event publisher bind conflict under PP (#29044) 2026-06-26 12:50:49 +08:00
ziang663 8fd6e9e017 Fix fixed-size HiCache capacity under PP (#29258) 2026-06-26 12:49:23 +08:00
Liangsheng Yin b6ebdcc92e [test] Split perf table out of fwd occupancy kit report (#29348) 2026-06-25 20:23:42 -07:00
cfc0a0e0e0 Add Intel Quantization Support in SGLang (#18139)
Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
2026-06-26 09:54:35 +08:00
hhhh1252023 781537b61d [NPU] Nightly CI refactor and enhancement (#27433) 2026-06-26 08:52:06 +08:00
Xinyuan Tong ed71fb8f95 fix(anthropic): detect-and-passthrough mid-conversation system messages (#28906) 2026-06-25 17:14:12 -07:00
R0CKSTAR 38e857f423 [MUSA][diffusion] Bump torchada version to 0.1.68 (#29236)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2026-06-25 16:53:43 -07:00
Ma Mingfei 1ba7c79761 [CPU] add indices in chunk_gated_delta_rule (#29267) 2026-06-26 07:51:07 +08:00
Augusto Yao ea8f4e9f3f [feature] implement dcp for deepseek_v2 (#14194) 2026-06-25 15:15:04 -07:00
Liangsheng Yin e4696ed62d [test] Report token tps in fwd occupancy kit and force ignore_eos (#29332) 2026-06-25 15:08:33 -07:00
kkandwunhuang b7d3c3016d [AMD] Feat/dsv4 aiter reduce scatter decode (#29103)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-06-25 13:45:18 -07:00
Mohammad Miadh Angkad 212c30d008 [MoE Refactor] Centralize FlashInfer CUTLASS MoE runner (#28211) 2026-06-25 13:40:33 -07:00
cctry dbe9e3b706 [PD] Early-send cached-prefix KV overlapping uncached prefill forward (#29316) 2026-06-25 13:31:53 -07:00
Lianmin Zheng 118d6b2e5e [Cleanup] Style and type annotation improvements extracted from #28688 (#29224) 2026-06-25 12:51:15 -07:00
weireweire f9a3720e2b Skip empty non-idle output batches (#28504) 2026-06-26 02:40:01 +08:00
52c32035eb [diffusion] Add Qwen-Image ModelOpt NVFP4 support (#28928)
Co-authored-by: jingyu-ml <jingyux@nvidia.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-25 22:56:09 +08:00
Mick 890b38c211 [diffusion] doc: fix diffusion docs and cookbook drift (#29302) 2026-06-25 21:13:00 +08:00
Xiaoyu Zhang ddda4f9028 [Bugfix] Fix Ministral3 init argument forwarding (#29111) 2026-06-25 18:26:45 +08:00
Rita Brugarolas 3d3a7ec031 [AMD] fix(moe): correct fused shared-expert scaling on aiter/DeepEP path (mori all-to-all) (#28237)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
2026-06-25 01:56:30 -07:00
Rita Brugarolas de2d01c8da [AMD] Fuse shared-expert append + DeepEP remap into one Triton kernel (#28450)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
2026-06-25 01:22:57 -07:00
Yuhao Yang 4a8200565e Fused QK GemmaRMSNorm + RoPE + gate kernel for Qwen3.5 (#28320) 2026-06-25 15:58:54 +08:00
Liangsheng Yin 2812a3c93a [Spec] Unify spec/non-spec decode result handling and overlap relay-payload gating (#29225) 2026-06-25 00:44:38 -07:00
jiayisunx d717e926c1 fix(runner): prevent eager token buffer under-allocation (#28894) 2026-06-25 14:37:19 +08:00
Raiden MakotoandRaiden-Makoto 9215da2515 [AMD] [GLM5] skip redundant -inf pre-fill of HIP indexer MQA-logits (#28757)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
2026-06-24 23:21:39 -07:00
AndyLi429 72cac88022 [NPU] perf: precompute mamba conv-state track indices once per batch (#29105) 2026-06-25 14:04:56 +08:00
Yanbin JiangandYusheng Su 9fd6d0ec99 [LoRA] BF16 support + EP cuda-graph crash fix for experimental_sgl_trtllm MoE-LoRA (#28953)
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
2026-06-24 21:16:50 -07:00
wenxuewuhdandronnie_zheng a9270250c3 Dllm radix cache npu (#27144)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-25 06:44:03 +03:00
CrazyCoderandClaude Opus 4.8 c268a7edf5 [Bugfix] Fix inverted PP-disable condition for diffusion LLM inference (#27700)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-24 20:18:00 -07:00
Mohammad Miadh Angkad 8b7a1e908a Revert Gemma4 modelopt fp4 MoE backend change (#28347) 2026-06-24 19:49:09 -07:00