Mick
|
4cb6d81bda
|
[diffusion] CI: make consistency GT probe robust to transient CDN failures (#29545)
|
2026-06-28 17:13:53 +08:00 |
|
Liangsheng Yin
|
6582fc1e5d
|
dflash: drop verify_done barrier; rely on scheduler WAR fallback (#29556)
|
2026-06-28 01:47:17 -07:00 |
|
Martin Hua
|
b1da2082ca
|
chore: bump sgl-deep-gemm build-time apache-tvm-ffi 0.1.9 -> 0.1.11 (#28481)
|
2026-06-28 00:26:24 -07:00 |
|
Liangsheng Yin
|
593f5ba68f
|
[Spec] Replace shared-infra dflash special-cases with capabilities (WAR barrier + seq_lens_cpu) (#29232)
|
2026-06-28 00:02:32 -07:00 |
|
Mick
|
97ddc66209
|
[diffusion] nightly: track SGLang-Diffusion only (#29434)
|
2026-06-28 14:23:17 +08:00 |
|
Mick
|
643e1cc779
|
fix: fix prefill-aware SWA floor tracking (#29520)
|
2026-06-28 14:18:28 +08:00 |
|
Xinyuan Tong
|
ddc389cf09
|
[minimax-m3] Split 3/4: disagg K-only index-K transfer (#28714)
|
2026-06-28 13:54:42 +08:00 |
|
Lianmin Zheng
|
6eedc8f376
|
Fix EAGLE draft hidden dim extraction and centralize spec helpers (#29464)
|
2026-06-27 21:48:26 -07:00 |
|
 Lianmin ZhengandYinghai Lu
|
5747ed3b19
|
Fix DP-attention SHM feature finalization race (#29543)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
|
2026-06-27 21:36:58 -07:00 |
|
Mohammad Miadh Angkad
|
ae09b8302f
|
[CI] Fix GB300 DSV4 Pro FP4 nightly (#29502)
|
2026-06-27 21:06:17 -07:00 |
|
Mick
|
4a76699dfc
|
[diffusion] fix: fix --warmup silently downgrading server-based warmup to request mode (#29514)
|
2026-06-28 11:46:07 +08:00 |
|
Lianmin Zheng
|
e6cbc8f5fe
|
Fix SWA cache loc slicing for all attention backends (#29460)
|
2026-06-27 20:37:58 -07:00 |
|
Liangsheng Yin
|
4e6ce8e4ab
|
[Spec] Capture DFLASH draft greedy sampling inside the draft decode cuda graph (#29395)
|
2026-06-27 19:34:26 -07:00 |
|
 sglang-botandClaude Sonnet 4.6
|
3d922a51fc
|
test: remove multimodal piecewise CUDA graph gate test (#29537)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-06-27 19:03:32 -07:00 |
|
 Khoa PhamandCursor
|
da802ddcaf
|
(perf): Shard Kimi-K2.5 Eagle3 draft fc + symm-mem AG (#29223)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-27 17:40:32 -07:00 |
|
 
|
073de15053
|
Fuse the DSA (V3.2, GLM-5.x) indexer Q/K paths into single kernels (#27705)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: Kaixi <kaiximatteoc@nvidia.com>
|
2026-06-27 14:29:56 -07:00 |
|
 Brayden ZhongandBrayden Zhong
|
e4253b39e2
|
Support JIT fused A GEMM (MLA down projection) and support GLM-5 hidden size, SM120 (#27397)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-27 13:32:06 -07:00 |
|
 Xinyuan Tongandhzh0425
|
592f6c849b
|
[minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-06-28 00:19:38 +08:00 |
|
Mick
|
cfd911ad6e
|
docs: refine diffusion cookbook overview (#29507)
|
2026-06-28 00:10:21 +08:00 |
|
 Aditya KamatandMick
|
1589603114
|
model: support baidu unlimited-ocr (#29186)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-27 23:36:19 +08:00 |
|
 
|
b030b1a5f3
|
hisparse: support NIXL DRAM KV destinations for HiSparse (#27563)
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-27 22:32:29 +08:00 |
|
 
|
c1b5c7e499
|
Fix DeepSeek V4 PP HiCache SWA allocation and layer mapping (#29106)
Co-authored-by: hjzhang <zhanghjzzz@qq.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-06-27 22:19:14 +08:00 |
|
 jonah-bermanandXinyuan Tong
|
2f34dbe372
|
Add native Exa-backed web_search support (#29342)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-27 14:41:09 +01:00 |
|
Mick
|
3306233961
|
[diffusion] optimize: optimize LTX2.3 CFG path (#28624)
|
2026-06-27 19:23:14 +08:00 |
|
Mick
|
91f9e7372d
|
[diffusion] CI: refactor CI (#28762)
|
2026-06-27 19:22:27 +08:00 |
|
amote-i
|
a3c5e286f6
|
[NPU] [DOC] Fix and update Ascend NPU docs (#29501)
|
2026-06-27 18:23:11 +08:00 |
|
 zijiexiaandClaude Opus 4.8
|
e0c0c0a45c
|
[Cookbook] GLM-5.2: tune GB300 NVFP4 recipes + fill benchmarks (#29486)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-27 01:01:28 -07:00 |
|
 
|
9214b9338f
|
[DSA] Enable draft-extend CUDA graph for DeepSeek Sparse Attention (#29413)
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
Co-authored-by: Jackey Hua <107608053+zhendonghua@users.noreply.github.com>
|
2026-06-26 23:53:46 -07:00 |
|
 Raiden MakotoandRaiden-Makoto
|
81d3c3ce77
|
[AMD] [GLM5] Guard cuda_runtime.h for ROCm in fused_metadata_copy (#29373)
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
|
2026-06-26 23:29:19 -07:00 |
|
Xiaoyu Zhang
|
c36f166364
|
[skill] Remove outdated llm-serving-auto-benchmark skill (#29487)
|
2026-06-27 14:19:11 +08:00 |
|
Chengze Fan
|
43435a2f8e
|
[mori] Add a combine-kwargs hook and use_external_inp_buf plumbing (#29097)
|
2026-06-26 22:34:27 -07:00 |
|
Chengze Fan
|
19abebcc6a
|
[server_args] Make MoRI per-rank dispatch-token requirement overridable (#29096)
|
2026-06-26 22:25:36 -07:00 |
|
 Xiaoyu ZhangandClaude Opus 4.8
|
495f13fa12
|
[KDA-Pilot] Add diffusion residual-gate CUDA fast path for LTX2 (#29361)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-27 12:59:41 +08:00 |
|
Liangsheng Yin
|
cd6dedf972
|
[router] Count requests/responses at the HTTP edge for true intake (#29467)
|
2026-06-26 21:21:41 -07:00 |
|
Lianmin Zheng
|
09ca4fc96b
|
Skip FlashInfer FP8 autotune for MXFP8 quantized models (#29462)
|
2026-06-26 18:15:08 -07:00 |
|
 IvanShan177andClaude Opus 4.8
|
13b5bd962a
|
fix(spec): track current_token in ReasonerGrammarObject (#29102)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-26 16:43:35 -07:00 |
|
 
|
da0f4f6f92
|
[HiCache] remove large host mem constraint (#28614)
Co-authored-by: Teng Ma <stmatengss@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-06-26 16:20:48 -07:00 |
|
Baizhou Zhang
|
12f76d115c
|
Update GLM-5.2 B300 and GB300 NVFP4 cookbook settings (#29466)
|
2026-06-26 16:15:33 -07:00 |
|
Michael
|
c470acde2b
|
[AMD] Register 1 kernel unit test for AMD nightly CI (#29333)
|
2026-06-26 16:06:02 -07:00 |
|
Lianmin Zheng
|
9c3227b689
|
Fix IPv6 wildcard bootstrap address resolution in disagg (#29459)
|
2026-06-26 16:05:36 -07:00 |
|
YC Yen-Ching Tseng
|
5eebb4b2e8
|
[AMD] Fix fused append+remap DeepEP equivalence test on aiter path (#29377)
|
2026-06-26 16:04:20 -07:00 |
|
Po-Han Huang (NVIDIA)
|
72812db138
|
Avoid dynamic Q quantization in trtllm_mha (#29423)
|
2026-06-26 15:51:15 -07:00 |
|
Baizhou Zhang
|
73741f7074
|
Bypass legacy GLM DSA layer types validation (#29454)
|
2026-06-26 15:24:16 -07:00 |
|
 
|
267d165ad0
|
shm_broadcast: retry bind on EADDRINUSE (fix dp-attention port race) (#29455)
Co-authored-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>
Co-authored-by: xingyuliu <xingyuliu@fb.com>
|
2026-06-26 14:49:39 -07:00 |
|
Jimmy Shong
|
e745b3af22
|
[Fix] compressed-tensors block FP8: requantize weight scales to UE8M0 for DeepGEMM on Blackwell (#28662)
|
2026-06-26 21:41:18 +00:00 |
|
Cheng Wan
|
7b02eab7a6
|
Revert "[DeepSeek V3] Run routed experts on main stream in dual-stream MoE" (#29452)
|
2026-06-26 13:59:36 -07:00 |
|
 Jackey HuaandClaude Opus 4.8
|
ee77a7d330
|
[Fix] DSA: size cudagraph page_table to req_to_token width (#29379)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-26 12:17:34 -07:00 |
|
 Rain JiangandLianmin Zheng
|
be1930133a
|
Convert IPC dataclasses to msgspec.Struct with opt-in msgpack transport (#28688)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-26 12:04:03 -07:00 |
|
 
|
714011a40f
|
[JIT Kernel] Migrate dsv3_router_gemm from AOT sgl-kernel to JIT kernel (#21531)
Co-authored-by: Guohao Shao <shao.gh.98@gmail.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-26 11:52:18 -07:00 |
|
 Yaochen Hanandronnie_zheng
|
c98d31143d
|
update quantization code owner and document quantization contributions (#26784)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-26 19:40:33 +03:00 |
|