|
54e71506b3
|
[AMD][DSV4] Remove per-batch D2H syncs in MTP to avoid bubbles between 2 batches (#29420)
Co-authored-by: amd-danli103 <amd-danli103@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-06-29 22:39:59 -07:00 |
|
|
yifei wuandXinyuan Tong
|
f41d455f37
|
[Model] Add HrmTextForCausalLM (Hierarchical Reasoning Model - Text) (#27887)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-30 13:32:32 +08:00 |
|
|
YC Yen-Ching Tseng
|
7d9116d9d7
|
Fix test_type_based_dispatcher after TokenizedGenerateReqInput field changes (#29376)
|
2026-06-29 22:22:22 -07:00 |
|
|
Michael
|
7da4e30d9b
|
[AMD] Register fused_metadata_copy JIT kernel test for AMD nightly CI (#29671)
|
2026-06-29 21:26:11 -07:00 |
|
|
Zhaoyi Liandbingxche
|
6bf15aa2b9
|
[AMD]: Enable NIXL PD disaggregation for ROCm(1/n) (#28348)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-06-29 21:23:09 -07:00 |
|
|
Mick
|
2068ae7eec
|
[diffusion] chore: document VAE decode parallel group axes (#29364)
|
2026-06-30 12:14:55 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
3add35e26d
|
[Diffusion] Reuse shared AlignedVector and tidy jit_kernel/diffusion (#29664)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-30 11:38:22 +08:00 |
|
|
Zaili Wang
|
8dbf04fc56
|
Add new Intel SGLang members into CI_permission list (#29700)
|
2026-06-30 11:06:28 +08:00 |
|
|
Mohammad Miadh Angkad
|
3a72d02415
|
[DSA] Optimize DSA CUDA graph replay metadata generation (#29499)
|
2026-06-29 19:53:23 -07:00 |
|
|
Mick
|
25b6051c70
|
[diffusion] warmup: default to model sampling resolution (declare Z-Image default) (#29519)
|
2026-06-30 10:32:11 +08:00 |
|
|
|
3e16be2122
|
[CI] Migrate JIT tests to runner config registration (#29066)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 19:12:14 -07:00 |
|
|
Ho-Ren (Jack) Chuang
|
bc8b3ab1f5
|
[Kernel] Add SM90 Q8KV8 FP8 Sparse MLA Prefill JIT Kernel with Tests and Benchmark (#25751)
|
2026-06-30 09:00:11 +08:00 |
|
|
Ho-Ren (Jack) Chuang
|
a6bc432fd8
|
[Perf][Kernel] Fuse SiLU+Mul into NVFP4 Expert Quantization for CUTLASS MoE (#18612)
|
2026-06-29 16:51:01 -07:00 |
|
|
eeechoandAliceChenyy
|
f0bf96390b
|
[SM120] Add FlashInfer sparse MLA decode for DSv4-Flash (#27455)
Co-authored-by: AliceChenyy <alicechenyy@users.noreply.github.com>
|
2026-06-29 16:27:16 -07:00 |
|
|
Trevor Morris
|
b8c25bfaa7
|
[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394)
|
2026-06-29 16:23:58 -07:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
6bdecb8206
|
[DeepSeek V3] Reland: run routed experts on main stream in dual-stream MoE (#29463)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-29 15:05:01 -07:00 |
|
|
Xinyuan Tong
|
45314a9fcb
|
[spec] Fix index_share_for_mtp_iteration being a no-op in EAGLE MTP draft (#29654)
|
2026-06-29 14:52:23 -07:00 |
|
|
Cheng Wanandlch1475369
|
fc96edd297
|
feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-06-29 14:49:54 -07:00 |
|
|
Mohammad Miadh Angkad
|
6c018eb4d1
|
Fix bounded checkpoint prefetching and buffered drop-cache handling (#29156)
|
2026-06-29 21:49:16 +00:00 |
|
|
|
5556631789
|
[Speculative Decoding] Validate vocabulary compatibility in STANDALONE mode (#23838)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 14:45:12 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
5106b42cbd
|
[cookbook] GLM-5.2 NVFP4 B300: TP8 recipe + 3 strategies (#29557)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:42:19 -07:00 |
|
|
Brayden Zhong
|
98d0e702c3
|
[GLM-5] Tune the threshold of router GEMM (#29470)
|
2026-06-29 14:19:24 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
11b7ed7c9e
|
[Docs] Add --prerelease=allow so uv installs the latest sglang (#29676)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:13:34 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
74a197af9d
|
docs: add B200 NVFP4 recipes + benchmarks to GLM-5.2 cookbook (#29674)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:06:30 -07:00 |
|
|
cctryandcctry
|
a5c45a12bb
|
CUDA graph executable dedup via cudaGraphExecUpdate (#29625)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-29 13:56:33 -07:00 |
|
|
|
f480c5f1f9
|
[Spec] Frozen-KV MTP: delay target KV binding to pool init + reset stale draft out_cache_loc (#29616)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: bef0rewind <490285+ronhuafeng@users.noreply.github.com>
Co-authored-by: AlejandroParedesLT <99832715+AlejandroParedesLT@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-29 11:57:10 -07:00 |
|
|
Mick
|
b0be644133
|
[diffusion] feat: keep image-model auxiliary components resident under auto memory policy (#29649)
|
2026-06-30 01:25:37 +08:00 |
|
|
Feng Yao
|
e6c15f76f3
|
[optimize] fix swa eviction boundary for unfinished inserts (#29350)
|
2026-06-30 00:19:15 +08:00 |
|
|
Jyothirmai KottuandXinyuan Tong
|
473a278dd1
|
model: support nvidia/LocateAnything-3B (#28958)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-30 00:16:42 +08:00 |
|
|
YC Yen-Ching Tsengandbingxche
|
5169df70f6
|
[AMD] Sgl-data mount opt-in (#29661)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-06-29 22:11:37 +08:00 |
|
|
McZyWu
|
bb7d3440b5
|
bugfix revise interface get cpu copy for npu mem pool to align with gpu (#29146)
|
2026-06-29 19:30:14 +08:00 |
|
|
amote-i
|
489017b3d6
|
[NPU] [DOC] Update deterministic inference feature support status to A2, A3 (#29632)
|
2026-06-29 19:17:06 +08:00 |
|
|
Shangming Cai
|
93926b9a95
|
Add Qwen3 MoE tests for PP compatibility with CP and DP (#29640)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2026-06-29 18:52:03 +08:00 |
|
|
danielafrimiandDaniel Afrimi
|
a2b5ce2ed1
|
Add stochastic rounding for FP16 Mamba SSM cache (#26929)
Signed-off-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@login-lyris01.lyris.clusters.nvidia.com>
|
2026-06-29 01:47:09 -07:00 |
|
|
iridiumineandiridiumine
|
d5133e925b
|
[NPU][Bugfix] Add scoring_func for mimo_v2 (#29493)
Co-authored-by: iridiumine <iridiumine@users.noreply.github.com>
|
2026-06-29 16:34:54 +08:00 |
|
|
bef0rewind
|
3b1b512a9a
|
Fix disaggregation receiver ZMQ cleanup (#29570)
|
2026-06-29 16:22:29 +08:00 |
|
|
SSSunzt
|
91cf159696
|
[PP] bugfix: include CP size in PP rank offset (#29571)
|
2026-06-29 16:01:41 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
c7b9b92d9a
|
Fix CI caused by https://github.com/sgl-project/sglang/pull/29576 (#29596)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-28 23:46:18 -07:00 |
|
|
Liangsheng Yin
|
c0d45cda29
|
[Spec] Add DFLASH basic sanity CI test (#29338)
|
2026-06-28 23:45:05 -07:00 |
|
|
AndyLi429
|
62d7929b3a
|
[NPU][Bugfix] Accept in_capture in Ascend replay metadata (#29598)
|
2026-06-29 14:37:45 +08:00 |
|
|
Yueming Yuan
|
cd91dd0757
|
fix test_weight_checker_comparator assertion and ue8m0 scale unpack (#29623)
|
2026-06-28 23:36:37 -07:00 |
|
|
silencejade
|
f85cc94d82
|
[NPU] Qwen3-VL-30B use split_qkv_rmsnorm_rope for extend (#29505)
|
2026-06-29 14:35:19 +08:00 |
|
|
Xinyuan Tong
|
38d4ffcd86
|
[cookbook] drop redundant serve flags (GLM-5.2) + fix M3 page-size note (#28731)
|
2026-06-29 13:34:13 +08:00 |
|
|
Lianmin Zheng
|
bb74ed4a8d
|
Replace hasattr with isinstance in SHM feature helpers (#29549)
|
2026-06-28 21:31:28 -07:00 |
|
|
Lianmin Zheng
|
f76e707f59
|
Clean up follow-ups for eagle hidden dim clean up (#29546)
|
2026-06-28 21:30:53 -07:00 |
|
|
jianzhao-xu
|
2260e612f6
|
[NPU] update best practicce docs from testcase (#29492)
|
2026-06-29 11:30:27 +08:00 |
|
|
Peng Xingchen
|
06fd2efedd
|
[NPU][Bugfix] Fix a ModelSlim loading failure (#29029)
|
2026-06-29 09:53:01 +08:00 |
|
|
Liangsheng Yin
|
be17475a1b
|
[Spec] Publish DFLASH verify read-done event for fine-grained WAR barrier (#29541)
|
2026-06-28 18:51:38 -07:00 |
|
|
Yueming Yuan
|
e1ca92a7fd
|
[weight checker] refactor: add precision branch; allow ULP quant err; used chunked compare (#28974)
|
2026-06-28 18:44:05 -07:00 |
|
|
Ma Mingfei
|
bd3b252e0a
|
[CPU] use faster exp in silu_and_mul (#29382)
|
2026-06-29 09:38:30 +08:00 |
|