 sglang-botandsglang-bot
|
081a01c37d
|
docs: sync LMSYS SGLang blog cards (#29307)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-06-30 20:48:10 +00:00 |
|
|
TzZtzt
|
e721259079
|
typo-fix: correct mooncake package name to "mooncake-transfer-engine" (#25153)
|
2026-06-30 11:54:36 -07:00 |
|
|
|
97fc4dfd73
|
[Doc]Checking and modifying Markdown formatting issues and link validity (#28586)
Signed-off-by: a60124901 <anyuxin4@h-partners.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-30 20:27:38 +03:00 |
|
|
Feng Yaoandispobock
|
1c2523b719
|
[bug1] keep full kv when swa skips leaf data (#29351)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-07-01 00:51:18 +08:00 |
|
|
YC Yen-Ching Tsengandbingxche
|
c70cc96905
|
[AMD] Stop rocm720 pr auto-runs (#29768)
Co-authored-by: bingxche <bingxche@users.noreply.github.com>
|
2026-06-30 23:58:25 +08:00 |
|
|
YC Yen-Ching Tsengandbingxche
|
f2756f53f3
|
[AMD] Update AMD local registry address (#29765)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-06-30 23:40:00 +08:00 |
|
|
|
cf36dca6d4
|
[JIT Kernel] Triton moe fused gate (#25835)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ziyi.xu <ziyi.xu@radixark.ai>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-06-30 23:26:18 +08:00 |
|
|
Yihao WangandClaude Opus 4.8
|
a531d81c19
|
[diffusion][cache-dit] support Krea-2 + run-driven has_separate_cfg (#29688)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-30 08:22:05 -07:00 |
|
|
Estrella-xx
|
c6a7c98ae4
|
[NPU]GLM-4.7-Flash optimize with fused kernels (#29509)
|
2026-06-30 19:22:19 +08:00 |
|
|
nvjullin
|
2f730e299f
|
Disable dsr1 prefill cudagraphs by default (#28053)
|
2026-06-30 16:34:44 +08:00 |
|
|
Stanley Winata
|
a5e6dd3767
|
[AMD] Implement QuarkW4A8MXFp4MoE to support amd/gpt-oss-120b-w-mxfp4-a-fp8 (#27204)
Signed-off-by: Stanley Winata <stanley.winata@amd.com>
|
2026-06-30 01:24:22 -07:00 |
|
|
|
89620b9169
|
[NPU] Support DeepSeek V4 Flash MTP on Ascend (#28980)
Co-authored-by: Kurkur <mccllm@qq.com>
Co-authored-by: gjsheu <gjsheu@163.com>
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: khalil2ji3mp6 <khalilzhk@gmail.com>
|
2026-06-30 16:22:13 +08:00 |
|
|
cctryandcctry
|
4b4b4af583
|
Budget EAGLE/STANDALONE draft KV pool in SWA pool configurators (#29622)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-30 00:58:33 -07:00 |
|
|
silencejade
|
ff51acd67b
|
[NPU] Qwen3-VL-8B use split_qkv_rmsnorm_rope for extend (#29627)
|
2026-06-30 15:55:50 +08:00 |
|
|
Mohammad Miadh Angkad
|
bae78a44da
|
[Deps] Bump transformers to 5.12.1 (#29393)
|
2026-06-30 00:54:01 -07:00 |
|
|
Thomas Wang
|
f920a37da4
|
[AMD] Copy decode result on forward_stream instead of copy_stream (#29642)
|
2026-06-29 23:53:48 -07:00 |
|
|
Mohammad Miadh Angkad
|
b6fceaa789
|
[DSA] Use cos_sin_cache for DSA indexer fusion (#29613)
|
2026-06-29 23:49:00 -07:00 |
|
|
|
dbb51c46ac
|
[CI] Migrate JIT tests missed by #29066 to runner_config registration (#29715)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-29 23:21:14 -07:00 |
|
|
Zhangheng
|
dad0120c57
|
[HiSparse]: Skip flaky hisparse-nixl ci (#29710)
|
2026-06-30 14:04:34 +08:00 |
|
|
Baizhou Zhang
|
cc238270b1
|
Update GLM tests to 5.2 and delete redundant tests (#29686)
|
2026-06-29 23:04:26 -07:00 |
|
|
|
b6907d9664
|
docker: install dynamo nightly in the dev image for rapid iteration/testing (#29634)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 22:58:19 -07:00 |
|
|
|
54e71506b3
|
[AMD][DSV4] Remove per-batch D2H syncs in MTP to avoid bubbles between 2 batches (#29420)
Co-authored-by: amd-danli103 <amd-danli103@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-06-29 22:39:59 -07:00 |
|
|
yifei wuandXinyuan Tong
|
f41d455f37
|
[Model] Add HrmTextForCausalLM (Hierarchical Reasoning Model - Text) (#27887)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-30 13:32:32 +08:00 |
|
|
YC Yen-Ching Tseng
|
7d9116d9d7
|
Fix test_type_based_dispatcher after TokenizedGenerateReqInput field changes (#29376)
|
2026-06-29 22:22:22 -07:00 |
|
|
Michael
|
7da4e30d9b
|
[AMD] Register fused_metadata_copy JIT kernel test for AMD nightly CI (#29671)
|
2026-06-29 21:26:11 -07:00 |
|
|
Zhaoyi Liandbingxche
|
6bf15aa2b9
|
[AMD]: Enable NIXL PD disaggregation for ROCm(1/n) (#28348)
Co-authored-by: bingxche <bingxche@amd.com>
|
2026-06-29 21:23:09 -07:00 |
|
|
Mick
|
2068ae7eec
|
[diffusion] chore: document VAE decode parallel group axes (#29364)
|
2026-06-30 12:14:55 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
3add35e26d
|
[Diffusion] Reuse shared AlignedVector and tidy jit_kernel/diffusion (#29664)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-30 11:38:22 +08:00 |
|
|
Zaili Wang
|
8dbf04fc56
|
Add new Intel SGLang members into CI_permission list (#29700)
|
2026-06-30 11:06:28 +08:00 |
|
|
Mohammad Miadh Angkad
|
3a72d02415
|
[DSA] Optimize DSA CUDA graph replay metadata generation (#29499)
|
2026-06-29 19:53:23 -07:00 |
|
|
Mick
|
25b6051c70
|
[diffusion] warmup: default to model sampling resolution (declare Z-Image default) (#29519)
|
2026-06-30 10:32:11 +08:00 |
|
|
|
3e16be2122
|
[CI] Migrate JIT tests to runner config registration (#29066)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 19:12:14 -07:00 |
|
|
Ho-Ren (Jack) Chuang
|
bc8b3ab1f5
|
[Kernel] Add SM90 Q8KV8 FP8 Sparse MLA Prefill JIT Kernel with Tests and Benchmark (#25751)
|
2026-06-30 09:00:11 +08:00 |
|
|
Ho-Ren (Jack) Chuang
|
a6bc432fd8
|
[Perf][Kernel] Fuse SiLU+Mul into NVFP4 Expert Quantization for CUTLASS MoE (#18612)
|
2026-06-29 16:51:01 -07:00 |
|
|
eeechoandAliceChenyy
|
f0bf96390b
|
[SM120] Add FlashInfer sparse MLA decode for DSv4-Flash (#27455)
Co-authored-by: AliceChenyy <alicechenyy@users.noreply.github.com>
|
2026-06-29 16:27:16 -07:00 |
|
|
Trevor Morris
|
b8c25bfaa7
|
[NVIDIA] Support flashinfer a2a with flashinfer_trtllm_routed moe (#22394)
|
2026-06-29 16:23:58 -07:00 |
|
|
Khoa PhamandClaude Opus 4.7
|
6bdecb8206
|
[DeepSeek V3] Reland: run routed experts on main stream in dual-stream MoE (#29463)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
|
2026-06-29 15:05:01 -07:00 |
|
|
Xinyuan Tong
|
45314a9fcb
|
[spec] Fix index_share_for_mtp_iteration being a no-op in EAGLE MTP draft (#29654)
|
2026-06-29 14:52:23 -07:00 |
|
|
Cheng Wanandlch1475369
|
fc96edd297
|
feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533)
Co-authored-by: lch1475369 <lch1475369@gmail.com>
|
2026-06-29 14:49:54 -07:00 |
|
|
Mohammad Miadh Angkad
|
6c018eb4d1
|
Fix bounded checkpoint prefetching and buffered drop-cache handling (#29156)
|
2026-06-29 21:49:16 +00:00 |
|
|
|
5556631789
|
[Speculative Decoding] Validate vocabulary compatibility in STANDALONE mode (#23838)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-29 14:45:12 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
5106b42cbd
|
[cookbook] GLM-5.2 NVFP4 B300: TP8 recipe + 3 strategies (#29557)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:42:19 -07:00 |
|
|
Brayden Zhong
|
98d0e702c3
|
[GLM-5] Tune the threshold of router GEMM (#29470)
|
2026-06-29 14:19:24 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
11b7ed7c9e
|
[Docs] Add --prerelease=allow so uv installs the latest sglang (#29676)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:13:34 -07:00 |
|
|
zijiexiaandClaude Opus 4.8
|
74a197af9d
|
docs: add B200 NVFP4 recipes + benchmarks to GLM-5.2 cookbook (#29674)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-29 14:06:30 -07:00 |
|
|
cctryandcctry
|
a5c45a12bb
|
CUDA graph executable dedup via cudaGraphExecUpdate (#29625)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-29 13:56:33 -07:00 |
|
|
|
f480c5f1f9
|
[Spec] Frozen-KV MTP: delay target KV binding to pool init + reset stale draft out_cache_loc (#29616)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: bef0rewind <490285+ronhuafeng@users.noreply.github.com>
Co-authored-by: AlejandroParedesLT <99832715+AlejandroParedesLT@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-29 11:57:10 -07:00 |
|
|
Mick
|
b0be644133
|
[diffusion] feat: keep image-model auxiliary components resident under auto memory policy (#29649)
|
2026-06-30 01:25:37 +08:00 |
|
|
Feng Yao
|
e6c15f76f3
|
[optimize] fix swa eviction boundary for unfinished inserts (#29350)
|
2026-06-30 00:19:15 +08:00 |
|
|
Jyothirmai KottuandXinyuan Tong
|
473a278dd1
|
model: support nvidia/LocateAnything-3B (#28958)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-06-30 00:16:42 +08:00 |
|