 Douglas YangandClaude Opus 5
|
86f373daff
|
docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 23:12:56 +00:00 |
|
|
Faradawn Yang
|
115cd7bde1
|
docs: update checkpoint to Qwen3.5 NVFP4 V2 for InfX (#32945)
|
2026-08-07 15:26:07 -07:00 |
|
|
Xinyuan Tong
|
0da25ee6f7
|
Docs: Ling-3.0-flash cookbook — serve native 256K, drop YaRN override (#33882)
|
2026-08-07 21:46:51 +00:00 |
|
|
|
bc148dfdc8
|
[diffusion] feat: make scheduler rpc deadlines explicit (#33965)
Co-authored-by: suoyf <suoyf@nscc-tj.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-07 21:33:23 +08:00 |
|
|
Lennox FuandMick
|
7af3d000f2
|
[diffusion] feat: gate /health and /health_generate on warmup completion and add liveness endpoint (#33787)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-07 17:59:23 +08:00 |
|
|
amote-i
|
470807ef74
|
[NPU] [DOC] Upgrade recommendeded sglang version on Ascend NPU (#33976)
|
2026-08-07 17:45:00 +08:00 |
|
|
Mick
|
c2657cc4bf
|
[diffusion] refactor: gate fast vae paths by quality (#33849)
|
2026-08-07 12:39:55 +08:00 |
|
|
WenhaoZhang
|
914644e81c
|
[diffusion] fix: fix 4/8-step distilled minimax-h3 turbo lora merge (#33875)
|
2026-08-07 12:38:37 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
0c3a76fa0a
|
Clean GLM-5.2 NVFP4 cookbook (#33935)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-07 11:51:34 +08:00 |
|
|
MickandClaude Fable 5
|
1e08b865f9
|
[diffusion] feat: support K/V-gather style sequence parallel (CP-like) attention (#32667)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 09:39:28 +08:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
434e646282
|
[Deps] Upgrade CUDA PyTorch stack to 2.13 (#28836)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-06 12:08:44 -07:00 |
|
|
Ziang LiandBrayden Zhong
|
4ad990ba7d
|
[ModelOpt FP4] Support online MoE weight quantization (#33115)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-06 11:01:55 -07:00 |
|
|
Mick
|
7195b8e4c7
|
[diffusion] refactor: validate and document spectrum controls (#33851)
|
2026-08-06 23:23:11 +08:00 |
|
|
Mick
|
44bde3911a
|
[diffusion] fix: resolve IPC A2A peers from process groups (#33848)
|
2026-08-06 23:22:41 +08:00 |
|
|
Mick
|
c212a6938c
|
[diffusion] chore: retire released warmup and decoder flags (#33850)
|
2026-08-06 23:02:32 +08:00 |
|
|
|
f8f2870a84
|
Profiling Enhancements [1/3]: cuda graph profile traces (#24370)
Co-authored-by: Basit <mohbasit@ctr2-alola-ctrl-01.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-08-06 03:19:35 -07:00 |
|
|
Thomas Wang
|
dea07b348b
|
[AMD] Update amd k3 cookbook for fp8 kv cache (#33825)
|
2026-08-05 23:35:38 -07:00 |
|
|
MickandClaude Fable 5
|
604d3561b0
|
[diffusion] feat: data-parallel serving (--dp-size) (#33725)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-06 11:50:13 +08:00 |
|
|
Khoa PhamandClaude Opus 5
|
beabc5949b
|
Enable MoE deferred finalize by default and drop its expert_weights dtype workaround (#33618)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:56:47 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
4c0a8940fa
|
[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-06 08:52:09 +08:00 |
|
|
Shu Wang
|
55b1c09e73
|
[core] Consolidate compiled-kernel caches under SGLANG_CACHE_DIR (#32434)
|
2026-08-05 13:54:27 -07:00 |
|
|
Xinyuan TongandZijie Xia
|
b3cdd016ba
|
Add Ling-3.0-flash cookbook (#33556)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-08-05 22:53:34 +08:00 |
|
|
Артем СавкинandXiaoyu Zhang
|
d96df7bed5
|
[Diffusion] Batch GLM-Image AR requests (#30683)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-05 08:47:06 +03:00 |
|
|
|
059269594c
|
[DSV4] Add official DSV4 reasoning effort support (#33140)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-08-05 12:50:41 +08:00 |
|
|
Baizhou Zhang
|
87ed82ff7e
|
Remove custom all-reduce disable from Kimi-K3 B300 recipe (#33612)
|
2026-08-04 16:07:31 -07:00 |
|
|
+26
|
abddb1c7e9
|
[Kimi] Support kimi-k3 (#32541)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: zhangxiaohao <1024393531@qq.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com>
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
Co-authored-by: Lee Nau <lee.nau@gmail.com>
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Xinyi Song <xinyis10@illinois.edu>
|
2026-08-04 13:22:49 -07:00 |
|
|
|
e76d0acdc9
|
migrate NPU PR/nightly test cases to a3-560T (#33346)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-08-05 01:17:58 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
c6f2a9c1d4
|
[diffusion] Restrict request-level quality to two validated tiers: lossless (default) and high (#33453)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-04 11:43:16 +08:00 |
|
|
Jinchen HanandMick
|
614825fd38
|
[vla] fix: pi05 models does not apply scale factor for language embeddings (#33367)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-04 11:25:54 +08:00 |
|
|
zijiexiaandClaude Opus 4.8
|
b819d2fb5b
|
[Docs] Rename docs_new/ to docs/ (#32123)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-03 16:51:00 -07:00 |
|
|
zijiexia
|
50ed4c011f
|
Remove legacy Sphinx docs/ and finish the Mintlify cutover (#28964)
|
2026-07-13 15:06:08 -07:00 |
|
|
Liangsheng Yin
|
186f1e300a
|
[CI] Move JIT kernel tests + benchmarks to test/registered/jit; add in-package guard (#27644)
|
2026-06-09 12:37:39 -07:00 |
|
|
Dawid Majchrowski
|
c317beda99
|
[diffusion] model: support a new model (#24994)
|
2026-05-27 08:51:03 +08:00 |
|
|
roikoren755
|
e958f4561f
|
[feat] Support extra_buffer in Mamba2-based models (#15829)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2026-05-26 16:03:29 +08:00 |
|
|
+2
|
3f5e2c7688
|
[AMD] Dsv4/pr2 compressor opt (#26208)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-05-25 23:54:40 -07:00 |
|
|
Ziang Li
|
2b9dd9c8b3
|
[FlashInfer v0.6.10] [RL] [DSv32] [GLM-5] Add --dsa-topk-backend and integrate FlashInfer and pytorch topk (#22851)
|
2026-05-25 13:08:03 -07:00 |
|
|
Xiaoyu Zhang
|
533ef41112
|
[Diffusion] Default NVFP4 backend to FlashInfer TRTLLM (#25523)
|
2026-05-25 18:14:06 +08:00 |
|
|
Zhanghengand晟海
|
a4db563c87
|
[hisparse]: update user guide (#26249)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-05-25 17:54:55 +08:00 |
|
|
Alex O. P.
|
ae7c4226eb
|
[diffusion] model: support FLUX.2-klein-base (#25661)
|
2026-05-22 11:24:46 +08:00 |
|
|
silencejade
|
e603beab55
|
[NPU] Add Qwen3.5-397B-A17B best practice doc (#25594)
|
2026-05-21 10:02:12 +08:00 |
|
|
Cheng WanandClaude Sonnet 4.6
|
8131641bc6
|
[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
|
2026-05-20 00:18:04 -07:00 |
|
|
Arseniy MironovandNapkin-AI
|
45a85efc3a
|
[Diffusion][NPU]Add attention backends for diffusion models for Ascend NPU (#23482)
Co-authored-by: Napkin-AI <arseniy.mironov.dev@gmail.com>
|
2026-05-19 12:46:55 +03:00 |
|
|
Ziang Li
|
78cb38ed5e
|
[FlashInfer v0.6.11] [RL] Support FlashInfer per-token NVFP4 MoE (#22918)
|
2026-05-19 01:04:48 -07:00 |
|
|
|
a080358cac
|
[Refactor] Refactor DeepEP dispatcher (#22822)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-18 04:36:42 +03:00 |
|
|
Mick
|
416fdbbb3d
|
[diffusion] feat: generalize layerwise offload residency mixin to all components (#24593)
|
2026-05-16 11:44:46 +08:00 |
|
|
Lewisand百麒
|
0680f1b3d1
|
Add IntraNode NVLink configration in PD disaggregation docs (#23329)
Co-authored-by: 百麒 <yaozhong.lyz@alibaba-inc.com>
|
2026-05-13 23:23:57 -07:00 |
|
|
|
c701a08765
|
feat: [2/2][DeepEP] Add waterfill load balancing for shared expert dispatch (#19290)
Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
Co-authored-by: root <aichenf@nvidia.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-05-13 19:23:41 -07:00 |
|
|
|
34c0029f0a
|
[diffusion] [AMD] feat: support online MXFP4 and fp8 quantization (#21431)
Co-authored-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-05-14 08:52:01 +08:00 |
|
|
Mick
|
ff70aeac30
|
[diffusion] feat: add performance mode server args (#24491)
|
2026-05-14 00:57:46 +08:00 |
|
|
Khoa Pham
|
c665edec6e
|
[env] Make max KV chunk capacity configurable via SGLANG_MAX_KV_CHUNK_CAPACITY (#25120)
|
2026-05-12 22:37:45 -07:00 |
|