 Mick
|
aeab1de1de
|
[diffusion] optimization: support cuda graph for Pi-0.5 prefix encoding (#34256)
|
2026-08-11 09:14:53 +08:00 |
|
|
Baizhou Zhang
|
a92bbf2f24
|
docs: remove DSV4 low-latency chunked prefill size (#34333)
|
2026-08-10 17:23:43 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
b86c90215f
|
[Docs] Muse Glimmer cookbook: drop --speculative-dflash-block-size 5 (#34323)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-10 15:46:34 -07:00 |
|
|
|
e54c153ba6
|
Add Intern-S2-Mobius cookbook (#33820)
Co-authored-by: Justin Tong <justintong0323@outlook.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-08-10 13:13:35 -07:00 |
|
|
|
d07ac32d05
|
[diffusion] feat: support --served-model-name in sglang serve (#34228)
Co-authored-by: TobyMint <tobymint@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-10 22:27:09 +08:00 |
|
|
Xinyuan Tong
|
77c90e7e54
|
Cookbook: add Ling-3.0-tiny (#34283)
|
2026-08-10 21:25:17 +08:00 |
|
|
Mick
|
8ba9385097
|
[diffusion] chore: optimize model weight loading (#34064)
|
2026-08-10 20:07:48 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
d95e824a49
|
Muse Glimmer Cookbook: install from the PR branch (#34281)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-08-10 11:39:55 +00:00 |
|
|
Brayden ZhongandBrayden Zhong
|
d96b1533ea
|
Muse Glimmer Cookbook: install from the PR branch (#34278)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-08-10 03:49:02 -07:00 |
|
|
|
a6c34df044
|
Muse Glimmer Cookbook (#34271)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Jimmy Shong <jimmysh341@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-08-10 10:21:13 +00:00 |
|
|
Mick
|
955569a2dc
|
[diffusion] feat: expose cosmos3 policies through the Action API (#34243)
|
2026-08-10 18:16:20 +08:00 |
|
|
Ke Bao
|
430f38ea25
|
Update dspark draft path in Inkling small cookbook (#34250)
|
2026-08-10 17:12:51 +08:00 |
|
|
Feng Su
|
fb3d1419fd
|
[tracing] sglang tracing v2: support exporting tracing data asynchronously (#30023)
|
2026-08-10 15:23:05 +08:00 |
|
|
|
2969ab3d41
|
[MLX] Window-bounded SWA KV storage and in-graph sampling (#34166)
Co-authored-by: Siming Deng <siming_deng_stat@163.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
Co-authored-by: Jiminator <Jiminator@users.noreply.github.com>
Co-authored-by: damahua <damahua@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-09 21:28:51 -07:00 |
|
|
Mick
|
169783d42f
|
[diffusion] chore: make torch.compile opt-in for speed mode (#34173)
|
2026-08-10 10:22:16 +08:00 |
|
|
Liangsheng Yin
|
7c90840bad
|
[CI] Key scheduled CUDA suites by runner_config instead of hand-written jobs (#34186)
|
2026-08-09 16:44:53 -07:00 |
|
|
WenhaoZhang
|
51470b376f
|
[diffusion] feat: support sol-attn sparse attention backend for h3 (#33702)
|
2026-08-09 16:26:06 +08:00 |
|
|
|
548ff545c5
|
[diffusion] fix: guard sage attention sm90 bindings (#34107)
Co-authored-by: RunFMe <RunFMe@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-08 21:32:40 +08:00 |
|
|
Mick
|
cf2d4fd679
|
docs: clarify K3 VLM feature transport (#34099)
|
2026-08-08 19:23:00 +08:00 |
|
|
DarkSharpnessandClaude Fable 5
|
4ad5bb5d9a
|
[jit_kernel] Move JIT kernels into namespace sglang (#33400)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 16:10:15 +08:00 |
|
|
Mick
|
d747bd052e
|
feat(vlm): auto-select cuda vmm on multi-node mnnvl (#33936)
|
2026-08-08 16:00:58 +08:00 |
|
|
|
f64328c7f6
|
[diffusion] feat: support quant-videogen prq kv-cache quantization (memory-saving) for causal-dit (#32581)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-08 12:56:54 +08:00 |
|
|
MickandClaude Fable 5
|
24c84dfa68
|
[diffusion] doc: add parallelism overview (#33704)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 11:36:06 +08:00 |
|
|
MickandClaude Fable 5
|
a25c330eb1
|
[diffusion] feat: cross-node sequence parallelism (Ulysses x Ring) (#33327)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-08 10:56:28 +08:00 |
|
|
Douglas YangandClaude Opus 5
|
86f373daff
|
docs(cookbook): DeepSeek-V4-Flash-0731 — drop chunked-prefill/autotune flags on B300 low-latency (#34044)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-07 23:12:56 +00:00 |
|
|
Faradawn Yang
|
115cd7bde1
|
docs: update checkpoint to Qwen3.5 NVFP4 V2 for InfX (#32945)
|
2026-08-07 15:26:07 -07:00 |
|
|
Xinyuan Tong
|
0da25ee6f7
|
Docs: Ling-3.0-flash cookbook — serve native 256K, drop YaRN override (#33882)
|
2026-08-07 21:46:51 +00:00 |
|
|
|
bc148dfdc8
|
[diffusion] feat: make scheduler rpc deadlines explicit (#33965)
Co-authored-by: suoyf <suoyf@nscc-tj.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-07 21:33:23 +08:00 |
|
|
Lennox FuandMick
|
7af3d000f2
|
[diffusion] feat: gate /health and /health_generate on warmup completion and add liveness endpoint (#33787)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-07 17:59:23 +08:00 |
|
|
amote-i
|
470807ef74
|
[NPU] [DOC] Upgrade recommendeded sglang version on Ascend NPU (#33976)
|
2026-08-07 17:45:00 +08:00 |
|
|
Mick
|
c2657cc4bf
|
[diffusion] refactor: gate fast vae paths by quality (#33849)
|
2026-08-07 12:39:55 +08:00 |
|
|
WenhaoZhang
|
914644e81c
|
[diffusion] fix: fix 4/8-step distilled minimax-h3 turbo lora merge (#33875)
|
2026-08-07 12:38:37 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
0c3a76fa0a
|
Clean GLM-5.2 NVFP4 cookbook (#33935)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-08-07 11:51:34 +08:00 |
|
|
MickandClaude Fable 5
|
1e08b865f9
|
[diffusion] feat: support K/V-gather style sequence parallel (CP-like) attention (#32667)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-07 09:39:28 +08:00 |
|
|
Mohammad Miadh AngkadandBrayden Zhong
|
434e646282
|
[Deps] Upgrade CUDA PyTorch stack to 2.13 (#28836)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-06 12:08:44 -07:00 |
|
|
Ziang LiandBrayden Zhong
|
4ad990ba7d
|
[ModelOpt FP4] Support online MoE weight quantization (#33115)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-06 11:01:55 -07:00 |
|
|
Mick
|
7195b8e4c7
|
[diffusion] refactor: validate and document spectrum controls (#33851)
|
2026-08-06 23:23:11 +08:00 |
|
|
Mick
|
44bde3911a
|
[diffusion] fix: resolve IPC A2A peers from process groups (#33848)
|
2026-08-06 23:22:41 +08:00 |
|
|
Mick
|
c212a6938c
|
[diffusion] chore: retire released warmup and decoder flags (#33850)
|
2026-08-06 23:02:32 +08:00 |
|
|
|
f8f2870a84
|
Profiling Enhancements [1/3]: cuda graph profile traces (#24370)
Co-authored-by: Basit <mohbasit@ctr2-alola-ctrl-01.amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-08-06 03:19:35 -07:00 |
|
|
Thomas Wang
|
dea07b348b
|
[AMD] Update amd k3 cookbook for fp8 kv cache (#33825)
|
2026-08-05 23:35:38 -07:00 |
|
|
MickandClaude Fable 5
|
604d3561b0
|
[diffusion] feat: data-parallel serving (--dp-size) (#33725)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-06 11:50:13 +08:00 |
|
|
Khoa PhamandClaude Opus 5
|
beabc5949b
|
Enable MoE deferred finalize by default and drop its expert_weights dtype workaround (#33618)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-05 17:56:47 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
4c0a8940fa
|
[Kernel] Unify BaseFusedOp and MultiPlatformOp dispatch (#33205)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-06 08:52:09 +08:00 |
|
|
Shu Wang
|
55b1c09e73
|
[core] Consolidate compiled-kernel caches under SGLANG_CACHE_DIR (#32434)
|
2026-08-05 13:54:27 -07:00 |
|
|
Xinyuan TongandZijie Xia
|
b3cdd016ba
|
Add Ling-3.0-flash cookbook (#33556)
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-08-05 22:53:34 +08:00 |
|
|
Артем СавкинandXiaoyu Zhang
|
d96df7bed5
|
[Diffusion] Batch GLM-Image AR requests (#30683)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-08-05 08:47:06 +03:00 |
|
|
|
059269594c
|
[DSV4] Add official DSV4 reasoning effort support (#33140)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: David Orman <ormandj@corenode.com>
|
2026-08-05 12:50:41 +08:00 |
|
|
Baizhou Zhang
|
87ed82ff7e
|
Remove custom all-reduce disable from Kimi-K3 B300 recipe (#33612)
|
2026-08-04 16:07:31 -07:00 |
|
|
+26
|
abddb1c7e9
|
[Kimi] Support kimi-k3 (#32541)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: zhangxiaohao <1024393531@qq.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com>
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
Co-authored-by: Lee Nau <lee.nau@gmail.com>
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Xinyi Song <xinyis10@illinois.edu>
|
2026-08-04 13:22:49 -07:00 |
|