Commit Graph
14325 Commits
Author SHA1 Message Date
Xiaoyu Zhang c1416bb3ee [Diffusion] Keep FastHunyuan VAE resident on high-memory GPUs (#28773) 2026-06-20 15:54:06 +08:00
Lianmin ZhengandYinghai Lu 45d203fb08 Fix tokenizer state cleanup on dispatch failure (#28694)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
2026-06-19 21:55:39 -07:00
Bi Xue 28e2096d1c [sgl] wire SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW on Unified Cache. (#28161) 2026-06-20 12:06:52 +08:00
Jimmy Shong 7516f0db9f [cookbook] Laguna-M.1: add PD disaggregation section (#28737) 2026-06-19 19:49:49 -07:00
Michael 653f6735a0 [AMD] add nightly kv_canary JIT benchmark suite (#28611) 2026-06-19 19:46:34 -07:00
Jae B.andR0CKSTAR 2cbe1e6404 [Apple Silicon] [MLX] Fix MlxModelRunnerStub.initialize() signature desync with base (#28660)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
2026-06-19 18:05:22 -07:00
Michael 871ed0dc0c Revert "ci: add 4-GPU mi35x runner and rebalance off the saturated 8-GPU pool" (#28751) 2026-06-19 16:23:18 -07:00
Yanbin Jiang 6b945c16f4 [LoRA] Fix experimental fast-path multi-adapter correctness + flashinfer 0.6.12 compatibility (#28091) 2026-06-19 16:20:19 -07:00
Kangyan-ZhouandClaude Opus 4.8 364bf976be [router] Tokenize prompt once at ingress; forward input_ids to the engine (all policies) (#28744)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 16:07:17 -07:00
Shu Wang c3bae61e16 [Bug] fix(DummyModelLoader): run post_load_weights before process_weights_after_loading (#28665) 2026-06-19 22:57:45 +00:00
Kangyan-ZhouandClaude Opus 4.8 abf7011cdd [router] Raise chat body cap to 5 MiB for long contexts (#28742)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 15:50:34 -07:00
Michael 420004827c [AMD] register 3 tests to stage-b-test-1-gpu-large-amd (batch-6) (#28736) 2026-06-19 15:45:16 -07:00
Michaelandmichaelzhang-ai 13aab2fc06 ci: add 4-GPU mi35x runner and rebalance off the saturated 8-GPU pool (#28745)
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
2026-06-19 15:41:19 -07:00
Mohammad Miadh Angkad 3a574846ff [CI] Publish 4-GPU nightly profiler traces (#28738) 2026-06-19 15:27:24 -07:00
Elizaveta MartirosianandElizaveta Martirosian b225f48fcc [NPU][FIX CI] Set the warm-up mode to "request" for NPU diffusion tests (#28724)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
2026-06-20 01:14:26 +03:00
3ed46f599f [core] Don't force seq_lens_cpu publication under piecewise CUDA graph (#28633)
Co-authored-by: jonnykong <jonnykong@fb.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-06-19 15:12:07 -07:00
Liangsheng Yin d271de64fe [misc] Move bench_one_batch_server into sglang/benchmark/ with a back-compat shim (#28625) 2026-06-19 14:19:29 -07:00
Liangsheng Yin c9c2445146 [CI] Bump actions/github-script to v8 (Node 24 runtime) (#28741) 2026-06-19 14:18:37 -07:00
Cheng Wan 6fdcb9934c fix(runner): size eager static buffers for prefill budget and MLP-sync autotune (#28677) 2026-06-19 13:23:26 -07:00
Cheng Wan 2aa7b58aa7 refactor(runner): reuse a prepared static buffer for every dummy run (#28740) 2026-06-19 13:16:07 -07:00
Cheng WanandClaude Opus 4.8 856b0dc74b refactor(runner): move kernel warmup into the shared runner lifecycle (warmup()) (#28739)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 13:13:13 -07:00
Cheng WanandClaude Opus 4.8 d705a91de1 refactor(runner): add EagerRunner, own the eager path, polymorphic dispatch (#28386)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 13:05:43 -07:00
ab0714d0ee ci: run GB300 nightly suite in the standard Nvidia nightly workflow (#28536)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-06-19 12:24:38 -07:00
Michael 7c505c2927 [AMD] fix(jit): port kv_canary write/verify/plan kernels to ROCm (#28357) 2026-06-19 12:19:37 -07:00
c436a8161a [AMD] Enable HiSparse on ROCm (#26639)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-06-19 11:59:45 -07:00
Jaybe ca88b7f1d2 fix: remove manual rope parameters injection in PretrainedConfig (#23910) 2026-06-19 17:41:51 +00:00
Vladislav Nosivskoy 2ad9a5b576 [UnifiedTree] Use dense model for HiCache+CP KL tests (#28726) 2026-06-20 00:18:01 +08:00
Kangyan-ZhouandClaude Opus 4.8 cab62855f5 [router] Align sgl_router_ttft_seconds buckets with engine TTFT grid (#28717)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-19 08:53:46 -07:00
Mohammad Miadh Angkad 88c261c3f3 Fix IndexCache PP topk handoff (#28532) 2026-06-19 23:39:09 +08:00
Oguz Ulgen 3af991fb3e [AMD] Make breakable CUDA graph run on ROCm/HIP (#28173) 2026-06-19 07:16:00 -07:00
sglang-botandClaude Sonnet 4.6 5eaae5bacd Add CODE_OF_CONDUCT.md (#28728)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-19 07:08:05 -07:00
Liangsheng Yin 9bb9d17e1a [Spec] Unify speculative grammar token-accept path in decode processing (#28682) 2026-06-19 02:49:40 -07:00
shuwenn 941a11ada3 [HiCache] refactor: remove unused transfer buffer (#26003) 2026-06-19 09:46:04 +00:00
Liangsheng Yin 0146692cc9 [CI] Fail fast on empty install_script in Rerun Test workflow (#28721) 2026-06-19 02:07:52 -07:00
Cheng Wan a6db86d535 refactor(runner): split BaseRunner (shared) from BaseCudaGraphRunner (#28385) 2026-06-19 02:04:15 -07:00
Cheng Wan 1c6331cbd6 refactor(runner): rename runner replay/load/can_run for the shared surface (#28384) 2026-06-19 01:45:04 -07:00
Xiaoyu Zhang 31c0a98066 [codex] Update diffusion skills for latest main (#28711) 2026-06-19 16:37:59 +08:00
Xiaoyu Zhang b6be5dd20f [codex] Remove outdated SGLang SOTA skill (#28719) 2026-06-19 16:26:44 +08:00
Mick af2ec2a0dd [diffusion] perf: merge LTX-2 stage-1 distilled LoRA into the base in original mode (#28594) 2026-06-19 15:41:47 +08:00
59eb142ec2 [NPU] [Diffusion] Performance Optimization for LTX-2 Model (#22445)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-06-19 08:58:45 +03:00
Xiaoyu Zhang 3b417d3999 Revert "[Diffusion] FLUX: fuse FeedForward GELU into up-proj GEMM (cublasLt epilogue)" (#28708) 2026-06-19 13:44:57 +08:00
Mick 547a017a77 [diffusion] CI: run nightly image comparisons on 2 GPUs (#28593) 2026-06-19 13:43:02 +08:00
Xiaoyu ZhangandClaude Opus 4.8 7da92e1112 [diffusion] Sana: pack self-attn q/k/v and cross-attn k/v into single GEMMs (#28393)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-19 13:25:52 +08:00
Xiaoyu Zhang 7e20e25848 [docs] Add B300 cookbook deployment options (#28697) 2026-06-18 21:52:45 -07:00
billishyahao 24d15dd92e [AMD][DSV4] fix nonetype issue when enabling hicache (#28541) 2026-06-18 21:26:48 -07:00
Clintandclintg6 fac11f3bc1 [AMD] Document Mori XGMI for Single-Node PD Disaggregation (#25094)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
2026-06-18 19:25:49 -07:00
Jimmy Shong d962d18f15 docs: add --trust-remote-code to Laguna-M.1 / XS.2 cookbook configs (#28693) 2026-06-19 10:21:39 +08:00
Mohammad Miadh Angkad c7397de571 Use Marlin for SM120 MXFP4 MoE (#28231) 2026-06-18 19:19:41 -07:00
4d94e9471a [AMD] Relax allreduce-fusion residual accuracy tolerance to 1 bf16 ULP (#28226)
Co-authored-by: kangwangamd <kangwangamd@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2026-06-18 19:18:53 -07:00
giang_ng_tr b36360dc5b [AMD][Perf] Split-KV flash-decode attention for EAGLE target-verify (Triton backend) (#27382) 2026-06-18 19:11:10 -07:00