 Mick
|
6a16573a7f
|
[diffusion] fix: fix Qwen-Image-Layered string image paths (#28790)
|
2026-06-21 09:43:56 +08:00 |
|
|
Lianmin Zheng
|
54b9b9d0c9
|
Remove threading atexit monkey patch (#28812)
|
2026-06-20 18:30:50 -07:00 |
|
|
karverma-amd
|
2552b860a3
|
[AMD][bugfix] Place TBO cuda-graph num_token_non_padded buffer on model devices (#28337)
|
2026-06-20 18:06:22 -07:00 |
|
|
pure water
|
5b3eeaf504
|
[Fix] MM pool GPU alloc with base_gpu_id (#23377)
|
2026-06-21 08:51:06 +08:00 |
|
|
Polisetty V R K Jyothendra Varma
|
fbbf559de2
|
fix bench_one_batch by extending array with array not list (#28732)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-06-21 08:28:41 +08:00 |
|
|
Lianmin Zheng
|
8a3d6c3403
|
Sort pyproject dependency lists (#28811)
|
2026-06-20 17:24:57 -07:00 |
|
|
|
f42ec350b4
|
[mtp] add rejection sampling for speculative decoding (#26312)
Co-authored-by: lyc508653 <lyc508653@alibaba-inc.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Huiqiang Jiang <30883354+iofu728@users.noreply.github.com>
Co-authored-by: Yi Zhang <25844240+yizhang2077@users.noreply.github.com>
Co-authored-by: Yizhong Cao <114661107+cao1zhg@users.noreply.github.com>
|
2026-06-20 15:10:42 -07:00 |
|
|
Lianmin Zheng
|
fe428dd845
|
Clean up startup log noise (#28807)
|
2026-06-20 15:02:52 -07:00 |
|
|
Rita BrugarolasandClaude Opus 4.6
|
d6d06cdc17
|
[AMD] Fix no-op dtype cast in _topk_ids_logical_to_physical_dynamic on HIP (#28074)
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-06-20 11:07:22 -07:00 |
|
|
shuwenn
|
ff1fc1fbdf
|
[mem_cache][5/N] refactor: extract host KV cache base layer into pool_host package (#27273)
|
2026-06-20 20:44:08 +08:00 |
|
|
Mick
|
1109acc24b
|
[diffusion] optimize: shard hunyuan text tokens under sp (#28319)
|
2026-06-20 18:21:38 +08:00 |
|
|
Mick
|
a38eba0f1a
|
[diffusion] CI: remove flaky layerwise offload diffusion case (#28778)
|
2026-06-20 17:27:27 +08:00 |
|
|
kkandwunhuang
|
47cad39f34
|
[AMD] Optimize o_proj gemm and attn output rope performance (#28722)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-06-20 02:11:01 -07:00 |
|
|
Zhiyao JiangandXinyu Jiang
|
1115373668
|
[AMD] Fix garbled unquantized Qwen3-30B-A3B output on ROCm/aiter where the aiter CK fused-MoE falls back to Triton with pre-shuffled weights (#28244)
Co-authored-by: Xinyu Jiang <xinyuj2@andrew.cmu.edu>
|
2026-06-20 01:25:01 -07:00 |
|
|
Xiaoyu Zhang
|
c1416bb3ee
|
[Diffusion] Keep FastHunyuan VAE resident on high-memory GPUs (#28773)
|
2026-06-20 15:54:06 +08:00 |
|
|
Lianmin ZhengandYinghai Lu
|
45d203fb08
|
Fix tokenizer state cleanup on dispatch failure (#28694)
Co-authored-by: Yinghai Lu <yinghai@meta.com>
|
2026-06-19 21:55:39 -07:00 |
|
|
Bi Xue
|
28e2096d1c
|
[sgl] wire SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW on Unified Cache. (#28161)
|
2026-06-20 12:06:52 +08:00 |
|
|
Jae B.andR0CKSTAR
|
2cbe1e6404
|
[Apple Silicon] [MLX] Fix MlxModelRunnerStub.initialize() signature desync with base (#28660)
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-06-19 18:05:22 -07:00 |
|
|
Yanbin Jiang
|
6b945c16f4
|
[LoRA] Fix experimental fast-path multi-adapter correctness + flashinfer 0.6.12 compatibility (#28091)
|
2026-06-19 16:20:19 -07:00 |
|
|
Shu Wang
|
c3bae61e16
|
[Bug] fix(DummyModelLoader): run post_load_weights before process_weights_after_loading (#28665)
|
2026-06-19 22:57:45 +00:00 |
|
|
Elizaveta MartirosianandElizaveta Martirosian
|
b225f48fcc
|
[NPU][FIX CI] Set the warm-up mode to "request" for NPU diffusion tests (#28724)
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
|
2026-06-20 01:14:26 +03:00 |
|
|
|
3ed46f599f
|
[core] Don't force seq_lens_cpu publication under piecewise CUDA graph (#28633)
Co-authored-by: jonnykong <jonnykong@fb.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-06-19 15:12:07 -07:00 |
|
|
Liangsheng Yin
|
d271de64fe
|
[misc] Move bench_one_batch_server into sglang/benchmark/ with a back-compat shim (#28625)
|
2026-06-19 14:19:29 -07:00 |
|
|
Cheng Wan
|
6fdcb9934c
|
fix(runner): size eager static buffers for prefill budget and MLP-sync autotune (#28677)
|
2026-06-19 13:23:26 -07:00 |
|
|
Cheng Wan
|
2aa7b58aa7
|
refactor(runner): reuse a prepared static buffer for every dummy run (#28740)
|
2026-06-19 13:16:07 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
856b0dc74b
|
refactor(runner): move kernel warmup into the shared runner lifecycle (warmup()) (#28739)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-19 13:13:13 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
d705a91de1
|
refactor(runner): add EagerRunner, own the eager path, polymorphic dispatch (#28386)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-06-19 13:05:43 -07:00 |
|
|
|
ab0714d0ee
|
ci: run GB300 nightly suite in the standard Nvidia nightly workflow (#28536)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
|
2026-06-19 12:24:38 -07:00 |
|
|
Michael
|
7c505c2927
|
[AMD] fix(jit): port kv_canary write/verify/plan kernels to ROCm (#28357)
|
2026-06-19 12:19:37 -07:00 |
|
|
|
c436a8161a
|
[AMD] Enable HiSparse on ROCm (#26639)
Co-authored-by: clintg6 <7388379+clintg6@users.noreply.github.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-06-19 11:59:45 -07:00 |
|
|
Jaybe
|
ca88b7f1d2
|
fix: remove manual rope parameters injection in PretrainedConfig (#23910)
|
2026-06-19 17:41:51 +00:00 |
|
|
Mohammad Miadh Angkad
|
88c261c3f3
|
Fix IndexCache PP topk handoff (#28532)
|
2026-06-19 23:39:09 +08:00 |
|
|
Oguz Ulgen
|
3af991fb3e
|
[AMD] Make breakable CUDA graph run on ROCm/HIP (#28173)
|
2026-06-19 07:16:00 -07:00 |
|
|
Liangsheng Yin
|
9bb9d17e1a
|
[Spec] Unify speculative grammar token-accept path in decode processing (#28682)
|
2026-06-19 02:49:40 -07:00 |
|
|
shuwenn
|
941a11ada3
|
[HiCache] refactor: remove unused transfer buffer (#26003)
|
2026-06-19 09:46:04 +00:00 |
|
|
Cheng Wan
|
a6db86d535
|
refactor(runner): split BaseRunner (shared) from BaseCudaGraphRunner (#28385)
|
2026-06-19 02:04:15 -07:00 |
|
|
Cheng Wan
|
1c6331cbd6
|
refactor(runner): rename runner replay/load/can_run for the shared surface (#28384)
|
2026-06-19 01:45:04 -07:00 |
|
|
Xiaoyu Zhang
|
31c0a98066
|
[codex] Update diffusion skills for latest main (#28711)
|
2026-06-19 16:37:59 +08:00 |
|
|
Mick
|
af2ec2a0dd
|
[diffusion] perf: merge LTX-2 stage-1 distilled LoRA into the base in original mode (#28594)
|
2026-06-19 15:41:47 +08:00 |
|
|
|
59eb142ec2
|
[NPU] [Diffusion] Performance Optimization for LTX-2 Model (#22445)
Co-authored-by: gengjinsong <gengjinsong@huawei.com>
Co-authored-by: gengjinsong <904939979@qq.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-06-19 08:58:45 +03:00 |
|
|
Xiaoyu Zhang
|
3b417d3999
|
Revert "[Diffusion] FLUX: fuse FeedForward GELU into up-proj GEMM (cublasLt epilogue)" (#28708)
|
2026-06-19 13:44:57 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
7da92e1112
|
[diffusion] Sana: pack self-attn q/k/v and cross-attn k/v into single GEMMs (#28393)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-19 13:25:52 +08:00 |
|
|
billishyahao
|
24d15dd92e
|
[AMD][DSV4] fix nonetype issue when enabling hicache (#28541)
|
2026-06-18 21:26:48 -07:00 |
|
|
Mohammad Miadh Angkad
|
c7397de571
|
Use Marlin for SM120 MXFP4 MoE (#28231)
|
2026-06-18 19:19:41 -07:00 |
|
|
giang_ng_tr
|
b36360dc5b
|
[AMD][Perf] Split-KV flash-decode attention for EAGLE target-verify (Triton backend) (#27382)
|
2026-06-18 19:11:10 -07:00 |
|
|
Lucia Fang
|
1c8551169d
|
Add opt-in CUDA-graph capture-trace export (#28551)
|
2026-06-18 18:51:14 -07:00 |
|
|
huangtingweiandhzh0425
|
6b7ecca663
|
[HiCache]Support hybrid pool staged H2D kernel (#28434)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-06-19 09:48:03 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
05ee93c44f
|
Remove redundant cast and copy in calling trtllm_fp8_block_scale_moe (#28555)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-18 18:11:29 -07:00 |
|
|
Rain Jiang
|
ef01618dfb
|
support MPServer and embedded server for granian to enable muti tokenizer worker (#28573)
|
2026-06-18 17:59:12 -07:00 |
|
|
Brayden ZhongandBrayden Zhong
|
ea407df4b0
|
Use Flashinfer allreduce fusion for MNNVL allreduce for Nemotron (#28346)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-18 17:30:12 -07:00 |
|