minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
14,866 Commits 2 Branches 0 Tags
80decc78ec226ec168977406277fec707c96b718
Commit Graph
14866 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Wang 80decc78ec [AMD][DeepSeek V4] Set SGLANG_OPT_FLASHMLA_SPARSE_PREFILL to false on hip code path (#30237) 2026-07-06 01:25:55 -07:00
Chetan Kumar VermaandMa Mingfei b3ab56545b Add Accuracy Benchmark for OCR models (#25364) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-07-06 16:18:43 +08:00
chengcuipingandMohammad Miadh Angkad e2b55bdbab NUMA: probe numactl binding and fall back when --membind is rejected (#28401) 
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-07-06 16:03:59 +08:00
zijiexiaandClaude Opus 4.8 7c9bb316cf docs(cookbook): total (input+output) throughput per GPU + percentile latency labels (#30214) 
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
 2026-07-06 00:39:48 -07:00
Mick 5f98f62a8a [diffusion] perf: tp-shard every text/image encoder across the full DiT replica (any parallelism) (#30086) 2026-07-06 14:48:07 +08:00
Jzz1943 de00b838c4 [diffusion] fix: pass progressive params through image API (#30148) 2026-07-06 14:45:45 +08:00
McZyWu 6bb2918938 Bugfix qwen prefix cache circumstances (#30047) 2026-07-06 14:39:30 +08:00
Lianmin Zheng 24c42c90be Clean up ServerArgs post-init dispatch (#30186) 2026-07-05 23:05:07 -07:00
Baizhou Zhang 5eb1b6a7ba Remove retired DSA env paths (#29912) 2026-07-05 22:58:02 -07:00
Xinyuan Tong 6f22790943 cookbook: add Hunyuan 3 (Hy3) Day-0 page (#30201) 2026-07-06 13:30:47 +08:00
Mohammad Miadh Angkad b1942fc3ea [Model] Support Qwen3.6 ModelOpt mixed NVFP4 (#27906) 2026-07-05 21:31:15 -07:00
ashwini rathi cc7d7ba3dd [Intel XPU] Bump nightly per-file timeout to 120m and extend XPU CI monitor (#30100) 2026-07-06 12:26:28 +08:00
ashwini rathiandarathi-hlab 850719ebd9 [XPU] Unbreak stage-b: re-add --disable-decode-cuda-graph, quarantine EAGLE3 parity (#30048) 
Co-authored-by: arathi-hlab <arathi.rajanraghavendran@intel.com>
 2026-07-06 12:25:46 +08:00
kkwunhuangAt1a8
 		81735ecf80 [AMD ]Feat/dsv4 ep tbo prefill (#29362) 
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: At1a8 <fangyuan@amd.com>
 2026-07-05 21:18:34 -07:00
DarkSharpnessandClaude c016c6f355 [JIT Kernel] DeepSeek-V4 DSA indexer: faster top-k + page-table transform (runtime k <= 2048) (#26788) 
Co-authored-by: Claude <noreply@anthropic.com>
 2026-07-05 20:23:39 -07:00
Duyi-Wang c9ceab34cf [AMD] [Docker] Update MoRI to v1.2.1 (#29394) 2026-07-05 19:37:04 -07:00
Lianmin Zheng 9d00385b63 Cleanup: relocate temp_set_env and consolidate multi-device/CUDA helpers in common.py (#30180) 2026-07-05 18:47:26 -07:00
Lianmin Zheng 8673e85e6c Remove # fmt: off from environ.py Envs class (#30153) 2026-07-05 12:45:24 -07:00
Lianmin Zheng 92a1f6e06c [refactor] Reorder ServerArgs sections common-first; inline LLAMA4/MIMO_V2 arch tuples (#30151) 2026-07-05 12:17:24 -07:00
Kevin Flansburg 48ba79c11e [BugFix] Release HiCache prefetch resources on disagg-prefill bootstrap-queue abort (#30053) 2026-07-06 00:06:59 +08:00
Cheng WanandClaude Fable 5 602c8615a1 [fix] Reconcile the legacy-getter ratchet baseline after racing merges (#30154) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-05 22:06:07 +08:00
Xiaoyu Zhang 931b00f1b0 [diffusion] Clean up duplicate helper definitions (#30159) 2026-07-05 22:05:11 +08:00
Cheng Wan 3ea875fef4 [chore] Remove the stack-review placeholder file (#30149) 2026-07-05 02:39:45 -07:00
ThomasClauderonnie_zheng
 		addffd7489 [Diffusion] Diffusion model support log-requests (#23049) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-07-05 12:01:26 +03:00
Elizaveta MartirosianElizaveta Martirosianronnie_zheng
 		b070cb2ae0 Fix Diffusion GT generation pipelines (#29926) 
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-07-05 11:43:50 +03:00
Cheng Wan 8fb99bbaf8 [refactor] Config resolution pipeline: full-stack review (10-PR series, review only) (#30137) 2026-07-05 00:00:07 -07:00
Yuankai ChenandChun Fang ce733f106b [AMD] Fix RMSNorm batch-invariance on ROCm under deterministic inference (#28787) 
Co-authored-by: Chun Fang <chun.fang@amd.com>
 2026-07-04 23:49:06 -07:00
Zhaoyi Liandbingxche 67361ff91b [AMD][DI][CI] 3/N Add Kimi K2.6 FP8 MI355X 1P1D nightly recipes (#29855) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-07-04 21:05:12 -07:00
Mick a37bc2456d [diffusion] refactor: consolidate diffusion weight load planning (#30118) 2026-07-05 11:59:50 +08:00
HuangJi 5e6f49c986 [diffusion] feat: add LingBot realtime prompt, KV window, and lazy VAE controls (#30040) 2026-07-05 11:11:54 +08:00
cctry fbe3110866 Make mem_fraction_static reserve disaggregation-mode aware (#29615) 2026-07-04 18:44:06 -07:00
Cheng Wan 754524d8de [Fix] Skip cross-node probe in MultimemAllGatherer on single-node runs (fixes mooncake EP segfault) (#30139) 2026-07-04 15:36:23 -07:00
Cheng Wan 00f088f6be [fix] Wrap the sp_shard test entry point in sys.exit so failures propagate (#30138) 2026-07-04 14:23:40 -07:00
ybyang 63c4996fef fix: populate batch req rids and per-request http_worker_ipc for mult… (#29882) 2026-07-04 12:09:41 -07:00
Xinyuan Tong 854b46be99 feat(parser): resolve special-token suffix at runtime for compatibility (#29920) 2026-07-05 00:13:46 +08:00
Mick 763c6bf372 [diffusion] perf: add unified SP shard helpers and zero-copy tail-pad attention (#30107) 2026-07-04 23:57:39 +08:00
Praneth ParuchuriandMick b7c3709f33 [diffusion] fix: fix z-Image online fp8 quantization crash with dit_cpu_offload (#29903) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-07-04 23:40:43 +08:00
Xiaoyu Zhang 6dd0cefb2a [CI] Revert ModelOpt NVFP4 threshold relax (#29844) 2026-07-04 21:17:32 +08:00
Mick 36fc0093d6 [diffusion] fix: shut down diffusion workers on serve exit (#30110) 2026-07-04 20:42:39 +08:00
Baizhou Zhang e552f6ed75 [Fix] Fix DSA indexer fusion for NeoX RoPE (#30111) 2026-07-04 03:20:55 -07:00
Kaixi 92b800c531 [DSA][GLM5.2] Index Share for MHA (#29959) 2026-07-04 02:50:26 -07:00
Cheng WanandClaude Fable 5 b941e337a4 [refactor] Rename Arg.model_overridable to Arg.resolvable (stack 15/15) (#30077) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:23:01 -07:00
Cheng WanandClaude Fable 5 7ea2284551 [refactor] Migrate the DeepSeek family and the parallel-request chains (stack 14/15) (#30076) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:50 -07:00
Cheng WanandClaude Fable 5 3836cba9ee [refactor] Migrate the moe_runner_backend / quantization resolution chains (stack 13/15) (#30075) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:38 -07:00
Cheng WanandClaude Fable 5 276fbfe880 [refactor] Migrate the page_size resolution chain (stack 12/15) (#30074) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:28 -07:00
Cheng WanandClaude Fable 5 abbb41a214 [refactor] Migrate the attention_backend resolution chain (stack 11/15) (#30073) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:17 -07:00
Cheng WanandClaude Fable 5 5c95bf15c8 [refactor] Add the post-process resolution stage; migrate sampling_backend (stack 10/15) (#30072) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:22:05 -07:00
Cheng WanandClaude Fable 5 ae29c5a1dc [refactor] Sweep disable_hybrid_swa_memory writers; close the dtype family (stack 9/15) (#30071) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:54 -07:00
Cheng WanandClaude Fable 5 4bf4db09f6 [refactor] Add predicate-keyed registration; migrate the Step3p family (stack 8/15) (#30070) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:43 -07:00
Cheng WanandClaude Fable 5 8d8f17e28c [refactor] Migrate the first override families: Mistral/Pixtral dtype, MiniMaxM2, MiMoV2 (stack 7/15) (#30069) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-04 02:21:32 -07:00