Commit Graph
579 Commits
Author SHA1 Message Date
Chetan Kumar VermaandMa Mingfei b3ab56545b Add Accuracy Benchmark for OCR models (#25364)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-07-06 16:18:43 +08:00
Baizhou Zhang c312cdd3a7 Upgrading tvm-ffi/sgl-deep-gemm/tilelang (#29554) 2026-07-01 12:32:18 -07:00
Jialin Ouyang 40594bd381 [passthrough] engine: zstd request-body decompression + header overrides (#29684) 2026-06-30 23:48:56 -07:00
Mohammad Miadh Angkad bae78a44da [Deps] Bump transformers to 5.12.1 (#29393) 2026-06-30 00:54:01 -07:00
cfc0a0e0e0 Add Intel Quantization Support in SGLang (#18139)
Signed-off-by: Mengni Wang <mengni.wang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: Weiwei <weiwei1.zhang@intel.com>
2026-06-26 09:54:35 +08:00
Khoa PhamandCursor 0642cd5020 (chore): bump tokenspeed_mla to 0.1.7 (#28759)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-21 21:25:37 -07:00
Mick a51d56d948 CI: Pin flash-attn-4 for diffusion CI consistency (#28838) 2026-06-21 21:13:41 +08:00
Lianmin Zheng 8a3d6c3403 Sort pyproject dependency lists (#28811) 2026-06-20 17:24:57 -07:00
sglang-botandsglang-bot b1d18d562b chore: bump sglang-kernel version to 0.4.4 (#28572)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-06-17 16:13:39 -07:00
Baizhou Zhang 27291118b9 Upgrade sgl-deep-gemm to 0.1.3 (#28402) 2026-06-16 23:06:36 -07:00
feliang-gitandxutizhou 92b42c8d8a LPLB: linear-programming load balancer for MoE expert parallelism (#24515)
Co-authored-by: xutizhou <xutingz@nvidia.com>
2026-06-16 10:19:42 -07:00
Xinyu Zhang 1800d7caa6 Bump ray minimum version to 2.55.1 (#27724) 2026-06-12 20:49:11 -07:00
Khoa Pham a0c6e0b3a4 chore: bump tokenspeed_mla 0.1.1 -> 0.1.6 (#28116) 2026-06-12 19:57:36 -07:00
Mohammad Miadh Angkad 7f706f4cfb [Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854) 2026-06-03 12:09:18 -07:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
Mick 64a1dec8b6 [diffusion] feat: add realtime webui super resolution controls (#27026) 2026-06-02 20:29:21 +08:00
Mick 3b26644bc4 [diffusion] misc: add realtime-webui (#26959) 2026-06-02 14:13:02 +08:00
Mick 2fc548f250 [diffusion] model: support lingot-world (#26954) 2026-06-02 13:52:49 +08:00
popsiclexuandpopsiclexu 951fa05a09 [MoE] Support BF16 standard A2A with DeepGEMM runner (#26473)
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
2026-06-01 20:40:38 -07:00
Liangsheng Yin ed85bcf8c3 pin kernels<0.15 (#26704) 2026-05-29 01:46:57 -07:00
Xinyuan Tong 79c844527c Upgrade xgrammar to 0.2.1 (#25676) 2026-05-29 11:40:07 +08:00
sglang-botandsglang-bot 14f81a67d9 chore: bump sglang-kernel version to 0.4.3 (#26421)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-05-27 11:31:11 -07:00
Kangyan-ZhouandLiangsheng Yin caa9f08294 [CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-21 22:01:42 +08:00
Kangyan-Zhou 4ea8282cb7 [Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938) 2026-05-21 14:36:56 +08:00
Mohammad Miadh Angkad a449ee4822 [Deps] Use cu13 extra for nvidia cutlass dsl (#25576) 2026-05-21 10:31:27 +08:00
Matt Van HornandMatt Van Horn e99f87c974 fix: add missing distro dependency to runtime docker image (#25817)
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
2026-05-20 00:46:32 -07:00
Xinyuan Tong aad00b0ed8 Upgrade transformers to 5.8.1 (#25451) 2026-05-19 22:20:30 +08:00
Baizhou Zhangandhnyls2002 b79e4b1e68 [Fix] Try to fix error caused by latest cutedsl packages (#25690)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-05-18 16:51:32 -07:00
0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
2026-05-15 01:04:56 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Baizhou Zhangandpranjalssh b7f856df70 DeepSeek V4 w4a4 MegaMoE (#25052)
Co-authored-by: pranjalssh <adkz.photos@gmail.com>
2026-05-13 18:35:32 -07:00
Qiaolin Yu 7618ad7075 [attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell) (#24925) 2026-05-13 17:36:17 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
Brayden Zhongandb8zhong d5f3254ed1 [Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452)
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
2026-05-12 14:38:32 -07:00
+6 35870d55ac Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
2026-05-07 18:32:21 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
952b3caf18 feat: use structural tags to enable strict tool calling and reasoning for more models (#21722)
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-05-04 02:30:28 -07:00
88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-02 12:25:36 -07:00
Kangyan-ZhouandClaude Opus 4.7 cd27baaffd [ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 22:50:38 -07:00
AlonKejzman 66ea0aee7f tokenizer: Add fastokens support (#23753) 2026-04-28 11:43:10 -07:00
Xinyuan Tong e5198386bd Upgrade transformers from 5.5.4 to 5.6.0 (#23525) 2026-04-26 22:33:54 -07:00
9003f24e2b chore: bump sglang-kernel version to 0.4.1.post1 (#23733)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-25 23:23:49 -07:00
sglang-botandsglang-bot f3b88e080a chore: bump flashinfer version to 0.6.8.post1 (#23281)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-23 15:23:03 -07:00
Alex Nails 10e17cc55e [gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736) 2026-04-20 12:39:35 +08:00
6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-04-19 05:32:36 -07:00
Xinyuan Tong 34fef07a15 Upgrade transformers to 5.5.3 and refactor hf_transformers_utils into subpackage (#21569) 2026-04-15 20:03:44 -07:00
Baizhou Zhang b441317aa4 Revert "Upgrade CI default CUDA version from 12.9 to 13.0" (#22727) 2026-04-13 14:39:24 -07:00
Asish Kumar 39810762d2 fix: use describe mode for SGLang version detection (#22600)
Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>
2026-04-13 09:45:45 -07:00
Alison Shao 3f4fbc165d Upgrade CI default CUDA version from 12.9 to 13.0 (#21441) 2026-04-12 21:48:40 -07:00
sglang-botandsglang-bot df3275bd6c chore: bump flashinfer version to 0.6.7.post3 (#22382)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-08 14:49:45 -07:00