 Yineng Zhangandgithub-actions[bot]
|
dab4663b4e
|
[Auto Sync] Update .clang-format (20250919) (#10670)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-09-19 12:31:44 -07:00 |
|
|
Yineng Zhang
|
610a6d6e86
|
fix: resolve sync issue (#10668)
|
2025-09-19 12:05:39 -07:00 |
|
|
Yineng Zhang
|
5bfafdfcb4
|
chore: bump sgl-kernel 0.3.11 (#10630)
|
2025-09-18 18:43:20 -07:00 |
|
|
Yineng Zhang
|
2a2ff9a840
|
refactor: use registry for _get_attention_backend_from_str (#10629)
|
2025-09-18 16:27:59 -07:00 |
|
|
Yineng Zhang
|
564050766d
|
fix: update dsv3 fp4 ut (#10584)
|
2025-09-17 14:34:58 -07:00 |
|
|
Yineng Zhang
|
c0c6f543e4
|
chore: upgrade sgl-kernel 0.3.10 (#10500)
|
2025-09-16 02:00:53 -07:00 |
|
|
Yineng Zhang
|
5207424014
|
chore: bump v0.3.10 sgl-kernel (#10478)
|
2025-09-15 15:20:09 -07:00 |
|
|
Yineng Zhang
|
5c08d7d21d
|
fix: resolve sgl-kernel ut (#10476)
|
2025-09-15 11:42:48 -07:00 |
|
|
Yineng Zhang
|
86a32bb5cd
|
chore: bump v0.5.3rc0 (#10468)
|
2025-09-15 03:55:18 -07:00 |
|
|
Yineng Zhang
|
5afd036533
|
feat: support pip install sglang (#10465)
|
2025-09-15 03:09:17 -07:00 |
|
|
Yineng Zhang
|
dcee42c200
|
feat: add dsv3 fp4 cutlass moe etp ut (#10433)
|
2025-09-14 18:44:09 -07:00 |
|
|
Yineng Zhang
|
7ce6c10eb6
|
fix: enable cu124 and cu128 build on main push (#10431)
|
2025-09-14 16:19:35 -07:00 |
|
|
Yineng Zhang
|
55025b9282
|
fix: use latest flashinfer (#10428)
|
2025-09-14 15:07:14 -07:00 |
|
|
Yineng Zhang
|
9d775b1a2d
|
feat: add deepseek v3 fp4 ut (#10391)
|
2025-09-12 15:43:29 -07:00 |
|
|
Yineng Zhang
|
98adac8ef7
|
fix: exclude protobuf generated code (#10388)
|
2025-09-12 13:52:09 -07:00 |
|
|
Yineng Zhang
|
cef11e9a55
|
fix: resolve gb200 image link (#10343)
|
2025-09-12 13:46:02 -07:00 |
|
|
Yineng Zhang
|
b3839a7f99
|
fix: resolve transfer_kv_all_layer_direct_lf_pf import error (#10360)
|
2025-09-11 23:53:23 -07:00 |
|
|
Yineng Zhang
|
b0d25e72c4
|
chore: bump v0.5.2 (#10221)
|
2025-09-11 16:09:20 -07:00 |
|
|
Yineng Zhang
|
bfe01a5eef
|
chore: upgrade v0.3.9.post2 sgl-kernel (#10297)
|
2025-09-11 04:10:29 -07:00 |
|
|
Yineng Zhang
|
532f998b0f
|
chore: bump sgl-kernel 0.3.9.post2 (#10311)
|
2025-09-11 01:29:50 -07:00 |
|
|
Yineng Zhang
|
de15d1405a
|
Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310)
|
2025-09-11 01:27:58 -07:00 |
|
|
Yineng Zhang
|
5b7448de77
|
chore: bump sgl-kernel 0.3.9.post1 (#10294)
|
2025-09-10 18:26:34 -07:00 |
|
|
Yineng Zhang
|
6d55f60e77
|
Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292)
|
2025-09-10 18:24:23 -07:00 |
|
|
Yineng Zhang
|
d3ee70985f
|
chore: upgrade v0.3.9 sgl-kernel (#10220)
|
2025-09-09 03:16:25 -07:00 |
|
|
Yineng Zhang
|
f3817cb0b2
|
chore: bump v0.3.9 sgl-kernel (#10208)
|
2025-09-09 01:40:05 -07:00 |
|
|
Yineng Zhangandcicirori
|
94fb4e9e54
|
feat: support fa cute in sgl-kernel (#10205)
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
|
2025-09-09 00:14:39 -07:00 |
|
|
Yineng Zhang
|
cdc56ef6c1
|
feat: use sgl-kernel cu129 as default (#10188)
|
2025-09-08 22:01:17 -07:00 |
|
|
Yineng Zhang
|
19d64f2b72
|
fix: resolve lint issue (#10181)
|
2025-09-08 15:09:55 -07:00 |
|
|
Yineng Zhang
|
45b3a6a256
|
Revert "[ModelOpt] Fix Weight Loading for DSR1-FP4 Quantization (#9712)" (#10176)
|
2025-09-08 11:28:15 -07:00 |
|
|
Yineng Zhang
|
b7d1f17b8d
|
Revert "enable auto-round quantization model (#6226)" (#10148)
|
2025-09-07 22:31:11 -07:00 |
|
|
Yineng Zhang
|
0e78c63c0e
|
Revert "[1/N][Bug] Fix w4afp8 MoE NaN issue (sgl-kernel) (#9953)" (#10097)
|
2025-09-05 19:57:53 -07:00 |
|
|
Yineng Zhang
|
0e9387a95d
|
fix: update gb200 dep (#10052)
|
2025-09-04 20:30:46 -07:00 |
|
|
Yineng Zhang
|
fa9c82d339
|
chore: bump v0.5.2rc2 (#10050)
|
2025-09-04 20:07:27 -07:00 |
|
|
Yineng Zhang
|
de9217334b
|
feat: add gpt oss b200 ci (#9988)
|
2025-09-03 17:26:38 -07:00 |
|
|
Yineng Zhang
|
1b2ff4fb7f
|
Revert "Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671)" (#9959)
|
2025-09-03 00:50:04 -07:00 |
|
|
Yineng Zhang
|
2c7ca33abb
|
Revert "[Fix] DeepSeek EP accuracy issue on B200 GPUs (#9946)" (#9955)
|
2025-09-02 23:49:56 -07:00 |
|
|
Yineng Zhang
|
18f91eb639
|
chore: bump v0.5.2rc1 (#9920)
|
2025-09-02 04:43:34 -07:00 |
|
|
Yineng Zhang
|
8766b3aca8
|
fix: update router deps (#9921)
|
2025-09-02 03:28:58 -07:00 |
|
|
Yineng Zhang
|
a96c5b5c14
|
chore: bump v0.3.8 sgl-kernel (#9907)
|
2025-09-02 01:27:26 -07:00 |
|
|
Yineng Zhang
|
16e56ea693
|
chore: bump v0.5.2rc0 (#9862)
|
2025-09-01 03:07:36 -07:00 |
|
|
Yineng Zhang
|
349b491c63
|
chore: upgrade flashinfer 0.3.0 (#9864)
|
2025-09-01 03:07:19 -07:00 |
|
|
Yineng Zhang
|
300676afac
|
chore: upgrade transformers 4.56.0 (#9827)
|
2025-08-30 14:07:34 -07:00 |
|
|
Yineng Zhang
|
9970e3bf32
|
chore: upgrade sgl-kernel 0.3.7.post1 with deepgemm fix (#9822)
|
2025-08-30 04:02:25 -07:00 |
|
|
Yineng Zhang
|
9c99949ef3
|
chore: update Dockerfile (#9820)
|
2025-08-30 03:08:14 -07:00 |
|
|
Yineng Zhang
|
c5082f0f73
|
chore: fix cuda driver api issue and bump sgl-kernel 0.3.7.post1 (#9746)
|
2025-08-30 02:01:54 -07:00 |
|
|
Yineng Zhang
|
8abe8deae6
|
fix: dsv3 lite q_lora_rank none (#9815)
|
2025-08-29 23:24:14 -07:00 |
|
|
Yineng Zhang
|
3d8fc43400
|
chore: upgrade flashinfer 0.3.0rc1 (#9793)
|
2025-08-29 16:24:17 -07:00 |
|
|
Yineng Zhang
|
bc80dc4ce0
|
chore: bump v0.5.1.post3 (#9716)
|
2025-08-27 15:42:42 -07:00 |
|
|
Yineng Zhang
|
b962a296ed
|
chore: upgrade sgl-kernel 0.3.7 (#9708)
|
2025-08-27 14:00:31 -07:00 |
|
|
Yineng Zhang
|
e3e97a120b
|
chore: bump v0.5.1.post2 (#9592)
|
2025-08-25 03:45:09 -07:00 |
|
|
Yineng Zhang
|
051068673c
|
chore: update config (#9591)
|
2025-08-25 03:41:09 -07:00 |
|
|
Yineng Zhang
|
f8b757bcac
|
fix: resolve tuning fused moe issue (#9587)
|
2025-08-25 01:41:15 -07:00 |
|
|
Yineng Zhang
|
ebd9dbe71b
|
fix: revert #8593 (#9581)
|
2025-08-25 01:29:06 -07:00 |
|
|
Yineng Zhang
|
938e986e15
|
chore: upgrade flashinfer 0.2.14.post1 (#9578)
|
2025-08-25 00:12:17 -07:00 |
|
|
Yineng Zhang
|
bf863e3bbf
|
fix: use sgl-kernel 0.3.5 (#9565)
|
2025-08-24 15:46:47 -07:00 |
|
|
Yineng Zhang
|
e0ab167db0
|
chore: bump v0.5.1.post1 (#9558)
|
2025-08-24 01:14:17 -07:00 |
|
|
Yineng Zhang
|
c807cd7c75
|
chore: update configurer (#9557)
|
2025-08-24 01:05:00 -07:00 |
|
|
Yineng Zhang
|
6b2b8bf0e1
|
fix: blackwell dsv3 fp8 issue temporary solution (#9530)
|
2025-08-23 01:33:21 -07:00 |
|
|
Yineng Zhang
|
b6b2287e4b
|
chore: bump sgl-kernel v0.3.6.post2 (#9475)
|
2025-08-21 23:02:08 -07:00 |
|
|
Yineng Zhang
|
0f9318f7d0
|
feat: update auto_choose_speculative_params (#9470)
|
2025-08-21 17:12:12 -07:00 |
|
|
Yineng Zhang
|
849957bc76
|
fix: tmp revert gpt oss tp sharding on hopper (#9469)
|
2025-08-21 17:03:21 -07:00 |
|
|
Yineng Zhang
|
4746aaea41
|
fix: support fb fp8 (#9462)
|
2025-08-21 14:31:43 -07:00 |
|
|
Yineng Zhang
|
7e8187e004
|
docs: fix spec (#9326)
|
2025-08-18 19:35:46 -07:00 |
|
|
Yineng Zhang
|
a1c7f742f9
|
chore: bump sgl-kernel v0.3.6.post1 (#9286)
|
2025-08-17 16:26:17 -07:00 |
|
|
Yineng Zhang
|
87dab54824
|
Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247)
|
2025-08-15 17:24:36 -07:00 |
|
|
Yineng Zhang
|
5121af4627
|
Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246)
|
2025-08-15 17:19:38 -07:00 |
|
|
Yineng Zhang
|
c186feed7f
|
chore: bump sgl-kernel v0.3.6 (#9220)
|
2025-08-15 02:50:50 -07:00 |
|
|
Yineng Zhang
|
9d54c6e6dd
|
feat: remove sm75 (#9207)
|
2025-08-14 22:27:14 -07:00 |
|
|
Yineng Zhang
|
fab0f6e77d
|
chore: bump v0.5.0rc2 (#9203)
|
2025-08-14 16:11:16 -07:00 |
|
|
Yineng Zhang
|
27985c27aa
|
feat: update model config (#9202)
|
2025-08-14 15:15:27 -07:00 |
|
|
Yineng Zhang
|
ac474869d4
|
chore: upgrade transformers 4.55.2 (#9197)
|
2025-08-14 13:51:02 -07:00 |
|
|
Yineng Zhang
|
1fea998a45
|
chore: bump sgl-kernel v0.3.5 (#9185)
|
2025-08-14 03:20:48 -07:00 |
|
|
Yineng Zhang
|
7b56e494be
|
chore: bump v0.5.0rc1 (#9069)
|
2025-08-13 10:44:14 -07:00 |
|
|
Yineng Zhang
|
71fb8c9527
|
feat: update fa3 (#9126)
|
2025-08-13 20:07:08 +08:00 |
|
|
Yineng Zhang
|
924827c3de
|
chore: use cp310 (#9130)
|
2025-08-12 15:33:22 -07:00 |
|
|
Yineng Zhang
|
c81daf838d
|
fix: update Dockerfile (#9129)
|
2025-08-12 15:01:29 -07:00 |
|
|
Yineng Zhang
|
305b27c124
|
fix: update Dockerfile (#9125)
|
2025-08-12 13:23:10 -07:00 |
|
|
Yineng Zhang
|
3a9afe2a42
|
chore: bump sgl-kernel v0.3.4 (#9103)
|
2025-08-12 01:48:47 -07:00 |
|
|
zhyncs
|
f4ae50e97c
|
fix: use flashinfer v0.2.11.post1
|
2025-08-11 02:49:25 -07:00 |
|
|
Yineng Zhang
|
84cb449eec
|
Revert "chore: upgrade flashinfer 0.2.11 (#9036)" (#9057)
|
2025-08-11 00:16:39 -07:00 |
|
|
Yineng Zhang
|
9d834fdcc1
|
Revert "feat: update flashinfer ar oneshot params (#8687)" (#9054)
|
2025-08-10 23:24:42 -07:00 |
|
|
Yineng Zhang
|
dd001a5477
|
chore: upgrade flashinfer 0.2.11 (#9036)
|
2025-08-10 17:35:37 -07:00 |
|
|
Yineng Zhang
|
dd949ace23
|
Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035)
|
2025-08-10 17:34:54 -07:00 |
|
|
Yineng Zhang
|
48b8b4c124
|
fix nvshmem cu126 (#9001)
|
2025-08-09 03:34:54 -07:00 |
|
|
Yineng Zhang
|
326a901df4
|
chore: upgrade sgl-kernel 0.3.3 (#8998)
|
2025-08-09 01:22:01 -07:00 |
|
|
Yineng Zhang
|
9020f7fc32
|
chore: bump v0.5.0rc0 (#8959)
|
2025-08-08 09:16:18 -07:00 |
|
|
Yineng Zhang
|
41357e511b
|
chore: update flashinfer (#8958)
|
2025-08-08 02:15:22 -07:00 |
|
|
Yineng Zhang
|
54ea57f245
|
chore: bump sgl-kernel v0.3.3 (#8957)
|
2025-08-08 01:35:37 -07:00 |
|
|
Yineng Zhang
|
361379b52b
|
docs: update README (#8929)
|
2025-08-07 14:28:35 -07:00 |
|
|
Yineng Zhang
|
1ac16add8b
|
chore: support blackwell cu129 image (#8928)
|
2025-08-07 14:24:57 -07:00 |
|
|
Yineng Zhang
|
4bf6e5a6b0
|
fix: use openai 1.99.1 (#8927)
|
2025-08-07 14:20:35 -07:00 |
|
|
Yineng Zhang
|
cbbd685a46
|
chore: use torch 2.8 stable (#8880)
|
2025-08-06 15:51:40 -07:00 |
|
|
Yineng Zhang
|
aeac900ca2
|
fix: resolve ci issue (#8859)
|
2025-08-06 02:28:14 -07:00 |
|
|
Yineng Zhang
|
3ae8e3ea8f
|
chore: upgrade torch 2.8.0 (#8836)
|
2025-08-05 17:32:01 -07:00 |
|
|
Yineng Zhang
|
556e4143f0
|
fix: remove unused import (#8809)
|
2025-08-05 13:40:22 -07:00 |
|
|
Yineng Zhang
|
4ef47839ae
|
feat: use py312 (#8832)
|
2025-08-05 13:38:22 -07:00 |
|
|
Yineng Zhang
|
4f4e0e4162
|
chore: upgrade flashinfer 0.2.10 (#8827)
|
2025-08-05 12:04:01 -07:00 |
|
|
Yineng Zhangandhebiao064
|
901ab758ec
|
chore: upgrade transformers 4.55.0 (#8823)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-08-05 11:37:21 -07:00 |
|
|
Yineng Zhang
|
8e8545caf6
|
fix: update cmake (#8817)
|
2025-08-05 09:38:30 -07:00 |
|
|
Yineng Zhang
|
75df31b60e
|
chore: bump sgl-kernel v0.3.2 (#8802)
|
2025-08-05 02:35:20 -07:00 |
|