Commit Graph
100 Commits
Author SHA1 Message Date
Yineng Zhang bc80dc4ce0 chore: bump v0.5.1.post3 (#9716) 2025-08-27 15:42:42 -07:00
Yineng Zhang b962a296ed chore: upgrade sgl-kernel 0.3.7 (#9708) 2025-08-27 14:00:31 -07:00
Yineng Zhang e3e97a120b chore: bump v0.5.1.post2 (#9592) 2025-08-25 03:45:09 -07:00
Yineng Zhang 051068673c chore: update config (#9591) 2025-08-25 03:41:09 -07:00
Yineng Zhang f8b757bcac fix: resolve tuning fused moe issue (#9587) 2025-08-25 01:41:15 -07:00
Yineng Zhang ebd9dbe71b fix: revert #8593 (#9581) 2025-08-25 01:29:06 -07:00
Yineng Zhang 938e986e15 chore: upgrade flashinfer 0.2.14.post1 (#9578) 2025-08-25 00:12:17 -07:00
Yineng Zhang bf863e3bbf fix: use sgl-kernel 0.3.5 (#9565) 2025-08-24 15:46:47 -07:00
Yineng Zhang e0ab167db0 chore: bump v0.5.1.post1 (#9558) 2025-08-24 01:14:17 -07:00
Yineng Zhang c807cd7c75 chore: update configurer (#9557) 2025-08-24 01:05:00 -07:00
Yineng Zhang 6b2b8bf0e1 fix: blackwell dsv3 fp8 issue temporary solution (#9530) 2025-08-23 01:33:21 -07:00
Yineng Zhang b6b2287e4b chore: bump sgl-kernel v0.3.6.post2 (#9475) 2025-08-21 23:02:08 -07:00
Yineng Zhang 0f9318f7d0 feat: update auto_choose_speculative_params (#9470) 2025-08-21 17:12:12 -07:00
Yineng Zhang 849957bc76 fix: tmp revert gpt oss tp sharding on hopper (#9469) 2025-08-21 17:03:21 -07:00
Yineng Zhang 4746aaea41 fix: support fb fp8 (#9462) 2025-08-21 14:31:43 -07:00
Yineng Zhang 7e8187e004 docs: fix spec (#9326) 2025-08-18 19:35:46 -07:00
Yineng Zhang a1c7f742f9 chore: bump sgl-kernel v0.3.6.post1 (#9286) 2025-08-17 16:26:17 -07:00
Yineng Zhang 87dab54824 Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) 2025-08-15 17:24:36 -07:00
Yineng Zhang 5121af4627 Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246) 2025-08-15 17:19:38 -07:00
Yineng Zhang c186feed7f chore: bump sgl-kernel v0.3.6 (#9220) 2025-08-15 02:50:50 -07:00
Yineng Zhang 9d54c6e6dd feat: remove sm75 (#9207) 2025-08-14 22:27:14 -07:00
Yineng Zhang fab0f6e77d chore: bump v0.5.0rc2 (#9203) 2025-08-14 16:11:16 -07:00
Yineng Zhang 27985c27aa feat: update model config (#9202) 2025-08-14 15:15:27 -07:00
Yineng Zhang ac474869d4 chore: upgrade transformers 4.55.2 (#9197) 2025-08-14 13:51:02 -07:00
Yineng Zhang 1fea998a45 chore: bump sgl-kernel v0.3.5 (#9185) 2025-08-14 03:20:48 -07:00
Yineng Zhang 7b56e494be chore: bump v0.5.0rc1 (#9069) 2025-08-13 10:44:14 -07:00
Yineng Zhang 71fb8c9527 feat: update fa3 (#9126) 2025-08-13 20:07:08 +08:00
Yineng Zhang 924827c3de chore: use cp310 (#9130) 2025-08-12 15:33:22 -07:00
Yineng Zhang c81daf838d fix: update Dockerfile (#9129) 2025-08-12 15:01:29 -07:00
Yineng Zhang 305b27c124 fix: update Dockerfile (#9125) 2025-08-12 13:23:10 -07:00
Yineng Zhang 3a9afe2a42 chore: bump sgl-kernel v0.3.4 (#9103) 2025-08-12 01:48:47 -07:00
zhyncs f4ae50e97c fix: use flashinfer v0.2.11.post1 2025-08-11 02:49:25 -07:00
Yineng Zhang 84cb449eec Revert "chore: upgrade flashinfer 0.2.11 (#9036)" (#9057) 2025-08-11 00:16:39 -07:00
Yineng Zhang 9d834fdcc1 Revert "feat: update flashinfer ar oneshot params (#8687)" (#9054) 2025-08-10 23:24:42 -07:00
Yineng Zhang dd001a5477 chore: upgrade flashinfer 0.2.11 (#9036) 2025-08-10 17:35:37 -07:00
Yineng Zhang dd949ace23 Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035) 2025-08-10 17:34:54 -07:00
Yineng Zhang 48b8b4c124 fix nvshmem cu126 (#9001) 2025-08-09 03:34:54 -07:00
Yineng Zhang 326a901df4 chore: upgrade sgl-kernel 0.3.3 (#8998) 2025-08-09 01:22:01 -07:00
Yineng Zhang 9020f7fc32 chore: bump v0.5.0rc0 (#8959) 2025-08-08 09:16:18 -07:00
Yineng Zhang 41357e511b chore: update flashinfer (#8958) 2025-08-08 02:15:22 -07:00
Yineng Zhang 54ea57f245 chore: bump sgl-kernel v0.3.3 (#8957) 2025-08-08 01:35:37 -07:00
Yineng Zhang 361379b52b docs: update README (#8929) 2025-08-07 14:28:35 -07:00
Yineng Zhang 1ac16add8b chore: support blackwell cu129 image (#8928) 2025-08-07 14:24:57 -07:00
Yineng Zhang 4bf6e5a6b0 fix: use openai 1.99.1 (#8927) 2025-08-07 14:20:35 -07:00
Yineng Zhang cbbd685a46 chore: use torch 2.8 stable (#8880) 2025-08-06 15:51:40 -07:00
Yineng Zhang aeac900ca2 fix: resolve ci issue (#8859) 2025-08-06 02:28:14 -07:00
Yineng Zhang 3ae8e3ea8f chore: upgrade torch 2.8.0 (#8836) 2025-08-05 17:32:01 -07:00
Yineng Zhang 556e4143f0 fix: remove unused import (#8809) 2025-08-05 13:40:22 -07:00
Yineng Zhang 4ef47839ae feat: use py312 (#8832) 2025-08-05 13:38:22 -07:00
Yineng Zhang 4f4e0e4162 chore: upgrade flashinfer 0.2.10 (#8827) 2025-08-05 12:04:01 -07:00
Yineng Zhangandhebiao064 901ab758ec chore: upgrade transformers 4.55.0 (#8823)
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
2025-08-05 11:37:21 -07:00
Yineng Zhang 8e8545caf6 fix: update cmake (#8817) 2025-08-05 09:38:30 -07:00
Yineng Zhang 75df31b60e chore: bump sgl-kernel v0.3.2 (#8802) 2025-08-05 02:35:20 -07:00
Yineng Zhang 194561f27a feat: support sgl-kernel cu129 (#8800) 2025-08-05 02:33:47 -07:00
Yineng Zhang 5e91fed1c5 Revert "[NVIDIA]Fix local_num_experts for EP (#8779)" (#8797) 2025-08-04 23:30:43 -07:00
Yineng Zhang 1ea94d3b92 chore: upgrade flashinfer v0.2.9 (#8780) 2025-08-04 21:59:18 -07:00
Yineng Zhang 02bc1c7d80 chore: bump sgl-kernel v0.3.1 (#8771) 2025-08-04 13:18:54 -07:00
Yineng Zhang 8cd344586e chore: bump v0.4.10.post2 (#8727) 2025-08-03 03:43:29 -07:00
Yineng Zhang 5ce5093b97 chore: bump sgl-kernel 0.3.0 with torch 2.8.0 (#8718) 2025-08-03 02:31:50 -07:00
Yineng Zhang 0a56b721d5 chore: bump sgl-kernel v0.2.9 (#8713) 2025-08-02 16:21:56 -07:00
Yineng Zhang 0ad098b494 Revert "Fix nan value generated after custom all reduce (#8532)" (#8642) 2025-07-31 17:26:49 -07:00
Yineng Zhang 023288645b chore: bump v0.4.10 (#8608) 2025-07-31 20:50:17 +08:00
Yineng Zhang 43118f5f2a chore: bump sgl-kernel v0.2.8 (#8599) 2025-07-30 22:23:52 -07:00
Yineng Zhang 6478831be9 chore: bump v0.4.9.post6 (#8517) 2025-07-29 02:30:07 -07:00
Yineng Zhang 8240a6b013 chore: add glm 4.5 fp8 tp4 config (#8480) 2025-07-28 16:14:01 -07:00
Yineng Zhang 3a04aa4be7 chore: add glm4 fp8 tp8 config (#8478) 2025-07-28 16:08:53 -07:00
Yineng Zhang 1466c1b896 feat: support glm4 tuning (#8473) 2025-07-28 14:32:58 -07:00
Yineng Zhang ccfe52a057 fix: update dep (#8467) 2025-07-28 10:19:33 -07:00
Yineng Zhang 45bc170b36 chore: bump v0.4.9.post5 (#8458) 2025-07-28 02:11:06 -07:00
Yineng Zhang 10ee89559e chore: upgrade flashinfer v0.2.9rc2 (#8406) 2025-07-27 01:41:22 -07:00
Yineng Zhang bf3352c559 chore: update CODEOWNERS (#8407) 2025-07-27 01:39:36 -07:00
Yineng Zhang 2272c2a5b5 chore: bump v0.4.9.post4 (#8305) 2025-07-25 17:12:47 -07:00
f8ca2368b2 fix: kimi k2 xgrammar crash (#8367)
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
Co-authored-by: gongwei-130 <56567052+gongwei-130@users.noreply.github.com>
2025-07-25 15:44:01 -07:00
Yineng Zhang 7181ec8cfc fix: upgrade nccl version (#8359) 2025-07-25 14:59:02 -07:00
Yineng Zhang 4953f4ca9a chore: upgrade sgl-kernel 0.2.7 (#8304) 2025-07-23 15:07:27 -07:00
Yineng Zhang 4c605235aa fix: workaround for deepgemm warmup issue (#8302) 2025-07-23 12:01:51 -07:00
Yineng Zhang 01c000043c chore: bump v0.4.9.post3 (#8265) 2025-07-22 15:55:48 -07:00
Yineng Zhang 114837854f docs: update 2025 h2 roadmap (#8237) 2025-07-21 14:02:48 -07:00
Yineng Zhang 74f59ae555 chore: upgrade sgl-kernel 0.2.6.post1 (#8202) 2025-07-21 02:10:24 -07:00
Yineng Zhang 429bb0efa2 chore: bump sgl-kernel v0.2.6.post1 (#8200) 2025-07-20 19:50:28 -07:00
Yineng Zhang 2db6719cc5 feat: update nccl 2.27.6 (#8182) 2025-07-19 22:55:45 -07:00
Yineng Zhang f62d75b6a1 feat: add b200 tp 16 kimi k2 moe config (#8178) 2025-07-19 20:04:12 -07:00
Yineng Zhang 0f9b11e310 feat: add h200 tp 16 kimi k2 moe config (#8176) 2025-07-19 20:04:02 -07:00
Yineng Zhang 561dd7b2ce chore: upgrade sgl-kernel 0.2.6 (#8166) 2025-07-19 03:17:08 -07:00
Yineng Zhang f98e88b9fb chore: bump sgl-kernel v0.2.6 (#8165) 2025-07-19 00:56:18 -07:00
Yineng Zhang 4a8837950a fix: resolve arm build issue (#8052) 2025-07-15 01:19:34 -07:00
Yineng Zhang 22bd857cb5 docs: update README (#7985) 2025-07-12 13:31:11 -07:00
Yineng Zhang eb118d88c4 chore: bump v0.4.9.post2 (#7963) 2025-07-11 21:11:20 -07:00
Yineng Zhang 732fc8e405 chore: upgrade sgl-kernel 0.2.5 (#7971) 2025-07-11 20:35:06 -07:00
Yineng Zhang 61bb285827 chore: upgrade xgrammar 0.1.21 (#7962) 2025-07-11 19:26:52 -07:00
Yineng Zhang 8f3173d0b0 chore: bump sgl-kernel v0.2.5 (#7964) 2025-07-11 18:24:20 -07:00
Yineng Zhang 066f4ec91f chore: bump v0.4.9.post1 (#7882) 2025-07-09 00:28:17 -07:00
Yineng Zhang b6b6268ccf Revert "Embedding parallel by attn_tp (#7623)" (#7880) 2025-07-08 22:03:09 -07:00
Yineng Zhang 6a6e0bb7fd docs: update README (#7821) 2025-07-07 02:47:04 -07:00
Yineng Zhang 625018d259 fix: free disk space (#7803) 2025-07-05 18:52:25 -07:00
Yineng Zhang ec5f9c6269 chore: bump v0.4.9 (#7802) 2025-07-05 17:40:29 -07:00
Yineng Zhang 62f5522ffe chore: upgrade sgl-kernel v0.2.4 (#7801) 2025-07-05 17:37:40 -07:00
Yineng Zhang f200af0d8c chore: bump sgl-kernel v0.2.4 (#7800) 2025-07-05 15:03:31 -07:00
Yineng Zhang 77cfea689d chore: upgrade sgl-kernel v0.2.3 (#7786) 2025-07-05 01:55:55 -07:00
Yineng Zhang 75354d9ae9 fix: use nvidia-nccl-cu12 2.27.5 (#7787) 2025-07-05 01:28:21 -07:00