Commit Graph
100 Commits
Author SHA1 Message Date
Yineng Zhang 2272c2a5b5 chore: bump v0.4.9.post4 (#8305) 2025-07-25 17:12:47 -07:00
f8ca2368b2 fix: kimi k2 xgrammar crash (#8367)
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
Co-authored-by: gongwei-130 <56567052+gongwei-130@users.noreply.github.com>
2025-07-25 15:44:01 -07:00
Yineng Zhang 7181ec8cfc fix: upgrade nccl version (#8359) 2025-07-25 14:59:02 -07:00
Yineng Zhang 4953f4ca9a chore: upgrade sgl-kernel 0.2.7 (#8304) 2025-07-23 15:07:27 -07:00
Yineng Zhang 4c605235aa fix: workaround for deepgemm warmup issue (#8302) 2025-07-23 12:01:51 -07:00
Yineng Zhang 01c000043c chore: bump v0.4.9.post3 (#8265) 2025-07-22 15:55:48 -07:00
Yineng Zhang 114837854f docs: update 2025 h2 roadmap (#8237) 2025-07-21 14:02:48 -07:00
Yineng Zhang 74f59ae555 chore: upgrade sgl-kernel 0.2.6.post1 (#8202) 2025-07-21 02:10:24 -07:00
Yineng Zhang 429bb0efa2 chore: bump sgl-kernel v0.2.6.post1 (#8200) 2025-07-20 19:50:28 -07:00
Yineng Zhang 2db6719cc5 feat: update nccl 2.27.6 (#8182) 2025-07-19 22:55:45 -07:00
Yineng Zhang f62d75b6a1 feat: add b200 tp 16 kimi k2 moe config (#8178) 2025-07-19 20:04:12 -07:00
Yineng Zhang 0f9b11e310 feat: add h200 tp 16 kimi k2 moe config (#8176) 2025-07-19 20:04:02 -07:00
Yineng Zhang 561dd7b2ce chore: upgrade sgl-kernel 0.2.6 (#8166) 2025-07-19 03:17:08 -07:00
Yineng Zhang f98e88b9fb chore: bump sgl-kernel v0.2.6 (#8165) 2025-07-19 00:56:18 -07:00
Yineng Zhang 4a8837950a fix: resolve arm build issue (#8052) 2025-07-15 01:19:34 -07:00
Yineng Zhang 22bd857cb5 docs: update README (#7985) 2025-07-12 13:31:11 -07:00
Yineng Zhang eb118d88c4 chore: bump v0.4.9.post2 (#7963) 2025-07-11 21:11:20 -07:00
Yineng Zhang 732fc8e405 chore: upgrade sgl-kernel 0.2.5 (#7971) 2025-07-11 20:35:06 -07:00
Yineng Zhang 61bb285827 chore: upgrade xgrammar 0.1.21 (#7962) 2025-07-11 19:26:52 -07:00
Yineng Zhang 8f3173d0b0 chore: bump sgl-kernel v0.2.5 (#7964) 2025-07-11 18:24:20 -07:00
Yineng Zhang 066f4ec91f chore: bump v0.4.9.post1 (#7882) 2025-07-09 00:28:17 -07:00
Yineng Zhang b6b6268ccf Revert "Embedding parallel by attn_tp (#7623)" (#7880) 2025-07-08 22:03:09 -07:00
Yineng Zhang 6a6e0bb7fd docs: update README (#7821) 2025-07-07 02:47:04 -07:00
Yineng Zhang 625018d259 fix: free disk space (#7803) 2025-07-05 18:52:25 -07:00
Yineng Zhang ec5f9c6269 chore: bump v0.4.9 (#7802) 2025-07-05 17:40:29 -07:00
Yineng Zhang 62f5522ffe chore: upgrade sgl-kernel v0.2.4 (#7801) 2025-07-05 17:37:40 -07:00
Yineng Zhang f200af0d8c chore: bump sgl-kernel v0.2.4 (#7800) 2025-07-05 15:03:31 -07:00
Yineng Zhang 77cfea689d chore: upgrade sgl-kernel v0.2.3 (#7786) 2025-07-05 01:55:55 -07:00
Yineng Zhang 75354d9ae9 fix: use nvidia-nccl-cu12 2.27.5 (#7787) 2025-07-05 01:28:21 -07:00
Yineng Zhang 4fece12be9 chore: bump sgl-kernel v0.2.3 (#7784) 2025-07-05 00:05:45 -07:00
Yineng Zhang aca1101a13 chore: bump sgl-kernel 0.2.2 (#7755) 2025-07-03 12:49:10 -07:00
Yineng Zhang f18a8fddd4 chore: upgrade flashinfer v0.2.7.post1 (#7698) 2025-07-01 14:05:57 -07:00
Yineng Zhang 637bfee448 chore: bump sgl-kernel v0.2.1 (#7675) 2025-06-30 22:12:33 -07:00
Yineng Zhang 392e441ad1 chore: upgrade flashinfer v0.2.7 jit (#7663) 2025-06-30 13:26:26 -07:00
Yineng Zhang d80539291b docs: add gb200 nvl72 and a16z grant (#7620) 2025-06-28 02:08:09 -07:00
Yineng Zhang a8c10aeeee fix unit tests (#7618) 2025-06-28 00:32:41 -07:00
Yineng Zhang 69183f8808 chore: bump v0.4.8.post1 (#7559) 2025-06-26 02:21:12 -07:00
Yineng Zhang 7c3a12c000 chore: bump v0.4.8 (#7493) 2025-06-23 23:14:22 -07:00
Yineng Zhang e846d95ef6 chore: bump sgl-kernel v0.2.0 (#7490) 2025-06-23 22:29:50 -07:00
Yineng Zhang 4d8d9b8efd chore: upgrade mooncake-transfer-engine 0.3.4 (#7401) 2025-06-20 16:38:54 -07:00
Yineng Zhang fadf18fdd5 docs: update installation (#7366) 2025-06-19 12:00:19 -07:00
Yineng Zhang 20a503c7d1 fix: resolve blackwell deepep image issue (#7331) 2025-06-18 17:04:02 -07:00
Yineng Zhang 0650e5176f fix: only enable flash_attn test on sm80 sm90 (#7289) 2025-06-17 16:56:41 -07:00
Yineng Zhang 4f204db57c fix: resolve b200 dsv3 mtp issue (#7286) 2025-06-17 16:22:46 -07:00
Yineng Zhang f9dc9dd28b chore: bump v0.4.7.post1 (#7248) 2025-06-16 15:20:29 -07:00
Yineng Zhang 7df7c679b6 feat: use zstd for docker (#7205) 2025-06-14 23:13:29 -07:00
Yineng Zhang 4473320380 chore: bump v0.1.8.post2 (#7189) 2025-06-14 17:01:48 -07:00
Yineng Zhang 8ab7d93c2e chore: bump v0.1.8.post1 (#7152) 2025-06-13 03:14:26 -07:00
Yineng Zhang 7046e0fab7 feat: update blackwell setup (#7119) 2025-06-12 01:54:40 -07:00
Yineng Zhang 344adb00ec fix arm sgl-kernel link issue (#7066) 2025-06-10 15:23:22 -07:00
Yineng Zhang ce5ee3bdf0 chore: update dev docker (#7064) 2025-06-10 12:57:58 -07:00
Yineng Zhang 2f58445531 Revert "Add sanity checks when a test file is not added to CI (#6947)" (#7063) 2025-06-10 12:43:25 -07:00
Yineng Zhang cef6655b26 fix 24.12 docker (#7045) 2025-06-10 02:43:22 -07:00
Yineng Zhang 4f723edd3b chore: bump v0.4.7 (#7038) 2025-06-10 01:56:20 -07:00
Yineng Zhang 1c8b42c84c chore: update pr test xeon (#7018) 2025-06-09 17:36:25 -07:00
Yineng Zhang 7059ae16fb chore: update pr test xeon (#7008) 2025-06-09 10:08:44 -07:00
Yineng Zhang 51d9a597f9 cleanup tmp dir (#7007) 2025-06-09 09:26:04 -07:00
56ccd3c22c chore: upgrade flashinfer v0.2.6.post1 jit (#6958)
Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
2025-06-09 09:22:39 -07:00
Yineng Zhang 6c0a48282a chore: bump sgl-kernel v0.1.7 (#6963) 2025-06-08 02:43:15 -07:00
Yineng Zhang 1fb76ebb93 Revert "Fuse routed scaling factor in topk_reduce kernel (#6220)" (#6968) 2025-06-07 21:02:49 -07:00
Yineng Zhang 23881fa60c chore: upgrade sgl-kernel v0.1.6.post1 (#6957) 2025-06-07 17:18:55 -07:00
Yineng Zhang 8db3ac55a9 chore: bump sgl-kernel v0.1.6.post1 (#6955) 2025-06-07 15:25:46 -07:00
Yineng Zhang d664ca18f2 chore: bump sgl-kernel v0.1.6 (#6943) 2025-06-07 00:25:22 -07:00
Yineng Zhang 1da8d23051 chore: update blackwell docker (#6800) 2025-06-01 13:37:40 -07:00
Yineng Zhang 34c63731fc chore: upgrade sgl-kernel v0.1.5 (#6795) 2025-05-31 18:32:00 -07:00
Yineng Zhang b520d02888 chore: bump sgl-kernel v0.1.5 (#6794) 2025-05-31 14:54:00 -07:00
Yineng Zhang fa6723f08f Revert "fix communicator for non-dp lm head (#6662)" (#6677) 2025-05-27 12:22:59 -07:00
Yineng Zhang f77da69964 chore: upgrade mooncake-transfer-engine (#6643) 2025-05-26 20:01:30 -07:00
Yineng Zhang fc419b62e8 Revert "Tiny fix lint CI does not trigger on master (#6609)" (#6610) 2025-05-25 22:52:34 -07:00
Yineng ZhangandMick 7eb9d8e594 chore: upgrade transformers 4.52.3 (#6575)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-05-25 22:49:58 -07:00
Yineng Zhang 7e257cd666 chore: bump v0.4.6.post5 (#6566) 2025-05-24 00:48:05 -07:00
Yineng Zhang a6970a17f3 misc: fix accept_length (#6536) 2025-05-22 14:27:10 -07:00
Yineng Zhang 0b07c4a99f chore: upgrade sgl-kernel v0.1.4 (#6532) 2025-05-22 13:28:16 -07:00
Yineng Zhang d71f3f0a2a chore: bump sgl-kernel v0.1.4 (#6522) 2025-05-22 09:47:42 -07:00
Yineng Zhang b146555749 Revert "Implement return_hidden_states for the OpenAI API (#6137)" (#6440) 2025-05-19 18:21:29 -07:00
Yineng Zhang eabcf82acb feat: add long context example (#6391) 2025-05-18 01:45:17 -07:00
Yineng Zhang f07c6a009b chore: upgrade sgl-kernel v0.1.3 (#6377) 2025-05-17 19:47:05 -07:00
Yineng Zhang 3d7f7a43c8 chore: bump sgl-kernel v0.1.3 (#6368) 2025-05-17 00:15:55 -07:00
Yineng Zhang 69748d088d docs: update readme (#6361) 2025-05-16 16:16:23 -07:00
Yineng Zhang 16267d4fa7 chore: bump v0.4.6.post4 (#6245) 2025-05-13 01:57:51 -07:00
Yineng Zhang f24fc5b86d fix typo (#6248) 2025-05-12 15:45:12 -07:00
Yineng Zhang f94543d22b chore: add hf_xet dep (#6243) 2025-05-12 13:08:40 -07:00
Yineng Zhangandalcanderian 230106304d chore: upgrade sgl-kernel v0.1.2.post1 (#6196)
Co-authored-by: alcanderian <alcanderian@gmail.com>
2025-05-11 22:41:37 +08:00
Yineng Zhang 45b4dcf037 chore: bump sgl-kernel v0.1.2.post1 (#6195) 2025-05-11 02:24:10 -07:00
Yineng Zhang 213e8c7dd5 chore: upgrade deepgemm (#6073) 2025-05-11 02:17:24 -07:00
Yineng Zhang 4d1c9db66c feat: support loogle eval (#6190) 2025-05-10 23:52:44 -07:00
Yineng Zhang 66fc63d6b1 Revert "feat: add thinking_budget (#6089)" (#6181) 2025-05-10 16:07:45 -07:00
Yineng Zhang 678d8cc987 chore: bump v0.4.6.post3 (#6165) 2025-05-09 15:38:47 -07:00
Yineng Zhang 8dc4efd0ab docs: update README (#6132) 2025-05-08 15:18:48 -07:00
Yineng Zhang 6578cf27de chore: bump sgl-kernel 0.1.2 (#6131) 2025-05-08 15:16:28 -07:00
Yineng Zhangandyizhang2077 6f56614734 chore: upgrade cutlass 3.9.2 (#6004)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-05-06 13:34:08 -07:00
Yineng Zhang 5f300141b7 docs: add new blog (#6048) 2025-05-06 00:48:10 -07:00
Yineng Zhang 1c05425bcb docs: add Google Cloud Vertex AI in Adoption and Sponsorship (#6047) 2025-05-06 00:31:48 -07:00
Yineng Zhang 141a459644 fix: only upgrade nccl for cu128 (#5986) 2025-05-02 11:31:29 -07:00
Yineng Zhang 9858113c33 chore: bump v0.4.6.post2 (#5939) 2025-04-30 22:04:40 -07:00
Yineng Zhang 8441baad6e fix: update model runner (#5934) 2025-04-30 19:49:26 -07:00
Yineng Zhang 9a6ad8916d chore: upgrade sgl-kernel 0.1.1 (#5933) 2025-04-30 16:13:30 -07:00
Yineng Zhang d353d08b4e chore: bump sgl-kernel 0.1.1 (#5932) 2025-04-30 14:01:49 -07:00
Yineng Zhang a043f7f2ab chore: use torch 2.6 for sgl-kernel build (#5898) 2025-04-29 17:51:18 -07:00
Yineng Zhang 9a62191ba7 chore: update CODEOWNERS (#5895) 2025-04-29 14:12:04 -07:00