 ishandhanani
|
0e4d8790d7
|
feat(ci): add framework target to release-docker workflows (#14559)
|
2025-12-07 13:25:24 +08:00 |
|
|
ishandhanani
|
498ea41ca6
|
dockerfile: add runtime stage + ubuntu 24.04 (#13861)
|
2025-12-05 00:28:36 -08:00 |
|
|
ishandhanani
|
07821352fb
|
Revert "Skip weight loading in deepgemm compilation" (#14241)
|
2025-12-01 12:59:09 -08:00 |
|
|
ishandhanani
|
b537ac0d1f
|
Fix ZMQ bind error on non-zero rank nodes when using SGLANG_BLOCK_NONZERO_RANK_CHILDREN=0 (#13686)
|
2025-11-20 22:54:41 -08:00 |
|
|
ishandhanani
|
1a5c313f97
|
feat(engine): add rid parameter to methods in Engine class (#13095)
|
2025-11-11 22:37:54 -08:00 |
|
|
ishandhanani
|
885cfca273
|
ci: try to fix gpg error during kernel build (#12928)
|
2025-11-09 11:45:29 -08:00 |
|
|
ishandhanani
|
93be7e863e
|
fix: respect --ignore-eos in PD case for benchmarking (#12597)
|
2025-11-03 21:44:14 -08:00 |
|
|
ishandhanani
|
263eab9f5d
|
fix: dummy health check server not accessible on non-zero rank nodes (#12297)
|
2025-10-31 11:34:57 -07:00 |
|
|
ishandhananiandBaizhou Zhang
|
285a8e6986
|
docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-27 22:00:54 -07:00 |
|
|
ishandhanani
|
cadfae666d
|
fix broken deepep/flashmla install in container by adding --no-build-isolation (#12170)
|
2025-10-26 16:39:51 -07:00 |
|
|
ishandhanani
|
3865afc5df
|
fix: release workflow should work on both archs (#12110)
|
2025-10-24 23:22:31 -07:00 |
|
|
ishandhanani
|
14203432b4
|
fix(compile_utils, ep_moe): update environment variable and dtype check (#12034)
|
2025-10-24 11:00:12 -07:00 |
|
|
ishandhanani
|
296f689242
|
fix(server_args): handle tokenizer init conflicts (#11776)
|
2025-10-20 00:27:19 -07:00 |
|
|
ishandhanani
|
73ea484af1
|
docker: add manifest to versioned docker releases (#11268)
|
2025-10-06 14:53:40 -07:00 |
|
|
ishandhanani
|
47488cc353
|
docker: x86 dev builds for hopper and blackwell (#11075)
|
2025-10-01 00:06:38 -07:00 |
|
|
ishandhananiandzhyncs
|
adba172fd1
|
ci: free space on workers for build (#10786)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-09-24 02:58:22 -07:00 |
|
|
ishandhanani
|
b06db198ba
|
followup: clean up dockerfiles and release yamls (#10783)
|
2025-09-23 00:19:46 -07:00 |
|
|
ishandhananiandYineng Zhang
|
1c82d9db28
|
feat: unify dockerfiles (#10705)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-22 23:23:48 -07:00 |
|
|
ishandhanani
|
662393f27d
|
fix: kv events with tp > 1 (#10541)
|
2025-09-22 15:55:44 -07:00 |
|
|
ishandhanani
|
148022fc36
|
gb200: update dockerfile to latest kernel (#9522)
|
2025-09-08 17:32:36 -07:00 |
|
|
ishandhanani
|
e52c3866eb
|
chore(docker): update sgl_kernel version to 0.3.6 in Dockerfile.gb200 (#9243)
|
2025-08-15 12:06:52 -07:00 |
|
|
ishandhanani
|
1f9ec65374
|
fix(docker): update sgl_kernel version to 0.3.4 in Dockerfile.gb200 (#9118)
|
2025-08-12 13:12:33 -07:00 |
|
|
ishandhanani
|
9f24dfefd1
|
chore(gb200): remove ToT flashinfer installation (#9079)
|
2025-08-11 11:02:15 -07:00 |
|
|
ishandhanani
|
de8b8b6e5c
|
chore(deps): update minimum python to 3.10 (#8984)
|
2025-08-09 00:30:23 -07:00 |
|
|
ishandhanani
|
7d3af603e7
|
chore(ci): update Python version from 3.9 to 3.10 in sgl-kernel workflow (#8981)
|
2025-08-08 14:03:17 -07:00 |
|
|
ishandhanani
|
4e7f025219
|
chore(gb200): update to CUDA 12.9 and improve build process (#8772)
|
2025-08-08 13:42:47 -07:00 |
|
|
ishandhanani
|
b27b11919c
|
chore(gb200): update dockerfile to handle fp4 disaggregation (#8694)
|
2025-08-01 18:58:00 -07:00 |
|
|
ishandhanani
|
31fccf5a4f
|
chore: change logs fromINFO to DEBUG for dp and add force quit for tokenizer manager (#7251)
|
2025-06-18 01:36:43 -07:00 |
|
|
ishandhanani
|
f1569876d5
|
feat: add direct routing strategy to DP worker (#6884)
|
2025-06-09 11:44:05 -07:00 |
|
|
ishandhanani
|
f0f84975f4
|
feat: add dp-rank to KV events (#6852)
|
2025-06-04 15:29:34 -07:00 |
|
|
ishandhanani
|
b6909aa223
|
fix: allow launch_dummy_health_check_server to start inside of running asyncio loop (#6330)
|
2025-05-17 18:32:41 -07:00 |
|
|
ishandhanani
|
e444c13fb4
|
feat(engine): add bootstrap parameters to generate methods (dynamo) (#6075)
|
2025-05-07 10:33:58 -07:00 |
|