Revert "Revert "enable csgmv automatically on cuda"" (#14277)

2025-12-03 13:12:30 -08:00
parent 8ab5d8b40d
commit 9d82340298
2 changed files with 7 additions and 0 deletions
@@ -119,6 +119,7 @@ SGLang supports various environment variables that can be used to configure its
 | --- | --- | --- |
 | `SGLANG_WAIT_WEIGHTS_READY_TIMEOUT` | Timeout period for waiting on weights | `120` |
 | `SGLANG_DISABLE_OUTLINES_DISK_CACHE` | Disable Outlines disk cache | `true` |
+| `SGLANG_USE_CUSTOM_TRITON_KERNEL_CACHE` | Use SGLang's custom Triton kernel cache implementation for lower overheads (automatically enabled on CUDA) | `false` |

 ## Function Calling / Tool Use