 cctry
|
22cf7d2b42
|
[Fix] Handle nixlRemoteDisconnectError in NixlKVSender (#24296)
|
2026-05-05 17:23:42 -07:00 |
|
|
cctry
|
0addd185af
|
Fix /generate endpoint crash when sampling params contain null values (#23401)
|
2026-04-22 09:56:10 -07:00 |
|
|
cctryandgemini-code-assist[bot]
|
e39f0f4ff3
|
Use libdevice tanh and support 2D-strided tensors in fused softcap kernel (#23157)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-21 22:54:37 -07:00 |
|
|
|
f855a0bde6
|
Introduce CUDA graph debug mode with breakable CUDA graph (#19102)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-04-11 00:36:56 -07:00 |
|
|
cctry
|
027f314050
|
[Fix] data race in req_to_token pool (#17850)
|
2026-02-02 14:38:15 -08:00 |
|
|
cctry
|
dda35ccbd8
|
Fix gid calculation in per_tensor_absmax_kernel (#17126)
|
2026-01-15 23:21:41 +08:00 |
|
|
cctry
|
cad7878964
|
Gather static input buffers for cuda graph (#13676)
|
2025-11-22 13:01:50 -08:00 |
|
|
cctry
|
e0e6a6efb2
|
Fix CPP Radix Cache and add test to CI (#11645)
|
2025-11-11 11:51:37 -08:00 |
|
|
cctryandfzyzcjy
|
3029d30189
|
Fix crash after flush cache (#12107)
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
|
2025-10-27 23:52:27 +08:00 |
|
|
cctryandLiangsheng Yin
|
b0b4f71679
|
[Fix] memory leak by overlap + retract (#11981)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-10-23 22:59:23 +08:00 |
|
|
cctry
|
1d7f783501
|
Refactor kv cache free (#11351)
|
2025-10-14 17:45:19 -07:00 |
|
|
cctry
|
b36afed4a7
|
Separate allocation logic from scheduler (#11313)
|
2025-10-10 17:38:54 -07:00 |
|
|
cctry
|
f3764c26a3
|
Clean match_prefix and prepare_for_extend for mem cache V2 (#11200)
|
2025-10-07 17:54:18 -07:00 |
|