 Leon Gao
|
f7a56494b1
|
Fix SWA ownership across grouped frees (#36381)
|
2026-08-25 14:57:30 -07:00 |
|
|
Leon Gao
|
78cd60b4e3
|
[srt] Reuse batched Mamba boundary mask (#33477)
|
2026-08-09 16:47:05 +08:00 |
|
|
Leon Gao
|
cfb354bcfc
|
[Bugfix] Fix batched KV free aliasing (#34067)
|
2026-08-08 03:34:44 -07:00 |
|
|
Leon Gao
|
4d4f8023c4
|
[srt] Batch scheduler cache frees (#33475)
|
2026-08-06 21:49:59 -07:00 |
|
|
Leon GaoandAndrew Gu
|
ee678910f7
|
[Kernel] Skip KV writes to reserved padding slots (#32477)
Co-authored-by: Andrew Gu <andrew@thinkingmachines.ai>
|
2026-07-29 09:58:18 +08:00 |
|
|
Leon Gao
|
eb646c7b78
|
[srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363)
|
2026-06-08 23:41:54 +08:00 |
|
|
Leon Gao
|
a10bd785be
|
Reduce mamba prefill allocation overhead (#25000)
|
2026-06-04 15:10:16 +08:00 |
|
|
Leon Gao
|
63c38aba5e
|
Fix token leak with logprob_start_len=0 in streaming sessions (#20557)
|
2026-03-19 15:37:27 -07:00 |
|
|
|
b1246c50f8
|
Fix chunked prefill and KV cache leaks for streaming sessions (#20476)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-13 02:36:55 -07:00 |
|
|
Leon Gao
|
07ef5f7be1
|
Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639)
|
2026-03-02 15:03:42 +08:00 |
|
|
|
b5a8e4179e
|
[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-02-27 18:11:05 -08:00 |
|
|
Leon Gao
|
ab0fb248fd
|
feat: add SGLANG_DISTRIBUTED_INIT_METHOD_OVERRIDE env var (#18743)
|
2026-02-14 09:37:33 +08:00 |
|