 Sam Shleifer
|
b3a0185cab
|
model_runner: extract post-memory-pool wiring into _init_post_memory (#31601)
|
2026-07-19 00:57:54 +08:00 |
|
|
Sam Shleifer
|
d86ae51fcf
|
metrics: allow extra labels on HTTP request/response Prometheus metrics (#31530)
|
2026-07-19 00:57:26 +08:00 |
|
|
Sam Shleifer
|
0675d3033f
|
Fix mamba track-boundary seqlen under overlap scheduler (#31369)
|
2026-07-17 10:22:07 +08:00 |
|
|
Sam ShleiferandAlex Nails
|
dec0836302
|
Fix processor config loading for object-storage model paths (#31211)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-15 00:21:31 -07:00 |
|
|
Sam Shleifer
|
133254086b
|
Plug mamba_extra_buffer ping-pong slot leaks (#26941)
|
2026-06-04 21:46:36 +08:00 |
|
|
Sam Shleifer
|
ce2506e1c6
|
Deprecate record_nolora_graph dual MoE CUDA graph capture (#24314)
|
2026-05-15 19:20:58 -07:00 |
|
|
Sam Shleifer
|
e6f252e9b8
|
Cache FlashInfer autotune configs (#24156)
|
2026-05-05 02:00:40 +08:00 |
|
|
Sam Shleifer
|
63f225ca2e
|
[session] fix mamba pool leak in StreamingSession.release_session + plumb idle leak check (#23496)
|
2026-05-02 11:38:08 +08:00 |
|
|
|
d41e8c459d
|
Support RunAI loading for quantized checkpoints (#23850)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Sam Shleifer <sam@thinkingmachines.ai>
|
2026-05-02 11:11:40 +08:00 |
|
|
Sam Shleifer
|
b9e33d6a5b
|
Dual MoE CUDA graph capture for lora/nolora batches (#22809)
|
2026-04-22 14:11:11 -07:00 |
|
|
Sam Shleifer
|
1100b9865c
|
Fix MxInt4 MoE returning wrong output variable (#21348)
|
2026-03-26 10:57:09 +08:00 |
|
|
Sam Shleifer
|
0d49b13fdd
|
Fix circular import in quantization modules (#17372)
|
2026-01-21 15:47:09 +08:00 |
|