Commit Graph
12 Commits
Author SHA1 Message Date
Khoa Pham b2008bf9e0 [Spec][Ngram] 5/N: Store and advance anchor match state across decode steps (#21243) 2026-04-05 22:21:05 -07:00
Khoa PhamandClaude Opus 4.6 cd75d54fc5 [Bugfix] Fix CUDA graph replay issues in trtllm_mla draft_extend (#21987)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-03 01:45:13 -07:00
Khoa Pham 2b5aed94f5 Remove maxItems=1 restriction when tool_choice is specified (#20208) 2026-04-03 02:35:24 +00:00
Khoa Pham f836658077 [Spec][Ngram] 4/N: Remove max_match_window_size and min_match_window_size, matching all suffixes of the Trie (#21225) 2026-04-01 22:09:46 -07:00
Khoa Pham 153359b4dd Multi tool streaming fix (#20004) 2026-04-01 21:53:05 -07:00
Khoa Pham 8d4fca5908 [Security] 1/N: Bind ZMQ sockets to localhost to prevent unauthenticated remote access (#21435) 2026-03-26 23:33:49 -07:00
kpham-sglandClaude Opus 4.6 59cb9a9da6 [Spec][Ngram] 3/N: Fix synchronization issues in Ngram.cpp (#21186)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-23 00:37:07 -07:00
kpham-sglandClaude Opus 4.6 bc4aaab6a1 [Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-22 23:35:25 -07:00
kpham-sgl 6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
kpham-sglandhnyls2002 346a4131cf [Spec] Refactor NaN/OOB checks to async maybe_detect_* with env-var control (#19899)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-03-05 13:51:05 -08:00
kpham-sgl 376dfb03f7 Fix issue 19717 by making qo_indptr uniform strided instead of packed (#19807) 2026-03-04 15:27:10 -08:00
kpham-sgl 88290690f0 Add kpham-sgl into CI Permission list (#19819) 2026-03-03 18:55:10 -08:00