Commit Graph
14 Commits
Author SHA1 Message Date
paulzhang-tm 9128d57966 [Spec] Allow speculative workers to stage prefill shared reads (#38554) 2026-09-14 14:03:27 -07:00
paulzhang-tmandQiaolin-Yu bb15be6d79 [Spec] Stage Inkling MTP draft metadata before verify (#38169)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-09-10 15:32:19 -07:00
paulzhang-tm a63efd9056 [Spec] Support large MTP batches in short-convolution metadata (#38558) 2026-09-10 15:13:17 -07:00
paulzhang-tm 6c1d0b1b29 Revert "[Spec] Publish the final multi-layer EAGLE shared-read event" (#38041) 2026-09-09 13:01:16 -07:00
paulzhang-tmandQiaolin-Yu 3fa6b86504 [Spec] Publish the final multi-layer EAGLE shared-read event (#36752)
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
2026-09-02 15:57:50 -07:00
paulzhang-tm 8739d56a31 [Spec] Generalize hybrid SWA MTP draft pool routing (#35379) 2026-08-26 17:02:36 -07:00
paulzhang-tm 06694071c6 [Spec] Avoid tensor scalar reads in spec decode allocation (#35377) 2026-08-26 14:51:31 -07:00
paulzhang-tm 0065fbfae1 [Scheduler] Cap prefill-delayer queue target by admission capacity (#35191) 2026-08-18 21:40:13 +08:00
paulzhang-tm 209857334e [Scheduler] Gate SWA eviction on accumulated tokens (#33404) 2026-08-08 08:28:26 +08:00
a6e5fa7081 [Scheduler] Honor explicit min-free-slots thresholds (#33403)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-08-05 01:44:18 -07:00
paulzhang-tmandClaude Fable 5 4e5a05148a [FullCG] Support chunked cached-prefix prefill (#30825)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-07-28 11:20:25 -07:00
paulzhang-tm d093c6a4bb [FullCG] Preserve attention LSE through the custom-op boundary (#31050) 2026-07-21 09:01:40 +08:00
paulzhang-tm 463a3f4248 [Mamba] Support configurable conv-window layouts (#31059) 2026-07-14 14:41:10 -07:00
paulzhang-tm 08c46e1f1a Add dummy forward batch preparation hook (#31070) 2026-07-14 14:30:31 -07:00