Commit Graph
13 Commits
Author SHA1 Message Date
Nan Jiang 24b6930076 [Sampling] Stream sampling masks as per-request arrays (#40986) 2026-09-25 12:20:25 -07:00
Nan Jiang c3685dff42 [Sampling] Add selected/support sampling logprob modes (#40932) 2026-09-23 21:38:19 -07:00
Lifan Shen 8ea0ee300d perf(sampling): avoid GPU syncs when applying custom logit processors (#39234) 2026-09-18 17:09:30 -07:00
fd7743e0e1 [Sampling] Support sampling masks with overlap scheduling (#36631)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
Co-authored-by: root <root@slurm-h200-208-179.slurm-compute.tenant-slurm.svc.cluster.local>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
2026-09-10 14:52:44 -07:00
Byron HsuandByron Hsu a88e852fab [Sampling] Allow sampling-mask replay with DisallowedTokensLogitsProcessor (#38279)
Co-authored-by: Byron Hsu <24364830+ByronHsu@users.noreply.github.com>
2026-09-06 23:56:16 -07:00
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-06 17:49:41 -07:00
Liangsheng Yin 0e5414fd2f [Test] Allow top-k cutoff ties in test_sampling_mask_matches_topk_logprobs (#37873) 2026-09-03 14:13:26 -07:00
Byron HsuandByronHsu 046cdaabaa [Sampling] Capture masks from sampler support (#36630)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
2026-09-02 17:13:28 -07:00
Nan Jiang f825d72936 [Sampling] Restore finite top-k requirement for sampling masks (#35205) 2026-08-20 16:55:25 -07:00
Jiajun Li e6df23f3c2 refactor: rename chat response token IDs (#35225) 2026-08-17 23:07:43 -07:00
Nan Jiang be804c1b83 [RL] Expose top-p-only sampling masks (#33593) 2026-08-14 16:40:27 -07:00
Lianmin Zheng 5f330004bd Fix flaky test_sampling_mask: mask length can legitimately be top_k + 1 (#32410) 2026-07-25 16:05:57 -07:00
hari-hm a909077d22 Return top-p/top-k sampling mask/nucleas (#27408) 2026-07-13 17:58:51 -05:00