 Byron HsuandByronHsu
|
046cdaabaa
|
[Sampling] Capture masks from sampler support (#36630)
Co-authored-by: ByronHsu <ByronHsu@users.noreply.github.com>
|
2026-09-02 17:13:28 -07:00 |
|
|
+1
|
3865efc9f7
|
[AMD] support gfx1250 on ROCM 10 (#36871)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Kao <akao@amd.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-08-31 01:19:11 -07:00 |
|
|
+8
|
5f216fc33f
|
qwen 3.8 rebase (#35758)
Co-authored-by: cherichy <cherichy@outlook.com>
Co-authored-by: guangyunh-nv <guangyunh@nvidia.com>
Co-authored-by: jiahanc <jiahanc@nvidia.com>
Co-authored-by: jinyangyuan-nvidia <joyuan@nvidia.com>
Co-authored-by: Cheng Hang <chang@nvidia.com>
Co-authored-by: Yicheng Qiang <yqiang@nvidia.com>
Co-authored-by: Sam Li <lsam@nvidia.com>
Co-authored-by: Tom-Zheng <tizheng@nvidia.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: xiaoweiw-nv <xiaoweiw@nvidia.com>
Co-authored-by: Zheng Li <lizheng.cs@zju.edu.cn>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
|
2026-08-28 20:41:34 -07:00 |
|
|
jacky.cheng
|
6314e9e4f5
|
[AMD][Fix] Qwen3.5: guard zero-grid launch in fused_qk_gemma_rmsnorm(_with_gate) (HIP invalid configuration on idle DP rank) (#31794)
|
2026-08-15 21:02:54 -07:00 |
|
|
Kurt ShusterandClaude Fable 5
|
3fe65e0654
|
Deterministic gumbel sampling: clamp u=1 so masked tokens can't be sampled (#33423)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-08-09 21:43:27 +08:00 |
|
|
Cheng Wan
|
55b6769b0e
|
config: read resolved config via namespace accessors (#33013)
|
2026-07-31 15:06:59 -07:00 |
|
|
Yuzhen Zhou
|
b954e9cf3d
|
[6/6][kimi-deterministic] Use deterministic seeded coins for EAGLE rejection sampling (#30822)
|
2026-07-24 02:11:21 -07:00 |
|
|
Cheng Wan
|
f5dcbe8f14
|
Revert RuntimeContext config-namespace reads/roles (#31813–#31817) (#32100)
|
2026-07-22 11:52:41 -07:00 |
|
|
Cheng Wan
|
11a4c2d057
|
config: read resolved config via namespace accessors (#31814)
|
2026-07-22 01:18:05 -07:00 |
|
|
Liangsheng Yin
|
ff6c755952
|
[Refactor] Unify logprob results into a single LogprobResult and rename chunk env vars (#31733)
|
2026-07-20 12:44:27 -07:00 |
|
|
Liangsheng Yin
|
639261f7b2
|
[Refactor] Move output logprob processing into the logprob_processor layer (#31624)
|
2026-07-17 22:33:52 -07:00 |
|
|
Qiaolin Yu
|
632adff9fd
|
refactor logprob processor layer (#20071)
|
2026-07-17 16:28:10 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
hari-hm
|
a909077d22
|
Return top-p/top-k sampling mask/nucleas (#27408)
|
2026-07-13 17:58:51 -05:00 |
|
|
Cheng Wan
|
1f15308dca
|
[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)
|
2026-07-09 02:10:47 -07:00 |
|
|
Cheng Wan
|
e703f9e566
|
[refactor] Adopt get_parallel() everywhere and close out the parallel wrapper surface (#30492)
|
2026-07-09 02:09:39 -07:00 |
|
|
Cheng Wan
|
be32c57598
|
[refactor] Read resolved config from server_args fields; retire the flags mirror tier (#30346)
|
2026-07-07 21:28:34 -07:00 |
|
|
Cheng Wan
|
8fb99bbaf8
|
[refactor] Config resolution pipeline: full-stack review (10-PR series, review only) (#30137)
|
2026-07-05 00:00:07 -07:00 |
|
|
Liangsheng Yin
|
493bb6ae0d
|
Fix fp16 NaN flake in spec CI: bf16 eagle fixture; sanitize NaN logits in sampler (#27883)
|
2026-06-11 01:16:12 -07:00 |
|
|
Estrella-xx
|
6abef38627
|
[NPU]adaptation to support deterministic inference (#21197)
|
2026-06-09 09:22:09 +08:00 |
|
|
YC Yen-Ching Tseng
|
69623f4b11
|
[AMD] Guard aiter greedy_sample OOB token id (fixes VLM MMMU CI) (#27247)
|
2026-06-04 12:53:58 -07:00 |
|
|
+2
|
deaba74745
|
[AMD][DSV4] DSV4 MTP graph + sparse triton attn optimizations (#26383)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-05-27 15:23:35 -07:00 |
|
|
Liangsheng Yin
|
ec6f8d61f7
|
[Spec] Async-assert probes across EAGLE/MTP; zero tgt_cache_loc (#26335)
|
2026-05-26 11:34:03 -07:00 |
|
|
|
897587b03a
|
[MUSA]: Add flashinfer sampling backend (#24978)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
|
2026-05-14 20:23:15 -07:00 |
|
|
|
b35213be11
|
[MUSA][16/N] Add MUSA backend support for layers and DeepSeek models (V2/V3/R1) (#22774)
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-04-23 18:59:51 -07:00 |
|
|
Xiaoyu Zhang
|
ee9d922f5a
|
Revert "[Kernel] Fuse temperature + softmax in sampling for decode speedup" (#22046)
|
2026-04-03 21:32:08 +08:00 |
|
|
Mook
|
7a59e05dd1
|
[Kernel] Fuse temperature + softmax in sampling for decode speedup (#20501)
|
2026-04-02 12:46:36 +08:00 |
|
|
Qiaolin Yu
|
a27651d5e0
|
Remove sync when enabling return_logprob (#20972)
|
2026-03-27 16:36:28 -07:00 |
|
|
pansicheng
|
2ad475b4ed
|
use flashinfer.sampling (#18696)
|
2026-02-26 10:02:38 +08:00 |
|
|
Lianmin ZhengandSehoon Kim
|
e02a9bec8d
|
Refactor sampler: Use a better hash function for deterministic sampling and clear dispatch for probs/logprobs/logits sampling paths (#18915)
Co-authored-by: Sehoon Kim <sehoon@x.ai>
|
2026-02-17 15:41:23 -08:00 |
|
|
Lianmin Zheng
|
d4180815a4
|
Make the functions in logits_processor.py and sampler.py more modular (#17885)
|
2026-01-28 16:24:23 -08:00 |
|
|
Liangsheng Yin
|
e6d40bff81
|
Revert "feat: reduce constrained-decoding overhead in TP" (#16845)
|
2026-01-10 11:39:38 +08:00 |
|
|
Raayan Dhar
|
76b3c698d6
|
feat: reduce constrained-decoding overhead in TP (#13947)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
|
2026-01-10 00:38:32 +08:00 |
|
|
Liangsheng Yin
|
8766a1dd24
|
[1 / N] Clean up logprob utils (#15509)
|
2025-12-22 03:12:25 +08:00 |
|
|
Qiaolin Yu
|
173940927f
|
Add customized sampler registration (#15423)
|
2025-12-18 23:10:23 -08:00 |
|
|
Zhihao Lyuandronnie_zheng
|
10592e9c08
|
[Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 21:59:58 +08:00 |
|
|
|
0296f1cdad
|
[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-07 22:07:51 -08:00 |
|
|
fzyzcjy
|
20bd2271e2
|
Support true on-policy (#12058)
|
2025-10-25 10:23:42 +08:00 |
|
|
Lianmin Zheng
|
cd7e1bd591
|
Sync code and test CI; rename some env vars (#11686)
|
2025-10-15 18:37:03 -07:00 |
|
|
Lianmin Zheng
|
5e3f7e7fa9
|
Minor: improve sampler & remove unused fields from model_config.py (#11531)
|
2025-10-13 11:04:44 -07:00 |
|
|
Liangsheng Yin
|
516738b096
|
Depreate global_server_args_dict (#11528)
|
2025-10-13 19:34:43 +08:00 |
|
|
Cheng Wan
|
1bdd010291
|
Revert "Deprecate global_server_args_dict" (#11520)
|
2025-10-12 17:40:40 -07:00 |
|
|
Lianmin Zheng
|
2ac46e94ef
|
Sync changes on io_struct.py and deterministic ops (#11498)
|
2025-10-12 16:03:10 -07:00 |
|
|
Liangsheng Yin
|
1083e7e3df
|
Deprecate global_server_args_dict (#11331)
|
2025-10-13 01:20:47 +08:00 |
|
|
|
e2ac7888b8
|
[2/2] Support deterministic inference for temperature > 0 (#10678)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
|
2025-09-21 19:36:08 -07:00 |
|
|
Sundara Raman Ramachandran
|
a360511d7b
|
[Generative Score API] Scoring(Prefill-only) optimizations. (#9748)
|
2025-09-14 01:57:06 +08:00 |
|
|
narutolhy
|
99757cc3e6
|
fix probs name which without temp scaling name (#9984)
|
2025-09-13 12:19:57 +08:00 |
|
|
|
839c93bd2d
|
feat: add original logprobs to response (#8375)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: luhongyu.4869 <luhongyu.4869@bytedance.com>
|
2025-08-29 11:43:57 -07:00 |
|
|
Cheng Wan
|
b87aacb5c5
|
[DP Attention] Refactor: adding some utility functions (#9136)
|
2025-08-13 21:08:06 -07:00 |
|
|
fzyzcjy
|
650127a173
|
Reintroduce tiny fix sampler error when prob is not contiguous (#7354)
|
2025-06-19 09:39:34 -07:00 |
|