 Jun LiuandXiaoyu Zhang
|
4d5917e744
|
Add DeepSeek-reference 1e-20 epsilon to top-k renormalization to prevent 0/0 NaN (#31017)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-24 19:45:44 +08:00 |
|
|
Jun LiuandXinyuan Tong
|
58f417049d
|
[PD] Fix multi-tokenizer disaggregation metrics labels (#30412)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-24 16:27:21 +08:00 |
|
|
Jun LiuandXinyuan Tong
|
d2b1243be0
|
docs: document CUDA crash dump output (#31333)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-15 22:18:36 +08:00 |
|
|
Jun Liu
|
c47f0e7cdd
|
[PD] Fix top logprobs crash in prefill path (#26299)
|
2026-05-26 22:01:10 +08:00 |
|
|
Jun LiuandAlex Nails
|
65ce9965ce
|
[Bug Fix] Fix RunAI streamer: corrupted weights, missing quant init, and broken URIs for multimodal models (#22715)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-05-06 19:20:04 -07:00 |
|
|
Jun Liu
|
38dc372dae
|
[Bugfix] Fix KeyError: 'prompt_tokens' when streaming requests are aborted (#19514)
|
2026-02-28 20:21:35 -08:00 |
|
|
Jun Liu
|
4063234c1a
|
Add H200 fused MoE kernel configs for DeepSeek-V3 in triton 3.3.1 (#7687)
|
2025-08-13 23:14:09 -07:00 |
|
|
Jun Liu
|
14344caa38
|
[docs] Update outdated description about torch.compile (#3844)
|
2025-03-12 22:09:38 -07:00 |
|