 elvischenv
|
46d9427b91
|
Fix MXFP8 MoE weight sizing for non-gated models (#36097)
|
2026-08-25 22:09:09 +08:00 |
|
|
elvischenvandClaude Opus 4.8
|
1df78c2cf1
|
chore: bump tilelang to 0.1.12 (#30874)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-08-19 17:01:19 -07:00 |
|
|
elvischenvandBrayden Zhong
|
a6bc0532c9
|
[Fix] Fix Nemotron-H Mamba illegal memory access under DP attention with CUDA graph (#34561)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-08-19 14:13:40 -07:00 |
|
|
elvischenv
|
035c622a14
|
Reenable breakable CUDA graph for NemotronH (#34538)
|
2026-08-13 13:58:10 +08:00 |
|
|
elvischenv
|
4f883636a2
|
[Perf] FlashInfer MLA: remove blocking D2H in spec-decode plan (#27689)
|
2026-08-12 12:29:03 -07:00 |
|
|
elvischenvandClaude Opus 5
|
03c942dfab
|
[Fix] Make wait_port_available actually wait timeout_s seconds (#33086)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-08-10 17:35:50 -07:00 |
|
|
elvischenvandBrayden Zhong
|
af3eccc9ab
|
[Perf] Eliminate the slice op for Flashinfer trtllm_fp4_block_scale_moe (#15731)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-02-26 22:23:40 -08:00 |
|
|
elvischenv
|
99fab2ce67
|
[Bugfix] Fix Mistral Large 3 NVFP4 TRTLLM MoE (#18065)
|
2026-02-03 20:32:49 +08:00 |
|
|
elvischenv
|
1d811094f8
|
[Misc] Auto download question file for benchmark/mtbench (#17019)
|
2026-01-13 10:34:29 -05:00 |
|
|
elvischenv
|
9970ee34e8
|
Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)
|
2025-12-18 11:11:42 +08:00 |
|
|
elvischenv
|
feb8e30b9d
|
[Hotfix] Fix required enable_mamba_track argument for Flashinfer autotune path (#15314)
|
2025-12-17 17:03:24 +08:00 |
|
|
elvischenv
|
435d1c83c1
|
[Perf] Enable Flashinfer autotune by default (#14357)
|
2025-12-16 23:01:39 -08:00 |
|
|
elvischenvandLinda-Stadter
|
205f041e96
|
Add Mistral Large 3 Eagle Support (#14466)
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-05 23:11:41 +08:00 |
|
|
|
848ee57067
|
feat: support flashinfer kernel autotune (#12306)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-29 00:05:37 -08:00 |
|
|
elvischenv
|
71aea45c41
|
[Fix] Add TPOT back to bench_serving (#12976)
|
2025-11-11 17:32:24 +08:00 |
|
|
elvischenv
|
1fa788ec14
|
[Bugfix] Fix illegal memory access (#12758)
|
2025-11-06 21:59:57 -08:00 |
|
|
elvischenv
|
069e490bcb
|
feat: support trtllm_mha FP8 query attention kernel (#12307)
|
2025-10-30 21:39:35 -07:00 |
|