 hlu1
|
7291c72e57
|
[Deepseek V3.2] Change indexer weights_proj to fp32 (#13459)
|
2025-11-20 12:24:10 -08:00 |
|
|
hlu1
|
a8fcbf6fe3
|
[Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-17 12:20:49 -08:00 |
|
|
hlu1
|
a7002e614b
|
[Deepseek V3.2] Clean up MTP (#13236)
|
2025-11-14 11:01:37 -08:00 |
|
|
hlu1
|
0d4a418424
|
[Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-11 16:15:26 -08:00 |
|
|
hlu1
|
b8ddc296f4
|
[sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-07 18:33:27 -08:00 |
|
|
hlu1
|
bef37d6de8
|
[Deepseek V3.2] Only skip Indexer logits computation when is_extend_without_speculative (#12816)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-11-07 01:34:04 -08:00 |
|
|
hlu1
|
42e1a72efb
|
[Deepseek V3.2] Enable flashmla_auto with MTP (#12294)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-28 23:51:20 -07:00 |
|
|
hlu1
|
0ee831dee0
|
Update deepseek_v32.md (#12296)
|
2025-10-28 14:52:38 -07:00 |
|
|
hlu1
|
81a632ace6
|
[DeepseekV32] Enable flashmla_prefill kernel with fp8 kvcache (#11655)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-27 23:11:48 -07:00 |
|
|
hlu1
|
3b80232d06
|
[DeepseekV32] Add fast_topk_transform_ragged_fused kernel (#11815)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-19 17:13:39 -07:00 |
|
|
hlu1
|
d6777a706d
|
Add --thinking-mode to run_eval (#11189)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-10-03 16:49:39 +08:00 |
|
|
hlu1
|
592ddf374f
|
Add simple docker file for B300 (#10944)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-09-26 17:26:57 -07:00 |
|
|
hlu1
|
5f1eb20484
|
[chore] Remove unused ep_moe cuda kernels (#9956)
|
2025-09-06 01:35:50 -07:00 |
|
|
hlu1
|
039cef76aa
|
Remove non-accelerated targets(100 and up) from cmake (#10041)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-09-06 01:35:28 -07:00 |
|
|
hlu1
|
4c22ebe2e8
|
Disable kernel cutlass_mla_decode on SM103 (#10058)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-09-06 01:35:18 -07:00 |
|
|
hlu1
|
2985090084
|
Update flashinfer to 0.3.1 for B300 support (#10087)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-09-05 13:41:01 -07:00 |
|
|
hlu1
|
1e85589dc5
|
Make fp4_quantize kernels work on sm103 (#9807)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-08-29 21:15:08 -07:00 |
|
|
hlu1
|
7a16db9bd9
|
Make sm100 fp8 kernels available on sm103 (#9789)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-08-28 23:47:29 -07:00 |
|
|
hlu1
|
a7d825fccc
|
Skip some tests on Blackwell (#9777)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-08-28 20:00:32 -07:00 |
|
|
hlu1
|
ccd3fb946e
|
[fix] Fix mxfp4 triton MoE tp bug (#9473)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
|
2025-08-23 01:48:40 -07:00 |
|
|
hlu1andXinyuan Tong
|
dae9a80f43
|
[fix] Fix mxfp4 weight loading bug with TP sharding in GPT-OSS (#9433)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-08-21 03:50:51 -07:00 |
|