Chunyuan WUandThien Tran 7eb47b0f3d [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641) ...

Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>

2025-06-25 01:43:33 -07:00

..

attention

Perormance: Enable cuda graph for dp idle batch (#7269)

2025-06-23 17:34:13 -07:00

moe

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)

2025-06-25 01:43:33 -07:00

quantization

Fix torch compile run (#7391)

2025-06-22 15:33:09 -07:00

activation.py

Update python API of activation, topk, norm and rope and remove vllm dependency (#6614)

2025-06-17 22:11:50 -07:00

communicator.py

[Feature] Comprehensive Hybrid Parallelism Support (#6389)

2025-06-20 14:43:11 -07:00

dp_attention.py

[fix] PD disaggregation when enable mtp and tp!=dp (#7420)

2025-06-21 12:03:11 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

Update python API of activation, topk, norm and rope and remove vllm dependency (#6614)

2025-06-17 22:11:50 -07:00

linear.py

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)

2025-06-25 01:43:33 -07:00

logits_processor.py

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)

2025-06-25 01:43:33 -07:00

multimodal.py

chore: upgrade flashinfer v0.2.6.post1 jit (#6958)

2025-06-09 09:22:39 -07:00

parameter.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

pooler.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

radix_attention.py

Fix grammar abort & Minor style fixes (#7204)

2025-06-14 22:49:41 -07:00

rotary_embedding.py

Update python API of activation, topk, norm and rope and remove vllm dependency (#6614)

2025-06-17 22:11:50 -07:00

sampler.py

Reintroduce tiny fix sampler error when prob is not contiguous (#7354)

2025-06-19 09:39:34 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

utils.py

[Feature] Support Flashinfer fmha on Blackwell (#6930)

2025-06-06 12:57:50 -07:00

vocab_parallel_embedding.py

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)

2025-06-25 01:43:33 -07:00