Yineng Zhang 55842eb81a feat: fused_moe fp8 monkey patch (#2174)

2024-11-25 17:06:36 +08:00

..

attention

Allow overwrite flashinfer use_tensorcore (#2169)

2024-11-24 20:58:17 -08:00

fused_moe_grok

Rename triton_fused_moe -> fused_moe_triton (#2163)

2024-11-24 08:12:35 -08:00

fused_moe_triton

[Fused moe] add tuning fused configs for qwen2 57b and mixtral 8x7b (#2167)

2024-11-25 10:37:50 +08:00

quantization

feat: fused_moe fp8 monkey patch (#2174)

2024-11-25 17:06:36 +08:00

activation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

fused_moe_patch.py

Update CI threshold & Improve code style (#2159)

2024-11-24 06:29:38 -08:00

layernorm.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

linear.py

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

logits_processor.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

rotary_embedding.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampler.py

Make constrained decoding work for overlap scheduler (#2095)

2024-11-19 15:04:43 -08:00

torchao_utils.py

Error out when torchao-config option is not recognized (#2107)

2024-11-20 17:37:28 -08:00

vocab_parallel_embedding.py

fix black in pre-commit (#1940)

2024-11-08 07:42:47 +08:00