Lianmin Zheng 74e0ac1dbd Clean up import vllm in quantization/__init__.py (#4834)

2025-03-28 10:34:10 -07:00

..

baichuan.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

chatglm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

clip.py

support clip embedding model (#4506)

2025-03-27 00:18:15 -07:00

commandr.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

dbrx.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

deepseek_janus_pro.py

[Misc] Fix issues reported by torchfix (#4837)

2025-03-27 20:10:32 -07:00

deepseek_nextn.py

cleanup deps 3/n (#4541)

2025-03-18 00:11:36 -07:00

deepseek_v2.py

Clean up import vllm in quantization/__init__.py (#4834)

2025-03-28 10:34:10 -07:00

deepseek_vl2.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

deepseek.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

exaone.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gemma2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gemma2.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gemma3_causal.py

gemma3: impl get_attention_sliding_window_size for attn init (#4823)

2025-03-27 10:43:58 -07:00

gemma3_mm.py

gemma3: impl get_attention_sliding_window_size for attn init (#4823)

2025-03-27 10:43:58 -07:00

gemma.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gpt2.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gpt_bigcode.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

granite.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

grok.py

Add some fused elementwise kernels for grok-1 (#4398)

2025-03-13 13:39:10 -07:00

internlm2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

internlm2.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama_classification.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama_eagle3.py

Fix EAGLE3 for llama3.3 70b (#4716)

2025-03-24 17:31:19 -07:00

llama_eagle.py

[Feature] Support EAGLE 3 (#4247)

2025-03-18 07:35:23 -07:00

llama_embedding.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

llava.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

llavavid.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

minicpm3.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

minicpm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

minicpmo.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

minicpmv.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

mistral.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mixtral_quant.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

mixtral.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

mllama.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

olmo2.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

olmo.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

olmoe.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

phi3_small.py

[Fix] Fix unexpected idx bug of Phi-3-small (#4728)

2025-03-25 21:33:48 -07:00

qwen2_5_vl.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

qwen2_classification.py

[Model] Support Qwen2ForSequenceClassification (#4609)

2025-03-24 19:13:44 -07:00

qwen2_eagle.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

qwen2_moe.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

qwen2_rm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

qwen2_vl.py

model: Minicpmo (#3023)

2025-03-24 20:08:40 -07:00

qwen2.py

refactor: bug fixes and refactor for vlm (#4661)

2025-03-22 22:48:49 -07:00

qwen.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

registry.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

stablelm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

torch_native_llama.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

xverse_moe.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

xverse.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

yivl.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00