sglang

apertus.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

arcee.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

baichuan.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

bailing_moe_nextn.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

bailing_moe.py

Enable bailing_moe to support TP=16 (#12369 )

2025-10-31 19:32:49 +08:00

bert.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

chatglm.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

clip.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

commandr.py

Revert "fix some typos" (#6244 )

2025-05-12 12:53:26 -07:00

dbrx.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

deepseek_janus_pro.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

deepseek_nextn.py

[1/2] Refactor DeepGeem requant for FP8 Linear on Blackwell (#13601 )

2025-11-23 16:07:56 -08:00

deepseek_ocr.py

model: support deepseek-ocr (#11891 )

2025-10-24 03:15:17 +08:00

deepseek_v2.py

Fix Deepseek v3.1 loading issue (#13954 )

2025-11-25 18:28:52 -08:00

deepseek_vl2.py

[Refactor] simplify multimodal data processing (#8107 )

2025-07-20 21:43:09 -07:00

deepseek.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

dots_ocr.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

dots_vlm_vit.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

dots_vlm.py

Add PP support for dots_vlm (#12763 )

2025-11-06 19:14:27 -08:00

ernie4_eagle.py

Add ernie4.py for ERNIE-4.5 (#7657 )

2025-08-08 00:55:48 -07:00

ernie4.py

Refactor TopK to ensure readability and extensibility (#9338 )

2025-09-14 19:16:25 -07:00

exaone.py

fix: EXAONE when using tie_word_embeddings (#5759 )

2025-05-21 11:30:04 -07:00

falcon_h1.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

gemma2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

gemma2.py

Fix incorrect default get_hidden_dim logic (#8987 )

2025-08-09 00:25:38 -07:00

gemma3_causal.py

Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614 )

2025-09-29 06:18:29 +00:00

gemma3_mm.py

Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261 )

2025-10-06 17:23:00 -07:00

gemma3n_audio.py

chore: remove vlm unnecessary import (#7541 )

2025-06-26 01:38:15 -07:00

gemma3n_causal.py

Updates Gemma3n MLP layer to adapt latest transformers version (#7573 )

2025-06-26 15:07:22 -07:00

gemma3n_mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

gemma.py

[Feature] Layer-wise Prefill (#7634 )

2025-07-17 01:57:46 +08:00

glm4_moe_nextn.py

Refactoring GLM-4.5 and GLM-4.5V related implementations (#11800 )

2025-10-24 08:22:36 +00:00

glm4_moe.py

Overlap glm moe gemms in two cuda streams (#13786 )

2025-11-24 18:15:24 -08:00

glm4.py

GLM-4-0414 and GLM-4.1V Code Refactor (#12117 )

2025-10-27 16:57:07 +08:00

glm4v_moe.py

GLM-4-0414 and GLM-4.1V Code Refactor (#12117 )

2025-10-27 16:57:07 +08:00

glm4v.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

gpt2.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

gpt_bigcode.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

gpt_oss.py

Support running FP4 Deepseek on SM120. (#11708 )

2025-10-27 17:37:49 -07:00

granite.py

Fix incorrect default get_hidden_dim logic (#8987 )

2025-08-09 00:25:38 -07:00

granitemoe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

grok.py

[Piecewise CUDA Graph] Fix recompile issue for Mixtral and Grok2 (#13667 )

2025-11-20 14:20:11 -08:00

hunyuan.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

idefics2.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

internlm2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

internlm2.py

Support InternVL3 (#5350 )

2025-05-01 22:38:59 -07:00

interns1.py

[Bug] Fix Intern-S1 model accuracy and support /generate interface with input_ids (#12367 )

2025-11-02 20:22:33 -08:00

internvl.py

[VLM] Support InternVL Vision Encoder Data Parallelism (#13925 )

2025-11-26 11:43:05 +08:00

jet_nemotron.py

model: support JetVLM (#13289 )

2025-11-18 12:02:03 +08:00

jet_vlm.py

model: support JetVLM (#13289 )

2025-11-18 12:02:03 +08:00

kimi_linear.py

overlap shared + routed expert computation in kimi linear (#12660 )

2025-11-11 14:52:58 -08:00

kimi_vl_moonvit.py

move more files under srt/utils (#11285 )

2025-10-09 16:46:15 -07:00

kimi_vl.py

move more files under srt/utils (#11285 )

2025-10-09 16:46:15 -07:00

llada2.py

[feature] Initial block diffusion language model support (#12588 )

2025-11-26 17:57:54 +08:00

llama4.py

use fast stream instead of torch.cuda.current_stream in llama 4 shared experts overlap (#12811 )

2025-11-08 15:04:37 -08:00

llama_classification.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

llama_eagle3.py

Eagle3 DP attention for Qwen3 MoE (#12002 )

2025-10-29 20:25:17 +08:00

llama_eagle.py

[PP] Add pipeline parallelism (#5724 )

2025-04-30 18:18:07 -07:00

llama_embedding.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

llama_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

llama.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

llava.py

chore: bump transformer to 4.54.0 (#8416 )

2025-07-27 21:27:25 -07:00

llavavid.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

longcat_flash_nextn.py

Tiny refactor condition to requant scale ue8m0 (#13286 )

2025-11-15 16:36:00 +08:00

longcat_flash.py

Tiny refactor condition to requant scale ue8m0 (#13286 )

2025-11-15 16:36:00 +08:00

mimo_mtp.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

mimo.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

mindspore.py

[feat][Ascend][Mindspore]: support model-impl of mindspore (#9234 )

2025-11-19 09:17:47 +08:00

minicpm3.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

minicpm.py

fix: remove redundant rotary embedding cache recomputation in MiniCPM (#8022 )

2025-07-15 00:12:45 -07:00

minicpmo.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

minicpmv.py

[model] support MiniCPM-V 4.0 (#8747 )

2025-09-02 15:33:03 -07:00

minimax_m2.py

Super tiny remove unused MiniMaxM2MLP class (#13659 )

2025-11-21 07:35:12 +08:00

mistral.py

refactor: unify names of the feature field of MultimodalDataItem (#8075 )

2025-07-16 17:52:38 -07:00

mixtral_quant.py

[feature]Ascend quantization support (#7791 )

2025-07-10 09:17:37 -07:00

mixtral.py

[Piecewise CUDA Graph] Fix recompile issue for Mixtral and Grok2 (#13667 )

2025-11-20 14:20:11 -08:00

mllama4.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

mllama.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

nemotron_h.py

Feat/nemotron nano v3 support (#12690 )

2025-11-21 13:53:05 -08:00

nemotron_nas.py

from python.sglang.srt -> from sglang.srt (#9268 )

2025-08-17 02:45:45 -07:00

nvila_lite.py

model: support NVILA and NVILA Lite (#10399 )

2025-10-26 09:58:09 -07:00

nvila.py

model: support NVILA and NVILA Lite (#10399 )

2025-10-26 09:58:09 -07:00

olmo2.py

Fix launch of Olmo3 (#13666 )

2025-11-20 12:04:30 -08:00

olmo.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

olmoe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

opt.py

[lint] improve ruff check (#11922 )

2025-10-22 11:32:50 +08:00

orion.py

Support orion (#10665 )

2025-11-15 03:08:32 +08:00

persimmon.py

Feat: Support for Persimmon Model (#7983 )

2025-07-19 23:07:47 -07:00

phi3_small.py

Fix Phi3 serving which was broke by earlier change (#5991 )

2025-05-03 00:28:47 -07:00

phi4mm_audio.py

Feat: Support audio in Phi4-mm model (#8048 )

2025-07-18 21:03:53 -07:00

phi4mm_utils.py

Feat: Support audio in Phi4-mm model (#8048 )

2025-07-18 21:03:53 -07:00

phi4mm.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

phi.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

phimoe.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

pixtral.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

points_v15_chat.py

[model] Support POINTSV15Chat (#9651 )

2025-10-22 16:58:17 +08:00

qwen2_5_vl.py

[VLM] Support Piecewise CUDA Graph for Qwen2.5-VL (#13055 )

2025-11-20 10:23:44 +08:00

qwen2_audio.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

qwen2_classification.py

[Model] Support Qwen2ForSequenceClassification (#4609 )

2025-03-24 19:13:44 -07:00

qwen2_eagle.py

[Bugfix] pipeline parallelism and Eagle Qwen2 (#6910 )

2025-06-07 01:58:50 -07:00

qwen2_moe.py

Enable Flashinfer TRTLLM-GEN-MoE FP8 blockwise kernel for Qwen3-Next on Blackwell (#12543 )

2025-11-13 19:44:44 +08:00

qwen2_rm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00

qwen2_vl.py

[VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736 )

2025-11-22 22:45:32 +08:00

qwen2.py

[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853 )

2025-11-07 22:07:51 -08:00

qwen3_classification.py

Add support for Qwen3-seq-cls (#9357 )

2025-08-20 16:51:56 -07:00

qwen3_moe.py

[Ascend] qwen optimization (#12078 )

2025-11-25 19:44:24 +08:00

qwen3_next_mtp.py

Depreate global_server_args_dict (#11528 )

2025-10-13 19:34:43 +08:00

qwen3_next.py

Support piecewise cuda graph for Qwen3-next (#13081 )

2025-11-25 21:01:27 +08:00

qwen3_omni_moe.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

qwen3_vl_moe.py

[BugFix] weight load bug when checkpoint expert.gate and exepert.up_proj are not fused (#13113 )

2025-11-14 00:35:44 -08:00

qwen3_vl.py

[VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736 )

2025-11-22 22:45:32 +08:00

qwen3.py

[Ascend] qwen optimization (#12078 )

2025-11-25 19:44:24 +08:00

qwen.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

registry.py

feat: support external custom models (#13429 )

2025-11-20 11:16:58 +08:00

roberta.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869 )

2025-10-22 13:46:16 -07:00

sarashina2_vision.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685 )

2025-10-17 16:49:46 -07:00

siglip.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

solar.py

Remove wrong imports from sglang.python (#10493 )

2025-09-15 22:12:21 -07:00

stablelm.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

starcoder2.py

model: support starcoder2 (#10609 )

2025-10-04 00:11:19 +08:00

step3_vl.py

refactor: cleanup vision attention related codes (#13228 )

2025-11-16 22:44:40 +08:00

teleflm.py

model: support teleflm (#10573 )

2025-11-15 03:14:49 +08:00

torch_native_llama.py

Fix multimodal registry and code sync scripts (#10759 )

2025-09-22 15:36:01 -07:00

transformers.py

Small bug fix in transformers model implementation (#9809 )

2025-08-29 18:51:44 -07:00

utils.py

[VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736 )

2025-11-22 22:45:32 +08:00

xverse_moe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849 )

2025-08-14 21:14:53 -07:00

xverse.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686 )

2025-04-08 09:11:35 -07:00

yivl.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790 )

2025-03-05 01:11:00 -08:00