Qi YuhangandFan Yin 7ea5b42d70 [sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666) ...

Co-authored-by: Fan Yin <1106310035@qq.com>

2025-11-11 21:23:25 -08:00

..

attention

[Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)

2025-11-11 16:15:26 -08:00

deep_gemm_wrapper

Fix hang in deepgemm compilation with symmetric memory enabled (#12715)

2025-11-06 14:06:22 -08:00

moe

[sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666)

2025-11-11 21:23:25 -08:00

quantization

[ROCM] Optimized deepseek-r1 model with rmsnorm + fp8 quant fusion (#12689)

2025-11-11 02:59:10 -08:00

activation.py

[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)

2025-11-07 22:07:51 -08:00

amx_utils.py

[CPU] refine CPU integration code (#7647)

2025-07-03 09:51:09 -07:00

communicator.py

Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915)

2025-11-11 13:30:33 -08:00

dp_attention.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

elementwise.py

[Auto Sync] Update elementwise.py (20250923) (#10823)

2025-09-23 13:50:22 -07:00

flashinfer_comm_fusion.py

Fix spec decoding acc length for dpsk-r1-fp4 tp8 (2nd attempt) (#12915)

2025-11-11 13:30:33 -08:00

layernorm.py

Enable mixed type LayerNorm kernel for NSA indexer (#12044)

2025-11-03 16:50:41 -08:00

linear.py

Fix CI and style (#12658)

2025-11-05 15:08:15 -08:00

logits_processor.py

[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)

2025-11-07 22:07:51 -08:00

model_parallel.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

modelopt_utils.py

Enable native ModelOpt quantization support (1/3) (#7149)

2025-10-06 13:24:15 -07:00

multimodal.py

[VLM] Improving multimodal tensor hash kernel (#9008)

2025-08-14 13:45:55 -07:00

parameter.py

fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112)

2025-09-27 05:05:23 +00:00

pooler.py

Add support for Matryoshka embeddings (#126) (#11142)

2025-10-28 02:49:36 +08:00

radix_attention.py

Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)

2025-11-09 21:06:32 -08:00

rocm_linear_utils.py

Optimized deepseek-v3/r1 model performance on mxfp4 run (#10008)

2025-09-04 15:11:22 -07:00

rotary_embedding.py

Support piecewise cuda graph for MLA (#11812)

2025-11-10 09:13:48 +08:00

sampler.py

[Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)

2025-11-07 22:07:51 -08:00

sparse_pooler.py

Implement BGE-M3 Sparse Embeddings in SGLang (#10869)

2025-10-22 13:46:16 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

utils.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

vocab_parallel_embedding.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00