Commit Graph

Select branches

Hide Pull Requests

dsv41-pd

dsv41-pd-visioncp

main

Mono Color

• ade714a67f Add Llama4 user guide (#5133) Ke BaoandCheng Wan 2025-04-08 10:09:34 +08:00
• 93470a1411 Refactor and Optimize FA3 Code (#5090) Stefan HeandQingquan Song 2025-04-07 11:52:42 -07:00
• db452760e5 [ci] fix llama4 ci error (#5126) Xiaoyu Zhang 2025-04-07 21:15:46 +08:00
• 57f99608f4 bump v0.4.5 (#5117) Yineng Zhang 2025-04-07 00:35:00 -07:00
• 819924748a Fix refactor error - fp8.py (#5106) HAIandLianmin Zheng 2025-04-07 00:34:08 -07:00
• f04c80dc42 Add Llama4 support (#5092) 4 people 2025-04-07 00:29:36 -07:00
• d1bb171180 Fix: Reduce the number of document ci attempts to avoid long ci running (#5097) mlmzandshuaills 2025-04-06 15:43:48 +08:00
• 35e0856b90 bump v0.4.4.post4 (#5091) Yineng Zhang 2025-04-05 15:36:17 -07:00
• aba5ca154d python transfer custom allreduce from trt kernel to vllm kernel (#5080) Yi Zhang 2025-04-06 06:35:55 +08:00
• 496dde8491 bump sgl-kernel 0.0.8 (#5089) Yineng Zhang 2025-04-05 14:28:04 -07:00
• bcbbf519f9 sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079) Yi Zhang 2025-04-06 05:23:20 +08:00
• 0d99adb715 upgrade transformers 4.51.0 (#5088) Yineng Zhang 2025-04-05 14:20:23 -07:00
• efbae697b3 [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) Baizhou Zhang 2025-04-05 01:23:02 -07:00
• ca8d02abd5 FA3 Spec Decoding to support top k = 1 and add cuda graph support (#5050) 3 people 2025-04-04 23:03:59 -07:00
• 3f287b8579 support sgl-kernel on blackwell (#5074) Yineng Zhang 2025-04-04 16:59:32 -07:00
• 7ed77d6b9e fix dummy-load deepseekv2 (#4535) inkcherry 2025-04-05 06:22:37 +08:00
• 4c54f44202 [deepep] fix: shared experts are not initialized when shared experts fusion is enabled (#5072) Cheng Wan 2025-04-04 18:08:30 -04:00
• 924ca7c92c Add DeepSeek V3/R1 shared experts fusion (#4918) Xiaoyu Zhang 2025-04-04 16:59:29 +08:00
• 6ff9c6a5e7 Cleanup unused resources after DeepEP operation (#4996) fzyzcjy 2025-04-04 15:36:04 +08:00
• 77e929a1a2 Support async DeepEP by splitting into two stages (#4995) fzyzcjy 2025-04-04 15:32:27 +08:00
• febe21ce03 Small refactor DeepEPDispatcher into subclasses (#4994) fzyzcjy 2025-04-04 15:24:18 +08:00
• a995a773a0 [fix] remove cuda_device_count_stateless (#5060) JieXin Liang 2025-04-04 15:18:26 +08:00
• 31035dda44 Add H20 fused MoE kernel tuning configs for DeepSeek V3/R1 (#5057) Tommy Yang 2025-04-04 13:14:28 +08:00
• 913e38dffa Feature/revise docs ci (#5056) renxin 2025-04-03 21:20:21 -07:00
• d95269f9b3 [2/3] fix dsv3 awq issue (#4625) 3 people 2025-04-04 08:36:39 +08:00
• e53bf190bc upgrade sgl-kernel v0.0.7 (#5049) Yineng Zhang 2025-04-03 17:07:54 -07:00
• 3289c1207d Update the retry count (#5051) Yineng Zhang 2025-04-03 17:07:38 -07:00
• 69df9761dd Add LlavaLlamaForCausaLM in MultiModal Processors (#5039) Ravi ThejaandRavi Theja Desetty 2025-04-04 04:11:12 +05:30
• 98f768d194 update eagle-3 docs (#4796) simveitandYifan Zhang 2025-04-04 00:24:41 +02:00
• d7954b7682 bump sgl-kernel v0.0.7 (#5046) Yineng Zhang 2025-04-03 13:38:13 -07:00
• 74885a848b Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) Lianmin Zheng 2025-04-03 13:30:56 -07:00
• b8b6008f47 [Fix] fix fa3 build at cu118 (#5036) yinfan98 2025-04-04 02:52:35 +08:00
• 8e10fec9a8 Small refactor DeepEPMode to clean up code a bit (#4992) fzyzcjy 2025-04-03 17:56:44 +08:00
• e8999b13b7 Replace enable_flashinfer_mla argument with attention_backend (#5005) Baizhou Zhang 2025-04-03 02:53:58 -07:00
• 772d2a191d try to fix ci oserror (#5024) Xiaoyu Zhang 2025-04-03 17:45:05 +08:00
• 9d0b36c47a fix deepgemm as well (#5030) Zhiqiang Xie 2025-04-03 02:41:37 -07:00
• 7d8c0ce7ce [Build] Support build sgl-kernel with ccache (#5020) Yuhong Guo 2025-04-03 15:22:37 +08:00
• e41549c3d6 fix: fix illegal cuda memory access at fused_moe_kernel (#4727) saltyfish66andyuethe 2025-04-03 15:07:32 +08:00
• cccfc10e9c Feature/revise docs ci (#5009) renxin 2025-04-02 20:08:56 -07:00
• a2aea59b6e update cutlass tag (#5011) Zhiqiang Xie 2025-04-02 18:30:30 -07:00
• 2c8fd99363 [sgl-kernel] per token group quant support COLUMN MAJOR (#4817) Xiaoyu Zhang 2025-04-03 09:29:59 +08:00
• 31da75abed Update tokenizer_manager.py (#5008) Kaiyu Yang 2025-04-02 16:56:19 -04:00
• e983e43248 Add Eagle Speculative Decoding to FA3 Backend (#4951) 4 people 2025-04-02 13:09:02 -07:00
• e9c6ce461d sgl scaled_fp8_quant support output padding (#4861) Xiaoyu Zhang 2025-04-02 23:53:57 +08:00
• 3fadc64793 bug fix for hicache host eviction (#4989) Zhiqiang Xie 2025-04-02 00:33:50 -07:00
• e119f04215 Large page size aligned hierarchical caching (#4581) Zhiqiang Xie 2025-04-01 22:38:15 -07:00
• 9eb49e878b [VLM RLHF] Take Image input for verl vlm rollout (#4915) XinyuanTongandGeLee 2025-04-01 20:03:17 -07:00
• 12047f5e94 Prevent memory leak of retract_decode when page_size > 1 (#4977) Zhiqiang Xie 2025-04-01 15:30:45 -07:00
• fda6bb78da update bench_serving (#4958) Yineng Zhang 2025-04-01 15:10:56 -07:00
• 23c764b18a [Feature] Support DeepEP Low Latency (#4767) 4 people 2025-04-02 00:23:25 +08:00
• 87fafa0105 Revert PR 4764 & 4813 related to R1 RoPE (#4959) Yuhong Guo 2025-04-01 11:56:58 +08:00
• 1c63e79756 use fa3 in sgl-kernel (#4954) Yineng Zhang 2025-03-31 16:14:49 -07:00
• ee47a6c1c3 [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) Yuhong Guo 2025-04-01 03:00:34 +08:00
• 6384d31776 bump sgl-kernel v0.0.6 (#4950) Yineng Zhang 2025-03-31 11:24:09 -07:00
• 5cb552b1d4 refactor: multimodal data (#4754) Mick 2025-04-01 00:57:51 +08:00
• c7457191a0 [Fix] revert clean m.def for cudagraph (#4944) yinfan98 2025-03-31 17:08:55 +08:00
• 51ac297ace [feat] interface for platforms abstraction (#4928) JieXin Liang 2025-03-31 15:04:21 +08:00
• a169b9f813 Fix oom error for large page size (#4913) Zhiqiang XieandLianmin Zheng 2025-03-30 21:34:21 -07:00
• 4a63bc32b7 [Fix] Add torch compile for torch.clamp back (#4936) Baizhou Zhang 2025-03-30 20:46:07 -07:00
• a303325fdb Fix DeepSeek bug causing 2.2% MMLU drop when TP!=DP (#4883) fzyzcjyandch-wan 2025-03-31 11:10:21 +08:00
• 42873eac09 [Fix] Improve Lora tests and reduce CI runtime (#4925) Baizhou Zhang 2025-03-30 19:40:14 -07:00
• 4814ecaff9 cleanup sgl-kernel (#4933) Yineng Zhang 2025-03-30 14:12:30 -07:00
• e62d60fe6d [Fix] avoid stream sync and torch compile in prefill for fa3 backend (#4932) Baizhou Zhang 2025-03-30 13:53:44 -07:00
• 032f8faaab Fix sglang frontend's incorrect dependency on torch (#4931) SEPLOS 2025-03-31 04:00:24 +08:00
• 37c66ec856 [feat] add fa3 in sgl-kernel (#4902) yinfan98andSleepcoo 2025-03-31 03:57:10 +08:00
• 9adf178cc2 Fix 2-gpu CI test and suppress some warnings (#4930) Lianmin Zheng 2025-03-30 12:51:44 -07:00
• f842853a40 Fix the timeout for unit-test-2-gpu in pr-test.yml (#4927) Lianmin Zheng 2025-03-30 12:15:40 -07:00
• 195a09f57c fix bmm fp8 (#4926) Yineng Zhang 2025-03-30 12:15:20 -07:00
• 9fccda3111 [Feature] use pytest for sgl-kernel (#4896) Adarsh Shirawalmath 2025-03-30 23:06:52 +05:30
• 4ede6770cd Fix retract for page size > 1 (#4914) Lianmin Zheng 2025-03-30 02:57:15 -07:00
• b26bc86b36 Support page size > 1 + eagle (#4908) Lianmin Zheng 2025-03-30 00:46:23 -07:00
• 5ec5eaf760 fix allreduce test (#4909) Yi Zhang 2025-03-30 14:16:53 +08:00
• 0d7fe866f9 [Misc] Clean m.def and add Development Tips (#4890) yinfan98 2025-03-30 14:06:18 +08:00
• 54b9a2de0a remove setup for sgl-kernel (#4899) Yineng Zhang 2025-03-29 12:47:38 -07:00
• 8e7b31546c quick fix: add default for new kernel (#4898) yinfan98 2025-03-30 03:31:59 +08:00
• 45dcfc2e76 Add deepseek style fused moe group gate selection kernel (#4530) Qingquan Song 2025-03-29 11:51:45 -07:00
• ddf8981d91 Delete test_deep_gemm.py (#4891) yinfan98 2025-03-30 01:46:11 +08:00
• 400ad66019 Update CODEOWNERS (#4889) Yineng Zhang 2025-03-29 09:56:51 -07:00
• 05625b9792 [Docs] Update DeepGEMM at README.md (#4886) yinfan98 2025-03-30 00:53:39 +08:00
• 736502d4fd Tiny fix doc error (#4795) fzyzcjy 2025-03-29 23:22:17 +08:00
• 8690c40bb0 Improve stack trace of retry errors (#4845) fzyzcjy 2025-03-29 23:21:31 +08:00
• b1cfb4e972 Fix BadRequestError wrong arguments and remove openai dependency (#4882) fzyzcjy 2025-03-29 23:16:21 +08:00
• 19e96e5923 bump v0.4.4.post3 (#4878) Yineng Zhang 2025-03-28 23:21:24 -07:00
• aa08aeacf4 update torch compile doc (#4874) Ke Bao 2025-03-29 10:49:30 +08:00
• d8a136a113 upgrade sgl-kernel 0.0.5.post4 (#4873) Yineng Zhang 2025-03-28 19:48:56 -07:00
• 20c90be23d [Feature] Support FA3 backend for MLA (#4831) Baizhou Zhang 2025-03-28 18:30:14 -07:00
• ec3ee0289d fix sgl-kernel cu118 build (#4872) Yineng Zhang 2025-03-28 17:23:51 -07:00
• 92941ce7b5 bump sgl-kernel 0.0.5.post4 (#4768) Yineng Zhang 2025-03-28 14:40:53 -07:00
• 2bb0e7cf43 fix sampling issue (#4871) Yineng Zhang 2025-03-28 14:07:21 -07:00
• 72549263c6 update sgl-kernel test ci (#4866) Yineng Zhang 2025-03-28 11:42:41 -07:00
• 044c315970 Make torch compile configurable for biased_grouped_topk (#4749) Qingquan Song 2025-03-28 10:57:52 -07:00
• 4db29e82ec [Feat] support deepgemm for cmake (#4864) yinfan98 2025-03-29 01:51:44 +08:00
• c483377ed7 Fix wrong variable name when stopping memory profile (#4772) Fr4nk1in 2025-03-29 01:35:02 +08:00
• 74e0ac1dbd Clean up import vllm in quantization/__init__.py (#4834) Lianmin Zheng 2025-03-28 10:34:10 -07:00
• ef9a378a20 [Feature] add multi-rank support for Lora (#4492) chaobo jiaandrudy152 2025-03-29 00:38:44 +08:00
• 6dea5c96bf Revert "get the python version from env (#4729)" (#4863) Yineng Zhang 2025-03-28 08:07:48 -07:00
• 6ffb6bd47a Fix fa3 cuda graph page_size > 1 precision and page_size=1 speed (#4855) Qingquan Song 2025-03-28 01:35:59 -07:00
• 47e6628aae Fix CI tests (#4853) Lianmin Zheng 2025-03-28 00:28:35 -07:00
• 7907f9eb20 test: reduce mem_fraction_static for gemma3 vision test (#4840) Juwan Yoo 2025-03-27 23:20:10 -07:00
• 8c04f0f2e1 Support with_stack and record_shapes in profiler (#4740) fzyzcjyandLianmin Zheng 2025-03-28 14:01:42 +08:00