19 Commits
Author SHA1 Message Date
Ethan (Yusheng) SuandCursor 2b769d37a4 (2/n - prefill optimize)perf(lora): remove GPU-CPU sync barrier (.item()) in MoE LoRA path and remove duplicate code (#24246)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-04 18:11:28 -07:00
Ethan (Yusheng) Su b7fefc0e85 feat(lora): enable csgmv backend with virtual experts for MoE LoRA (#24007) 2026-05-03 18:44:17 -07:00
Ethan (Yusheng) Su 125f75db72 fix(lora): avoid CUDA graph-breaking scalar assignment in seg_indptr (#23738) 2026-04-30 01:11:45 -07:00
Ethan (Yusheng) Su 3cfd1561df docs(DeepSeek-V4): add h200|big verified recipes + tune H200 Pro parameters (#23742) 2026-04-25 21:44:51 -07:00
Ethan (Yusheng) Su 2ef1a21d5e [bug fix] fix: detect FP8 weights from safetensors header instead of ass… (#23414) 2026-04-23 14:49:57 +08:00
Ethan (Yusheng) Su 6d79c60995 [Lora] Lora kimi support (#22381) 2026-04-09 22:31:53 -07:00
Ethan (Yusheng) Su 28ef6de091 [Lora] Lora quat info re-factor and support deepseekv3 mla lora (#22323) 2026-04-09 14:19:58 -07:00
Ethan (Yusheng) Su ff8e47edf9 [5/n] Lora support cuda graph (#21647) 2026-04-04 00:31:46 -07:00
Ethan (Yusheng) Su 566b4a4f1c [4/n] Support gpt oss 20b lora (#21570) 2026-04-02 12:57:38 -07:00
Ethan (Yusheng) SuandBaizhou Zhang cffc95edf4 [3/n] lora moe - Support Qwen3-VL-30B-A3B-Instruct (#21469)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-31 23:15:16 -07:00
Ethan (Yusheng) SuandBaizhou Zhang 3c91ebdf55 [2/n] lora - Shared outer experts and support qwen3_30b_a3b_instruct (#21466)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-31 14:06:23 -07:00
Ethan (Yusheng) SuandBaizhou Zhang 6d48719e31 [1/n] lora support - Auto detect lora target modules (#21439)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-27 16:08:36 -07:00
Ethan (Yusheng) Su 7f6f1a3ab1 [LoRA][II] Add fused MOE LoRA Triton kernel and tests (#19711) 2026-03-18 19:58:14 -07:00
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710)
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
2026-03-12 12:23:46 -07:00
Ethan (Yusheng) Su e555a6c171 [feat] Enhance lora_update_weight_from_tensor for RL training (#19314) 2026-03-04 18:10:42 -08:00
Ethan (Yusheng) Su 9c5aae4df5 [Fix] Add lora tied lm head support (for Qwen2.5, Gemma, etc model need) (#18634) 2026-02-19 00:34:51 +08:00
Ethan (Yusheng) Su 5ed384d07b [CI/CD] re-enable lora test (#16187) 2025-12-31 16:32:20 +08:00
0c63fb9420 [Feature] Add LoRA support for embedding layers (#14177)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Beichen-Ma <bm685@cornell.edu>
2025-12-09 15:53:33 -08:00
Ethan (Yusheng) Su 134b4f7ec2 Support deterministic inference with triton backend (#10694) 2025-09-22 09:20:40 +08:00