Commit Graph
16 Commits
Author SHA1 Message Date
Yanbin Jiang 1ce515a53d Refocus LoRA tests on regression coverage (#34464) 2026-08-11 17:37:52 -07:00
Yanbin Jiang b9d572ee02 [test] Re-enable a pruned Inkling LoRA unit-test set (68 -> 9 cases) (#33752) 2026-08-05 15:06:28 -07:00
Yanbin Jiang 92b3a51ba6 [LoRA] Fix Marlin MoE kernel import (#32884) 2026-07-30 15:17:29 +08:00
Yanbin Jiang 57e5846b90 [LoRA] Guard TMA down path for LoRA hooks (#31608) 2026-07-21 09:47:17 -07:00
Yanbin Jiang 40517b593b [docs] Inkling cookbook: LoRA cells require --disable-prefill-cuda-graph (#31418) 2026-07-16 05:19:49 +00:00
Yanbin JiangandYusheng Su 9fd6d0ec99 [LoRA] BF16 support + EP cuda-graph crash fix for experimental_sgl_trtllm MoE-LoRA (#28953)
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
2026-06-24 21:16:50 -07:00
Yanbin Jiang 6b945c16f4 [LoRA] Fix experimental fast-path multi-adapter correctness + flashinfer 0.6.12 compatibility (#28091) 2026-06-19 16:20:19 -07:00
Yanbin Jiang 093908d4c0 [LoRA] Fix chunked SGMV (csgmv) CUDA graph segment replay (#28371) 2026-06-16 19:19:07 -07:00
Yanbin Jiang 1747b88c5e [LoRA] Support DSA indexer LoRA targets for GLM-5.1 / DeepSeek-V3.2-family models (#28110) 2026-06-13 23:02:33 -07:00
c9f582a272 [LoRA] Experimental fast LoRA path with experimental_sgl_trtllm MoE backend for FP8 and NVFP4 models (#27329)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
2026-06-05 14:45:59 -07:00
Yanbin Jiangandgh1595 01a225ac6f [LoRA] MLA attention LoRA: q_b_proj / kv_b_proj support (#25001)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
2026-05-13 15:15:30 -07:00
Yanbin Jiangandgh1595 f0368a6666 [LoRA] Use deterministic lora_id for --lora-paths so multi-node ranks agree (#24555)
Co-authored-by: gh1595 <278903827+gh1595@users.noreply.github.com>
2026-05-06 22:20:15 -07:00
Yanbin Jiang 8975479f87 [LoRA][MOE] Fix EP correctness in MoE LoRA slicing and virtual-experts kernels (#24171) 2026-04-30 22:42:10 -07:00
Yanbin Jiang 917d2aa1dc [LoRA] Fix EP + per-expert MoE LoRA illegal memory access (#23178) 2026-04-22 14:22:32 -07:00
Yanbin Jiang 4f764dfbb8 [Lora] Support LoRA and multi-batch in bench_one_batch_server (#23047) 2026-04-21 14:20:11 -07:00
Yanbin Jiang fd7db0eace Update CI_PERMISSIONS (#23108) 2026-04-17 16:53:03 -07:00