Commit Graph
13 Commits
Author SHA1 Message Date
Junrong Lin 69158e9d9f [Bugfix] Skip _mamba_verify_update for idle batch (#20167) 2026-03-10 14:53:01 +08:00
Junrong Lin 6448de7e96 Reorganize topk logic to clean up code and expose logical experts (#16945) 2026-02-23 00:30:57 -08:00
Junrong Lin 2a7b67adff [CI/NPU] Fix ascend CI issue (#16953) 2026-01-13 23:39:12 +08:00
Junrong Lin eec7dbd31e remove redundant max_running_reqs calculation in r3 (#16629) 2026-01-08 09:45:21 +08:00
Junrong Lin bc2f40bebc [test] Add mamba cache release/resume memory test (#14215) 2026-01-06 15:51:10 +08:00
bed301a5ac [Feature] Enable return routed experts (#12162)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-12-21 15:16:43 +08:00
Junrong Lin 2ecee7571c [Bug] fix not desired disable fused share experts caused by rocm logic (#14432) 2025-12-05 09:55:07 +08:00
Junrong Lin 518467be64 [Feature] Re:Enable hybrid mem saver (#12962) 2025-11-18 21:29:15 +08:00
Junrong Lin 173e0f704f Enable memory saver for hybrid model (#11974) 2025-11-04 14:55:26 +08:00
Junrong Lin 2103b80607 [CI] update verlengine ci to 4-gpu test (#6007) 2025-05-27 14:32:23 -07:00
Junrong Lin f3bf611054 feat: add flush cache to EngineBase and HttpServerEngineAdapter (#6009) 2025-05-14 19:15:02 -07:00
Junrong Lin 357fb2dba5 fix: fix broadcast_pyobj breaking VerlEngine (#5997) 2025-05-04 13:15:53 -07:00
Junrong Lin bb0fd749a6 [Fix] Add compressed_tensors as deps (#4819) 2025-03-27 18:08:24 -07:00