2 Commits
Author SHA1 Message Date
yuchengz816-botandRunkai Tao 061f41affc MoE: Skip SiLU/GELU activation for masked experts (#15539)
Co-authored-by: Runkai Tao <rt572@physics.rutgers.edu>
2025-12-22 19:08:31 -08:00
e54307f26a [6/n] Fix num_token_non_padded computation in prefill (#14313)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Runkai Tao <rt572@physics.rutger.edu>
2025-12-10 19:15:19 -08:00