2 citations · 2 across the 3 of their papers we have counts for
1 paper · 1 filter
Mohammed Nowaz Rabbani Chowdhury, Meng Wang, Kaoutar El Maghraoui +3
The sparsely gated mixture of experts (MoE) architecture sends different inputs to different subnetworks, i.e., experts, through trainable routers. MoE reduces the training computa…