Inner Ensemble Networks: Average Ensemble as an Effective Regularizer

Abduallah Mohamed, Muhammed Mohaimin Sadiq, Ehab AlBadawy +2

We introduce Inner Ensemble Networks (IENs) which reduce the variance within the neural network itself without an increase in the model complexity. IENs utilize ensemble parameters…