Effects of the optimisation of the margin distribution on generalisation in deep architectures

Lech Szymanski, Brendan McCane, Wei Gao +1

Despite being so vital to success of Support Vector Machines, the principle of separating margin maximisation is not used in deep learning. We show that minimisation of margin vari…