Interpreting Basis Path Set in Neural Networks

Juanping Zhu, Qi Meng, Wei Chen +1

Based on basis path set, G-SGD algorithm significantly outperforms conventional SGD algorithm in optimizing neural networks. However, how the inner mechanism of basis paths work re…