8 citations · 17 across the 4 of their papers we have counts for
3 papers · 1 filter
Making Sigmoid-MSE Great Again: Output Reset Challenges Softmax Cross-Entropy in Neural Network Classification
Kanishka Tyagi, Chinmay Rane, Ketaki Vaidya +3
This study presents a comparative analysis of two objective functions, Mean Squared Error (MSE) and Softmax Cross-Entropy (SCE) for neural network classification tasks. While SCE c…
Automated Sizing and Training of Efficient Deep Autoencoders using Second Order Algorithms
Kanishka Tyagi, Chinmay Rane, Michael Manry
We propose a multi-step training method for designing generalized linear classifiers. First, an initial multi-class linear classifier is found through regression. Then validation e…
Optimal Input Gain: All You Need to Supercharge a Feed-Forward Neural Network
Chinmay Rane, Kanishka Tyagi, Sanjeev Malalur +2
Linear transformation of the inputs alters the training performance of feed-forward networks that are otherwise equivalent. However, most linear transforms are viewed as a pre-proc…