Revisiting Gradient Descent: A Dual-Weight Method for Improved Learning

Xi Wang

We introduce a novel framework for learning in neural networks by decomposing each neuron's weight vector into two distinct parts, $W_1$ and $W_2$, thereby modeling contrastive inf…