4 papers
Network of Theseus (like the ship)
Vighnesh Subramaniam, Colin Conwell, Boris Katz +2
A standard assumption in deep learning is that the inductive bias introduced by a neural network architecture must persist from training through inference. The architecture you tra…
Training the Untrainable: Introducing Inductive Bias via Representational Alignment
Vighnesh Subramaniam, David Mayo, Colin Conwell +4
We demonstrate that architectures which traditionally are considered to be ill-suited for a task can be trained using inductive biases from another architecture. We call a network…
What if Eye...? Computationally Recreating Vision Evolution
Kushagra Tiwary, Aaron Young, Zaid Tasneem +6
Vision systems in nature show remarkable diversity, from simple light-sensitive patches to complex camera eyes with lenses. While natural selection has produced these eyes through…
Self-Assembly of a Biologically Plausible Learning Circuit
Qianli Liao, Liu Ziyin, Yulu Gan +3
Over the last four decades, the amazing success of deep learning has been driven by the use of Stochastic Gradient Descent (SGD) as the main optimization technique. The default imp…