2 citations · 2 across the 3 of their papers we have counts for
3 papers
Approaching Deep Learning through the Spectral Dynamics of Weights
David Yunis, Kumar Kshitij Patel, Samuel Wheeler +5
We propose an empirical approach centered on the spectral dynamics of weights -- the behavior of singular values and vectors during optimization -- to unify and clarify several phe…
Drop-Connect as a Fault-Tolerance Approach for RRAM-based Deep Neural Network Accelerators
Mingyuan Xiang, Xuhan Xie, Pedro Savarese +3
Resistive random-access memory (RRAM) is widely recognized as a promising emerging hardware platform for deep neural networks (DNNs). Yet, due to manufacturing limitations, current…
Learning Identity Mappings with Residual Gates
Pedro H. P. Savarese, Leonardo O. Mazza, Daniel R. Figueiredo
We propose a new layer design by adding a linear gating mechanism to shortcut connections. By using a scalar parameter to control each gate, we provide a way to learn identity mapp…