226 citations · 1.9k across the 128 of their papers we have counts for
4 papers · 2 filters
Deep-RBF Networks Revisited: Robust Classification with Rejection
Pourya Habib Zadeh, Reshad Hosseini, Suvrit Sra
One of the main drawbacks of deep neural networks, like many other classifiers, is their vulnerability to adversarial attacks. An important reason for their vulnerability is assign…
Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
We study finite sample expressivity, i.e., memorization power of ReLU networks. Recent results require hidden nodes to memorize/interpolate arbitrary data points. In contra…
Learning Determinantal Point Processes by Corrective Negative Sampling
Zelda Mariet, Mike Gartrell, Suvrit Sra
Determinantal Point Processes (DPPs) have attracted significant interest from the machine-learning community due to their ability to elegantly and tractably model the delicate bala…
Small nonlinearities in activation functions create bad local minima in neural networks
Chulhee Yun, Suvrit Sra, Ali Jadbabaie
We investigate the loss surface of neural networks. We prove that even for one-hidden-layer networks with "slightest" nonlinearity, the empirical risks have spurious local minima i…