15 citations · 20 across the 2 of their papers we have counts for
3 papers · 1 filter
How catastrophic can catastrophic forgetting be in linear regression?
Itay Evron, Edward Moroshko, Rachel Ward +2
To better understand catastrophic forgetting, we study fitting an overparameterized linear model to a sequence of tasks with different input distributions. We analyze how much the…
How do infinite width bounded norm networks look in function space?
Pedro Savarese, Itay Evron, Daniel Soudry +1
We consider the question of what functions can be captured by ReLU networks with an unbounded number of units (infinite width), but where the overall network Euclidean norm (sum of…
Efficient Loss-Based Decoding on Graphs For Extreme Classification
Itay Evron, Edward Moroshko, Koby Crammer
In extreme classification problems, learning algorithms are required to map instances to labels from an extremely large label set. We build on a recent extreme classification frame…