174 citations · 991 across the 46 of their papers we have counts for
4 papers · 1 filter
Actor-critic is implicitly biased towards high entropy optimal policies
Yuzheng Hu, Ziwei Ji, Matus Telgarsky
We show that the simplest actor-critic method -- a linear softmax policy updated with TD through interaction with a linear MDP, but featuring no explicit regularization or explorat…
Fast Margin Maximization via Dual Acceleration
Ziwei Ji, Nathan Srebro, Matus Telgarsky
We present and analyze a momentum-based gradient method for training linear classifiers with an exponentially-tailed loss (e.g., the exponential or logistic loss), which maximizes…
Early-stopped neural networks are consistent
Ziwei Ji, Justin D. Li, Matus Telgarsky
This work studies the behavior of shallow ReLU networks trained with the logistic loss via gradient descent on binary classification data where the underlying data distribution is…
Generalization bounds via distillation
Daniel Hsu, Ziwei Ji, Matus Telgarsky +1
This paper theoretically investigates the following empirical phenomenon: given a high-complexity network with poor generalization bounds, one can distill it into a network with ne…