19 citations · 24 across the 4 of their papers we have counts for
4 papers
P3O: Policy-on Policy-off Policy Optimization
Rasool Fakoor, Pratik Chaudhari, Alexander J. Smola
On-policy reinforcement learning (RL) algorithms have high sample complexity while off-policy algorithms are difficult to tune. Merging the two holds the promise to develop efficie…
Stochastic gradient descent performs variational inference, converges to limit cycles for deep networks
Pratik Chaudhari, Stefano Soatto
Stochastic gradient descent (SGD) is widely believed to perform implicit regularization when used to train deep neural networks, but the precise manner in which this occurs has thu…
Parle: parallelizing stochastic gradient descent
Pratik Chaudhari, Carlo Baldassi, Riccardo Zecchina +3
We propose a new algorithm called Parle for parallel training of deep networks that converges 2-4x faster than a data-parallel implementation of SGD, while achieving significantly…
Deep Relaxation: partial differential equations for optimizing deep neural networks
Pratik Chaudhari, Adam Oberman, Stanley Osher +2
In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation te…