Showing cs.LGShow all
3 papers · 1 filter
cs.LG2023
Importance Sampling for Stochastic Gradient Descent in Deep Neural Networks
Thibault Lahire
Stochastic gradient descent samples uniformly the training set to build an unbiased gradient estimate with a limited number of samples. However, at a given step of the training pro…
cs.LG2021
Actor Loss of Soft Actor Critic Explained
Thibault Lahire
This technical report is devoted to explaining how the actor loss of soft actor critic is obtained, as well as the associated gradient estimate. It gives the necessary mathematical…
cs.LG2021
Large Batch Experience Replay
Thibault Lahire, Matthieu Geist, Emmanuel Rachelson
Several algorithms have been proposed to sample non-uniformly the replay buffer of deep Reinforcement Learning (RL) agents to speed-up learning, but very few theoretical foundation…