A Progressive Design Study of Visual Encoders and Value Estimation for Replay-Free Parallelized Q-Learning

Taha Shieenavaz, Shabnam Zareshahraki, Loris Nanni

Replay-free parallelized Q-learning removes the large experience replay buffers and target networks used by conventional deep Q-learning, but the role of network architecture in th…