Analysis of Stochastic Processes through Replay Buffers

Shirli Di Castro Shashua, Shie Mannor, Dotan Di-Castro

Replay buffers are a key component in many reinforcement learning schemes. Yet, their theoretical properties are not fully understood. In this paper we analyze a system where a sto…