A Contraction Framework for Stochastic Operators with Bootstrapping: Application to TD Learning

Ids van der Werf, Sergio Rozada, Antonio G. Marques

Many iterative algorithms rely on bootstrapping. A variable is updated using a second, frozen copy as a target, which is periodically replaced with the updated variable. Majorize-m…