Feedback in Imitation Learning: The Three Regimes of Covariate Shift

Jonathan Spencer, Sanjiban Choudhury, Arun Venkatraman +2

Imitation learning practitioners have often noted that conditioning policies on previous actions leads to a dramatic divergence between "held out" error and performance of the lear…