275 citations · 437 across the 32 of their papers we have counts for
Showing 2017Show all
2 papers · 1 filter
cs.AI2017★ 8 cited
Finite Sample Analyses for TD(0) with Function Approximation
Gal Dalal, Balázs Szörényi, Gugan Thoppe +1
TD(0) is one of the most commonly used algorithms in reinforcement learning. Despite this, there is no existing finite sample analysis for TD(0) with function approximation, even f…
cs.AI2017★ 36 cited
Finite Sample Analysis of Two-Timescale Stochastic Approximation with Applications to Reinforcement Learning
Gal Dalal, Balazs Szorenyi, Gugan Thoppe +1
Two-timescale Stochastic Approximation (SA) algorithms are widely used in Reinforcement Learning (RL). Their iterates have two parts that are updated using distinct stepsizes. In t…