Conservative DDPG -- Pessimistic RL without Ensemble

Nitsan Soffair, Shie Mannor

DDPG is hindered by the overestimation bias problem, wherein its $Q$-estimates tend to overstate the actual $Q$-values. Traditional solutions to this bias involve ensemble-based me…