Revisiting TD Target Aggregation under Uncertainty in Q-Learning

Lipeng Zu, Xiaonan Zhang

Deep Q-Networks (DQNs) learn value functions through bootstrapped temporal-difference updates, where future returns are approximated using a greedy maximization over next-state act…