Reward Imputation with Sketching for Contextual Batched Bandits

Xiao Zhang, Ninglu Shao, Zihua Si +4

Contextual batched bandit (CBB) is a setting where a batch of rewards is observed from the environment at the end of each episode, but the rewards of the non-executed actions are u…