Schedules and Prioritization: A Behavioral Foundation for Multi-Armed Bandits and Stopping Problems

Jaden Yang Chen, Can Urgun

Bandit models typically begin with arms, states, rewards, and transition rules. This paper instead begins with preferences over stopped local contingent schedules: possible unfoldi…