Coarse Q-learning: Indifference, Indeterminacy, and Instability

Philippe Jehiel, Aviman Satpathy

We introduce Coarse Q-learning (CQL), a reinforcement-learning model for bandit problems with stochastically varying menus. Alternatives are exogenously partitioned into similarity…