Contextual Bandits with Stage-wise Constraints

Aldo Pacchiano, Mohammad Ghavamzadeh, Peter Bartlett

We study contextual bandits in the presence of a stage-wise constraint when the constraint must be satisfied both with high probability and in expectation. We start with the linear…