4 papers · 1 filter
Reinforcement Learning for Exponential Utility: Algorithms and Convergence in Discounted MDPs
Gugan Thoppe, L. A. Prashanth, Ankur Naskar +1
Reinforcement learning (RL) for exponential-utility optimization in discounted Markov decision processes (MDPs) lacks principled value-based algorithms. We address this gap in the…
Risk-sensitive reinforcement learning using expectiles, shortfall risk and optimized certainty equivalent risk
Sumedh Gupte, Shrey Rakeshkumar Patel, Soumen Pachal +2
We propose risk-sensitive reinforcement learning algorithms catering to three families of risk measures, namely expectiles, utility-based shortfall risk and optimized certainty equ…
Risk Estimation in a Markov Cost Process: Lower and Upper Bounds
Gugan Thoppe, L. A. Prashanth, Sanjay Bhat
We tackle the problem of estimating risk measures of the infinite-horizon discounted cost within a Markov cost process. The risk measures we study include variance, Value-at-Risk (…
Optimization of utility-based shortfall risk: A non-asymptotic viewpoint
Sumedh Gupte, Prashanth L. A., Sanjay P. Bhat
We consider the problems of estimation and optimization of utility-based shortfall risk (UBSR), which is a popular risk measure in finance. In the context of UBSR estimation, we de…