4 papers
NS-Gym: Open-Source Simulation Environments and Benchmarks for Non-Stationary Markov Decision Processes
Nathaniel S. Keplinger, Baiting Luo, Iliyas Bektas +5
In many real-world applications, agents must make sequential decisions in environments where conditions are subject to change due to various exogenous factors. These non-stationary…
Shrinking POMCP: A Framework for Real-Time UAV Search and Rescue
Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +8
Efficient path optimization for drones in search and rescue operations faces challenges, including limited visibility, time constraints, and complex information gathering in urban…
Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes
Baiting Luo, Yunuo Zhang, Abhishek Dubey +1
A fundamental (and largely open) challenge in sequential decision-making is dealing with non-stationary environments, where exogenous environmental conditions change over time. Suc…
Decision Making in Non-Stationary Environments with Policy-Augmented Search
Ava Pettet, Yunuo Zhang, Baiting Luo +5
Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (…