Showing cs.AIShow all
2 papers · 1 filter
cs.AI2025
Observation Adaptation via Annealed Importance Resampling for Partially Observable Markov Decision Processes
Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +1
Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs a…
cs.AI2025
NS-Gym: Open-Source Simulation Environments and Benchmarks for Non-Stationary Markov Decision Processes
Nathaniel S. Keplinger, Baiting Luo, Iliyas Bektas +5
In many real-world applications, agents must make sequential decisions in environments where conditions are subject to change due to various exogenous factors. These non-stationary…