3 citations · 3 across the 8 of their papers we have counts for
8 papers
In-Context Planning with Latent Temporal Abstractions
Baiting Luo, Yunuo Zhang, Nathaniel S. Keplinger +3
Planning-based reinforcement learning for continuous control is bottlenecked by two practical issues: planning at primitive time scales leads to prohibitive branching and long hori…
Online Decision-Making Under Uncertainty for Vehicle-to-Building Systems
Rishav Sen, Yunuo Zhang, Fangqi Liu +5
Vehicle-to-building (V2B) systems integrate physical infrastructures, such as smart buildings and electric vehicles (EVs) connected to chargers at the building, with digital contro…
ESCORT: Efficient Stein-variational and Sliced Consistency-Optimized Temporal Belief Representation for POMDPs
Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +2
In Partially Observable Markov Decision Processes (POMDPs), maintaining and updating belief distributions over possible underlying states provides a principled way to summarize act…
Observation Adaptation via Annealed Importance Resampling for Partially Observable Markov Decision Processes
Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +1
Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs a…
NS-Gym: Open-Source Simulation Environments and Benchmarks for Non-Stationary Markov Decision Processes
Nathaniel S. Keplinger, Baiting Luo, Iliyas Bektas +5
In many real-world applications, agents must make sequential decisions in environments where conditions are subject to change due to various exogenous factors. These non-stationary…
Shrinking POMCP: A Framework for Real-Time UAV Search and Rescue
Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +8
Efficient path optimization for drones in search and rescue operations faces challenges, including limited visibility, time constraints, and complex information gathering in urban…
Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes
Baiting Luo, Yunuo Zhang, Abhishek Dubey +1
A fundamental (and largely open) challenge in sequential decision-making is dealing with non-stationary environments, where exogenous environmental conditions change over time. Suc…
Decision Making in Non-Stationary Environments with Policy-Augmented Search
Ava Pettet, Yunuo Zhang, Baiting Luo +5
Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (…