activity
20212026
most citedOnline Decision-Making Under Uncertainty for Vehicle-to-Building Systems

3 citations · 12 across the 28 of their papers we have counts for

collaborators
Showing 2025Show all

6 papers · 1 filter

cs.LG2025

ESCORT: Efficient Stein-variational and Sliced Consistency-Optimized Temporal Belief Representation for POMDPs

Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +2

In Partially Observable Markov Decision Processes (POMDPs), maintaining and updating belief distributions over possible underlying states provides a principled way to summarize act…

cs.CY2025

MoveOD: Synthesizing Origin-Destination Commute Distribution from U.S. Census Data

Rishav Sen, Jose Paolo Talusan, Abhishek Dubey +3

High-resolution origin-destination (OD) tables are essential for a wide spectrum of transportation applications, from modeling traffic and signal timing optimization to congestion…

cs.AI2025

Observation Adaptation via Annealed Importance Resampling for Partially Observable Markov Decision Processes

Yunuo Zhang, Baiting Luo, Ayan Mukhopadhyay +1

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs a…

cs.LG2025

Scalable Decision-Making in Stochastic Environments through Learned Temporal Abstraction

Baiting Luo, Ava Pettet, Aron Laszka +2

Sequential decision-making in high-dimensional continuous action spaces, particularly in stochastic environments, faces significant computational challenges. We explore this challe…

cs.LG2025

Reinforcement Learning-based Approach for Vehicle-to-Building Charging with Heterogeneous Agents and Long Term Rewards

Fangqi Liu, Rishav Sen, Jose Paolo Talusan +5

Strategic aggregation of electric vehicle batteries as energy reservoirs can optimize power grid demand, benefiting smart and connected communities, especially large office buildin…

cs.AI2025

NS-Gym: Open-Source Simulation Environments and Benchmarks for Non-Stationary Markov Decision Processes

Nathaniel S. Keplinger, Baiting Luo, Iliyas Bektas +5

In many real-world applications, agents must make sequential decisions in environments where conditions are subject to change due to various exogenous factors. These non-stationary…