26 citations · 30 across the 3 of their papers we have counts for
3 papers
cs.LG2023
Non-Stationary Policy Learning for Multi-Timescale Multi-Agent Reinforcement Learning
Patrick Emami, Xiangyu Zhang, David Biagioni +1
In multi-timescale multi-agent reinforcement learning (MARL), agents interact across different timescales. In general, policies for time-dependent behaviors, such as those induced…
eess.SY2021★ 4 cited
A Comparison of Model-Free and Model Predictive Control for Price Responsive Water Heaters
David J. Biagioni, Xiangyu Zhang, Peter Graf +2
We present a careful comparison of two model-free control algorithms, Evolution Strategies (ES) and Proximal Policy Optimization (PPO), with receding horizon model predictive contr…
cs.LG2019★ 26 cited
Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning
Hanchen Xu, Xiao Li, Xiangyu Zhang +1
In this letter, we address the problem of controlling energy storage systems (ESSs) for arbitrage in real-time electricity markets under price uncertainty. We first formulate this…