activity
20242026
most citedApplication of Soft Actor-Critic Algorithms in Optimizing Wastewater Treatment with Time Delays Integration

28 citations · 31 across the 16 of their papers we have counts for

collaborators
Showing eess.SYShow all

8 papers · 1 filter

eess.SY2026

Solving Markov Decision Processes with Future Information via MPC

Shambhuraj Sawant, Akhil S Anand, Dirk Reinhardt +1

Model Predictive Control (MPC) is widely used in industrial and robotic systems for enforcing constraints and embedding domain knowledge through finite-horizon optimization-based p…

eess.SY2026

Uncertainty Propagation under Residual Disturbances: A Smart-Home Case Study

Guanru Pan, Dirk Reinhardt, Sebastien Gros +1

This paper presents a data-driven framework for uncertainty propagation under unmeasured or statistically unmodeled (unstructured) disturbances. We consider residual disturbances,…

eess.SY2025

Direct transfer of optimized controllers to similar systems using dimensionless MPC

Josip Kir Hromatko, Shambhuraj Sawant, Šandor Ileš +1

Scaled model experiments are commonly used in various engineering fields to reduce experimentation costs and overcome constraints associated with full-scale systems. The relevance…

eess.SY2025★ 1 cited

Synthesis of Model Predictive Control and Reinforcement Learning: Survey and Classification

Rudolf Reiter, Jasper Hoffmann, Dirk Reinhardt +6

The fields of MPC and RL consider two successful control techniques for Markov decision processes. Both approaches are derived from similar fundamental principles, and both are wid…

eess.SY2025★ 1 cited

MPC4RL -- A Software Package for Reinforcement Learning based on Model Predictive Control

Dirk Reinhardt, Katrin Baumgärnter, Jonathan Frey +2

In this paper, we present an early software integrating Reinforcement Learning (RL) with Model Predictive Control (MPC). Our aim is to make recent theoretical contributions from th…

eess.SY2024★ 28 cited

Application of Soft Actor-Critic Algorithms in Optimizing Wastewater Treatment with Time Delays Integration

Esmaeel Mohammadi, Daniel Ortiz-Arroyo, Aviaja Anna Hansen +4

Wastewater treatment plants face unique challenges for process control due to their complex dynamics, slow time constants, and stochastic delays in observations and actions. These…