5 papers
Towards Field-Deployable Wearable IMU Systems for Occupational Activity Recognition
Ihsan Ul Haq, James Brusey, Farnad Nasirzadeh +1
Wearable inertial measurement unit (IMU) systems for construction worker human activity recognition (HAR) routinely report aggregate accuracies above 95 %, rarely under genuine sub…
Learning to Modulate, Not to Cycle: Soft Actor---Critic Recovers Inverter-Style Heat-Pump Control
Faizan Ahmed, Aniket Dixit, James Brusey
On--off cycling is the main cause of compressor wear in residential heat pumps, yet reinforcement learning (RL) controllers for buildings typically optimise only energy cost and th…
Deadline-Aware, Energy-Efficient Control of Domestic Immersion Hot Water Heater
Muhammad Ibrahim Khan, Bivin Pradeep, James Brusey
Typical domestic immersion water heater systems are often operated continuously during winter, heating quickly rather than efficiently and ignoring predictable demand windows and a…
Higher-Order Action Regularization in Deep Reinforcement Learning: From Continuous Control to Building Energy Management
Faizan Ahmed, Aniket Dixit, James Brusey
Deep reinforcement learning agents often exhibit erratic, high-frequency control behaviors that hinder real-world deployment due to excessive energy consumption and mechanical wear…
Learning from Less: SINDy Surrogates in RL
Aniket Dixit, Muhammad Ibrahim Khan, Faizan Ahmed +1
This paper introduces an approach for developing surrogate environments in reinforcement learning (RL) using the Sparse Identification of Nonlinear Dynamics (SINDy) algorithm. We d…