10 papers
End-to-End Abstraction-Based Control with LLM-Enhanced NL-to-LTL Translation
Amir Bayat, Necmiye Ozay, Alessandro Abate +1
Abstraction-Based Controller Design (ABCD) offers a principled framework for the safe control of complex Cyber-Physical Systems (CPSs), but interfacing real-world requirements with…
Active Reward Machine Inference From Raw State Trajectories
Mohamad Louai Shehab, Antoine Aspeel, Necmiye Ozay
Reward machines are automaton-like structures that capture the memory required to accomplish a multi-stage task. When combined with reinforcement learning or optimal control method…
Safe and Optimal Learning from Preferences via Weighted Temporal Logic with Applications in Robotics and Formula 1
Ruya Karagulle, Cristian-Ioan Vasile, Necmiye Ozay
Autonomous systems increasingly rely on human feedback to align their behavior, expressed as pairwise comparisons, rankings, or demonstrations. While existing methods can adapt beh…
Safe Control of Multi-Agent Systems with Minimal Communication
Mo Yang, Jing Yu, Necmiye Ozay
In many multi-agent systems, communication is limited by bandwidth, latency, and energy constraints. Designing controllers that achieve coordination and safety with minimal communi…
Learning Reward Machines from Partially Observed Policies
Mohamad Louai Shehab, Antoine Aspeel, Necmiye Ozay
Inverse reinforcement learning is the problem of inferring a reward function from an optimal policy or demonstrations by an expert. In this work, it is assumed that the reward is e…
Initial Distribution Sensitivity of Constrained Markov Decision Processes
Alperen Tercan, Necmiye Ozay
Constrained Markov Decision Processes (CMDPs) are notably more complex to solve than standard MDPs due to the absence of universally optimal policies across all initial state distr…