4 papers
A Framework for Designing Reward Functions: From Objectives to Features to Human-Aligned Reward Functions
Di Yang Shi, W. Bradley Knox
We present a formal process to enable non-experts to instantiate and iterate on human-aligned reward functions, i.e. reward functions that adhere to a given preference ordering ove…
Influencing Humans to Conform to Preference Models for RLHF
Stephane Hatgis-Kessell, W. Bradley Knox, Serena Booth +1
Designing a reinforcement learning from human feedback (RLHF) algorithm to approximate a human's unobservable reward function requires assuming, implicitly or explicitly, a model o…
GUIDE: Reinforcement Learning for Behavioral Action Support in Type 1 Diabetes
Saman Khamesian, Sri Harini Balaji, Di Yang Shi +5
Type 1 Diabetes (T1D) management requires continuous adjustment of insulin and lifestyle behaviors to maintain blood glucose within a safe target range. Although automated insulin…
Harmful Traits of AI Companions
W. Bradley Knox, Katie Bradford, Samanta Varela Castro +6
Amid the growing prevalence of human-AI interaction, large language models and other AI-based entities increasingly provide forms of companionship to human users. Such AI companion…