3 citations · 4 across the 3 of their papers we have counts for
3 papers
RRM: Robust Reward Model Training Mitigates Reward Hacking
Tianqi Liu, Wei Xiong, Jie Ren +15
Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. However, traditional RM training, which relies on response pairs tied to sp…
Model-based Causal Bayesian Optimization
Scott Sussex, Anastasiia Makarova, Andreas Krause
How should we intervene on an unknown structural equation model to maximize a downstream variable of interest? This setting, also known as causal Bayesian optimization (CBO), has i…
Risk-averse Heteroscedastic Bayesian Optimization
Anastasiia Makarova, Ilnura Usmanova, Ilija Bogunovic +1
Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expect…