4 papers
Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Models
Yinlam Chow, Guy Tennenholtz, Izzeddin Gur +7
Recent studies have indicated that effectively utilizing inference-time compute is crucial for attaining better performance from large language models (LLMs). In this work, we prop…
A2Perf: Real-World Autonomous Agents Benchmark
Ikechukwu Uchendu, Jason Jabbour, Korneel Van den Berghe +15
Autonomous agents and systems cover a number of application areas, from robotics and digital assistants to combinatorial optimization, all sharing common, unresolved research chall…
Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web
Hiroki Furuta, Yutaka Matsuo, Aleksandra Faust +1
Language model agents (LMA) recently emerged as a promising paradigm on muti-step decision making tasks, often outperforming humans and other reinforcement learning agents. Despite…
Geometric-Averaged Preference Optimization for Soft Preference Labels
Hiroki Furuta, Kuang-Huei Lee, Shixiang Shane Gu +4
Many algorithms for aligning LLMs with human preferences assume that human preferences are binary and deterministic. However, human preferences can vary across individuals, and the…