4 papers · 1 filter
Pluralistic Off-policy Evaluation and Alignment
Chengkai Huang, Junda Wu, Zhouhang Xie +6
Personalized preference alignment for LLMs with diverse human preferences requires evaluation and alignment methods that capture pluralism. Most existing preference alignment datas…
Personalization of Large Language Models: A Survey
Zhehao Zhang, Ryan A. Rossi, Branislav Kveton +18
Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most exist…
RCStat: A Statistical Framework for using Relative Contextualization in Transformers
Debabrata Mahapatra, Shubham Agarwal, Apoorv Saxena +1
Prior work on input-token importance in auto-regressive transformers has relied on Softmax-normalized attention weights, which obscure the richer structure of pre-Softmax query-key…
A Framework for Fine-Tuning LLMs using Heterogeneous Feedback
Ryan Aponte, Ryan A. Rossi, Shunan Guo +5
Large language models (LLMs) have been applied to a wide range of tasks, including text summarization, web navigation, and chatbots. They have benefitted from supervised fine-tunin…