L3Ms -- Lagrange Large Language Models

Guneet S. Dhillon, Xingjian Shi, Yee Whye Teh +1

Supervised fine-tuning (SFT) and alignment of large language models (LLMs) are key steps in providing a good user experience. However, the concept of an appropriate alignment is in…