Is Free Self-Alignment Possible?

Dyah Adila, Changho Shin, Yijing Zhang +1

Aligning pretrained language models (LMs) often requires large-scale preference data and substantial computational resources. These costs become even more prohibitive for multi-obj…