Balancing Privacy, Utility, and Safety in LLM Alignment through Preference Optimization

Dishu Yang, Jingjing Liu, Jize Li

Preference optimization is widely used to align large language models with human preferences, but preference-data composition may also influence privacy-relevant memorization. We e…