Adaptive Helpfulness-Harmlessness Alignment with Preference Vectors

Ren-Wei Liang, Chin-Ting Hsu, Chan-Hung Yu +6

Ensuring that large language models (LLMs) are both helpful and harmless is a critical challenge, as overly strict constraints can lead to excessive refusals, while permissive mode…