Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Abstractive Red-Teaming of Language Model Character
Nate Rahn, Allison Qi, Avery Griffin +3
We want language model assistants to conform to a character specification, which asserts how the model should act across diverse user interactions. While models typically follow th…
cs.LG2025
Inoculation Prompting: Instructing LLMs to misbehave at train-time improves test-time alignment
Nevan Wichers, Aram Ebtekar, Ariana Azarbal +8
Large language models are sometimes trained with imperfect oversight signals, leading to undesired behaviors such as reward hacking and sycophancy. Improving oversight quality can…