The Pushback Paradox: A Two-Probe Diagnostic for Language Model Compliance

Stefan Bühler, David Exler, Markus Reischl +1

Are language models compliant with user instructions? A model that always complies can be stopped but also exploited, while one that always resists can be neither exploited nor sto…