Covert Influence Between Language Models

Avidan Shah, Jay Chooi, Jinghua Ou +1

As language models increasingly consume one another's outputs, covert influence -- a phenomenon where a sender's payload (the behavioral disposition it is conditioned to propagate)…