Provably Overwhelming Transformer Models with Designed Inputs

Lev Stambler, Seyed Sajjad Nezhadi, Matthew Coudron

We develop an algorithm which, given a trained transformer model $\mathcal{M}$ as input, as well as a string of tokens $s$ of length $n_{fix}$ and an integer $n_{free}$, can genera…