How Many Different Outputs Can a Transformer Generate?

Maxime Meyer, Mario Michelessa, Caroline Chaux +1

We study how we can leverage only a handful of characteristics of a transformer's architecture to closely predict the number of different sequences it can output, both qualitativel…