Universal Approximation Under Constraints is Possible with Transformers

Anastasis Kratsios, Behnoosh Zamanlooy, Tianlin Liu +1

Many practical problems need the output of a machine learning model to satisfy a set of constraints, $K$. Nevertheless, there is no known guarantee that classical neural network ar…