Pathologies in priors and inference for Bayesian transformers

Tristan Cinquin, Alexander Immer, Max Horn +1

In recent years, the transformer has established itself as a workhorse in many applications ranging from natural language processing to reinforcement learning. Similarly, Bayesian…