Uncertainty Decomposition for Bayes-Filtered Transformers via Bayesian Predictive Inference

Sandra Fortini, Kenyon Ng, Sonia Petrone +2

Bayes-filtered transformers are transformers meta-learned on sequences from a prior predictive distribution to approximate the corresponding posterior predictive distribution. They…