The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction

Alice Martin, Charles Ollion, Florian Strub +2

This paper introduces the Sequential Monte Carlo Transformer, an original approach that naturally captures the observations distribution in a transformer architecture. The keys, qu…