Explicit Dropout: Deterministic Regularization for Transformer Architectures

Vidhi Agrawal, Illia Oleksiienko, Alexandros Iosifidis

Dropout is a widely used regularization technique in deep learning, but its effects are typically realized through stochastic masking rather than explicit optimization objectives.…