On Exact Bit-level Reversible Transformers Without Changing Architectures

Guoqiang Zhang, J. P. Lewis, W. B. Kleijn

Various reversible deep neural networks (DNN) models have been proposed to reduce memory consumption in the training process. However, almost all existing reversible DNNs either re…