FTerViT: Fully Ternary Vision Transformer

Szymon Ruciński, Pietro Bonazzi, Engin Türetken +3

Ternary Vision Transformers offer substantial model compression, however state-of-the-art methods only ternarize the encoder layers, leaving patch embeddings, LayerNorm parameters,…