GrayShield: Bit-Level Sanitization for Transformer Model Supply-Chain Security

Armstrong Foundjem, Tsung-Hsien Chuang, Foutse Khomh +1

Transformer models such as BERT and Vision Transformer~(ViT) achieve strong performance via densely parameterized attention backbones. However, the least significant bits~(LSBs) of…