Mixed-precision Supernet Training from Vision Foundation Models using Low Rank Adapter

Yuiko Sakuma, Masakazu Yoshimura, Junji Otsuka +2

Compression of large and performant vision foundation models (VFMs) into arbitrary bit-wise operations (BitOPs) allows their deployment on various hardware. We propose to fine-tune…