ESsEN: Training Compact Discriminative Vision-Language Transformers in a Low-Resource Setting

Clayton Fields, Casey Kennington

Vision-language modeling is rapidly increasing in popularity with an ever expanding list of available models. In most cases, these vision-language models have parameters in the ten…