TVLT: Textless Vision-Language Transformer

Zineng Tang, Jaemin Cho, Yixin Nie +1

In this work, we present the Textless Vision-Language Transformer (TVLT), where homogeneous transformer blocks take raw visual and audio inputs for vision-and-language representati…