Like a Baby: Visually Situated Neural Language Acquisition

Alexander G. Ororbia, Ankur Mali, Mary Alexandria Kelly +1

We examine the benefits of visual context in training neural language models to perform next-word prediction. A multi-modal neural architecture is introduced that outperform its eq…