Cross-Modal Taxonomic Generalization in (Vision-) Language Models

Tianyang Xu, Marcelo Sandoval-Castaneda, Karen Livescu +2

What is the interplay between semantic representations learned by language models (LM) from surface form alone to those learned from more grounded evidence? We study this question…