Encoder-Free Multimodal LLMs Learn Implicit Encoders

David Harwath, Desh Raj, Xavier Velez +5

We empirically analyze two recently proposed encoder-free multimodal LLMs, Gemma-4 12B and Inkling-Small. Unlike previous multimodal LLMs, these models do not use modality-specific…