LLMs can see and hear without any training

Kumar Ashutosh, Yossi Gandelsman, Xinlei Chen +2

We present MILS: Multimodal Iterative LLM Solver, a surprisingly simple, training-free approach, to imbue multimodal capabilities into your favorite LLM. Leveraging their innate ab…