Be My Eyes: Extending Large Language Models to New Modalities Through Multi-Agent Collaboration

James Y. Huang, Sheng Zhang, Qianchu Liu +5

Large Language Models (LLMs) have demonstrated remarkable capabilities in challenging, knowledge-intensive reasoning tasks. However, extending LLMs to perceive and reason over a ne…