Controlling Multimodal Conversational Agents with Coverage-Enhanced Latent Actions

Yongqi Li, Hao Lang, Tieyun Qian +1

Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinforcement learning (RL) has been widely…