Training a Vision Language Model as Smartphone Assistant

Nicolai Dorka, Janusz Marecki, Ammar Anwar

Addressing the challenge of a digital assistant capable of executing a wide array of user tasks, our research focuses on the realm of instruction-based mobile device control. We le…