Caption: Generating Informative Content Labels for Image Buttons Using Next-Screen Context

Mingyuan Zhong, Ajit Mallavarapu, Qing Nie

We present Caption, an LLM-powered content label generation tool for visual interactive elements on mobile devices. Content labels are essential for screen readers to provide annou…