activity
20202023
most citedScreen Parsing: Towards Reverse Engineering of UI Models from Screenshots

61 citations · 64 across the 3 of their papers we have counts for

collaborators
Showing cs.HCShow all

5 papers · 1 filter

cs.HC2023

Never-ending Learning of User Interfaces

Jason Wu, Rebecca Krosnick, Eldon Schoop +3

Machine learning models have been trained to predict semantic information about user interfaces (UIs) to make apps more accessible, easier to test, and to automate. Currently, most…

cs.HC202161 cited

Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots

Jason Wu, Xiaoyi Zhang, Jeff Nichols +1

Automated understanding of user interfaces (UIs) from their pixels can improve accessibility, enable task automation, and facilitate interface design without relying on developers…

cs.HC2021

When Can Accessibility Help?: An Exploration of Accessibility Feature Recommendation on Mobile Devices

Jason Wu, Gabriel Reyes, Sam C. White +2

Numerous accessibility features have been developed and included in consumer operating systems to provide people with a variety of disabilities additional ways to access computing…

cs.HC20213 cited

Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin +9

Many accessibility features available on mobile platforms require applications (apps) to provide complete and accurate metadata describing user interface (UI) components. Unfortuna…

cs.HC2020

Making Mobile Augmented Reality Applications Accessible

Jaylin Herskovitz, Jason Wu, Samuel White +4

Augmented Reality (AR) technology creates new immersive experiences in entertainment, games, education, retail, and social media. AR content is often primarily visual and it is cha…