4 citations · 5 across the 4 of their papers we have counts for
5 papers
Android in the Wild: A Large-Scale Dataset for Android Device Control
Christopher Rawles, Alice Li, Daniel Rodriguez +2
There is a growing interest in device-control systems that can interpret human natural language instructions and execute them on a digital device by directly controlling its user i…
Lexi: Self-Supervised Learning of the UI Language
Pratyay Banerjee, Shweti Mahajan, Kushal Arora +2
Humans can learn to operate the user interface (UI) of an application by reading an instruction manual or how-to guide. Along with text, these resources include visual content such…
Inducing a hierarchy for multi-class classification problems
Hayden S. Helm, Weiwei Yang, Sujeeth Bharadwaj +5
In applications where categorical labels follow a natural hierarchy, classification methods that exploit the label structure often outperform those that do not. Un-fortunately, the…
Bew: Towards Answering Business-Entity-Related Web Questions
Qingqing Cao, Oriana Riva, Aruna Balasubramanian +1
We present BewQA, a system specifically designed to answer a class of questions that we call Bew questions. Bew questions are related to businesses/services such as restaurants, ho…
FLIN: A Flexible Natural Language Interface for Web Navigation
Sahisnu Mazumder, Oriana Riva
AI assistants can now carry out tasks for users by directly interacting with website UIs. Current semantic parsing and slot-filling techniques cannot flexibly adapt to many differe…