5 papers · 1 filter
ControlGUI: Guiding Generative GUI Exploration through Perceptual Visual Flow
Aryan Garg, Yue Jiang, Antti Oulasvirta
During the early stages of interface design, designers need to produce multiple sketches to explore a design space. Design tools often fail to support this critical stage, because…
Cost-Aware Bayesian Optimization for Prototyping Interactive Devices
Thomas Langerak, Renate Zhang, Ziyuan Wang +2
Deciding which idea is worth prototyping is a central concern in iterative design. A prototype should be produced when the expected improvement is high and the cost is low. However…
Mind & Motion: Opportunities and Applications of Integrating Biomechanics and Cognitive Models in HCI
Arthur Fleig, Florian Fischer, Markus Klar +5
Computational models of how users perceive and act within a virtual or physical environment offer enormous potential for the understanding and design of user interactions. Cognitio…
SIM2VR: Towards Automated Biomechanical Testing in VR
Florian Fischer, Aleksi Ikkala, Markus Klar +6
Automated biomechanical testing has great potential for the development of VR applications, as initial insights into user behaviour can be gained in silico early in the design proc…
Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces
Yue Jiang, Changkong Zhou, Vikas Garg +1
Present-day graphical user interfaces (GUIs) exhibit diverse arrangements of text, graphics, and interactive elements such as buttons and menus, but representations of GUIs have no…