activity
20192026
most citedMultimodal Integration of Human-Like Attention in Visual Question Answering

21 citations · 45 across the 14 of their papers we have counts for

collaborators

16 papers

cs.AI2026

RevalExo: A Functional Daily-Activity Benchmark for Inertial and Visual Locomotion Mode Recognition in Older Adults and Clinical Cohorts

Diwas Lamsal, Juha Carlon, Reinhard Claeys +8

Assistive devices for people with mobility impairments, such as powered exoskeletons, rely on accurate locomotion mode recognition to adapt control strategies and provide appropria…

cs.HC2026

Lightweight Cybersickness Detection based on User-Specific Eye and Head Tracking Data in Virtual Reality

Yijun Wang, Mihai Bâce, Maria Torres Vega

The occurrence of cybersickness in virtual reality (VR) significantly impairs users' perception and sense of immersion. Therefore, timely detection of cybersickness and the applica…

cs.CV2025

Learning Spatio-Temporal Feature Representations for Video-Based Gaze Estimation

Alexandre Personnic, Mihai Bâce

Video-based gaze estimation methods aim to capture the inherently temporal dynamics of human eye gaze from multiple image frames. However, since models must capture both spatial an…

cs.CV2024

HAIFAI: Human-AI Interaction for Mental Face Reconstruction

Florian Strohm, Mihai Bâce, Andreas Bulling

We present HAIFAI - a novel two-stage system where humans and AI interact to tackle the challenging task of reconstructing a visual representation of a face that exists only in a p…

cs.CV2024★ 1 cited

DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360° Images

Chuhan Jiao, Yao Wang, Guanhua Zhang +3

We present DiffGaze, a novel method for generating realistic and diverse continuous human gaze sequences on 360° images based on a conditional score-based denoising diffusion model…

cs.CV2024★ 1 cited

Learning User Embeddings from Human Gaze for Personalised Saliency Prediction

Florian Strohm, Mihai Bâce, Andreas Bulling

Reusable embeddings of user behaviour have shown significant performance improvements for the personalised saliency prediction task. However, prior works require explicit user char…

cs.CV2024★ 1 cited

UP-FacE: User-predictable Fine-grained Face Shape Editing

Florian Strohm, Mihai Bâce, Andreas Bulling

We present User-predictable Face Editing (UP-FacE) -- a novel method for predictable face shape editing. In stark contrast to existing methods for face editing using trial and erro…

cs.LG2023

Int-HRL: Towards Intention-based Hierarchical Reinforcement Learning

Anna Penzkofer, Simon Schaefer, Florian Strohm +3

While deep reinforcement learning (RL) agents outperform humans on an increasing number of tasks, training them requires data equivalent to decades of human gameplay. Recent hierar…

cs.HC2023

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

Guanhua Zhang, Matteo Bortoletto, Zhiming Hu +3

Analysing and modelling interactive behaviour is an important topic in human-computer interaction (HCI) and a key requirement for the development of intelligent interactive systems…

cs.CV2022★ 1 cited

Neuro-Symbolic Visual Dialog

Adnen Abdessaied, Mihai Bâce, Andreas Bulling

We propose Neuro-Symbolic Visual Dialog (NSVD) -the first method to combine deep learning and symbolic program execution for multi-round visually-grounded reasoning. NSVD significa…

cs.HC2021★ 9 cited

VisRecall: Quantifying Information Visualisation Recallability via Question Answering

Yao Wang, Chuhan Jiao, Mihai Bâce +1

Despite its importance for assessing the effectiveness of communicating information visually, fine-grained recallability of information visualisations has not been studied quantita…

cs.CV2021

Scanpath Prediction on Information Visualisations

Yao Wang, Mihai Bâce, Andreas Bulling

We propose Unified Model of Saliency and Scanpaths (UMSS) -- a model that learns to predict visual saliency and scanpaths (i.e. sequences of eye fixations) on information visualisa…

cs.CV2021★ 21 cited

Multimodal Integration of Human-Like Attention in Visual Question Answering

Ekta Sood, Fabian Kögel, Philipp Müller +3

Human-like attention as a supervisory signal to guide neural attention has shown significant promise but is currently limited to uni-modal integration - even for inherently multimo…

cs.CV2021

Neural Photofit: Gaze-based Mental Image Reconstruction

Florian Strohm, Ekta Sood, Sven Mayer +3

We propose a novel method that leverages human fixations to visually decode the image a person has in mind into a photofit (facial composite). Our method combines three neural netw…

cs.HC2019★ 3 cited

Accurate and Robust Eye Contact Detection During Everyday Mobile Device Interactions

Mihai Bâce, Sander Staal, Andreas Bulling

Quantification of human attention is key to several tasks in mobile human-computer interaction (HCI), such as predicting user interruptibility, estimating noticeability of user int…

cs.HC2019★ 8 cited

How far are we from quantifying visual attention in mobile HCI?

Mihai Bâce, Sander Staal, Andreas Bulling

With an ever-increasing number of mobile devices competing for our attention, quantifying when, how often, or for how long users visually attend to their devices has emerged as a c…