222 citations · 765 across the 21 of their papers we have counts for
30 papers
The Six Hug Commandments: Design and Evaluation of a Human-Sized Hugging Robot with Visual and Haptic Perception
Alexis E. Block, Sammy Christen, Roger Gassert +2
Receiving a hug is one of the best ways to feel socially supported, and the lack of social touch can have severe negative effects on an individual's well-being. Based on previous r…
ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation
Xucong Zhang, Seonwook Park, Thabo Beeler +3
Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on cust…
Detecting Relevance during Decision-Making from Eye Movements for UI Adaptation
Anna Maria Feit, Lukas Vordemann, Seonwook Park +2
This paper proposes an approach to detect information relevance during decision-making from eye movements in order to enable user interface adaptation. This is a challenging task b…
The DIDI dataset: Digital Ink Diagram data
Philippe Gervais, Thomas Deselaers, Emre Aksan +1
We are releasing a dataset of diagram drawings with dynamic drawing information. The dataset aims to foster research in interactive graphical symbolic understanding. The dataset wa…
Hierarchical Reinforcement Learning as a Model of Human Task Interleaving
Christoph Gebhardt, Antti Oulasvirta, Otmar Hilliges
How do people decide how long to continue in a task, when to switch, and to which other task? Understanding the mechanisms that underpin task interleaving is a long-standing goal i…
Content-Consistent Generation of Realistic Eyes with Style
Marcel Bühler, Seonwook Park, Shalini De Mello +2
Accurately labeled real-world training data can be scarce, and hence recent works adapt, modify or generate images to boost target datasets. However, retaining relevant details fro…
Structured Prediction Helps 3D Human Motion Modelling
Emre Aksan, Manuel Kaufmann, Otmar Hilliges
Human motion prediction is a challenging and important task in many computer vision application domains. Existing work only implicitly models the spatial structure of the human ske…
Sample Efficient Learning of Path Following and Obstacle Avoidance Behavior for Quadrotors
Stefan Stevsic, Tobias Naegeli, Javier Alonso-Mora +1
In this paper we propose an algorithm for the training of neural network control policies for quadrotors. The learned control policy computes control commands directly from sensor…
Dynamic Drawing Guidance via Electromagnetic Haptic Feedback
Thomas Langerak, Juan Zarate, Velko Vechev +2
We propose a system to deliver dynamic guidance in drawing, sketching and handwriting tasks via an electromagnet moving underneath a high refresh rate pressure sensitive tablet. Th…
Optimizing for Aesthetically Pleasing Quadrotor Camera Motion
Christoph Gebhardt, Stefan Stevsic, Otmar Hilliges
In this paper we first contribute a large scale online study (N=400) to better understand aesthetic perception of aerial video. The results indicate that it is paramount to optimiz…
Airways: Optimization-Based Planning of Quadrotor Trajectories according to High-Level User Goals
Christoph Gebhardt, Benjamin Hepp, Tobias Naegeli +2
In this paper we propose a computational design tool that al-lows end-users to create advanced quadrotor trajectories witha variety of application scenarios in mind. Our algorithm…
Demonstration-Guided Deep Reinforcement Learning of Control Policies for Dexterous Human-Robot Interaction
Sammy Christen, Stefan Stevsic, Otmar Hilliges
In this paper, we propose a method for training control policies for human-robot interactions such as handshakes or hand claps via Deep Reinforcement Learning. The policy controls…
Few-Shot Adaptive Gaze Estimation
Seonwook Park, Shalini De Mello, Pavlo Molchanov +3
Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications req…
Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks
Zhe He, Adrian Spurr, Xucong Zhang +1
Gaze redirection is the task of changing the gaze to a desired direction for a given monocular eye patch image. Many applications such as videoconferencing, films, games, and gener…
STCN: Stochastic Temporal Convolutional Networks
Emre Aksan, Otmar Hilliges
Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs),…
Unpaired Pose Guided Human Image Generation
Xu Chen, Jie Song, Otmar Hilliges
This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance…
Monocular Neural Image Based Rendering with Continuous View Control
Xu Chen, Jie Song, Otmar Hilliges
We present an approach that learns to synthesize high-quality, novel views of 3D objects or scenes, while providing fine-grained and precise control over the 6-DOF viewpoint. The a…
End-to-end Learning for Graph Decomposition
Jie Song, Bjoern Andres, Michael Black +2
We propose a novel end-to-end trainable framework for the graph decomposition problem. The minimum cost multicut problem is first converted to an unconstrained binary cubic formula…
Learn-to-Score: Efficient 3D Scene Exploration by Predicting View Utility
Benjamin Hepp, Debadeepta Dey, Sudipta N. Sinha +3
Camera equipped drones are nowadays being used to explore large scenes and reconstruct detailed 3D maps. When free space in the scene is approximately known, an offline planner can…
Deep Pictorial Gaze Estimation
Seonwook Park, Adrian Spurr, Otmar Hilliges
Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D…
Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settings
Seonwook Park, Xucong Zhang, Andreas Bulling +1
Conventional feature-based and model-based gaze estimation methods have proven to perform well in settings with controlled illumination and specialized cameras. In unconstrained re…
Deformation Capture via Soft and Stretchable Sensor Arrays
Oliver Glauser, Daniele Panozzo, Otmar Hilliges +1
We propose a hardware and software pipeline to fabricate flexible wearable sensors and use them to capture deformations without line of sight. Our first contribution is a low-cost…
Cross-modal Deep Variational Hand Pose Estimation
Adrian Spurr, Jie Song, Seonwook Park +1
The human hand moves in complex and high-dimensional ways, making estimation of 3D hand pose configurations from images alone a challenging task. In this work we propose a method t…
AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time
Seonwook Park, Christoph Gebhardt, Roman Rädle +8
Developing cross-device multi-user interfaces (UIs) is a challenging problem. There are numerous ways in which content and interactivity can be distributed. However, good solutions…