Deep Pictorial Gaze Estimation
arXiv:1807.10002 · doi:10.1007/978-3-030-01261-8_44
Abstract
Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is an ill-posed problem. In this paper, we introduce a novel deep neural network architecture specifically designed for the task of gaze estimation from single eye input. Instead of directly regressing two angles for the pitch and yaw of the eyeball, we regress to an intermediate pictorial representation which in turn simplifies the task of 3D gaze direction estimation. Our quantitative and qualitative results show that our approach achieves higher accuracies than the state-of-the-art and is robust to variation in gaze, head pose and image quality.
References in corpus (10)
- Adam: A Method for Stochastic Optimization
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- DeepPose: Human Pose Estimation via Deep Neural Networks
- Deeply-Supervised Nets
- Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation
- Appearance-Based Gaze Estimation in the Wild
- Stacked Hourglass Networks for Human Pose Estimation
- It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimation
- Convolutional Pose Machines
- Eye Tracking for Everyone
Cited by in corpus (29)
- RITnet: Real-time Semantic Segmentation of the Eye for Gaze Tracking
- EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking
- Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmark
- An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices
- Towards High Performance Low Complexity Calibration in Appearance Based Gaze Estimation
- The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation
- ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation
- Automatic Gaze Analysis: A Survey of Deep Learning based Approaches
- Enjoy the Ride Consciously with CAWA: Context-Aware Advisory Warnings for Automated Driving
- RIT-Eyes: Rendering of near-eye images for eye-tracking applications
- Recent Advances in Leveraging Human Guidance for Sequential Decision-Making Tasks
- Controllable Continuous Gaze Redirection
- Continuous Gaze Tracking With Implicit Saliency-Aware Calibration on Mobile Devices
- EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking
- Privacy-Preserving Eye Videos using Rubber Sheet Model
- EyeCoD: Eye Tracking System Acceleration via FlatCam-based Algorithm & Accelerator Co-Design
- Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning
- Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis
- OpenEDS2020: Open Eyes Dataset
- Evaluating User Experience and Data Quality in Gamified Data Collection for Appearance-Based Gaze Estimation
- Unsupervised Representation Learning for Gaze Estimation
- Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition
- Learning to Detect Head Movement in Unconstrained Remote Gaze Estimation in the Wild
- SalGaze: Personalizing Gaze Estimation Using Visual Saliency
- - Enhancing the Precision of Eye Tracking using Iris Feature Motion Vectors
- Gaze Estimation using Transformer
- Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance
- HybridGazeNet: Geometric model guided Convolutional Neural Networks for gaze estimation
- Bayesian Eye Tracking