PupilNet: Convolutional Neural Networks for Robust Pupil Detection
arXiv:1601.04902
Abstract
Real-time, accurate, and robust pupil detection is an essential prerequisite for pervasive video-based eye-tracking. However, automated pupil detection in real-world scenarios has proven to be an intricate challenge due to fast illumination changes, pupil occlusion, non centered and off-axis eye recording, and physiological eye characteristics. In this paper, we propose and evaluate a method based on a novel dual convolutional neural network pipeline. In its first stage the pipeline performs coarse pupil position identification using a convolutional neural network and subregions from a downscaled input image to decrease computational costs. Using subregions derived from a small window around the initial pupil position estimate, the second pipeline stage employs another convolutional neural network to refine this position, resulting in an increased pupil detection rate up to 25% in comparison with the best performing state-of-the-art algorithm. Annotated data sets can be made available upon request.
9 pages, 11 figures
References in corpus (1)
Cited by in corpus (7)
- PuRe: Robust pupil detection for real-time pervasive eye tracking
- EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking
- TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types
- A High-Level Description and Performance Evaluation of Pupil Invisible
- Tensor Normalization and Full Distribution Training
- SIP-SegNet: A Deep Convolutional Encoder-Decoder Network for Joint Semantic Segmentation and Extraction of Sclera, Iris and Pupil based on Periocular Region Suppression
- Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality