Survey on Hand Gesture Recognition from Visual Input

Abstract

Hand gesture recognition has become an important research area, driven by the growing demand for human-computer interaction in fields such as sign language recognition, virtual and augmented reality, and robotics. Despite the rapid growth of the field, there are few surveys that comprehensively cover recent research developments, available solutions, and benchmark datasets. This survey addresses this gap by examining the latest advancements in hand gesture and 3D hand pose recognition from various types of camera input data including RGB images, depth images, and videos from monocular or multiview cameras, examining the differing methodological requirements of each approach. Furthermore, an overview of widely used datasets is provided, detailing their main characteristics and application domains. Finally, open challenges such as achieving robust recognition in real-world environments, handling occlusions, ensuring generalization across diverse users, and addressing computational efficiency for real-time applications are highlighted to guide future research directions. By synthesizing the objectives, methodologies, and applications of recent studies, this survey offers valuable insights into current trends, challenges, and opportunities for future research in human hand gesture recognition.

37 pages

References in corpus (22)

• Distilling the Knowledge in a Neural Network
• Representation Learning with Contrastive Predictive Coding
• Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
• Capturing Hands in Action using Discriminative Salient Points and Physics Simulation
• Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor
• AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methods
• A Comprehensive Study on Deep Learning-based Methods for Sign Language Recognition
• MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Language
• 3D Hand Pose Tracking and Estimation Using Stereo Matching
• CNN+RNN Depth and Skeleton based Dynamic Hand Gesture Recognition
• Consistent 3D Hand Reconstruction in Video via self-supervised Learning
• Spatial-Temporal Graph Convolutional Networks for Sign Language Recognition
• Using Motion History Images with 3D Convolutional Networks in Isolated Sign Language Recognition
• A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalities
• 3D Hand Pose and Shape Estimation from RGB Images for Keypoint-Based Hand Gesture Recognition
• The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation
• BosphorusSign22k Sign Language Recognition Dataset
• Multi-Task and Multi-Modal Learning for RGB Dynamic Gesture Recognition
• Snapture -- A Novel Neural Architecture for Combined Static and Dynamic Hand Gesture Recognition
• In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition
• RGB Arabic Alphabets Sign Language Dataset
• BdSL36: A Dataset for Bangladeshi Sign Letters Recognition