A Comprehensive Study on Deep Learning-based Methods for Sign Language Recognition

Abstract

In this paper, a comparative experimental assessment of computer vision-based methods for sign language recognition is conducted. By implementing the most recent deep neural network methods in this field, a thorough evaluation on multiple publicly available datasets is performed. The aim of the present study is to provide insights on sign language recognition, focusing on mapping non-segmented video streams to glosses. For this task, two new sequence training criteria, known from the fields of speech and scene text recognition, are introduced. Furthermore, a plethora of pretraining schemes is thoroughly discussed. Finally, a new RGB+D dataset for the Greek sign language is created. To the best of our knowledge, this is the first sign language dataset where sentence and gloss level annotations are provided for a video capture.

References in corpus (7)

• Neural Machine Translation by Jointly Learning to Align and Translate
• Caffe: Convolutional Architecture for Fast Feature Embedding
• MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Language
• Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective
• An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing
• LSA64: An Argentinian Sign Language Dataset
• SF-Net: Structured Feature Network for Continuous Sign Language Recognition

Cited by in corpus (7)

• A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalities
• Quantitative Survey of the State of the Art in Sign Language Recognition
• From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluation
• Survey on Hand Gesture Recognition from Visual Input
• Multimodal Smart Glove for Sign Language Recognition Using Deep Learning
• See-Through Face Display for DHH People: Enhancing Gaze Awareness in Remote Sign Language Conversations with Camera-Behind Displays
• The Influence of Iconicity in Transfer Learning for Sign Language Recognition