5 papers
ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation
Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain +2
Gloss-free Sign Language Translation (SLT) translates sign language videos into spoken-language sentences without gloss annotations, avoiding costly labeling but requiring fine-gra…
USTM: Unified Spatial and Temporal Modeling for Continuous Sign Language Recognition
Ahmed Abul Hasanaath, Hamzah Luqman
Continuous sign language recognition (CSLR) requires precise spatio-temporal modeling to accurately recognize sequences of gestures in videos. Existing frameworks often rely on CNN…
Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognition
Sarah Alyami, Hamzah Luqman, Sadam Al-Azani +3
Current benchmarks for sign language recognition (SLR) focus mainly on isolated SLR, while there are limited datasets for continuous SLR (CSLR), which recognizes sequences of signs…
SSLR: A Semi-Supervised Learning Method for Isolated Sign Language Recognition
Hasan Algafri, Hamzah Luqman, Sarah Alyami +1
Sign language is the primary communication language for people with disabling hearing loss. Sign language recognition (SLR) systems aim to recognize sign gestures and translate the…
CLIP-SLA: Parameter-Efficient CLIP Adaptation for Continuous Sign Language Recognition
Sarah Alyami, Hamzah Luqman
Continuous sign language recognition (CSLR) focuses on interpreting and transcribing sequences of sign language gestures in videos. In this work, we propose CLIP sign language adap…