6 papers
Meaningful Pose-Based Sign Language Evaluation
Zifan Jiang, Colin Leong, Amit Moryossef +8
We present a comprehensive study on meaningfully evaluating sign language utterances in the form of human skeletal poses. The study covers keypoint distance-based, embedding-based,…
MultimodalHugs: Enabling Sign Language Processing in Hugging Face
Gerard Sant, Zifan Jiang, Carlos Escolano +4
In recent years, sign language processing (SLP) has gained importance in the general field of Natural Language Processing. However, compared to research on spoken languages, SLP re…
Pose-Based Sign Language Appearance Transfer
Amit Moryossef, Gerard Sant, Zifan Jiang
We introduce a method for transferring the signer's appearance in sign language skeletal poses while preserving the sign content. Using estimated poses, we transfer the appearance…
IlluSign: Illustrating Sign Language Videos by Leveraging the Attention Mechanism
Janna Bruner, Amit Moryossef, Lior Wolf
Sign languages are dynamic visual languages that involve hand gestures, in combination with non manual elements such as facial expressions. While video recordings of sign language…
Ham2Pose: Animating Sign Language Notation into Pose Sequences
Rotem Shalev-Arkushin, Amit Moryossef, Ohad Fried
Translating spoken languages into Sign languages is necessary for open communication between the hearing and hearing-impaired communities. To achieve this goal, we propose the firs…
Real-Time Multilingual Sign Language Processing
Amit Moryossef
Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural Language Processing (NLP) and Computer Vision. It is focused on the computational understanding, t…