9 citations · 23 across the 10 of their papers we have counts for
10 papers
Meaningful Pose-Based Sign Language Evaluation
Zifan Jiang, Colin Leong, Amit Moryossef +8
We present a comprehensive study on meaningfully evaluating sign language utterances in the form of human skeletal poses. The study covers keypoint distance-based, embedding-based,…
MultimodalHugs: Enabling Sign Language Processing in Hugging Face
Gerard Sant, Zifan Jiang, Carlos Escolano +4
In recent years, sign language processing (SLP) has gained importance in the general field of Natural Language Processing. However, compared to research on spoken languages, SLP re…
Pose-Based Sign Language Appearance Transfer
Amit Moryossef, Gerard Sant, Zifan Jiang
We introduce a method for transferring the signer's appearance in sign language skeletal poses while preserving the sign content. Using estimated poses, we transfer the appearance…
SignCLIP: Connecting Text and Sign Language by Contrastive Learning
Zifan Jiang, Gerard Sant, Amit Moryossef +3
We present SignCLIP, which re-purposes CLIP (Contrastive Language-Image Pretraining) to project spoken language text and sign language videos, two classes of natural languages of d…
Linguistically Motivated Sign Language Segmentation
Amit Moryossef, Zifan Jiang, Mathias Müller +2
Sign language segmentation is a crucial task in sign language processing systems. It enables downstream tasks such as sign recognition, transcription, and machine translation. In t…
SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models
Amit Moryossef, Zifan Jiang
We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing sy…
An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation
Amit Moryossef, Mathias Müller, Anne Göhring +3
Sign language translation systems are complex and require many components. As a result, it is very hard to compare methods across publications. We present an open-source implementa…
Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks
Zifan Jiang, Adrian Soldati, Isaac Schamberg +2
We present a novel approach to automatically detect and classify great ape calls from continuous raw audio recordings collected during field research. Our method leverages deep pre…
Considerations for meaningful sign language machine translation based on glosses
Mathias Müller, Zifan Jiang, Amit Moryossef +2
Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language…
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting
Zifan Jiang, Amit Moryossef, Mathias Müller +1
This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writi…