15 citations · 53 across the 26 of their papers we have counts for
18 papers · 1 filter
Meaningful Pose-Based Sign Language Evaluation
Zifan Jiang, Colin Leong, Amit Moryossef +8
We present a comprehensive study on meaningfully evaluating sign language utterances in the form of human skeletal poses. The study covers keypoint distance-based, embedding-based,…
MultimodalHugs: Enabling Sign Language Processing in Hugging Face
Gerard Sant, Zifan Jiang, Carlos Escolano +4
In recent years, sign language processing (SLP) has gained importance in the general field of Natural Language Processing. However, compared to research on spoken languages, SLP re…
Real-Time Multilingual Sign Language Processing
Amit Moryossef
Sign Language Processing (SLP) is an interdisciplinary field comprised of Natural Language Processing (NLP) and Computer Vision. It is focused on the computational understanding, t…
signwriting-evaluation: Effective Sign Language Evaluation via SignWriting
Amit Moryossef, Rotem Zilberman, Ohad Langer
The lack of automatic evaluation metrics tailored for SignWriting presents a significant obstacle in developing effective transcription and translation models for signed languages.…
SignCLIP: Connecting Text and Sign Language by Contrastive Learning
Zifan Jiang, Gerard Sant, Amit Moryossef +3
We present SignCLIP, which re-purposes CLIP (Contrastive Language-Image Pretraining) to project spoken language text and sign language videos, two classes of natural languages of d…
Linguistically Motivated Sign Language Segmentation
Amit Moryossef, Zifan Jiang, Mathias Müller +2
Sign language segmentation is a crucial task in sign language processing systems. It enables downstream tasks such as sign recognition, transcription, and machine translation. In t…
sign.mt: Real-Time Multilingual Sign Language Translation Application
Amit Moryossef
This demo paper presents sign.mt, an open-source application pioneering real-time multilingual bi-directional translation between spoken and signed languages. Harnessing state-of-t…
SignBank+: Preparing a Multilingual Sign Language Dataset for Machine Translation Using Large Language Models
Amit Moryossef, Zifan Jiang
We introduce SignBank+, a clean version of the SignBank dataset, optimized for machine translation between spoken language text and SignWriting, a phonetic sign language writing sy…
An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation
Amit Moryossef, Mathias Müller, Anne Göhring +3
Sign language translation systems are complex and require many components. As a result, it is very hard to compare methods across publications. We present an open-source implementa…
Considerations for meaningful sign language machine translation based on glosses
Mathias Müller, Zifan Jiang, Amit Moryossef +2
Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language…
Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting
Zifan Jiang, Amit Moryossef, Mathias Müller +1
This paper presents work on novel machine translation (MT) systems between spoken and signed languages, where signed languages are represented in SignWriting, a sign language writi…
Data Augmentation for Sign Language Gloss Translation
Amit Moryossef, Kayo Yin, Graham Neubig +1
Sign language translation (SLT) is often decomposed into video-to-gloss recognition and gloss-to-text translation, where a gloss is a sequence of transcribed spoken-language words…
Including Signed Languages in Natural Language Processing
Kayo Yin, Amit Moryossef, Julie Hochgesang +2
Signed languages are the primary means of communication for many deaf and hard of hearing individuals. Since signed languages exhibit all the fundamental linguistic properties of n…
Evaluating the Immediate Applicability of Pose Estimation for Sign Language Recognition
Amit Moryossef, Ioannis Tsochantaridis, Joe Dinn +6
Signed languages are visual languages produced by the movement of the hands, face, and body. In this paper, we evaluate representations based on skeleton poses, as these are explai…
Improving Quality and Efficiency in Plan-based Neural Data-to-Text Generation
Amit Moryossef, Ido Dagan, Yoav Goldberg
We follow the step-by-step approach to neural data-to-text generation we proposed in Moryossef et al (2019), in which the generation process is divided into a text-planning stage f…
Step-by-Step: Separating Planning from Realization in Neural Data-to-Text Generation
Amit Moryossef, Yoav Goldberg, Ido Dagan
Data-to-text generation can be conceptually divided into two parts: ordering and structuring the information (planning), and generating fluent language describing the information (…
Filling Gender & Number Gaps in Neural Machine Translation with Black-box Context Injection
Amit Moryossef, Roee Aharoni, Yoav Goldberg
When translating from a language that does not morphologically mark information such as gender and number into a language that does, translation systems must "guess" this missing i…
ABI Neural Ensemble Model for Gender Prediction Adapt Bar-Ilan Submission for the CLIN29 Shared Task on Gender Prediction
Eva Vanmassenhove, Amit Moryossef, Alberto Poncelas +2
We present our system for the CLIN29 shared task on cross-genre gender detection for Dutch. We experimented with a multitude of neural models (CNN, RNN, LSTM, etc.), more "traditio…