From the 1 of 3 linked papers with an AI index.
3 papers
Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs
Serpil Karabüklü, Kanishka Misra, Shester Gueuwou +3
The paper presents ASL Minimal Translation Pairs (ASL-MTP), a benchmark of minimal translation pairs covering various linguistic phenomena in American Sign Language, and uses it to…
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich +2
Sign language processing has traditionally relied on task-specific models, limiting the potential for transfer learning across tasks. Pre-training methods for sign language have ty…
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich +1
A persistent challenge in sign language video processing, including the task of sign to written language translation, is how we learn representations of sign language in an effecti…