From the 1 of 5 linked papers with an AI index.
5 papers
Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs
Serpil Karabüklü, Kanishka Misra, Shester Gueuwou +3
The paper presents ASL Minimal Translation Pairs (ASL-MTP), a benchmark of minimal translation pairs covering various linguistic phenomena in American Sign Language, and uses it to…
Cross-Modal Taxonomic Generalization in (Vision-) Language Models
Tianyang Xu, Marcelo Sandoval-Castaneda, Karen Livescu +2
What is the interplay between semantic representations learned by language models (LM) from surface form alone to those learned from more grounded evidence? We study this question…
EditDuet: A Multi-Agent System for Video Non-Linear Editing
Marcelo Sandoval-Castaneda, Bryan Russell, Josef Sivic +2
Automated tools for video editing and assembly have applications ranging from filmmaking and advertisement to content creation for social media. Previous video editing work has mai…
SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich +2
Sign language processing has traditionally relied on task-specific models, limiting the potential for transfer learning across tasks. Pre-training methods for sign language have ty…
SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale
Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich +1
A persistent challenge in sign language video processing, including the task of sign to written language translation, is how we learn representations of sign language in an effecti…