4 papers
LA-Sign: Looped Transformers with Geometry-aware Alignment for Skeleton-based Sign Language Recognition
Muxin Pu, Mei Kuan Lim, Chun Yong Chong +1
Skeleton-based isolated sign language recognition (ISLR) demands fine-grained understanding of articulated motion across multiple spatial scales, from subtle finger movements to gl…
SignDPO: Multi-level Direct Preference Optimisation for Skeleton-based Gloss-free Sign Language Translation
Muxin Pu, Xiao-Ming Wu, Mei Kuan Lim +3
We present SignDPO, a novel multi-level Direct Preference Optimisation (DPO) framework designed to enhance the alignment of skeleton-based Sign Language Translation. While current…
Sigma: Semantically Informative Pre-training for Skeleton-based Sign Language Understanding
Muxin Pu, Mei Kuan Lim, Chun Yong Chong +1
Pre-training has proven effective for learning transferable features in sign language understanding (SLU) tasks. Recently, skeleton-based methods have gained increasing attention b…
Siformer: Feature-isolated Transformer for Efficient Skeleton-based Sign Language Recognition
Muxin Pu, Mei Kuan Lim, Chun Yong Chong
Sign language recognition (SLR) refers to interpreting sign language glosses from given videos automatically. This research area presents a complex challenge in computer vision bec…