11 papers
SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation
Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden
Sign language translation (SLT) remains challenging due to its high spatio-temporal complexity, long sequences, and the need to model multiple articulators without relying on gloss…
SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning
Jianhe Low, Alexandre Symeonidis-Herzig, Maksym Ivashechkin +2
Sign Language Production (SLP) faces a fundamental trade-off: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionary-retrieval methods produce disj…
SAGE: Segment-Aware Gloss-Free Encoding for Token-Efficient Sign Language Translation
JianHe Low, Ozge Mercanoglu Sincan, Richard Bowden
Gloss-free Sign Language Translation (SLT) has advanced rapidly, achieving strong performances without relying on gloss annotations. However, these gains have often come with incre…
Hands-On: Segmenting Individual Signs from Continuous Sequences
JianHe Low, Harry Walsh, Ozge Mercanoglu Sincan +1
This work tackles the challenge of continuous sign language segmentation, a key task with huge implications for sign language translation and data annotation. We propose a transfor…
M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production
Alexandre Symeonidis-Herzig, Jianhe Low, Ozge Mercanoglu Sincan +1
Sign language production requires more than hand motion generation. Non-manual features, including mouthings, eyebrow raises, gaze, and head movements, are grammatically obligatory…
SignAgent: Agentic LLMs for Linguistically-Grounded Sign Language Annotation and Dataset Curation
Oliver Cory, Ozge Mercanoglu Sincan, Richard Bowden
This paper introduces SignAgent, a novel agentic framework that utilises Large Language Models (LLMs) for scalable, linguistically-grounded Sign Language (SL) annotation and datase…