5 papers
OneSign: Unifying Sign Language Understanding Tasks with One Model
Shiwei Gan, Yafeng Yin, Xiao Liu +3
SLU encompasses a diverse set of tasks, including ISLR, CSLR, and SLT. Although these tasks share basic semantic and linguistic foundations, they are typically addressed with task-…
Bridging the Gap Between Semantics and Reconstruction:Unifying Sign Language Translation and Production
Xiao Liu, Shiwei Gan, Yafeng Yin +5
Recent advances in sign language (SL) research have shown a trend toward unifying multiple sign language understanding (SLU) subtasks, such as isolated sign language recognition (I…
SignLlama: Enhancing Gloss-free Sign Language Translation by Prioritizing Visual Features for LLMs
Shiwei Gan, Xiao Liu, Yafeng Yin +5
Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks. However, fine-tuning LLMs for Gloss-Free Sign Language Translation (GFSLT) remains a cha…
Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understanding
Shiwei Gan, Lichen Wang, Xiao Liu +4
Recent advances in sign language (SL) understanding (SLU) have led to remarkable progress in tasks such as continuous SL recognition and SL translation. However, these tasks are de…
InfoMerge: Information-aware Token Compression for Efficient Video Large Language Models
Xinxin Liu, Shiwei Gan, Xiao Liu +3
Video Large Language Models (Video-LLMs) achieve strong performance in video understanding, but their excessive visual tokens bring substantial computational overhead. Existing tra…