3 papers
cs.CL2024
Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks
Chien-yu Huang, Wei-Chih Chen, Shu-wen Yang +77
Multimodal foundation models, such as Gemini and ChatGPT, have revolutionized human-machine interactions by seamlessly integrating various forms of data. Developing a universal spo…
cs.MM2024
Diverse Sign Language Translation
Xin Shen, Lei Shen, Shaozu Yuan +3
Like spoken languages, a single sign language expression could correspond to multiple valid textual interpretations. Hence, learning a rigid one-to-one mapping for sign language tr…
cs.CL2024
Unifying Structured Data as Graph for Data-to-Text Pre-Training
Shujie Li, Liang Li, Ruiying Geng +8
Data-to-text (D2T) generation aims to transform structured data into natural language text. Data-to-text pre-training has proved to be powerful in enhancing D2T generation and yiel…