activity
20212026
most citedConnecting Multi-modal Contrastive Representations

13 citations · 27 across the 11 of their papers we have counts for

collaborators
Showing 2023Show all

8 papers · 1 filter

cs.SD2023

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation

Xize Cheng, Rongjie Huang, Linjun Li +7

Direct speech-to-speech translation achieves high-quality results through the introduction of discrete units obtained from self-supervised learning. This approach circumvents delay…

cs.CL2023

Language Model is a Branch Predictor for Simultaneous Machine Translation

Aoxiong Yin, Tianyun Zhong, Haoyuan Li +2

The primary objective of simultaneous machine translation (SiMT) is to minimize latency while preserving the quality of the final translation. Drawing inspiration from CPU branch p…

cs.AI2023★ 3 cited

TrainerAgent: Customizable and Efficient Model Training through LLM-Powered Multi-Agent System

Haoyuan Li, Hao Jiang, Tianke Zhang +6

Training AI models has always been challenging, especially when there is a need for custom models to provide personalized services. Algorithm engineers often face a lengthy process…

cs.CV2023

3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding

Zehan Wang, Haifeng Huang, Yang Zhao +5

3D visual grounding aims to localize the target object in a 3D point cloud by a free-form language description. Typically, the sentences describing the target object tend to provid…

cs.CV2023★ 1 cited

Distilling Coarse-to-Fine Semantic Matching Knowledge for Weakly Supervised 3D Visual Grounding

Zehan Wang, Haifeng Huang, Yang Zhao +5

3D visual grounding involves finding a target object in a 3D scene that corresponds to a given sentence query. Although many approaches have been proposed and achieved impressive p…

cs.CV2023★ 2 cited

Gloss Attention for Gloss-free Sign Language Translation

Aoxiong Yin, Tianyun Zhong, Li Tang +3

Most sign language translation (SLT) methods to date require the use of gloss annotations to provide additional supervision information, however, the acquisition of gloss is not ea…

cs.LG2023★ 13 cited

Connecting Multi-modal Contrastive Representations

Zehan Wang, Yang Zhao, Xize Cheng +8

Multi-modal Contrastive Representation learning aims to encode different modalities into a semantically aligned shared space. This paradigm shows remarkable generalization ability…

cs.CV2023★ 8 cited

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition

Xize Cheng, Linjun Li, Tao Jin +7

Multi-media communications facilitate global interaction among people. However, despite researchers exploring cross-lingual translation techniques such as machine translation and a…