2 papers
cs.CL2023
Translatotron 3: Speech to Speech Translation with Monolingual Data
Eliya Nachmani, Alon Levkovitch, Yifan Ding +3
This paper presents Translatotron 3, a novel approach to unsupervised direct speech-to-speech translation from monolingual speech-text datasets by combining masked autoencoder, uns…
cs.CL2023
Spoken Question Answering and Speech Continuation Using Spectrogram-Powered LLM
Eliya Nachmani, Alon Levkovitch, Roy Hirsch +6
We present Spectron, a novel approach to adapting pre-trained large language models (LLMs) to perform spoken question answering (QA) and speech continuation. By endowing the LLM wi…