67 citations · 160 across the 25 of their papers we have counts for
25 papers
SeamlessM4T: Massively Multilingual & Multimodal Machine Translation
Seamless Communication, Loïc Barrault, Yu-An Chung +65
What does it take to create the Babel Fish, a tool that can help individuals translate speech between any two languages? While recent breakthroughs in text-based models have pushed…
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations
Paul-Ambroise Duquenne, Hongyu Gong, Ning Dong +7
We present SpeechMatrix, a large-scale multilingual corpus of speech-to-speech translations mined from real speech of European Parliament recordings. It contains speech alignments…
Unified Speech-Text Pre-training for Speech Translation and Recognition
Yun Tang, Hongyu Gong, Ning Dong +8
We describe a method to jointly pre-train speech and text in an encoder-decoder modeling framework for speech translation and recognition. The proposed method incorporates four sel…
Efficient Language Modeling with Sparse all-MLP
Ping Yu, Mikel Artetxe, Myle Ott +4
All-MLP architectures have attracted increasing interest as an alternative to attention-based models. In NLP, recent work like gMLP shows that all-MLPs can match Transformers in la…
Idiomatic Expression Paraphrasing without Strong Supervision
Jianing Zhou, Ziheng Zeng, Hongyu Gong +1
Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a senten…
Textless Speech-to-Speech Translation on Real Data
Ann Lee, Hongyu Gong, Paul-Ambroise Duquenne +8
We present a textless speech-to-speech translation (S2ST) system that can translate speech from one language into another language and can be built without the need of any text dat…
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task
Yun Tang, Hongyu Gong, Xian Li +4
In this paper, we describe our end-to-end multilingual speech translation system submitted to the IWSLT 2021 evaluation campaign on the Multilingual Speech Translation shared task.…
Pay Better Attention to Attention: Head Selection in Multilingual and Multi-Domain Sequence Modeling
Hongyu Gong, Yun Tang, Juan Pino +1
Multi-head attention has each of the attention heads collect salient information from different parts of an input sequence, making it a powerful mechanism for sequence modeling. Mu…
LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models
Hongyu Gong, Vishrav Chaudhary, Yuqing Tang +1
Cross-lingual document representations enable language understanding in multilingual contexts and allow transfer learning from high-resource to low-resource languages at the docume…
Abusive Language Detection in Heterogeneous Contexts: Dataset Collection and the Role of Supervised Attention
Hongyu Gong, Alberto Valido, Katherine M. Ingram +3
Abusive language is a massive problem in online social platforms. Existing abusive language detection techniques are particularly ill-suited to comments containing heterogeneous ab…
From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation
Jianing Zhou, Hongyu Gong, Srihari Nanniyur +1
We study a new application for text generation -- idiomatic sentence generation -- which aims to transfer literal phrases in sentences into their idiomatic counterparts. Inspired b…
Robust Optimization for Multilingual Translation with Imbalanced Data
Xian Li, Hongyu Gong
Multilingual models are parameter-efficient and especially effective in improving low-resource languages by leveraging crosslingual transfer. Despite recent advance in massive mult…
Adaptive Sparse Transformer for Multilingual Translation
Hongyu Gong, Xian Li, Dmitriy Genzel
Multilingual machine translation has attracted much attention recently due to its support of knowledge transfer among languages and the low cost of training and deployment compared…
Self-Supervised Euphemism Detection and Identification for Content Moderation
Wanzheng Zhu, Hongyu Gong, Rohan Bansal +4
Fringe groups and organizations have a long history of using euphemisms--ordinary-sounding words with a secret meaning--to conceal what they are discussing. Nowadays, one common us…
Enriching Word Embeddings with Temporal and Spatial Information
Hongyu Gong, Suma Bhat, Pramod Viswanath
The meaning of a word is closely linked to sociocultural factors that can change over time and location, resulting in corresponding meaning changes. Taking a global view of words a…
Recurrent Chunking Mechanisms for Long-Text Machine Reading Comprehension
Hongyu Gong, Yelong Shen, Dian Yu +2
In this paper, we study machine reading comprehension (MRC) on long texts, where a model takes as inputs a lengthy document and a question and then extracts a text span from the do…
FUSE: Multi-Faceted Set Expansion by Coherent Clustering of Skip-grams
Wanzheng Zhu, Hongyu Gong, Jiaming Shen +4
Set expansion aims to expand a small set of seed entities into a complete set of relevant entities. Most existing approaches assume the input seed set is unambiguous and completely…
PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space
Omer Anjum, Hongyu Gong, Suma Bhat +2
Finding the right reviewers to assess the quality of conference submissions is a time consuming process for conference organizers. Given the importance of this step, various automa…
WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipedia
Holger Schwenk, Vishrav Chaudhary, Shuo Sun +2
We present an approach based on multilingual sentence embeddings to automatically extract parallel sentences from the content of Wikipedia articles in 85 languages, including sever…
Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus
Hongyu Gong, Suma Bhat, Lingfei Wu +2
Text style transfer rephrases a text from a source style (e.g., informal) to a target style (e.g., formal) while keeping its original meaning. Despite the success existing works ha…
Document Similarity for Texts of Varying Lengths via Hidden Topics
Hongyu Gong, Tarek Sakakini, Suma Bhat +1
Measuring similarity between texts is an important task for several applications. Available approaches to measure document similarity are inadequate for document pairs that have no…
Context-Sensitive Malicious Spelling Error Correction
Hongyu Gong, Yuchen Li, Suma Bhat +1
Misspelled words of the malicious kind work by changing specific keywords and are intended to thwart existing automated applications for cyber-environment control such as harassing…
Embedding Syntax and Semantics of Prepositions via Tensor Decomposition
Hongyu Gong, Suma Bhat, Pramod Viswanath
Prepositions are among the most frequent words in English and play complex roles in the syntax and semantics of sentences. Not surprisingly, they pose well-known difficulties in au…
Prepositions in Context
Hongyu Gong, Jiaqi Mu, Suma Bhat +1
Prepositions are highly polysemous, and their variegated senses encode significant semantic information. In this paper we match each preposition's complement and attachment and the…