36 citations · 93 across the 11 of their papers we have counts for
5 papers · 1 filter
A Simple and Effective Method To Eliminate the Self Language Bias in Multilingual Representations
Ziyi Yang, Yinfei Yang, Daniel Cer +1
Language agnostic and semantic-language information isolation is an emerging research direction for multilingual representations models. We explore this problem from a novel angle…
Universal Sentence Representation Learning with Conditional Masked Language Model
Ziyi Yang, Yinfei Yang, Daniel Cer +2
This paper presents a novel training method, Conditional Masked Language Modeling (CMLM), to effectively learn sentence representations on large scale unlabeled corpora. CMLM integ…
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
Ziyi Yang, Chenguang Zhu, Robert Gmyr +3
Text summarization aims to extract essential information from a piece of text and transform the text into a concise version. Existing unsupervised abstractive summarization models…
Out-of-Vocabulary Embedding Imputation with Grounded Language Information by Graph Convolutional Networks
Ziyi Yang, Chenguang Zhu, Vin Sachidananda +1
Due to the ubiquitous use of embeddings as input representations for a wide range of natural language tasks, imputation of embeddings for rare and unseen words is a critical proble…
Parameter-free Sentence Embedding via Orthogonal Basis
Ziyi Yang, Chenguang Zhu, Weizhu Chen
We propose a simple and robust non-parameterized approach for building sentence representations. Inspired by the Gram-Schmidt Process in geometric theory, we build an orthogonal ba…