activity
20202024
most citedTaking Notes on the Fly Helps BERT Pre-training

4 citations · 7 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL2024

Word Alignment as Preference for Machine Translation

Qiyu Wu, Masaaki Nagata, Zhongtao Miao +1

The problem of hallucination and omission, a long-standing problem in machine translation (MT), is more pronounced when a large language model (LLM) is used in MT because an LLM it…

cs.CL2024

Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment

Zhongtao Miao, Qiyu Wu, Kaiyan Zhao +2

The field of cross-lingual sentence embeddings has recently experienced significant advancements, but research concerning low-resource languages has lagged due to the scarcity of p…

cs.LG2024

Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding

Guangyi Liu, Yu Wang, Zeyu Feng +9

The vast applications of deep generative models are anchored in three core capabilities -- generating new instances, reconstructing inputs, and learning compact representations --…

cs.LG2024

Reinforcement Learning from Bagged Reward

Yuting Tang, Xin-Qiang Cai, Yao-Xiang Ding +3

In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative reward…

cs.CV2023

Towards reporting bias in visual-language datasets: bimodal augmentation by decoupling object-attribute association

Qiyu Wu, Mengjie Zhao, Yutong He +4

Reporting bias arises when people assume that some knowledge is universally understood and hence, do not necessitate explicit elaboration. In this paper, we focus on the wide exist…

cs.CL2023★ 2 cited

Leveraging Multi-lingual Positive Instances in Contrastive Learning to Improve Sentence Embedding

Kaiyan Zhao, Qiyu Wu, Xin-Qiang Cai +1

Learning multi-lingual sentence embeddings is a fundamental task in natural language processing. Recent trends in learning both mono-lingual and multi-lingual sentence embeddings a…

cs.CL2023

WSPAlign: Word Alignment Pre-training via Large-Scale Weakly Supervised Span Prediction

Qiyu Wu, Masaaki Nagata, Yoshimasa Tsuruoka

Most existing word alignment methods rely on manual alignment datasets or parallel corpora, which limits their usefulness. Here, to mitigate the dependence on manual data, we broad…

cs.CL2022★ 1 cited

PCL: Peer-Contrastive Learning with Diverse Augmentations for Unsupervised Sentence Embeddings

Qiyu Wu, Chongyang Tao, Tao Shen +3

Learning sentence embeddings in an unsupervised manner is fundamental in natural language processing. Recent common practice is to couple pre-trained language models with unsupervi…

cs.CL2020★ 4 cited

Taking Notes on the Fly Helps BERT Pre-training

Qiyu Wu, Chen Xing, Yatao Li +3

How to make unsupervised language pre-training more efficient and less resource-intensive is an important research direction in NLP. In this paper, we focus on improving the effici…