3 citations · 11 across the 16 of their papers we have counts for
4 papers · 1 filter
Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval
Guangyuan Ma, Yongliang Ma, Xing Wu +3
Large Language Model-based Dense Retrieval (LLM-DR) optimizes over numerous heterogeneous fine-tuning collections from different domains. However, the discussion about its training…
Drop your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval
Guangyuan Ma, Xing Wu, Zijia Lin +1
Masked auto-encoder pre-training has emerged as a prevalent technique for initializing and enhancing dense retrieval systems. It generally utilizes additional Transformer decoder b…
Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrieval
Guangyuan Ma, Xing Wu, Peng Wang +2
In this paper, we systematically study the potential of pre-training with Large Language Model(LLM)-based document expansion for dense passage retrieval. Concretely, we leverage th…
PUNR: Pre-training with User Behavior Modeling for News Recommendation
Guangyuan Ma, Hongtao Liu, Xing Wu +4
News recommendation aims to predict click behaviors based on user behaviors. How to effectively model the user representations is the key to recommending preferred news. Existing w…