416 citations · 1k across the 55 of their papers we have counts for
56 papers
Hypertext Entity Extraction in Webpage
Yifei Yang, Tianqiao Liu, Bo Shao +4
Webpage entity extraction is a fundamental natural language processing task in both research and applications. Nowadays, the majority of webpage entity extraction models are traine…
Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
Nuo Chen, Ning Wu, Shining Liang +4
This paper presents an in-depth analysis of Large Language Models (LLMs), focusing on LLaMA, a prominent open-source foundational model in natural language processing. Instead of a…
Coherent Entity Disambiguation via Modeling Topic and Categorical Dependency
Zilin Xiao, Linjun Shou, Xingyao Zhang +4
Previous entity disambiguation (ED) methods adopt a discriminative paradigm, where prediction is made based on matching scores between mention context and candidate entities using…
Instructed Language Models with Retrievers Are Powerful Entity Linkers
Zilin Xiao, Ming Gong, Jie Wu +4
Generative approaches powered by large language models (LLMs) have demonstrated emergent abilities in tasks that require complex reasoning abilities. Yet the generative nature stil…
Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations
Nuo Chen, Zinan Zheng, Ning Wu +3
Existing research predominantly focuses on developing powerful language learning models (LLMs) for mathematical reasoning within monolingual languages, with few explorations in pre…
RUEL: Retrieval-Augmented User Representation with Edge Browser Logs for Sequential Recommendation
Ning Wu, Ming Gong, Linjun Shou +2
Online recommender systems (RS) aim to match user needs with the vast amount of resources available on various platforms. A key challenge is to model user preferences accurately un…
DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory
Shengming Yin, Chenfei Wu, Jian Liang +4
Controllable video generation has gained significant attention in recent years. However, two main limitations persist: Firstly, most existing works focus on either text, image, or…
Alleviating Over-smoothing for Unsupervised Sentence Representation
Nuo Chen, Linjun Shou, Ming Gong +5
Currently, learning better unsupervised sentence representations is the pursuit of many natural language processing communities. Lots of approaches based on pre-trained language mo…
Typos-aware Bottlenecked Pre-Training for Robust Dense Retrieval
Shengyao Zhuang, Linjun Shou, Jian Pei +4
Current dense retrievers (DRs) are limited in their ability to effectively process misspelled queries, which constitute a significant portion of query traffic in commercial search…
TaskMatrix.AI: Completing Tasks by Connecting Foundation Models with Millions of APIs
Yaobo Liang, Chenfei Wu, Ting Song +11
Artificial Intelligence (AI) has made incredible progress recently. On the one hand, advanced foundation models like ChatGPT can offer powerful conversation, in-context learning an…
Empowering Dual-Encoder with Query Generator for Cross-Lingual Dense Retrieval
Houxing Ren, Linjun Shou, Ning Wu +2
In monolingual dense retrieval, lots of works focus on how to distill knowledge from cross-encoder re-ranker to dual-encoder retriever and these methods achieve better performance…
Lexicon-Enhanced Self-Supervised Training for Multilingual Dense Retrieval
Houxing Ren, Linjun Shou, Jian Pei +3
Recent multilingual pre-trained models have shown better performance in various multilingual tasks. However, these models perform poorly on multilingual retrieval tasks due to lack…
Large Language Models are Diverse Role-Players for Summarization Evaluation
Ning Wu, Ming Gong, Linjun Shou +2
Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluat…
Bridge the Gap between Language models and Tabular Understanding
Nuo Chen, Linjun Shou, Ming Gong +5
Table pretrain-then-finetune paradigm has been proposed and employed at a rapid pace after the success of pre-training in the natural language domain. Despite the promising finding…
Modeling Sequential Sentence Relation to Improve Cross-lingual Dense Retrieval
Shunyu Zhang, Yaobo Liang, Ming Gong +2
Recently multi-lingual pre-trained language models (PLM) such as mBERT and XLM-R have achieved impressive strides in cross-lingual dense retrieval. Despite its successes, they are…
Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA
Junjie Huang, Wanjun Zhong, Qian Liu +3
Retrieving evidences from tabular and textual resources is essential for open-domain question answering (OpenQA), which provides more comprehensive information. However, training a…
Unsupervised Context Aware Sentence Representation Pretraining for Multi-lingual Dense Retrieval
Ning Wu, Yaobo Liang, Houxing Ren +4
Recent research demonstrates the effectiveness of using pretrained language models (PLM) to improve dense retrieval and multilingual dense retrieval. In this work, we present a sim…
Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generation
Shengyao Zhuang, Houxing Ren, Linjun Shou +4
The Differentiable Search Index (DSI) is an emerging paradigm for information retrieval. Unlike traditional retrieval architectures where index and retrieval are two different and…
Negative Sampling for Contrastive Representation Learning: A Review
Lanling Xu, Jianxun Lian, Wayne Xin Zhao +5
The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great succe…
Label-aware Multi-level Contrastive Learning for Cross-lingual Spoken Language Understanding
Shining Liang, Linjun Shou, Jian Pei +4
Despite the great success of spoken language understanding (SLU) in high-resource languages, it remains challenging in low-resource languages mainly due to the lack of labeled trai…
Bridging the Gap between Language Models and Cross-Lingual Sequence Labeling
Nuo Chen, Linjun Shou, Ming Gong +2
Large-scale cross-lingual pre-trained language models (xPLMs) have shown effectiveness in cross-lingual sequence labeling tasks (xSL), such as cross-lingual machine reading compreh…
Transformer-Empowered Content-Aware Collaborative Filtering
Weizhe Lin, Linjun Shou, Ming Gong +4
Knowledge graph (KG) based Collaborative Filtering is an effective approach to personalizing recommendation systems for relatively static domains such as movies and books, by lever…
Multi-View Document Representation Learning for Open-Domain Dense Retrieval
Shunyu Zhang, Yaobo Liang, Ming Gong +2
Dense retrieval has achieved impressive advances in first-stage retrieval from a large-scale document collection, which is built on bi-encoder architecture to produce single vector…
From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension
Nuo Chen, Linjun Shou, Min Gong +2
Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a reso…