activity
20212023
most citedRetentive Network: A Successor to Transformer for Large Language Models

109 citations · 140 across the 9 of their papers we have counts for

collaborators

9 papers

cs.CL2023★ 109 cited

Retentive Network: A Successor to Transformer for Large Language Models

Yutao Sun, Li Dong, Shaohan Huang +5

In this work, we propose Retentive Network (RetNet) as a foundation architecture for large language models, simultaneously achieving training parallelism, low-cost inference, and g…

cs.IR2023★ 1 cited

Knowledge-aware Collaborative Filtering with Pre-trained Language Model for Personalized Review-based Rating Prediction

Quanxiu Wang, Xinlei Cao, Jianyong Wang +1

Personalized review-based rating prediction aims at leveraging existing reviews to model user interests and item characteristics for rating prediction. Most of the existing studies…

cs.CL2023★ 9 cited

FlexKBQA: A Flexible LLM-Powered Framework for Few-Shot Knowledge Base Question Answering

Zhenyu Li, Sunqi Fan, Yu Gu +5

Knowledge base question answering (KBQA) is a critical yet challenging task due to the vast number of entities within knowledge bases and the diversity of natural language question…

cs.CL2023★ 1 cited

Bridging the Language Gap: Knowledge Injected Multilingual Question Answering

Zhichao Duan, Xiuxing Li, Zhengyan Zhang +3

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractiv…

cs.CL2022★ 1 cited

Optimization Techniques for Unsupervised Complex Table Reasoning via Self-Training Framework

Zhenyu Li, Xiuxing Li, Sunqi Fan +1

Structured tabular data is a fundamental data type in numerous fields, and the capacity to reason over tables is crucial for answering questions and validating hypotheses. However,…

cs.CL2022

Not Just Plain Text! Fuel Document-Level Relation Extraction with Explicit Syntax Refinement and Subsentence Modeling

Zhichao Duan, Xiuxing Li, Zhenyu Li +2

Document-level relation extraction (DocRE) aims to identify semantic labels among entities within a single document. One major challenge of DocRE is to dig decisive details regardi…

cs.CL2022★ 1 cited

Effective Few-Shot Named Entity Linking by Meta-Learning

Xiuxing Li, Zhenyu Li, Zhengyan Zhang +5

Entity linking aims to link ambiguous mentions to their corresponding entities in a knowledge base, which is significant and fundamental for various downstream applications, e.g.,…

cs.CL2022

Prompt Tuning for Discriminative Pre-trained Language Models

Yuan Yao, Bowen Dong, Ao Zhang +6

Recent works have shown promising results of prompt tuning in stimulating pre-trained language models (PLMs) for natural language processing (NLP) tasks. However, to the best of ou…

cs.LG2021★ 18 cited

Data-Free Knowledge Transfer: A Survey

Yuang Liu, Wei Zhang, Jun Wang +1

In the last decade, many deep learning models have been well trained and made a great success in various fields of machine intelligence, especially for computer vision and natural…