activity
20112023
most citedERNIE: Enhanced Language Representation with Informative Entities

135 citations · 839 across the 29 of their papers we have counts for

collaborators

29 papers

cs.AI2023★ 4 cited

Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis

Li Du, Yequan Wang, Xingrun Xing +4

Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. T…

cs.CL2023★ 2 cited

FLM-101B: An Open LLM and How to Train It with $100K Budget

Xiang Li, Yiqun Yao, Xin Jiang +10

Large language models (LLMs) are considered important approaches towards foundational machine intelligence, achieving remarkable success in Natural Language Processing and multimod…

cs.CL2023

CAME: Confidence-guided Adaptive Memory Efficient Optimization

Yang Luo, Xiaozhe Ren, Zangwei Zheng +3

Adaptive gradient methods, such as Adam and LAMB, have demonstrated excellent performance in the training of large language models. Nevertheless, the need for adaptivity requires m…

cs.CL2023★ 9 cited

Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline

Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue +3

Large language models (LLMs) have revolutionized the field of AI, demonstrating unprecedented capacity across various tasks. However, the inference process for LLMs comes with sign…

cs.CL2023

FreeLM: Fine-Tuning-Free Language Model

Xiang Li, Xin Jiang, Xuying Meng +2

Pre-trained language models (PLMs) have achieved remarkable success in NLP tasks. Despite the great success, mainstream solutions largely follow the pre-training then finetuning pa…

cs.LG2022★ 4 cited

Boosting Graph Structure Learning with Dummy Nodes

Xin Liu, Jiayang Cheng, Yangqiu Song +1

With the development of graph kernels and graph representation learning, many superior methods have been proposed to handle scalability and oversmoothing issues on graph structure…