5 papers
Pre-trained Models Perform the Best When Token Distributions Follow Zipf's Law
Yanjin He, Qingkai Zeng, Meng Jiang
Tokenization is a fundamental step in natural language processing (NLP) and other sequence modeling domains, where the choice of vocabulary size significantly impacts model perform…
Amplifying Your Social Media Presence: Personalized Influential Content Generation with LLMs
Yuying Zhao, Yu Wang, Xueqi Cheng +5
The remarkable advancements in Large Language Models (LLMs) have revolutionized the content generation process in social media, offering significant convenience in writing tasks. H…
Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Survey
Bo Ni, Zheyuan Liu, Leyao Wang +17
Retrieval-Augmented Generation (RAG) is an advanced technique designed to address the challenges of Artificial Intelligence-Generated Content (AIGC). By integrating context retriev…
Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models
Zheyuan Liu, Guangyao Dou, Xiangchi Yuan +3
Generative models such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) trained on massive datasets can lead them to memorize and inadvertently reveal s…
Can Large Language Models Understand Preferences in Personalized Recommendation?
Zhaoxuan Tan, Zinan Zeng, Qingkai Zeng +4
Large Language Models (LLMs) excel in various tasks, including personalized recommendations. Existing evaluation methods often focus on rating prediction, relying on regression err…