70 citations · 92 across the 8 of their papers we have counts for
9 papers
QAM: Quadratic-Accurate Checkpoint Merging via Sequential Consistency
Shihao Wang, Rui Kong, Xinran Chen +7
Saved checkpoints record states along a training trajectory, but generally do not determine the updates at states that would be visited under a different schedule. We study how acc…
Measuring Maximum Activations in Open Large Language Models
Luxuan Chen, Han Tian, Xinran Chen +9
The dynamic range of activations is a first-order constraint for low-bit quantization, activation scaling, and stable LLM inference. Prior work characterized outlier features and m…
RAG-Enhanced Large Language Models for Dynamic Content Expiration Prediction in Web Search
Tingyu Chen, Wenkai Zhang, Li Gao +4
In commercial web search, aligning content freshness with user intent remains challenging due to the highly varied lifespans of information. Traditional industrial approaches rely…
EndPrompt: Efficient Long-Context Extension via Terminal Anchoring
Han Tian, Luxuan Chen, Xinran Chen +10
Extending the context window of large language models typically requires training on sequences at the target length, incurring quadratic memory and computational costs that make lo…
Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with LLMs
Jiani Huang, Shijie Wang, Liang-bo Ning +4
Recommender systems (RecSys) are widely used across various modern digital platforms and have garnered significant attention. Traditional recommender systems usually focus only on…
Knowledge Graph Retrieval-Augmented Generation for LLM-based Recommendation
Shijie Wang, Wenqi Fan, Yue Feng +4
Recommender systems have become increasingly vital in our daily lives, helping to alleviate the problem of information overload across various user-oriented online services. The em…
A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models
Wenqi Fan, Yujuan Ding, Liangbo Ning +5
As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tas…
A Survey of Large Language Models for Graphs
Xubin Ren, Jiabin Tang, Dawei Yin +2
Graphs are an essential data structure utilized to represent relationships in real-world scenarios. Prior research has established that Graph Neural Networks (GNNs) deliver impress…
Graph Machine Learning in the Era of Large Language Models (LLMs)
Shijie Wang, Jiani Huang, Zhikai Chen +8
Graphs play an important role in representing complex relationships in various domains like social networks, knowledge graphs, and molecular discovery. With the advent of deep lear…