338 citations · 454 across the 70 of their papers we have counts for
6 papers · 2 filters
LLM Cache Bandit Revisited: Addressing Query Heterogeneity for Cost-Effective LLM Inference
Hantao Yang, Hong Xie, Defu Lian +1
This paper revisits the LLM cache bandit problem, with a special focus on addressing the query heterogeneity for cost-effective LLM inference. Previous works often assume uniform q…
CoSteer: Collaborative Decoding-Time Personalization via Local Delta Steering
Hang Lv, Sheng Liang, Hao Wang +6
Personalization has become crucial for adapting models to the diverse and evolving needs of users across cultural, temporal, and contextual dimensions. While existing methods often…
Thought-Augmented Planning for LLM-Powered Interactive Recommender Agent
Haocheng Yu, Yaxiong Wu, Hao Wang +6
Interactive recommendation is a typical information-seeking task that allows users to interactively express their needs through natural language and obtain personalized recommendat…
Prompting is not Enough: Exploring Knowledge Integration and Controllable Generation
Tingjia Shen, Hao Wang, Chuan Qin +5
Open-domain question answering (OpenQA) represents a cornerstone in natural language processing (NLP), primarily focused on extracting answers from unstructured textual data. With…
RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discovery
Hongchao Gu, Dexun Li, Kuicai Dong +6
Generating knowledge-intensive and comprehensive long texts, such as encyclopedia articles, remains significant challenges for Large Language Models. It requires not only the preci…
Learning to Substitute Components for Compositional Generalization
Zhaoyi Li, Gangwei Jiang, Chenwang Wu +3
Despite the rising prevalence of neural language models, recent empirical evidence suggests their deficiency in compositional generalization. One of the current de-facto solutions…