3 papers
cs.CL2025
Lookahead Routing for Large Language Models
Canbin Huang, Tianyuan Shi, Yuhua Zhu +2
Large language model (LLM) routers improve the efficiency of multi-model systems by directing each query to the most appropriate model while leveraging the diverse strengths of het…
cs.CL2025
PsyPlay: Personality-Infused Role-Playing Conversational Agents
Tao Yang, Yuhua Zhu, Xiaojun Quan +2
The current research on Role-Playing Conversational Agents (RPCAs) with Large Language Models (LLMs) primarily focuses on imitating specific speaking styles and utilizing character…
cs.AR2024
Efficient LLM inference solution on Intel GPU
Hui Wu, Yi Gan, Feng Yuan +8
Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are u…