4 papers · 1 filter
Prompt and Parameter Co-Optimization for Large Language Models
Xiaohe Bo, Rui Li, Zexu Sun +5
Prompt optimization and fine-tuning are two major approaches to improve the performance of Large Language Models (LLMs). They enhance the capabilities of LLMs from complementary pe…
HAPS: Hierarchical LLM Routing with Joint Architecture and Parameter Search
Zihang Tian, Rui Li, Jingsen Zhang +3
Large language model (LLM) routing aims to exploit the specialized strengths of different LLMs for diverse tasks. However, existing approaches typically focus on selecting LLM arch…
CAM: A Constructivist View of Agentic Memory for LLM-Based Reading Comprehension
Rui Li, Zeyu Zhang, Xiaohe Bo +5
Current Large Language Models (LLMs) are confronted with overwhelming information volume when comprehending long-form documents. This challenge raises the imperative of a cohesive…
KnowTrace: Bootstrapping Iterative Retrieval-Augmented Generation with Structured Knowledge Tracing
Rui Li, Quanyu Dai, Zeyu Zhang +3
Recent advances in retrieval-augmented generation (RAG) furnish large language models (LLMs) with iterative retrievals of relevant information to handle complex multi-hop questions…