9 papers
MultiCube-RAG for Multi-hop Question Answering
Jimeng Shi, Wei Hu, Runchu Tian +8
Multi-hop question answering (QA) necessitates multi-step reasoning and retrieval across interconnected subjects, attributes, and relations. Existing retrieval-augmented generation…
Steer2Adapt: Dynamically Composing Steering Vectors Elicits Efficient Adaptation of LLMs
Pengrui Han, Xueqiang Xu, Keyang Xuan +12
Activation steering has emerged as a promising approach for efficiently adapting large language models (LLMs) to downstream behaviors. However, most existing steering methods rely…
PairSem: LLM-Guided Pairwise Semantic Matching for Scientific Document Retrieval
Wonbin Kweon, Runchu Tian, SeongKu Kang +4
Scientific document retrieval is a critical task for enabling knowledge discovery and supporting research across diverse domains. However, existing dense retrieval methods often st…
Finish First, Perfect Later: Test-Time Token-Level Cross-Validation for Diffusion Large Language Models
Runchu Tian, Junxia Cui, Xueqiang Xu +2
Diffusion large language models (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) models, offering advantages such as accelerated parallel decoding an…
Topic Coverage-based Demonstration Retrieval for In-Context Learning
Wonbin Kweon, SeongKu Kang, Runchu Tian +3
The effectiveness of in-context learning relies heavily on selecting demonstrations that provide all the necessary information for a given test input. To achieve this, it is crucia…
A Survey on Retrieval And Structuring Augmented Generation with Large Language Models
Pengcheng Jiang, Siru Ouyang, Yizhu Jiao +3
Large Language Models (LLMs) have revolutionized natural language processing with their remarkable capabilities in text generation and reasoning. However, these models face critica…