5 papers
Search for Truth from Reasoning: A Dynamic Representation Editing Framework for Steering LLM Trajectories
Tianlong Wang, Yuhang Wang, Weibin Liao +5
Current approaches to enhance Large Language Model (LLM) reasoning, such as Chain-of-Thought and "Wait" prompts, primarily encourage models to think more, yet often fail to guide t…
LearNAT: Learning NL2SQL with AST-guided Task Decomposition for Large Language Models
Weibin Liao, Xin Gao, Tianyu Jia +6
Natural Language to SQL (NL2SQL) aims to translate natural language queries into executable SQL statements, offering non-expert users intuitive access to databases. While recent ap…
DRESSing Up LLM: Efficient Stylized Question-Answering via Style Subspace Editing
Xinyu Ma, Yifeng Xu, Yang Lin +5
We introduce DRESS, a novel approach for generating stylized large language model (LLM) responses through representation editing. Existing methods like prompting and fine-tuning ar…
Enhancing Topic Interpretability for Neural Topic Modeling through Topic-wise Contrastive Learning
Xin Gao, Yang Lin, Ruiqing Li +4
Data mining and knowledge discovery are essential aspects of extracting valuable insights from vast datasets. Neural topic models (NTMs) have emerged as a valuable unsupervised too…
Parameter Efficient Quasi-Orthogonal Fine-Tuning via Givens Rotation
Xinyu Ma, Xu Chu, Zhibang Yang +3
With the increasingly powerful performances and enormous scales of pretrained models, promoting parameter efficiency in fine-tuning has become a crucial need for effective and effi…