6 papers · 1 filter
SAEExplainer: Interpreting SAE Features with Activation-Guided Preference Optimization
Jingyi He, Haiyan Zhao, Ruxue Shi +4
Although Sparse Autoencoders (SAEs) have mitigated the opacity of large language models (LLMs) by decomposing dense representations into sparse features, explaining these features…
FinAnchor: Aligned Multi-Model Representations for Financial Prediction
Zirui He, Huopu Zhang, Yanguang Liu +2
Financial prediction from long documents involves significant challenges, as actionable signals are often sparse and obscured by noise, and the optimal LLM for generating embedding…
Improving LLM Reasoning through Interpretable Role-Playing Steering
Anyi Wang, Dong Shu, Yifan Wang +2
Role-playing has emerged as an effective technique for enhancing the reasoning capabilities of large language models (LLMs). However, existing methods primarily rely on prompt engi…
DBR: Divergence-Based Regularization for Debiasing Natural Language Understanding Models
Zihao Li, Ruixiang Tang, Lu Cheng +3
Pre-trained language models (PLMs) have achieved impressive results on various natural language processing tasks. However, recent research has revealed that these models often rely…
Comparative Analysis of Demonstration Selection Algorithms for LLM In-Context Learning
Dong Shu, Mengnan Du
In-context learning can help Large Language Models (LLMs) to adapt new tasks without additional training. However, this performance heavily depends on the quality of the demonstrat…
DemoShapley: Valuation of Demonstrations for In-Context Learning
Shan Xie, Man Luo, Chadly Daniel Stern +2
Large language models (LLMs) using in-context learning (ICL) excel in many tasks without task-specific fine-tuning. However, demonstration selection and ordering greatly impact ICL…