5 citations · 6 across the 27 of their papers we have counts for
4 papers · 2 filters
Ideology as a Problem: Lightweight Logit Steering for Annotator-Specific Alignment in Social Media Analysis
Wei Xia, Haowen Tang, Luozheng Li
LLMs internally organize political ideology along low-dimensional structures that are partially, but not fully aligned with human ideological space. This misalignment is systematic…
SDA: Steering-Driven Distribution Alignment for Open LLMs without Fine-Tuning
Wei Xia, Zhi-Hong Deng
With the rapid advancement of large language models (LLMs), their deployment in real-world applications has become increasingly widespread. LLMs are expected to deliver robust perf…
Learning to Focus: Focal Attention for Selective and Scalable Transformers
Dhananjay Ram, Wei Xia, Stefano Soatto
Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces nois…
Maximally-Informative Retrieval for State Space Model Generation
Evan Becker, Benjamin Bowman, Matthew Trager +4
Given a query and dataset, the optimal way of answering the query is to make use all the information available. Modern LLMs exhibit impressive ability to memorize training data, bu…