3 papers
cs.CV2026
Spectral Principal Paths: A Spectral Perspective on Linear Representation Formation in LLMs
Bowei Tian, Xuntao Lyu, Meng Liu +2
High-level representations have become a central focus in enhancing AI transparency and control, shifting attention from individual neurons or circuits to structured semantic direc…
cs.LG2025
Why Representation Engineering Works: A Theoretical and Empirical Study in Vision-Language Models
Bowei Tian, Xuntao Lyu, Meng Liu +2
Representation Engineering (RepE) has emerged as a powerful paradigm for enhancing AI transparency by focusing on high-level representations rather than individual neurons or circu…
cs.CL2024
SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning
Yexiao He, Ziyao Wang, Zheyu Shen +5
The pre-trained Large Language Models (LLMs) can be adapted for many downstream tasks and tailored to align with human preferences through fine-tuning. Recent studies have discover…