4 papers
Abstention and Noise Filtering: Two Missing Primitives of Softmax Attention
Richard Zhe Wang
Softmax attention has two structural gaps. A head cannot abstain, because its weights sum to one, so it outputs something even when nothing is relevant. Nor can it filter what it r…
The Communication Map of a Transformer
Richard Zhe Wang
The components of a transformer communicate by writing to and reading from a shared residual stream, and the mechanistic interpretability literature has mapped these connections by…
When Does Legacy Data Start to Help? Emergent Transfer in Cross-Configuration Robot Learning
Tao Wang, Hudson Hou, Yingdong Hu +7
Robotic hardware evolves over time, but demonstration data is often tied to a specific sensor and actuator configuration. This raises a practical and underexplored question: when d…
Confidently Wrong: Detecting Hallucinations in Financial Question Answering from LLM Internal States
Richard Zhe Wang
Large language models (LLMs) in financial applications fail most consequentially when they are confidently wrong. Hedged, uncertain answers invite scrutiny, whereas confident error…