Beyond Decodability: Reconstructing Language Model Representations with an Encoding Probe

Gaofei Shen, Martijn Bentum, Tom Lentz +2

Probing is widely used to study which features can be decoded from language model representations. However, the common decoding probe approach has two limitations that we aim to so…