Attention Calibration for Position-Fair Dense Retrieval

Andrianos Michail, Elias Schuhmacher, Juri Opitz +2

Dense retrieval compresses a passage into a single vector, but this compression is positionally skewed: early content dominates the embedding, and retrieval degrades when the relev…