Bayesian Test-Time Inference of Task-Aligned Similarity from Weak Interactive Feedback

Weida Liang, Kenji Kawaguchi

Language model systems repeatedly make test-time decisions by comparing similarity: they retrieve exemplars, rank candidates, and revise responses. Yet similarity is not unique: le…