LLMs can be Fooled into Labelling a Document as Relevant (best café near me; this paper is perfectly relevant)

Marwah Alaofi, Paul Thomas, Falk Scholer +1

LLMs are increasingly being used to assess the relevance of information objects. This work reports on experiments to study the labelling of short texts (i.e., passages) for relevan…