The Simpson's Paradox in the Offline Evaluation of Recommendation Systems

Amir H. Jadidinejad, Craig Macdonald, Iadh Ounis

Recommendation systems are often evaluated based on user's interactions that were collected from an existing, already deployed recommendation system. In this situation, users only…