176 citations · 289 across the 11 of their papers we have counts for
6 papers · 1 filter
Distributionally-Informed Recommender System Evaluation
Michael D. Ekstrand, Ben Carterette, Fernando Diaz
Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additio…
Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education
Christine Bauer, Ben Carterette, Nicola Ferro +1
This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together…
Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search
Ben Carterette, Rosie Jones, Gareth F. Jones +6
Rapidly growing online podcast archives contain diverse content on a wide range of topics. These archives form an important resource for entertainment and professional use, but the…
Estimation of Fair Ranking Metrics with Incomplete Judgments
Ömer Kırnap, Fernando Diaz, Asia Biega +3
There is increasing attention to evaluating the fairness of search system ranking decisions. These metrics often consider the membership of items to particular groups, often identi…
Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste
Zahra Nazari, Christophe Charbuillet, Johan Pages +4
Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge. We…
Evaluating Stochastic Rankings with Expected Exposure
Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand +2
We introduce the concept of \emph{expected exposure} as the average attention ranked items receive from users over repeated samples of the same query. Furthermore, we advocate for…