176 citations · 289 across the 11 of their papers we have counts for
11 papers
Stochastic Primal-Dual Decoding for Multiobjective Generative Recommender Systems
Dmitrii Moor, Ben Carterette, Senthilkumar Krishnamoorthy +5
Recent advances in recommender systems (RS) have shown substantial performance gains through generative modelling. In practice, recommendation often involves constructing slates --…
Distributionally-Informed Recommender System Evaluation
Michael D. Ekstrand, Ben Carterette, Fernando Diaz
Current practice for evaluating recommender systems typically focuses on point estimates of user-oriented effectiveness metrics or business metrics, sometimes combined with additio…
Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education
Christine Bauer, Ben Carterette, Nicola Ferro +1
This report documents the program and the outcomes of Dagstuhl Seminar 23031 ``Frontiers of Information Access Experimentation for Research and Education'', which brought together…
Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search
Ben Carterette, Rosie Jones, Gareth F. Jones +6
Rapidly growing online podcast archives contain diverse content on a wide range of topics. These archives form an important resource for entertainment and professional use, but the…
Estimation of Fair Ranking Metrics with Incomplete Judgments
Ömer Kırnap, Fernando Diaz, Asia Biega +3
There is increasing attention to evaluating the fairness of search system ranking decisions. These metrics often consider the membership of items to particular groups, often identi…
Model Selection for Production System via Automated Online Experiments
Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia +2
A challenge that machine learning practitioners in the industry face is the task of selecting the best model to deploy in production. As a model is often an intermediate component…
Trajectory Based Podcast Recommendation
Greg Benton, Ghazal Fazelnia, Alice Wang +1
Podcast recommendation is a growing area of research that presents new challenges and opportunities. Individuals interact with podcasts in a way that is distinct from most other me…
Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions
James McInerney, Brian Brost, Praveen Chandar +2
Users of music streaming, video streaming, news recommendation, and e-commerce services often engage with content in a sequential manner. Providing and evaluating good sequences of…
Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste
Zahra Nazari, Christophe Charbuillet, Johan Pages +4
Recommender systems are increasingly used to predict and serve content that aligns with user taste, yet the task of matching new users with relevant content remains a challenge. We…
Evaluating Stochastic Rankings with Expected Exposure
Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand +2
We introduce the concept of \emph{expected exposure} as the average attention ranked items receive from users over repeated samples of the same query. Furthermore, we advocate for…
The Spotify Podcast Dataset
Ann Clifton, Aasish Pappu, Sravana Reddy +4
Podcasts are a relatively new form of audio media. Episodes appear on a regular cadence, and come in many different formats and levels of formality. They can be formal news journal…