42 citations · 87 across the 11 of their papers we have counts for
8 papers · 1 filter
Stop Using the Wilcoxon Test: Myth, Misconception and Misuse in IR Research
Julián Urbano
In benchmarking of Information Retrieval systems, the Wilcoxon signed-rank test is often treated as a safer alternative to the t-test. This belief is fueled by textbooks and recomm…
Mitigating Mainstream Bias in Recommendation via Cost-sensitive Learning
Roger Zhe Li, Julián Urbano, Alan Hanjalic
Mainstream bias, where some users receive poor recommendations because their preferences are uncommon or simply because they are less active, is an important aspect to consider reg…
New Insights into Metric Optimization for Ranking-based Recommendation
Roger Zhe Li, Julián Urbano, Alan Hanjalic
Direct optimization of IR metrics has often been adopted as an approach to devise and develop ranking-based recommender systems. Most methods following this approach aim at optimiz…
Leave No User Behind: Towards Improving the Utility of Recommender Systems for Non-mainstream Users
Roger Zhe Li, Julián Urbano, Alan Hanjalic
In a collaborative-filtering recommendation scenario, biases in the data will likely propagate in the learned recommendations. In this paper we focus on the so-called mainstream bi…
Statistical Significance Testing in Information Retrieval: An Empirical Analysis of Type I, Type II and Type III Errors
Julián Urbano, Harlley Lima, Alan Hanjalic
Statistical significance testing is widely accepted as a means to assess how well a difference in effectiveness reflects an actual difference between systems, as opposed to random…
Overview of EIREX 2012: Social Media
Julián Urbano, Mónica Marrero, Diego Martín +1
The third Information Retrieval Education through EXperimentation track (EIREX 2012) was run at the University Carlos III of Madrid, during the 2012 spring semester. EIREX 2012 is…
Overview of EIREX 2011: Crowdsourcing
Julián Urbano, Diego Martín, Mónica Marrero +1
The second Information Retrieval Education through EXperimentation track (EIREX 2011) was run at the University Carlos III of Madrid, during the 2011 spring semester. EIREX 2011 is…
Overview of EIREX 2010: Computing
Julián Urbano, Mónica Marrero, Diego Martín +1
The first Information Retrieval Education through Experimentation track (EIREX 2010) was run at the University Carlos III of Madrid, during the 2010 spring semester. EIREX 2010 is…