2 papers
cs.IR2019
Critically Examining the "Neural Hype": Weak Baselines and the Additivity of Effectiveness Gains from Neural Ranking Models
Wei Yang, Kuang Lu, Peilin Yang +1
Is neural IR mostly hype? In a recent SIGIR Forum article, Lin expressed skepticism that neural ranking models were actually improving ad hoc retrieval effectiveness in limited dat…
cs.IR2018
Repeatability Corner Cases in Document Ranking: The Impact of Score Ties
Jimmy Lin, Peilin Yang
Document ranking experiments should be repeatable. However, the interaction between multi-threaded indexing and score ties during retrieval may yield non-deterministic rankings, ma…