5 papers
Value Over Language Model: Detecting Original Contribution in Writing
Vibhhu Sharma, Thorsten Joachims, Sarah Dean
LLMs have been rapidly adopted across writing tasks, prompting the development of tools for detecting LLM-generated text. Yet, these tools largely measure how much of a document's…
The Digital Divide in Generative AI: Evidence from Large Language Model Use in College Admissions Essays
Jinsook Lee, Conrad Borchers, AJ Alvero +2
Large language models (LLMs) have become popular writing tools among students and may expand access to high-quality feedback for students with less access to traditional writing su…
Does Algorithmic Uncertainty Sway Human Experts? Evidence from a Field Experiment in Selective College Admissions
Hansol Lee, AJ Alvero, René F. Kizilcec +1
Algorithmic predictions are inherently uncertain: even models with similar aggregate accuracy can produce different predictions for the same individual, raising concerns that high-…
Do LLMs Favor LLMs? Quantifying Interaction Effects in Peer Review
Vibhhu Sharma, Thorsten Joachims, Sarah Dean
There are increasing indications that LLMs are not only used for producing scientific papers, but also as part of the peer review process. In this work, we provide the first compre…
Unbiased Offline Evaluation for Learning to Rank with Business Rules
Matej Jakimov, Alexander Buchholz, Yannik Stein +1
For industrial learning-to-rank (LTR) systems, it is common that the output of a ranking model is modified, either as a results of post-processing logic that enforces business requ…