activity
20202023
most citedReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing

27 citations · 78 across the 7 of their papers we have counts for

collaborators

7 papers

cs.AI2023★ 3 cited

Improving Interpersonal Communication by Simulating Audiences with Language Models

Ryan Liu, Howard Yen, Raja Marjieh +2

How do we communicate with others to achieve our goals? We use our prior experience or advice from others, or construct a candidate utterance by predicting how it will be received.…

cs.HC2023

Testing for Reviewer Anchoring in Peer Review: A Randomized Controlled Trial

Ryan Liu, Steven Jecmen, Vincent Conitzer +2

Peer review frequently follows a process where reviewers first provide initial reviews, authors respond to these reviews, then reviewers update their reviews based on the authors'…

cs.CL2023★ 6 cited

LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs

Tongshuang Wu, Haiyi Zhu, Maya Albayrak +21

LLMs have shown promise in replicating human-like behavior in crowdsourcing tasks that were previously thought to be exclusive to human abilities. However, current efforts focus ma…

cs.CL2023★ 27 cited

ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing

Ryan Liu, Nihar B. Shah

Given the rapid ascent of large language models (LLMs), we study the question: (How) can large language models help in reviewing of scientific papers or proposals? We first conduct…

cs.DL2022★ 19 cited

Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review

Ivan Stelmakh, Charvi Rastogi, Ryan Liu +3

Citations play an important role in researchers' careers as a key factor in evaluation of scientific impact. Many anecdotes advice authors to exploit this fact and cite prospective…

cs.AI2021

Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Design

Steven Jecmen, Hanrui Zhang, Ryan Liu +3

Many scientific conferences employ a two-phase paper review process, where some papers are assigned additional reviewers after the initial reviews are submitted. Many conferences a…

cs.AI2020★ 23 cited

Mitigating Manipulation in Peer Review via Randomized Reviewer Assignments

Steven Jecmen, Hanrui Zhang, Ryan Liu +3

We consider three important challenges in conference peer review: (i) reviewers maliciously attempting to get assigned to certain papers to provide positive reviews, possibly as pa…