activity
20232025
most citedBenchmarking Cognitive Biases in Large Language Models as Evaluators

25 citations · 27 across the 6 of their papers we have counts for

collaborators

6 papers

cs.LG2025

Learning Explainable Dense Reward Shapes via Bayesian Optimization

Ryan Koo, Ian Yang, Vipul Raheja +3

Current reinforcement learning from human feedback (RLHF) pipelines for large language model (LLM) alignment typically assign scalar rewards to sequences, using the final token as…

cs.CL2024

Dynamic Multi-Reward Weighting for Multi-Style Controllable Generation

Karin de Langis, Ryan Koo, Dongyeop Kang

Textual style expresses a diverse set of information, including interpersonal dynamics (e.g., formality) and the author's emotions or attitudes (e.g., disgust). An open question is…

cs.CL2024★ 2 cited

Under the Surface: Tracking the Artifactuality of LLM-Generated Data

Debarati Das, Karin De Langis, Anna Martin-Boyle +14

This work delves into the expanding role of large language models (LLMs) in generating artificial data. LLMs are increasingly employed to create a variety of outputs, including ann…

cs.CL2023★ 25 cited

Benchmarking Cognitive Biases in Large Language Models as Evaluators

Ryan Koo, Minhwa Lee, Vipul Raheja +3

Large Language Models are cognitively biased judges. Large Language Models (LLMs) have recently been shown to be effective as automatic evaluators with simple prompting and in-cont…

cs.CL2023

CoEdIT: Text Editing by Task-Specific Instruction Tuning

Vipul Raheja, Dhruv Kumar, Ryan Koo +1

We introduce CoEdIT, a state-of-the-art text editing system for writing assistance. CoEdIT takes instructions from the user specifying the attributes of the desired text, such as "…

cs.CL2023

Decoding the End-to-end Writing Trajectory in Scholarly Manuscripts

Ryan Koo, Anna Martin, Linghe Wang +1

Scholarly writing presents a complex space that generally follows a methodical procedure to plan and produce both rationally sound and creative compositions. Recent works involving…