5 papers
Generating Edit-Inducing Questions for AI Research Manuscripts
Sebastian Joseph, Zichao Wang, Jennifer Healey +3
We study the ability of LLMs to generate edit-inducing questions whose answer will improve a paper draft. On a dataset of paired submission and camera-ready papers from ICLR and Ne…
LinkNav: Surfacing Interconnected Information in Scientific Articles
Sebastian Joseph, Jennifer Healey, Junyi Jessy Li +1
We present LinkNav, an enhanced experience for reading academic papers which makes explicit connections between related but non-adjacent passages. To create the experience, we inst…
Clarification Is Not Enough: Post-Clarification Answering Remains the Bottleneck in Multi-Turn QA
Jinyan Su, Jennifer Healey
Pluralistic alignment requires systems to adapt to diverse user values, communication styles, and contextual assumptions. We believe that a foundational prerequisite for such align…
Developing A Framework to Support Human Evaluation of Bias in Generated Free Response Text
Jennifer Healey, Laurie Byrum, Md Nadeem Akhtar +2
LLM evaluation is challenging even the case of base models. In real world deployments, evaluation is further complicated by the interplay of task specific prompts and experiential…
Evaluating Nuanced Bias in Large Language Model Free Response Answers
Jennifer Healey, Laurie Byrum, Md Nadeem Akhtar +1
Pre-trained large language models (LLMs) can now be easily adapted for specific business purposes using custom prompts or fine tuning. These customizations are often iteratively re…