2 citations · 2 across the 8 of their papers we have counts for
9 papers
FigAct: Turning Scientific Figures into Active Canvases for Explanation
Shishi Xiao, Zichao Wang, Alexa Siu +2
Scientific figures are designed to communicate information visually, yet MLLMs typically explain them by translating their visual content back into text. This requires readers to m…
A Survey on LLM-based Conversational User Simulation
Bo Ni, Leyao Wang, Yu Wang +27
User simulation has long played a vital role in computer science due to its potential to support a wide range of applications. Language, as the primary medium of human communicatio…
Learning to Reason in LLMs by Expectation Maximization
Junghyun Lee, Branislav Kveton, Anup Rao +4
Large language models (LLMs) solve reasoning problems by first generating a rationale and then answering. We formalize reasoning as a latent variable model and derive a reward-base…
SweeperBot: Making 3D Browsing Accessible through View Analysis and Visual Question Answering
Chen Chen, Cuong Nguyen, Alexa Siu +2
Accessing 3D models remains challenging for Screen Reader (SR) users. While some existing 3D viewers allow creators to provide alternative text, they often lack sufficient detail a…
Quantitative LLM Judges
Aishwarya Sahoo, Jeevana Kruthi Karnuthala, Tushar Parmanand Budhwani +9
LLM-as-a-judge is a framework where a large language model (LLM) evaluates the output of another LLM. While LLMs excel at producing qualitative textual evaluations, they often stru…
InfoVids: Reimagining the Viewer Experience with Alternative Visualization-Presenter Relationships
Ji Won Chung, Tongyu Zhou, Ivy Chen +7
Traditional data presentations typically separate the presenter and visualization into two separate spaces--the 3D world and a 2D screen--enforcing visualization-centric stories. T…
MODS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections
Nishant Balepur, Alexa Siu, Nedim Lipka +4
Query-focused summarization (QFS) gives a summary of documents to answer a query. Past QFS work assumes queries have one answer, ignoring debatable ones (Is law school worth it?).…
Optimizing Data Delivery: Insights from User Preferences on Visuals, Tables, and Text
Reuben Luera, Ryan Rossi, Franck Dernoncourt +9
In this work, we research user preferences to see a chart, table, or text given a question asked by the user. This enables us to understand when it is best to show a chart, table,…
Survey of User Interface Design and Interaction Techniques in Generative AI Applications
Reuben Luera, Ryan A. Rossi, Alexa Siu +10
The applications of generative AI have become extremely impressive, and the interplay between users and AI is even more so. Current human-AI interaction literature has taken a broa…