6 papers
Evaluating Commercial AI Chatbots as News Intermediaries
Mirac Suzgun, Emily Shen, Federico Bianchi +5
AI chatbots are rapidly shaping how people encounter the news, yet no prior study has systematically measured how accurately these systems, with their proprietary search integratio…
WebDS: An End-to-End Benchmark for Web-based Data Science
Ethan Hsu, Hong Meng Yam, Ines Bouissou +9
Many real-world data science tasks involve complex web-based interactions: finding appropriate data available on the internet, synthesizing multimodal data from different locations…
NewsInterview: a Dataset and a Playground to Evaluate LLMs' Ground Gap via Informational Interviews
Alexander Spangher, Michael Lu, Sriya Jeslyn Kalyan +3
Large Language Models (LLMs) have demonstrated impressive capabilities in generating coherent text but often struggle with grounding language and strategic dialogue. To address thi…
DiscoSum: Discourse-aware News Summarization
Alexander Spangher, Tenghao Huang, Jialiang Gu +2
Recent advances in text summarization have predominantly leveraged large language models to generate concise summaries. However, language models often do not maintain long-term dis…
NewsEdits 2.0: Learning the Intentions Behind Updating News
Alexander Spangher, Kung-Hsiang Huang, Hyundong Cho +1
As events progress, news articles often update with new information: if we are not cautious, we risk propagating outdated facts. In this work, we hypothesize that linguistic featur…
NewsHomepages: Homepage Layouts Capture Information Prioritization Decisions
Ben Welsh, Naitian Zhou, Arda Kaz +2
Information prioritization plays an important role in how humans perceive and understand the world. Homepage layouts serve as a tangible proxy for this prioritization. In this work…