activity
20222026
most citedBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

565 citations · 588 across the 12 of their papers we have counts for

collaborators

15 papers

cs.CL2026

Learning Scientific Trajectories to Predict Future Biomedical Discoveries

Chia-Hsuan Chang, Brian Ondov, Jiang Lv +7

AI co-scientists have expanded the use of large language models for generating scientific hypotheses and guiding experimental investigation. Here we investigate whether temporal pa…

cs.CY2026

A misinformation playbook sharpens judgement without breeding cynicism

Tong Guo, Teng Ye, Yutong Xie +1

Misinformation harms public health and democracy, and generative artificial intelligence now writes falsehoods as persuasive as people's. Defences range from fact-checking individu…

cs.CL2026

HouseholdBench: Evaluating Large Language Models as Predictors of Household Economic Behavior

Jin Huang, Diego Ferreras Garrucho, Yutong Xie +4

Large language models (LLMs) have the potential to meet a key goal in economics: a quantitative model of household decision making, across a variety of settings. Yet existing evalu…

econ.TH2026

Modeling Human Behavior with Type Vectors Using AI

Matthew O. Jackson, Benjamin S. Manning, Yutong Xie +2

We introduce a general, easy-to-implement AI-based modeling technique for analyzing human behavior. A key feature of this approach, which contrasts with existing modeling technique…

cs.CL2026

BehaviorBench: Benchmarking Foundation Models for Behavioral Science Tasks

Jin Huang, Yutong Xie, Wanli Song +5

Foundation models have been increasingly applied to behavioral science domains such as psychology, sociology, and economics. While these models show promise in tasks such as survey…

cs.LG2026

IRIS: time-structured manifold projections

Brian Ondov, Chia-Hsuan Chang, Weipeng Zhou +6

High-dimensional biomedical data, such as cell-by-gene matrices, are increasingly generated temporally. However, Manifold Learning algorithms, like t-SNE and UMAP, cannot incorpora…

cs.IR2026

MedViz: An Agent-based, Visual-guided Research Assistant for Navigating Biomedical Literature

Huan He, Xueqing Peng, Yutong Xie +6

Biomedical researchers face increasing challenges in navigating millions of publications in diverse domains. Traditional search engines typically return articles as ranked text lis…

cs.HC2025

AI Behavioral Science: A Framework and Agenda

Matthew O. Jackson, Qiaozhu Me, Stephanie W. Wang +16

We discuss the challenges and opportunities present in the rapidly emerging area of ``AI Behavioral Science.'' We frame it via three subfields. First, as AI becomes ubiquitous and…

cs.AI2025

Be.FM: Open Foundation Models for Human Behavior

Yutong Xie, Zhuoheng Li, Xiyuan Wang +10

Despite their success in numerous fields, the potential of foundation models for modeling and understanding human behavior remains largely unexplored. We introduce Be.FM, one of th…

cs.LG2025

ExAnte: A Benchmark for Ex-Ante Inference in Large Language Models

Yachuan Liu, Xiaochun Wei, Lin Shi +4

Large language models (LLMs) face significant challenges in ex-ante reasoning, where analysis, inference, or predictions must be made without access to information from future even…

cs.AI2025

Using Large Language Models to Categorize Strategic Situations and Decipher Motivations Behind Human Behaviors

Yutong Xie, Qiaozhu Mei, Walter Yuan +1

By varying prompts to a large language model, we can elicit the full range of human behaviors in a variety of different scenarios in classic economic games. By analyzing which prom…

cs.AI2024★ 2 cited

How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games

Yutong Xie, Yiyao Liu, Zhuang Ma +5

The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplemen…

cs.AI2024★ 5 cited

Bridging AI and Science: Implications from a Large-Scale Literature Analysis of AI4Science

Yutong Xie, Yijun Pan, Hua Xu +1

Artificial Intelligence has proven to be a transformative tool for advancing scientific research across a wide range of disciplines. However, a significant gap still exists between…

cs.HC2024★ 16 cited

Position: Towards Bidirectional Human-AI Alignment

Hua Shen, Tiffany Knearem, Reshmi Ghosh +21

Recent advances in general-purpose AI underscore the urgent need to align AI systems with human goals and values. Yet, the lack of a clear, shared understanding of what constitutes…

cs.CL2022★ 565 cited

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao +448

Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabil…