1 citations · 1 across the 9 of their papers we have counts for
11 papers
RealControlBench: A Benchmark for Interpretability-Informed Fine-Grained Control of LLMs and Agents
Xinying Cai, Bin Hu, Mingyu Jin +16
Existing steering benchmarks are built around simplified, isolated generation tasks and evaluate a single behavioral attribute under controlled settings that do not reflect the div…
Artificial Intelligence and the New Science of Culture
Douglas R. Guilbeault, Bhargav Srinivasa Desikan, James A. Evans
Cognition and culture have long been treated as parallel objects of study, joined more by metaphor than by mechanism. We argue they are co-constituted in a manner now empirically t…
Filling holes in science draws collective attention, but most higher-order holes remain unexplored
Jiajie Luo, James A. Evans
Most scientific discoveries justify their significance by filling holes between existing ideas and arguments. Representing knowledge as high-dimensional concept embeddings, we use…
Representational Similarity and Model Behavior in Multi-Agent Interaction
Yujin Potter, Seun Eisape, Shiyang Lai +6
Researchers have shown that neural similarity among humans predicts social closeness and cooperative success, whereas innovation often emerges from interactions among dissimilar in…
Contemporary AI lacks the imagination to diverge or negate in science
Honglin Bao, Siyang Wu, Xiao Liu +3
Bold claims that AI will accelerate scientific discovery have raced ahead of evidence from working scientists, yet large-scale, scientist-in-the-loop evidence is scarce. Here we mo…
Building an Atlas of Social Experiments to Link Studies, Reconcile Conflicts, and Bridge Gaps
Jiawei Zhang, Honglin Bao, Pengda Wang +3
Social and behavioral science runs thousands of experiments each year, yet their findings rarely accumulate into a coherent map of what is known, what conflicts, and what remains m…
A Theory of Appropriateness That Accounts for Norms of Rationality
Joel Z. Leibo, Alexander Sasha Vezhnevets, Manfred Diaz +10
We propose a society-first theory of normative appropriateness where individuals, modeled as pre-trained actors with cognitive architectures analogous to Large Language Models (LLM…
Mapping Overlaps in Benchmarks through Perplexity in the Wild
Siyang Wu, Honglin Bao, Sida Li +2
We introduce benchmark signatures to characterize the capacity demands of LLM benchmarks and their overlaps. Signatures are sets of salient tokens from in-the-wild corpora whose mo…
Language Models Should be Used to Surface the Unwritten Code of Science and Society
Honglin Bao, Siyang Wu, Jiwoong Choi +2
This paper calls on the research community not only to investigate how human biases are inherited by large language models (LLMs) but also to explore how these biases in LLMs can b…
Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understanding
Siyang Wu, Honglin Bao, Nadav Kunievsky +1
While large language models (LLMs) excel at factual recall, the real challenge lies in knowledge application. A gap persists between their ability to answer complex questions and t…
From Division to Unity: A Large-Scale Study on the Emergence of Computational Social Science, 1990-2021
Honglin Bao, Jiawei Zhang, Mingxuan Cao +1
We present a comprehensive study on the emergence of Computational Social Science (CSS) - an interdisciplinary field leveraging computational methods to address social science ques…