4 papers
Knowing Your Uncertainty -- On the application of LLM in social sciences
Bolun Zhang, Linzhuo Li, Yunqi Chen +4
Large language models (LLMs) are rapidly being integrated into computational social science research, yet their blackboxed training and designed stochastic elements in inference po…
ChatGPT is not A Man but Das Man: Representativeness and Structural Consistency of Silicon Samples Generated by Large Language Models
Dai Li, Linzhuo Li, Huilian Sophie Qiu
Large language models (LLMs) in the form of chatbots like ChatGPT and Llama are increasingly proposed as "silicon samples" for simulating human opinions. This study examines this n…
Architectural Vulnerability and Reliability Challenges in AI Text Annotation: A Survey-Inspired Framework with Independent Probability Assessment
Linzhuo li
Large Language Models, despite their power, have a fundamental architectural vulnerability stemming from their causal transformer design -- order sensitivity. This architectural co…
Tinkering Against Scaling
Bolun Zhang, Yang Shen, Linzhuo Li +4
The ascent of scaling in artificial intelligence research has revolutionized the field over the past decade, yet it presents significant challenges for academic researchers, partic…