2 citations · 4 across the 12 of their papers we have counts for
13 papers
Human-AI Collaboration for Estimating Scientific Replicability
Tatiana Chakravorti, Robert Fraleigh, Timothy Fritton +7
Determining whether published scientific findings can successfully be replicated is a long-standing challenge in the empirical sciences. Existing approaches for replicability asses…
Many Ways to Be Fake: Benchmarking Fake News Detection Under Strategy-Driven AI Generation
Xinyu Wang, Sai Koneru, Wenbo Zhang +3
Recent advances in large language models (LLMs) have enabled the large-scale generation of highly fluent and deceptive news-like content. While prior work has often treated fake ne…
Context Selection for Hypothesis and Statistical Evidence Extraction from Full-Text Scientific Articles
Sai Koneru, Jian Wu, Sarah Rajtmajer
Extracting hypotheses and their supporting statistical evidence from full-text scientific articles is central to the synthesis of empirical findings, but remains difficult due to d…
Evaluating Evidence Grounding Under User Pressure in Instruction-Tuned Language Models
Sai Koneru, Elphin Joe, Christine Kirchhoff +2
In contested domains, instruction-tuned language models must balance user-alignment pressures against faithfulness to the in-context evidence. To evaluate this tension, we introduc…
ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
Bang Nguyen, Dominik Soós, Qian Ma +8
The literature has witnessed an emerging interest in AI agents for automated assessment of scientific papers. Existing benchmarks focus primarily on the computational aspect of thi…
Social Scientists on the Role of AI in Research
Tatiana Chakravorti, Xinyu Wang, Pranav Narayanan Venkit +3
The integration of artificial intelligence (AI) into social science research practices raises significant technological, methodological, and ethical issues. We present a community-…
Have LLMs Reopened the Pandora's Box of AI-Generated Fake News?
Xinyu Wang, Wenbo Zhang, Sai Koneru +5
With the rise of AI-generated content spewed at scale from large language models (LLMs), genuine concerns about the spread of fake news have intensified. The perceived ability of L…
Assessing the Effectiveness of GPT-4o in Climate Change Evidence Synthesis and Systematic Assessments: Preliminary Insights
Elphin Tom Joe, Sai Dileep Koneru, Christine J Kirchhoff
In this research short, we examine the potential of using GPT-4o, a state-of-the-art large language model (LLM) to undertake evidence synthesis and systematic assessment tasks. Tra…
The Failed Migration of Academic Twitter: A Case Study of Precocious Adopters
Xinyu Wang, Sai Koneru, Sarah Rajtmajer
Following changes in Twitter's ownership in 2022 and subsequent changes to content moderation policies, many in academia looked to move their discourse elsewhere and migration to M…
The Unappreciated Role of Intent in Algorithmic Moderation of Social Media Content
Xinyu Wang, Sai Koneru, Pranav Narayanan Venkit +2
As social media has become a predominant mode of communication globally, the rise of abusive content threatens to undermine civil discourse. Recognizing the critical nature of this…
Reproducibility, Replicability, and Transparency in Research: What 430 Professors Think in Universities across the USA and India
Tatiana Chakravorti, Sai Dileep Koneru, Sarah Rajtmajer
In the past decade, open science and science of science communities have initiated innovative efforts to address concerns about the reproducibility and replicability of published s…
Perspectives from India: Opportunities and Challenges for AI Replication Prediction to Improve Confidence in Published Research
Tatiana Chakravorti, Chuhao Wu, Sai Koneru +1
Over the past decade, a crisis of confidence in scientific literature has gained attention, particularly in the West. In response, we have seen changes in policy and practice among…
Can Large Language Models Discern Evidence for Scientific Hypotheses? Case Studies in the Social Sciences
Sai Koneru, Jian Wu, Sarah Rajtmajer
Hypothesis formulation and testing are central to empirical research. A strong hypothesis is a best guess based on existing evidence and informed by a comprehensive view of relevan…