7 citations · 19 across the 11 of their papers we have counts for
11 papers
Human-AI Collaboration for Estimating Scientific Replicability
Tatiana Chakravorti, Robert Fraleigh, Timothy Fritton +7
Determining whether published scientific findings can successfully be replicated is a long-standing challenge in the empirical sciences. Existing approaches for replicability asses…
Beyond Detection: Governing GenAI in Academic Peer Review as a Sociotechnical Challenge
Tatiana Chakravorti, Pranav Narayanan Venkit, Sourojit Ghosh +1
Generative AI tools are increasingly entering academic peer review workflows, raising questions about fairness, accountability, and the legitimacy of evaluative judgment. While the…
Towards Experience-Centered AI: A Framework for Integrating Lived Experience in Design and Development
Sanjana Gautam, Mohit Chandra, Ankolika De +3
Lived experiences fundamentally shape how individuals interact with AI systems, influencing perceptions of safety, trust, and usability. While prior research has focused on develop…
Social Scientists on the Role of AI in Research
Tatiana Chakravorti, Xinyu Wang, Pranav Narayanan Venkit +3
The integration of artificial intelligence (AI) into social science research practices raises significant technological, methodological, and ethical issues. We present a community-…
Embracing Transparency: A Study of Open Science Practices Among Early Career HCI Researchers
Tatiana Chakravorti, Sanjana Gautam, Sarah M. Rajtmajer
Many fields of science, including Human-Computer Interaction (HCI), have heightened introspection in the wake of concerns around reproducibility and replicability of published find…
An Audit on the Perspectives and Challenges of Hallucinations in NLP
Pranav Narayanan Venkit, Tatiana Chakravorti, Vipul Gupta +5
We audit how hallucination in large language models (LLMs) is characterized in peer-reviewed literature, using a critical examination of 103 publications across NLP research. Throu…
Reproducibility, Replicability, and Transparency in Research: What 430 Professors Think in Universities across the USA and India
Tatiana Chakravorti, Sai Dileep Koneru, Sarah Rajtmajer
In the past decade, open science and science of science communities have initiated innovative efforts to address concerns about the reproducibility and replicability of published s…
Integrating measures of replicability into scholarly search: Challenges and opportunities
Chuhao Wu, Tatiana Chakravorti, John Carroll +1
Challenges to reproducibility and replicability have gained widespread attention, driven by large replication projects with lukewarm success rates. A nascent work has emerged devel…
Perspectives from India: Opportunities and Challenges for AI Replication Prediction to Improve Confidence in Published Research
Tatiana Chakravorti, Chuhao Wu, Sai Koneru +1
Over the past decade, a crisis of confidence in scientific literature has gained attention, particularly in the West. In response, we have seen changes in policy and practice among…
A prototype hybrid prediction market for estimating replicability of published work
Tatiana Chakravorti, Robert Fraleigh, Timothy Fritton +7
We present a prototype hybrid prediction market and demonstrate the avenue it represents for meaningful human-AI collaboration. We build on prior work proposing artificial predicti…
Artificial prediction markets present a novel opportunity for human-AI collaboration
Tatiana Chakravorti, Vaibhav Singh, Sarah Rajtmajer +6
Despite high-profile successes in the field of Artificial Intelligence, machine-driven technologies still suffer important limitations, particularly for complex tasks where creativ…