5 papers
ReflectEd: Evaluating Reflection-Driven Learning in an AI-Assisted System
Md Nazmus Sakib, Ishika Tarin, Naga Manogna Rayasam +2
In collaborative settings, sustaining momentum and engagement between checkpoints (e.g., meetings) can be challenging, often leading to task drift and reduced preparedness. To addr…
Expecting Too Much, Getting Too Little: Exploring the Challenges and Design Opportunities of Asynchronous AI Interviewers
Md Nazmus Sakib, Naga Manogna Rayasam, Sanorita Dey
Organizations use asynchronous AI interview systems to efficiently manage large applicant pools, enabling quick and uniform evaluations. However, concerns remain about their impact…
Competing or Collaborating? The Role of Hackathon Formats in Shaping Team Dynamics and Project Choices
Sadia Nasrin Tisha, Md Nazmus Sakib, Sanorita Dey
Hackathons have emerged as dynamic platforms for fostering innovation, collaboration, and skill development in the technology sector. Structural differences across hackathon format…
Analyzing the Sensitivity of Vision Language Models in Visual Question Answering
Monika Shah, Sudarshan Balaji, Somdeb Sarkhel +2
We can think of Visual Question Answering as a (multimodal) conversation between a human and an AI system. Here, we explore the sensitivity of Vision Language Models (VLMs) through…
COBIAS: Assessing the Contextual Reliability of Bias Benchmarks for Language Models
Priyanshul Govil, Hemang Jain, Vamshi Krishna Bonagiri +4
Large Language Models (LLMs) often inherit biases from the web data they are trained on, which contains stereotypes and prejudices. Current methods for evaluating and mitigating th…