13 citations · 58 across the 34 of their papers we have counts for
35 papers
Who Is Talking to the Agent? LLMs in Multi-User 3D Virtual Environments
Mohammad Al-Ratrout, Shayla Sharmin, Roghayeh Leila Barmaki
When several people share a 3D virtual room with an LLM agent, the agent must decide not only what to say, but whether an utterance was addressed to it and, if accessible, what pro…
The Effectiveness of Virtual Patient Simulation Versus Peer Simulation in Providing Sexual Counseling During Pregnancy: A Randomized Controlled Trial
Neslihan Yilmaz Sezer, Menekşe Nazlı Aker, Pinar Kullu +3
Although sexual health counseling is one of the important responsibilities of healthcare professionals, effective educational methods are needed to develop students' counseling ski…
Do Video-LLMs Actually Watch? Diagnosing Character-Tracking Failures in Long-Form Video
Mohammad Al-Ratrout, Shayla Sharmin, Aditya Raikwar +1
Can a Video Large Language Model (Video-LLM) follow one person through a long video, keeping track of who they are well enough to report, in order, how their outfit changes across…
Reading the Eyes in VR: Multimodal Modeling of Social Intelligence
Mohammad Fahim Abrar, Shayla Sharmin, Roghayeh Leila Barmaki
Social intelligence, the ability to interpret others' emotions, beliefs, and intentions, is often assessed with the Reading the Mind in the Eyes Test (RMET), in which participants…
When LLM Tutoring Responses Work: Evidence from Student Programming Conversations
Mohammad Fahim Abrar, Shayla Sharmin, Roghayeh Leila Barmaki
As students increasingly use LLM tutors in computer science education, one question becomes especially important: what kind of response helps a student continue productively? Prior…
Indirect and Direct AI Scaffolding for Computational Problem Posing: A Pilot Experience Report
Shayla Sharmin, Mohammad Fahim Abrar, Mohammad Al-Ratrout +1
Problem posing is a valuable learning activity in computing education, encouraging learners to actively construct, refine, and reflect on problems rather than simply solving them.…
Understanding Computing Identity Development Through Mentorship and Epistemic Network Analysis
Behdokht Kiafar, Roghayeh Leila Barmaki
Computing identity plays an important role in students' participation, persistence, and sense of belonging in computing, yet identity development can be difficult to capture throug…
Micro-level AI Feedback Features and Student Responses in Consecutive LLM Tutoring Interactions
Shayla Sharmin, Mohammad Fahim Abrar, Roghayeh Leila Barmaki
AI-assisted feedback research has shown that micro-level feedback features, such as concrete elaboration, affective language, and response length, are associated with learning outc…
How YouTube Frames ChatGPT Use in Education: An Epistemic Network Analysis with Supporting Multimodal Metadata
Shayla Sharmin, Mohammad Al-Ratrout, Mohammad Fahim Abrar +1
We examine educational YouTube videos through multimodal metadata, such as transcripts, titles, thumbnails, and viewer comments, to investigate how ChatGPT is framed across creator…
AFA: Identity-Aware Memory for Preventing Persona Confusion in Multi-User Dialogue
Mohammad Al-Ratrout, Pavan Uttej Ravva, Shayla Sharmin +3
When multiple people share a single voice assistant, the system conflates their histories: one resident's preferences can leak into another's responses, eroding utility and trust.…
Feedback Effects on Cognitive Dynamics: Network-Based Insights from EEG Patterns and Behavioral Performance
Behdokht Kiafar, Mohammad Fahim Abrar, Roghayeh Leila Barmaki
This study examines the impact of feedback on Electroencephalography (EEG) activity and performance during the Reading the Mind in the Eyes Test. In a within-subject design, eleven…
Beyond Cognitive Load: AI-Based Estimation of Cognitive Effort Using Brain Signals During Digital Tasks
Shayla Sharmin, Mohammad Fahim Abrar, Gael Lucero-Palacios +2
Cognitive effort, defined as the relationship between cognitive load and task performance, provides insight into how individuals allocate mental resources during demanding tasks. T…
MENA: Multimodal Epistemic Network Analysis for Visualizing Competencies and Emotions
Behdokht Kiafar, Pavan Uttej Ravva, Asif Ahmmed Joy +2
The need to improve geriatric care quality presents a challenge that requires insights from stakeholders. While simulated trainings can boost competencies, extracting meaningful in…
Hybrid Deep Learning Model to Estimate Cognitive Effort from fNIRS Signals
Shayla Sharmin, Roghayeh Leila Barmaki
This study estimates cognitive effort based on functional near-infrared spectroscopy data and performance scores using a hybrid DeepNet model. The estimation of cognitive effort en…
From Complexity to Simplicity: Using Python Instead of PsychoPy for fNIRS Data Collection
Shayla Sharmin, Md Fahim Abrar, Roghayeh Leila Barmaki
Functional near-infrared spectroscopy (fNIRS) is a non-invasive optical technique that measures brain activity by estimating blood oxygenation using near-infrared light. Traditiona…
Neurophysiological Insights into Multimedia-based Education: A PRISMA-ScR Review of fNIRS in Game-Integrated Learning Systems
Shayla Sharmin, Gael Lucero-Palacios, Behdokht Kiafar +4
Game-integrated learning systems (GILS) are a growing form of multimedia education. Neurophysiological evidence can complement behavioral and learning measures when examining how u…
MMASD+: A Novel Dataset for Privacy-Preserving Behavior Analysis of Children with Autism Spectrum Disorder
Pavan Uttej Ravva, Behdokht Kiafar, Pinar Kullu +3
Autism spectrum disorder (ASD) is characterized by significant challenges in social interaction and comprehending communication signals. Recently, therapeutic interventions for ASD…
A Machine Learning Approach for Predicting Upper Limb Motion Intentions with Multimodal Data in Virtual Reality
Pavan Uttej Ravva, Pinar Kullu, Mohammad Fahim Abrar +1
Over the last decade, there has been significant progress in the field of interactive virtual rehabilitation. Physical therapy (PT) stands as a highly effective approach for enhanc…
Analyzing Nursing Assistant Attitudes Towards Empathic Geriatric Caregiving Using Quantitative Ethnography
Behdokht Kiafar, Salam Daher, Shayla Sharmin +3
An emergent challenge in geriatric care is improving the quality of care, which requires insight from stakeholders. Qualitative methods offer detailed insights, but they can be bia…
Functional Near-Infrared Spectroscopy (fNIRS) Analysis of Interaction Techniques in Touchscreen-Based Educational Gaming
Shayla Sharmin, Elham Bakhshipour, Behdokht Kiafar +4
Educational games enhance learning experiences by integrating touchscreens, making interactions more engaging and intuitive for learners. However, the cognitive impacts of educatio…
A Large-Scale Feasibility Study of Screen-based 3D Visualization and Augmented Reality Tools for Human Anatomy Education: Exploring Gender Perspectives in Learning Experience
Roghayeh Leila Barmaki, Kangsoo Kim, Zhang Guo +4
Anatomy education is an indispensable part of medical training, but traditional methods face challenges like limited resources for dissection in large classes and difficulties unde…
Cognitive Engagement for STEM+C Education: Investigating Serious Game Impact on Graph Structure Learning with fNIRS
Shayla Sharmin, Reza Koiler, Rifat Sadik +6
For serious games on education, understanding the effectiveness of different learning methods in influencing cognitive processes remains a significant challenge. This study investi…
Towards Anatomy Education with Generative AI-based Virtual Assistants in Immersive Virtual Reality Environments
Vuthea Chheang, Shayla Sharmin, Rommy Marquez-Hernandez +7
Virtual reality (VR) and interactive 3D visualization systems have enhanced educational experiences and environments, particularly in complicated subjects such as anatomy education…
MMASD: A Multimodal Dataset for Autism Intervention Analysis
Jicheng Li, Vuthea Chheang, Pinar Kullu +5
Autism spectrum disorder (ASD) is a developmental disorder characterized by significant social communication impairments and difficulties perceiving and presenting communication cu…