92 citations · 246 across the 24 of their papers we have counts for
24 papers
SAPIEN: Affective Virtual Agents Powered by Large Language Models
Masum Hasan, Cengiz Ozel, Sammy Potter +1
In this demo paper, we introduce SAPIEN, a platform for high-fidelity virtual agents driven by large language models that can hold open domain conversations with users in 13 differ…
Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework
Tariq Adnan, Md Saiful Islam, Wasifur Rahman +6
We present an efficient and accessible PD screening method by leveraging AI-driven models enabled by the largest video dataset of facial expressions from 1,059 unique participants.…
Validating a virtual human and automated feedback system for training doctor-patient communication skills
Kurtis Haut, Caleb Wohn, Benjamin Kane +6
Effective communication between a clinician and their patient is critical for delivering healthcare maximizing outcomes. Unfortunately, traditional communication training approache…
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models
Md Kamrul Hasan, Md Saiful Islam, Sangwu Lee +4
Pre-trained large language models have recently achieved ground-breaking performance in a wide variety of language understanding tasks. However, the same model can not be applied t…
Using AI to Measure Parkinson's Disease Severity at Home
Md Saiful Islam, Wasifur Rahman, Abdelrahman Abdelkader +6
We present an artificial intelligence system to remotely assess the motor performance of individuals with Parkinson's disease (PD). Participants performed a motor task (i.e., tappi…
Don't follow the leader: Independent thinkers create scientific innovation
Sean Kelty, Raiyan Abdul Baten, Adiba Mahbub Proma +3
Academic success is distributed unequally; a few top scientists receive the bulk of attention, citations, and resources. However, do these ``superstars" foster leadership in scient…
NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters
Adiba Mahbub Proma, Md Saiful Islam, Stela Ciko +2
Climate change has increased the intensity, frequency, and duration of extreme weather events and natural disasters across the world. While the increased data on natural disasters…
SEER: Sustainable E-commerce with Environmental-impact Rating
Md Saiful Islam, Adiba Mahbub, Caleb Wohn +5
With online shopping gaining massive popularity over the past few years, e-commerce platforms can play a significant role in tackling climate change and other environmental problem…
A Flexible Schema-Guided Dialogue Management Framework: From Friendly Peer to Virtual Standardized Cancer Patient
Benjamin Kane, Catherine Giugno, Lenhart Schubert +3
A schema-guided approach to dialogue management has been shown in recent work to be effective in creating robust customizable virtual agents capable of acting as friendly peers or…
Auto-Gait: Automatic Ataxia Risk Assessment with Computer Vision on Gait Task Videos
Wasifur Rahman, Masum Hasan, Md Saiful Islam +6
In this paper, we investigated whether we can 1) detect participants with ataxia-specific gait characteristics (risk-prediction), and 2) assess severity of ataxia from gait (severi…
It's Time to Do Something: Mitigating the Negative Impacts of Computing Through a Change to the Peer Review Process
Brent Hecht, Lauren Wilcox, Jeffrey P. Bigham +9
The computing research community needs to work much harder to address the downsides of our innovations. Between the erosion of privacy, threats to democracy, and automation's effec…
Creativity in social networks is enhanced by 'Goldilocks' dispersal of ideators' visibility
Raiyan Abdul Baten, Richard N. Aslin, Gourab Ghoshal +1
Recent works suggest that striking a balance between maximizing idea stimulation and minimizing idea redundancy can elevate creativity in self-organizing social networks. We explor…
DBATES: DataBase of Audio features, Text, and visual Expressions in competitive debate Speeches
Taylan K. Sen, Gazi Naven, Luke Gerstner +11
In this work, we present a database of multimodal communication features extracted from debate speeches in the 2019 North American Universities Debate Championships (NAUDC). Featur…
Could you become more credible by being White? Assessing Impact of Race on Credibility with Deepfakes
Kurtis Haut, Caleb Wohn, Victor Antony +6
Computer mediated conversations (e.g., videoconferencing) is now the new mainstream media. How would credibility be impacted if one could change their race on the fly in these envi…
A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non-Invasive AI Lie Detection
Taylan Sen, Kurtis Haut, Denis Lomakin +1
Imagine an app on your phone or computer that can tell if you are being dishonest, just by processing affective features of your facial expressions, body movements, and voice. Peop…
Facial expressions can detect Parkinson's disease: preliminary evidence from videos collected online
Mohammad Rafayet Ali, Taylor Myers, Ellen Wagner +3
One of the symptoms of Parkinson's disease (PD) is hypomimia or reduced facial expressions. In this paper, we present a digital biomarker for PD that utilizes the study of micro-ex…
Technology-driven Alteration of Nonverbal Cues and its Effects on Negotiation
Raiyan Abdul Baten, Ehsan Hoque
A person's appearance, identity, and other nonverbal cues can substantially influence how one is perceived by a negotiation counterpart, potentially impacting the outcome of the ne…
Fairness in Rating Prediction by Awareness of Verbal and Gesture Quality of Public Speeches
Ankani Chattoraj, Rupam Acharyya, Shouman Das +2
The role of verbal and non-verbal cues towards great public speaking has been a topic of exploration for many decades. We identify a commonality across present theories, the elemen…
Immediate or Reflective?: Effects of Real-timeFeedback on Group Discussions over Videochat
Samiha Samrose, Reza Rawassizadeh, Ehsan Hoque
Having a group discussion with the members holding conflicting viewpoints is difficult. It is especially challenging for machine-mediated discussions in which the subtle social cue…
Detecting Individuals with Depressive Disorder fromPersonal Google Search and YouTube History Logs
Boyu Zhang, Anis Zaman, Rupam Acharyya +3
Depressive disorder is one of the most prevalent mental illnesses among the global population. However, traditional screening methods require exacting in-person interviews and may…
Novel Computational Linguistic Measures, Dialogue System and the Development of SOPHIE: Standardized Online Patient for Healthcare Interaction Education
Mohammad Rafayet Ali, Taylan Sen, Benjamin Kane +5
In this paper, we describe the iterative participatory design of SOPHIE, an online virtual patient for feedback-based practice of sensitive patient-physician conversations, and dis…
The Relationship between Deteriorating Mental Health Conditions and Longitudinal Behavioral Changes in Google and YouTube Usages among College Students in the United States during COVID-19: Observational Study
Anis Zaman, Boyu Zhang, Ehsan Hoque +2
Mental health problems among the global population are worsened during the coronavirus disease (COVID-19). How individuals engage with online platforms such as Google Search and Yo…
Detecting Parkinson's Disease From an Online Speech-task
Wasifur Rahman, Sangwu Lee, Md. Saiful Islam +9
In this paper, we envision a web-based framework that can help anyone, anywhere around the world record a short speech task, and analyze the recorded data to screen for Parkinson's…
Individual-level Anxiety Detection and Prediction from Longitudinal YouTube and Google Search Engagement Logs
Anis Zaman, Boyu Zhang, Vincent Silenzio +2
Anxiety disorder is one of the world's most prevalent mental health conditions, arising from complex interactions of biological and environmental factors and severely interfering o…