152 citations · 262 across the 8 of their papers we have counts for
8 papers
Unmasking Parkinson's Disease with Smile: An AI-enabled Screening Framework
Tariq Adnan, Md Saiful Islam, Wasifur Rahman +6
We present an efficient and accessible PD screening method by leveraging AI-driven models enabled by the largest video dataset of facial expressions from 1,059 unique participants.…
TextMI: Textualize Multimodal Information for Integrating Non-verbal Cues in Pre-trained Language Models
Md Kamrul Hasan, Md Saiful Islam, Sangwu Lee +4
Pre-trained large language models have recently achieved ground-breaking performance in a wide variety of language understanding tasks. However, the same model can not be applied t…
Using AI to Measure Parkinson's Disease Severity at Home
Md Saiful Islam, Wasifur Rahman, Abdelrahman Abdelkader +6
We present an artificial intelligence system to remotely assess the motor performance of individuals with Parkinson's disease (PD). Participants performed a motor task (i.e., tappi…
Auto-Gait: Automatic Ataxia Risk Assessment with Computer Vision on Gait Task Videos
Wasifur Rahman, Masum Hasan, Md Saiful Islam +6
In this paper, we investigated whether we can 1) detect participants with ataxia-specific gait characteristics (risk-prediction), and 2) assess severity of ataxia from gait (severi…
DBATES: DataBase of Audio features, Text, and visual Expressions in competitive debate Speeches
Taylan K. Sen, Gazi Naven, Luke Gerstner +11
In this work, we present a database of multimodal communication features extracted from debate speeches in the 2019 North American Universities Debate Championships (NAUDC). Featur…
Detecting Parkinson's Disease From an Online Speech-task
Wasifur Rahman, Sangwu Lee, Md. Saiful Islam +9
In this paper, we envision a web-based framework that can help anyone, anywhere around the world record a short speech task, and analyze the recorded data to screen for Parkinson's…
Integrating Multimodal Information in Large Pretrained Transformers
Wasifur Rahman, Md. Kamrul Hasan, Sangwu Lee +4
Recent Transformer-based contextual word representations, including BERT and XLNet, have shown state-of-the-art performance in multiple disciplines within NLP. Fine-tuning the trai…
UR-FUNNY: A Multimodal Language Dataset for Understanding Humor
Md Kamrul Hasan, Wasifur Rahman, Amir Zadeh +5
Humor is a unique and creative communicative behavior displayed during social interactions. It is produced in a multimodal manner, through the usage of words (text), gestures (visi…