Measuring Depression Symptom Severity from Spoken Language and 3D Facial Expressions
arXiv:1811.08592
Abstract
With more than 300 million people depressed worldwide, depression is a global problem. Due to access barriers such as social stigma, cost, and treatment availability, 60% of mentally-ill adults do not receive any mental health services. Effective and efficient diagnosis relies on detecting clinical symptoms of depression. Automatic detection of depressive symptoms would potentially improve diagnostic accuracy and availability, leading to faster intervention. In this work, we present a machine learning method for measuring the severity of depressive symptoms. Our multi-modal method uses 3D facial expressions and spoken language, commonly available from modern cell phones. It demonstrates an average error of 3.67 points (15.3% relative) on the clinically-validated Patient Health Questionnaire (PHQ) scale. For detecting major depressive disorder, our model demonstrates 83.3% sensitivity and 82.6% specificity. Overall, this paper shows how speech recognition, computer vision, and natural language processing can be combined to assist mental health patients and practitioners. This technology could be deployed to cell phones worldwide and facilitate low-cost universal access to mental health care.
arXiv commentMachine Learning for Health (ML4H) Workshop at NeurIPS 2018 arXiv:1811.07216
References in corpus (5)
- An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
- Semantics derived automatically from language corpora contain human-like biases
- Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypes
- Character-Aware Neural Language Models
- Topic Modeling Based Multi-modal Depression Detection
Cited by in corpus (5)
- Text-based depression detection on sparse data
- Two-stage Temporal Modelling Framework for Video-based Depression Recognition using Graph Representation
- Predicting Mood Disorder Symptoms with Remotely Collected Videos Using an Interpretable Multimodal Dynamic Attention Fusion Network
- Interpreting Depression From Question-wise Long-term Video Recording of SDS Evaluation
- Cognitive computation of brain disorders based primarily on ocular responses