Multi-Task Learning for Mental Health using Social Media Text

Abstract

We introduce initial groundwork for estimating suicide risk and mental health in a deep learning framework. By modeling multiple conditions, the system learns to make predictions about suicide risk and mental health at a low false positive rate. Conditions are modeled as tasks in a multi-task learning (MTL) framework, with gender prediction as an additional auxiliary task. We demonstrate the effectiveness of multi-task learning by comparison to a well-tuned single-task baseline with the same number of parameters. Our best MTL model predicts potential suicide attempt, as well as the presence of atypical mental health, with AUC > 0.8. We also find additional large improvements using multi-task learning on mental health tasks with limited training data.

Cited by in corpus (12)

• Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications
• Machine Learning-based Approach for Depression Detection in Twitter Using Content and Activity Features
• MiME: Multilevel Medical Embedding of Electronic Health Records for Predictive Healthcare
• Suicidal Ideation and Mental Disorder Detection with Attentive Relation Networks
• Characterization of Time-variant and Time-invariant Assessment of Suicidality on Reddit using C-SSRS
• Detection and Classification of mental illnesses on social media using RoBERTa
• Deep Representation Learning for Clustering of Health Tweets
• Multi-task Domain Adaptation for Sequence Tagging
• Not Just Depressed: Bipolar Disorder Prediction on Reddit
• Jointly Learning Clinical Entities and Relations with Contextual Language Models and Explicit Context
• Multi-Task Learning for Argumentation Mining
• Modeling Proficiency with Implicit User Representations