46 citations · 54 across the 5 of their papers we have counts for
3 papers · 1 filter
Evaluating Contextual Embeddings and their Extraction Layers for Depression Assessment
Matthew Matero, Albert Hung, H. Andrew Schwartz
Recent works have demonstrated ability to assess aspects of mental health from personal discourse. At the same time, pre-trained contextual word embedding models have grown to domi…
MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection
Matthew Matero, Nikita Soni, Niranjan Balasubramanian +1
Much of natural language processing is focused on leveraging large capacity language models, typically trained over single messages with a task of predicting one or more tokens. Ho…
Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality
Adithya V Ganesan, Matthew Matero, Aravind Reddy Ravula +2
In human-level NLP tasks, such as predicting mental health, personality, or demographics, the number of observations is often smaller than the standard 768+ hidden state sizes of e…