169 citations · 299 across the 17 of their papers we have counts for
4 papers · 1 filter
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Nan Du, Yanping Huang, Andrew M. Dai +24
Scaling language models with more data, compute and parameters has driven significant progress in natural language processing. For example, thanks to scaling, GPT-3 was able to ach…
Toxicity Detection can be Sensitive to the Conversational Context
Alexandros Xenos, John Pavlopoulos, Ion Androutsopoulos +3
User posts whose perceived toxicity depends on the conversational context are rare in current toxicity detection datasets. Hence, toxicity detectors trained on existing datasets wi…
Augmenting the User-Item Graph with Textual Similarity Models
Federico López, Martin Scholz, Jessica Yung +3
This paper introduces a simple and effective form of data augmentation for recommender systems. A paraphrase similarity model is applied to widely available textual data, such as r…
Civil Rephrases Of Toxic Texts With Self-Supervised Transformers
Leo Laugier, John Pavlopoulos, Jeffrey Sorensen +1
Platforms that support online commentary, from social networks to news sites, are increasingly leveraging machine learning to assist their moderation efforts. But this process does…