activity
20172026
most citedMegatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

832 citations · 1.4k across the 48 of their papers we have counts for

collaborators
Showing 2020Show all

5 papers · 1 filter

cs.CL2020★ 1 cited

Local Knowledge Powered Conversational Agents

Sashank Santhanam, Wei Ping, Raul Puri +3

State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, co…

cs.CL2020★ 11 cited

BioMegatron: Larger Biomedical Domain Language Model

Hoo-Chang Shin, Yang Zhang, Evelina Bakhturina +4

There has been an influx of biomedical domain-specific language models, showing language models pre-trained on biomedical text perform better on biomedical domain benchmarks than t…

cs.CL2020★ 12 cited

MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

Peng Xu, Mostofa Patwary, Mohammad Shoeybi +4

Existing pre-trained large language models have shown unparalleled generative capabilities. However, they are not controllable. In this paper, we propose MEGATRON-CNTRL, a novel fr…

cs.CL2020

Large Scale Multi-Actor Generative Dialog Modeling

Alex Boyd, Raul Puri, Mohammad Shoeybi +2

Non-goal oriented dialog agents (i.e. chatbots) aim to produce varying and engaging conversations with a user; however, they typically exhibit either inconsistent personality acros…

cs.CL2020

Training Question Answering Models From Synthetic Data

Raul Puri, Ryan Spring, Mostofa Patwary +2

Question and answer generation is a data augmentation method that aims to improve question answering (QA) models given the limited amount of human labeled data. However, a consider…