14 citations · 25 across the 9 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020
An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training
Kristjan Arumae, Qing Sun, Parminder Bhatia
Pre-training large language models has become a standard in the natural language processing community. Such models are pre-trained on generic data (e.g. BookCorpus and English Wiki…
cs.IR2020★ 14 cited
AWS CORD-19 Search: A Neural Search Engine for COVID-19 Literature
Parminder Bhatia, Lan Liu, Kristjan Arumae +12
Coronavirus disease (COVID-19) has been declared as a pandemic by WHO with thousands of cases being reported each day. Numerous scientific articles are being published on the disea…
cs.CL2020
CALM: Continuous Adaptive Learning for Language Modeling
Kristjan Arumae, Parminder Bhatia
Training large language representation models has become a standard in the natural language processing community. This allows for fine tuning on any number of specific tasks, howev…