2.2k citations · 6.2k across the 59 of their papers we have counts for
6 papers · 1 filter
Self-supervised self-supervision by combining deep learning and probabilistic logic
Hunter Lang, Hoifung Poon
Labeling training examples at scale is a perennial challenge in machine learning. Self-supervision methods compensate for the lack of direct supervision by leveraging prior knowled…
CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
Chenyan Xiong, Zhenghao Liu, Si Sun +7
Neural rankers based on deep pretrained language models (LMs) have been shown to improve many information retrieval benchmarks. However, these methods are affected by their the cor…
The Fourth Catalog of Active Galactic Nuclei Detected by the Fermi Large Area Telescope -- Data Release 2
B. Lott, D. Gasparrini, S. Ciprini
An incremental version (4LAC-DR2) of the fourth catalog of active galactic nuclei (AGNs) detected by the Fermi-LAT is presented. This version is associated with the second release…
Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
Yu Gu, Robert Tinn, Hao Cheng +6
Pretraining large neural language models, such as BERT, has led to impressive gains on many natural language processing (NLP) tasks. However, most pretraining efforts focus on gene…
Adversarial Training for Large Neural Language Models
Xiaodong Liu, Hao Cheng, Pengcheng He +4
Generalization and robustness are both key desiderata for designing machine learning methods. Adversarial training can enhance robustness, but past work often finds it hurts genera…
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
Xiaodong Liu, Yu Wang, Jianshu Ji +8
We present MT-DNN, an open-source natural language understanding (NLU) toolkit that makes it easy for researchers and developers to train customized deep learning models. Built upo…