activity
20172024
most citedLarge language models surpass human experts in predicting neuroscience results

134 citations · 459 across the 41 of their papers we have counts for

collaborators
Showing 2021Show all

9 papers · 1 filter

cs.LG2021

A Probabilistic Framework for Knowledge Graph Data Augmentation

Jatin Chauhan, Priyanshu Gupta, Pasquale Minervini

We present NNMFAug, a probabilistic framework to perform data augmentation for the task of knowledge graph completion to counter the problem of data scarcity, which can enhance the…

cs.CL2021★ 7 cited

Relation Prediction as an Auxiliary Training Objective for Improving Multi-Relational Graph Representations

Yihong Chen, Pasquale Minervini, Sebastian Riedel +1

Learning good representations on multi-relational graphs is essential to knowledge base completion (KBC). In this paper, we propose a new self-supervised training objective for mul…

cs.CL2021

Training Adaptive Computation for Open-Domain Question Answering with Computational Constraints

Yuxiang Wu, Pasquale Minervini, Pontus Stenetorp +1

Adaptive Computation (AC) has been shown to be effective in improving the efficiency of Open-Domain Question Answering (ODQA) systems. However, current AC approaches require tuning…

cs.AI2021

Combining Inductive and Deductive Reasoning for Query Answering over Incomplete Knowledge Graphs

Medina Andresel, Trung-Kien Tran, Csaba Domokos +2

Current methods for embedding-based query answering over incomplete Knowledge Graphs (KGs) only focus on inductive reasoning, i.e., predicting answers by learning patterns from the…

cs.LG2021★ 6 cited

Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions

Mathias Niepert, Pasquale Minervini, Luca Franceschi

Combining discrete probability distributions and combinatorial optimization problems with neural network components has numerous applications but poses several challenges. We propo…

cs.CL2021★ 13 cited

Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models

Daniel de Vassimon Manela, David Errington, Thomas Fisher +2

This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun r…

cs.CL2021

PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them

Patrick Lewis, Yuxiang Wu, Linqing Liu +5

Open-domain Question Answering models which directly leverage question-answer (QA) pairs, such as closed-book QA (CBQA) models and QA-pair retrievers, show promise in terms of spee…

cs.LG2021★ 3 cited

Grid-to-Graph: Flexible Spatial Relational Inductive Biases for Reinforcement Learning

Zhengyao Jiang, Pasquale Minervini, Minqi Jiang +1

Although reinforcement learning has been successfully applied in many domains in recent years, we still lack agents that can systematically generalize. While relational inductive b…

cs.CL2021★ 64 cited

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned

Sewon Min, Jordan Boyd-Graber, Chris Alberti +50

We review the EfficientQA competition from NeurIPS 2020. The competition focused on open-domain question answering (QA), where systems take natural language questions as input and…