13 citations · 28 across the 6 of their papers we have counts for
9 papers
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question
Alireza Mohammadshahi, Thomas Scialom, Majid Yazdani +4
Existing metrics for evaluating the quality of automatically generated questions such as BLEU, ROUGE, BERTScore, and BLEURT compare the reference and predicted questions, providing…
Policy Compliance Detection via Expression Tree Inference
Neema Kotonya, Andreas Vlachos, Majid Yazdani +2
Policy Compliance Detection (PCD) is a task we encounter when reasoning over texts, e.g. legal frameworks. Previous work to address PCD relies heavily on modeling the task as a spe…
Open Vocabulary Extreme Classification Using Generative Models
Daniel Simig, Fabio Petroni, Pouya Yanki +4
The extreme multi-label classification (XMC) task aims at tagging content with a subset of labels from an extremely large label set. The label vocabulary is typically defined in ad…
PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models
Rabeeh Karimi Mahabadi, Luke Zettlemoyer, James Henderson +4
Current methods for few-shot fine-tuning of pretrained masked language models (PLMs) require carefully engineered prompts and verbalizers for each new task to convert examples into…
Cross-Policy Compliance Detection via Question Answering
Marzieh Saeidi, Majid Yazdani, Andreas Vlachos
Policy compliance detection is the task of ensuring that a scenario conforms to a policy (e.g. a claim is valid according to government rules or a post in an online platform confor…
Database Reasoning Over Text
James Thorne, Majid Yazdani, Marzieh Saeidi +3
Neural models have shown impressive performance gains in answering queries from natural language text. However, existing works are unable to support database queries, such as "List…
Neural Databases
James Thorne, Majid Yazdani, Marzieh Saeidi +3
In recent years, neural networks have shown impressive performance gains on long-standing AI problems, and in particular, answering queries from natural language text. These advanc…
KILT: a Benchmark for Knowledge Intensive Language Tasks
Fabio Petroni, Aleksandra Piktus, Angela Fan +10
Challenging problems such as open-domain question answering, fact checking, slot filling and entity linking require access to large, external knowledge sources. While some models d…
SESA: Supervised Explicit Semantic Analysis
Dasha Bogdanova, Majid Yazdani
In recent years supervised representation learning has provided state of the art or close to the state of the art results in semantic analysis tasks including ranking and informati…