52 citations · 113 across the 8 of their papers we have counts for
13 papers
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…
Local Knowledge Powered Conversational Agents
Sashank Santhanam, Wei Ping, Raul Puri +3
State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, co…
Learning to Plan and Realize Separately for Open-Ended Dialogue Systems
Sashank Santhanam, Zhuo Cheng, Brodie Mather +7
Achieving true human-like ability to conduct a conversation remains an elusive goal for open-ended dialogue systems. We posit this is because extant approaches towards natural lang…
The Panacea Threat Intelligence and Active Defense Platform
Adam Dalton, Ehsan Aghaei, Ehab Al-Shaer +13
We describe Panacea, a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human langu…
Adaptation of a Lexical Organization for Social Engineering Detection and Response Generation
Archna Bhatia, Adam Dalton, Brodie Mather +5
We present a paradigm for extensible lexicon development based on Lexical Conceptual Structure to support social engineering detection and response generation. We leverage the cent…
Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents
Sashank Santhanam, Alireza Karduni, Samira Shaikh
Humans quite frequently interact with conversational agents. The rapid advancement in generative language modeling through neural networks has helped advance the creation of intell…