activity
20202022
most citedThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

52 citations · 108 across the 6 of their papers we have counts for

collaborators

7 papers

cs.CL202224 cited

Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges

Shikib Mehri, Jinho Choi, Luis Fernando D'Haro +13

This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog. The workshop explored the current state of the art along with its limitations and suggeste…

cs.CL20223 cited

A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective

Erfan Al-Hossami, Samira Shaikh

In this survey paper, we overview major deep learning methods used in Natural Language Processing (NLP) and source code over the last 35 years. Next, we present a survey of the app…

cs.SE202223 cited

Can We Generate Shellcodes via Natural Language? An Empirical Study

Pietro Liguori, Erfan Al-Hossami, Domenico Cotroneo +3

Writing software exploits is an important practice for offensive security analysts to investigate and prevent attacks. In particular, shellcodes are especially time-consuming and a…

cs.CL202152 cited

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53

We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…

cs.CL2020

Learning to Plan and Realize Separately for Open-Ended Dialogue Systems

Sashank Santhanam, Zhuo Cheng, Brodie Mather +7

Achieving true human-like ability to conduct a conversation remains an elusive goal for open-ended dialogue systems. We posit this is because extant approaches towards natural lang…

cs.CL20205 cited

The Panacea Threat Intelligence and Active Defense Platform

Adam Dalton, Ehsan Aghaei, Ehab Al-Shaer +13

We describe Panacea, a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human langu…