activity
20202022
most citedThe GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

52 citations · 149 across the 8 of their papers we have counts for

collaborators

9 papers

cs.CL2022★ 24 cited

Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges

Shikib Mehri, Jinho Choi, Luis Fernando D'Haro +13

This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog. The workshop explored the current state of the art along with its limitations and suggeste…

cs.CL2022★ 3 cited

A Survey on Artificial Intelligence for Source Code: A Dialogue Systems Perspective

Erfan Al-Hossami, Samira Shaikh

In this survey paper, we overview major deep learning methods used in Natural Language Processing (NLP) and source code over the last 35 years. Next, we present a survey of the app…

cs.SE2022★ 23 cited

Can We Generate Shellcodes via Natural Language? An Empirical Study

Pietro Liguori, Erfan Al-Hossami, Domenico Cotroneo +3

Writing software exploits is an important practice for offensive security analysts to investigate and prevent attacks. In particular, shellcodes are especially time-consuming and a…

cs.SE2021★ 26 cited

EVIL: Exploiting Software via Natural Language

Pietro Liguori, Erfan Al-Hossami, Vittorio Orbinato +4

Writing exploits for security assessment is a challenging task. The writer needs to master programming and obfuscation techniques to develop a successful exploit. To make the task…

cs.SE2021★ 15 cited

Shellcode_IA32: A Dataset for Automatic Shellcode Generation

Pietro Liguori, Erfan Al-Hossami, Domenico Cotroneo +3

We take the first step to address the task of automatically generating shellcodes, i.e., small pieces of code used as a payload in the exploitation of a software vulnerability, sta…

cs.CL2021★ 52 cited

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal +53

We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of auto…

cs.CL2020

Learning to Plan and Realize Separately for Open-Ended Dialogue Systems

Sashank Santhanam, Zhuo Cheng, Brodie Mather +7

Achieving true human-like ability to conduct a conversation remains an elusive goal for open-ended dialogue systems. We posit this is because extant approaches towards natural lang…

cs.CL2020★ 5 cited

The Panacea Threat Intelligence and Active Defense Platform

Adam Dalton, Ehsan Aghaei, Ehab Al-Shaer +13

We describe Panacea, a system that supports natural language processing (NLP) components for active defenses against social engineering attacks. We deploy a pipeline of human langu…

cs.CL2020★ 1 cited

Adaptation of a Lexical Organization for Social Engineering Detection and Response Generation

Archna Bhatia, Adam Dalton, Brodie Mather +5

We present a paradigm for extensible lexicon development based on Lexical Conceptual Structure to support social engineering detection and response generation. We leverage the cent…