34 citations · 51 across the 12 of their papers we have counts for
13 papers
FATHOMS-RAG: A Framework for the Assessment of Thinking and Observation in Multimodal Systems that use Retrieval Augmented Generation
Samuel Hildebrand, Curtis Taylor, Sean Oesch +5
Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evalua…
Agentic AI and the Cyber Arms Race
Sean Oesch, Jack Hutchins, Phillipe Austria +1
Agentic AI is shifting the cybersecurity landscape as attackers and defenders leverage AI agents to augment humans and automate common tasks. In this article, we examine the implic…
On the Abuse and Detection of Polyglot Files
Luke Koch, Sean Oesch, Amul Chaulagain +8
A polyglot is a file that is valid in two or more formats. Polyglot files pose a problem for malware detection systems that route files to format-specific detectors/signatures, as…
The Path To Autonomous Cyber Defense
Sean Oesch, Phillipe Austria, Amul Chaulagain +4
Defenders are overwhelmed by the number and scale of attacks against their networks.This problem will only be exacerbated as attackers leverage artificial intelligence to automate…
Testing SOAR Tools in Use
Robert A. Bridges, Ashley E. Rice, Sean Oesch +11
Modern security operation centers (SOCs) rely on operators and a tapestry of logging and alerting tools with large scale collection and query abilities. SOC investigations are tedi…
Toward the Detection of Polyglot Files
Luke Koch, Sean Oesch, Mary Adkisson +3
Standardized file formats play a key role in the development and use of computer software. However, it is possible to abuse standardized file formats by creating a file that is val…
A Mathematical Framework for Evaluation of SOAR Tools with Limited Survey Data
Savannah Norem, Ashley E Rice, Samantha Erwin +3
Security operation centers (SOCs) all over the world are tasked with reacting to cybersecurity alerts ranging in severity. Security Orchestration, Automation, and Response (SOAR) t…
What Clinical Trials Can Teach Us about the Development of More Resilient AI for Cybersecurity
Edmon Begoli, Robert A. Bridges, Sean Oesch +1
Policy-mandated, rigorously administered scientific testing is needed to provide transparency into the efficacy of artificial intelligence-based (AI-based) cyber defense tools for…
The Emperor's New Autofill Framework: A Security Analysis of Autofill on iOS and Android
Sean Oesch, Anuj Gautam, Scott Ruoti
Password managers help users more effectively manage their passwords, encouraging them to adopt stronger passwords across their many accounts. In contrast to desktop systems where…
An Integrated Platform for Collaborative Data Analytics
Sean Oesch, Rob Gillen, Tom Karnowski
While collaboration among data scientists is a key to organizational productivity, data analysts face significant barriers to achieving this end, including data sharing, accessing…
An Assessment of the Usability of Machine Learning Based Tools for the Security Operations Center
Sean Oesch, Robert Bridges, Jared Smith +5
Gartner, a large research and advisory company, anticipates that by 2024 80% of security operation centers (SOCs) will use machine learning (ML) based solutions to enhance their op…
Beyond the Hype: A Real-World Evaluation of the Impact and Cost of Machine Learning-Based Malware Detection
Robert A. Bridges, Sean Oesch, Miki E. Verma +12
In this paper, we present a scientific evaluation of four prominent malware detection tools to assist an organization with two primary questions: To what extent do ML-based tools a…
That Was Then, This Is Now: A Security Evaluation of Password Generation, Storage, and Autofill in Thirteen Password Managers
Sean Oesch, Scott Ruoti
Password managers have the potential to help users more effectively manage their passwords and address many of the concerns surrounding password-based authentication, however prior…