OSINT Clinic: Co-designing AI-Augmented Collaborative OSINT Investigations for Vulnerability Assessment

Abstract

Small businesses need vulnerability assessments to identify and mitigate cyber risks. Cybersecurity clinics provide a solution by offering students hands-on experience while delivering free vulnerability assessments to local organizations. To scale this model, we propose an Open Source Intelligence (OSINT) clinic where students conduct assessments using only publicly available data. We enhance the quality of investigations in the OSINT clinic by addressing the technical and collaborative challenges. Over the duration of the 2023-24 academic year, we conducted a three-phase co-design study with six students. Our study identified key challenges in the OSINT investigations and explored how generative AI could address these performance gaps. We developed design ideas for effective AI integration based on the use of AI probes and collaboration platform features. A pilot with three small businesses highlighted both the practical benefits of AI in streamlining investigations, and limitations, including privacy concerns and difficulty in monitoring progress.

References in corpus (10)

• The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
• The Metacognitive Demands and Opportunities of Generative AI
• Design Principles for Generative AI Applications
• "It Felt Like Having a Second Mind": Investigating Human-AI Co-creativity in Prewriting with Large Language Models
• Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI
• A Word is Worth a Thousand Pictures: Prompts as AI Design Material
• CoSINT: Designing a Collaborative Capture the Flag Competition to Investigate Misinformation
• The Use of Generative Search Engines for Knowledge Work and Complex Tasks
• OSINT Research Studios: A Flexible Crowdsourcing Framework to Scale Up Open Source Intelligence Investigations
• Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning