CANAL -- Cyber Activity News Alerting Language Model: Empirical Approach vs. Expensive LLM
arXiv:2405.06772 · doi:10.1109/ICAIC60265.2024.10433839
Abstract
In today's digital landscape, where cyber attacks have become the norm, the detection of cyber attacks and threats is critically imperative across diverse domains. Our research presents a new empirical framework for cyber threat modeling, adept at parsing and categorizing cyber-related information from news articles, enhancing real-time vigilance for market stakeholders. At the core of this framework is a fine-tuned BERT model, which we call CANAL - Cyber Activity News Alerting Language Model, tailored for cyber categorization using a novel silver labeling approach powered by Random Forest. We benchmark CANAL against larger, costlier LLMs, including GPT-4, LLaMA, and Zephyr, highlighting their zero to few-shot learning in cyber news classification. CANAL demonstrates superior performance by outperforming all other LLM counterparts in both accuracy and cost-effectiveness. Furthermore, we introduce the Cyber Signal Discovery module, a strategic component designed to efficiently detect emerging cyber signals from news articles. Collectively, CANAL and Cyber Signal Discovery module equip our framework to provide a robust and cost-effective solution for businesses that require agile responses to cyber intelligence.
Published in 2024 IEEE 3rd International Conference on AI in Cybersecurity (ICAIC), Conference Date: 07-09 February 2024
References in corpus (10)
- XGBoost: A Scalable Tree Boosting System
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- LoRA: Low-Rank Adaptation of Large Language Models
- PaLM: Scaling Language Modeling with Pathways
- Training Compute-Optimal Large Language Models
- BloombergGPT: A Large Language Model for Finance
- Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
- Compressing Large-Scale Transformer-Based Models: A Case Study on BERT
- Zephyr: Direct Distillation of LM Alignment
- CyNER: A Python Library for Cybersecurity Named Entity Recognition