A Survey on Big Data for Network Traffic Monitoring and Analysis
arXiv:2003.01648 · doi:10.1109/TNSM.2019.2933358
Abstract
Network Traffic Monitoring and Analysis (NTMA) represents a key component for network management, especially to guarantee the correct operation of large-scale networks such as the Internet. As the complexity of Internet services and the volume of traffic continue to increase, it becomes difficult to design scalable NTMA applications. Applications such as traffic classification and policing require real-time and scalable approaches. Anomaly detection and security mechanisms require to quickly identify and react to unpredictable events while processing millions of heterogeneous events. At last, the system has to collect, store, and process massive sets of historical data for post-mortem analysis. Those are precisely the challenges faced by general big data approaches: Volume, Velocity, Variety, and Veracity. This survey brings together NTMA and big data. We catalog previous work on NTMA that adopt big data approaches to understand to what extent the potential of big data is being explored in NTMA. This survey mainly focuses on approaches and technologies to manage the big NTMA data, additionally briefly discussing big data analytics (e.g., machine learning) for the sake of NTMA. Finally, we provide guidelines for future work, discussing lessons learned, and research directions.
References in corpus (1)
Cited by in corpus (8)
- Differential Privacy for Industrial Internet of Things: Opportunities, Applications and Challenges
- Active Learning for Network Traffic Classification: A Technical Study
- MBTree: Detecting Encryption RAT Communication Using Malicious Behavior Tree
- Mapping the Landscape of Generative AI in Network Monitoring and Management
- Visualization Of Class Activation Maps To Explain AI Classification Of Network Packet Captures
- Exploring Network-Wide Flow Data with Flowyager
- Network Anomaly Detection based on Tensor Decomposition
- VINEVI: A Virtualized Network Vision Architecture for Smart Monitoring of Heterogeneous Applications and Infrastructures