Applications of sketches in network traffic measurement: A survey

Loading...
Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä

Major/Subject

Mcode

Degree programme

Language

en

Pages

28

Series

Information Fusion, Volume 82, pp. 58-85

Abstract

Accurate and timely network traffic measurement is essential for network status monitoring, network fault analysis, network intrusion detection, and network security management. With the rapid development of the network, massive network traffic brings severe challenges to network traffic measurement. However, existing measurement methods suffer from many limitations for effectively recording and accurately analyzing big-volume traffic. Recently, sketches, a family of probabilistic data structures that employ hashing technology for summarizing traffic data, have been widely used to solve these problems. However, current literature still lacks a thorough review on sketch-based traffic measurement methods to offer a comprehensive insight on how to apply sketches for fulfilling various traffic measurement tasks. In this paper, we provide a detailed and comprehensive review on the applications of sketches in network traffic measurement. To this end, we classify the network traffic measurement tasks into four categories based on the target of traffic measurement, namely cardinality estimation, flow size estimation, change anomaly detection, and persistent spreader identification. First, we briefly introduce these four types of traffic measurement tasks and discuss the advantages of applying sketches. Then, we propose a series of requirements with regard to the applications of sketches in network traffic measurement. After that, we perform a fine-grained classification for each sketch-based measurement category according to the technologies applied on sketches. During the review, we evaluate the performance, advantages and disadvantages of current sketch-based traffic measurement methods based on the proposed requirements. Through the thorough review, we gain a number of valuable implications that can guide us to choose and design proper traffic measurement methods based on sketches. We also review a number of general sketches that are highly expected in modern network systems to simultaneously perform multiple traffic measurement tasks and discuss their performance based on the proposed requirements. Finally, through our serious review, we summarize a number of open issues and identify several promising research directions.

Description

Funding Information: This work is supported in part by the National Natural Science Foundation of China under Grant 62072351 ; in part by the Academy of Finland under Grant 308087 , Grant 335262 and Grant 345072 ; in part by the open research project of ZheJiang Lab, China ; in part by the Shaanxi Innovation Team Project, China under Grant 2018TD-007 ; and in part by the 111 Project, China under Grant B16037 , as well as Huawei Technologies Group Co., Ltd, China . Funding Information: This work is supported in part by the National Natural Science Foundation of China under Grant 62072351; in part by the Academy of Finland under Grant 308087, Grant 335262 and Grant 345072; in part by the open research project of ZheJiang Lab, China; in part by the Shaanxi Innovation Team Project, China under Grant 2018TD-007; and in part by the 111 Project, China under Grant B16037, as well as Huawei Technologies Group Co. Ltd, China. Publisher Copyright: © 2021

Other note

Citation

Han, H, Yan, Z, Jing, X & Pedrycz, W 2022, 'Applications of sketches in network traffic measurement : A survey', Information Fusion, vol. 82, pp. 58-85. https://doi.org/10.1016/j.inffus.2021.12.007