Towards a Universal Sketch for Origin-Destination Network Measurements - Network and Parallel Computing
Conference Papers Year : 2011

Towards a Universal Sketch for Origin-Destination Network Measurements

Nan Hua
  • Function : Author
  • PersonId : 1017407
Ashwin Lall
  • Function : Author
  • PersonId : 1017408
Ping Li
  • Function : Author
  • PersonId : 1017409
Jia Wang
  • Function : Author
  • PersonId : 1017410
Jun (jim) Xu
  • Function : Author
  • PersonId : 1017411

Abstract

Despite its importance in today’s Internet, network measurement was not an integral part of the original Internet architecture, i.e., there was (and still is) little native support for many essential measurement tasks. Targeting the inadequacy of counting/accounting capabilities of existing routers, many data streaming and sketching techniques have been proposed to estimate the important statistics of traffic going through a network link. Most of these techniques are, however, developed to track one specific statistic and/or answer a specific type of query. Since there are a large number of such statistics and queries of interest, it is very difficult, if not impossible, for network vendors and operators to implement and deploy data streaming/sketching solutions for all of them, due to router resource (memory, CPU, bus bandwidth, etc.) constraints.In this paper, we propose a general-purpose solution that can not only answer a wide range of queries, but also be able to answer types of queries that were not known a priori. In particular, we introduce the use of the Conditional Random Sampling (CRS) sketch data structure for succinctly capturing network traffic data between a set of nodes in the network. This sketch is the first step towards a “universal” sketch data structure in the sense that it is not tied to measurement of a single quantity. We show that the CRS sketch can compute unbiased estimates for any linear summary statistic in the intersection of a pair of traffic streams, e.g., traffic and flow matrix information, flow counts, and entropy. We present detailed experiments, using data collected at a tier-1 ISP, that show that our sketch is capable of estimating this wide range of statistics with fairly high accuracy.
Fichier principal
Vignette du fichier
978-3-642-24403-2_17_Chapter.pdf (169.22 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01593017 , version 1 (25-09-2017)

Licence

Identifiers

Cite

Haiquan (chuck) Zhao, Nan Hua, Ashwin Lall, Ping Li, Jia Wang, et al.. Towards a Universal Sketch for Origin-Destination Network Measurements. 8th Network and Parallel Computing (NPC), Oct 2011, Changsha,, China. pp.201-213, ⟨10.1007/978-3-642-24403-2_17⟩. ⟨hal-01593017⟩
94 View
50 Download

Altmetric

Share

More