Building a better NetFlow
Top Cited Papers
- 30 August 2004
- proceedings article
- Published by Association for Computing Machinery (ACM)
- Vol. 34 (4) , 245-256
- https://doi.org/10.1145/1015467.1015495
Abstract
Network operators need to determine the composition of the traffic mix on links when looking for dominant applications, users, or estimating traffic matrices. Cisco's NetFlow has evolved into a solution that satisfies this need by reporting flow records that summarize a sample of the traffic traversing the link. But sampled NetFlow has shortcomings that hinder the collection and analysis of traffic data. First, during flooding attacks router memory and network bandwidth consumed by flow records can increase beyond what is available; second, selecting the right static sampling rate is difficult because no single rate gives the right tradeoff of memory use versus accuracy for all traffic mixes; third, the heuristics routers use to decide when a flow is reported are a poor match to most applications that work with time bins; finally, it is impossible to estimate without bias the number of active flows for aggregates with non-TCP traffic.In this paper we propose Adaptive NetFlow, deployable through an update to router software, which addresses many shortcomings of NetFlow by dynamically adapting the sampling rate to achieve robustness without sacrificing accuracy. To enable counting of non-TCP flows, we propose an optional Flow Counting Extension that requires augmenting existing hardware at routers. Both our proposed solutions readily provide descriptions of the traffic of progressively smaller sizes. Transmitting these at progressively higher levels of reliability allows graceful degradation of the accuracy of traffic reports in response to network congestion on the reporting path.Keywords
This publication has 13 references indexed in Scilit:
- GigascopePublished by Association for Computing Machinery (ACM) ,2003
- Predicting resource usage and estimation accuracy in an IP flow measurement collection infrastructurePublished by Association for Computing Machinery (ACM) ,2003
- Bitmap algorithms for counting active flows on high speed linksPublished by Association for Computing Machinery (ACM) ,2003
- Adaptive random sampling for load change detectionPublished by Association for Computing Machinery (ACM) ,2002
- Properties and prediction of flow statistics from sampled packet streamsPublished by Association for Computing Machinery (ACM) ,2002
- A signal analysis of network traffic anomaliesPublished by Association for Computing Machinery (ACM) ,2002
- Deriving traffic demands for operational IP networksPublished by Association for Computing Machinery (ACM) ,2000
- Bro: a system for detecting network intruders in real-timeComputer Networks, 1999
- Receiver-driven layered multicastACM SIGCOMM Computer Communication Review, 1996
- On adaptive samplingComputing, 1990