Combining active and passive network measurements to build scalable monitoring systems on the grid
- 1 March 2003
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 30 (4) , 19-26
- https://doi.org/10.1145/773056.773061
Abstract
Because the network provides the wires that connect a grid, understanding the performance provided by a network is crucial to achieving satisfactory performance from many grid applications. Monitoring the network to predict its performance for applications is an effective solution, but the costs and scalability challenges of actively injecting measurement traffic, as well as the information access and accuracy challenges of using passively collected measurements, complicate the problem of developing a monitoring solution for a global grid. This paper is a preliminary report on the Wren project, which is focused on developing scalable solutions for network performance monitoring. By combining active and passive monitoring techniques, Wren is able to reduce the need for invasive measurements of the network without sacrificing measurement accuracy on either the WAN or LAN levels. Specifically, we present topology-based steering, which dramatically reduces the number of measurements taken for a system by using passively acquired topology and utilization to select the bottleneck links that require active bandwidth probing. Furthermore, by using passive measurements while an application is running and active measurements when none is running, we preserve our ability to offer accurate, timely predictions of network performance, while eliminating additional invasive measurements.Keywords
This publication has 10 references indexed in Scilit:
- On the placement of Internet instrumentationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamic distance maps of the InternetPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Topology discovery in heterogeneous IP networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Internet tomographyIEEE Signal Processing Magazine, 2002
- Topology discovery for large ethernet networksPublished by Association for Computing Machinery (ACM) ,2001
- An investigation of geographic mapping techniques for internet hostsPublished by Association for Computing Machinery (ACM) ,2001
- Using pathchar to estimate Internet link characteristicsPublished by Association for Computing Machinery (ACM) ,1999
- Bandwidth modelling for network-aware applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,1999
- Dynamically forecasting network performance using the Network Weather ServiceCluster Computing, 1998
- The macroscopic behavior of the TCP congestion avoidance algorithmACM SIGCOMM Computer Communication Review, 1997