Self-similarity through high-variability
- 1 October 1995
- journal article
- conference paper
- Published by Association for Computing Machinery (ACM) in ACM SIGCOMM Computer Communication Review
- Vol. 25 (4) , 100-113
- https://doi.org/10.1145/217391.217418
Abstract
A number of recent empirical studies of traffic measurements from a variety of working packet networks have convincingly demonstrated that actual network traffic is self-similar or long-range dependent in nature (i.e., bursty over a wide range of time scales) - in sharp contrast to commonly made traffic modeling assumptions. In this paper, we provide a plausible physical explanation for the occurrence of self-similarity in high-speed network traffic. Our explanation is based on convergence results for processes that exhibit high variability (i.e., infinite variance) and is supported by detailed statistical analyses of real-time traffic measurements from Ethernet LAN's at the level of individual sources.Our key mathematical result states that the superposition of many ON/OFF sources (also known as packet trains ) whose ON-periods and OFF-periods exhibit the Noah Effect (i.e., have high variability or infinite variance) produces aggregate network traffic that features the Joseph Effect (i.e., is self-similar or long-range dependent). There is, moreover, a simple relation between the parameters describing the intensities of the Noah Effect (high variability) and the Joseph Effect (self-similarity). An extensive statistical analysis of two sets of high time-resolution traffic measurements from two Ethernet LAN's (involving a few hundred active source-destination pairs) confirms that the data at the level of individual sources or source-destination pairs are consistent with the Noah Effect. We also discuss implications of this simple physical explanation for the presence of self-similar traffic patterns in modern high-speed network traffic for (i) parsimonious traffic modeling (ii) efficient synthetic generation of realistic traffic patterns, and (iii) relevant network performance and protocol analysis.Keywords
This publication has 15 references indexed in Scilit:
- Large deviations and overflow probabilities for the general single-server queue, with applicationsMathematical Proceedings of the Cambridge Philosophical Society, 1995
- MBONE: the multicast backboneCommunications of the ACM, 1994
- The World-Wide WebCommunications of the ACM, 1994
- On the self-similar nature of Ethernet traffic (extended version)IEEE/ACM Transactions on Networking, 1994
- On the self-similar nature of Ethernet trafficPublished by Association for Computing Machinery (ACM) ,1993
- Effective bandwidth of general Markovian traffic sources and admission control of high speed networksIEEE/ACM Transactions on Networking, 1993
- Characterizing the variability of arrival processes with indexes of dispersionIEEE Journal on Selected Areas in Communications, 1991
- A measurement study of diskless workstation traffic on an EthernetIEEE Transactions on Communications, 1990
- Packet Trains--Measurements and a New Model for Computer Network TrafficIEEE Journal on Selected Areas in Communications, 1986
- A Simple General Approach to Inference About the Tail of a DistributionThe Annals of Statistics, 1975