The base-rate fallacy and the difficulty of intrusion detection
Top Cited Papers
- 1 August 2000
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information and System Security
- Vol. 3 (3) , 186-205
- https://doi.org/10.1145/357830.357849
Abstract
Many different demands can be made of intrusion detection systems. An important requirement is that an intrusion detection system be effective ; that is, it should detect a substantial percentage of intrusions into the supervised system, while still keeping the false alarm rate at an acceptable level. This article demonstrates that, for a reasonable set of assumptions, the false alarm rate is the limiting factor for the performance of an intrusion detection system. This is due to the base-rate fallacy phenomenon, that in order to achieve substantial values of the Bayesian detection rate P(Intrusion***Alarm) , we have to achieve a (perhaps in some cases unattainably) low false alarm rate. A selection of reports of intrusion detection performance are reviewed, and the conclusion is reached that there are indications that at least some types of intrusion detection have far to go before they can attain such low false alarm rates.Keywords
This publication has 5 references indexed in Scilit:
- Temporal sequence learning and data reduction for anomaly detectionACM Transactions on Information and System Security, 1999
- Decision-theoretic limits on earthquake predictionGeophysical Journal International, 1997
- Base-rate errors and rain forecastsNature, 1996
- Statistical foundations of audit trail analysis for the detection of computer misuseIEEE Transactions on Software Engineering, 1993
- An Intrusion-Detection ModelIEEE Transactions on Software Engineering, 1987