The Minimum Spanning Tree Histogram as a Verification Tool for Multidimensional Ensemble Forecasts
Open Access
- 1 June 2004
- journal article
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 132 (6) , 1329-1340
- https://doi.org/10.1175/1520-0493(2004)132<1329:tmstha>2.0.co;2
Abstract
The minimum spanning tree (MST) histogram is a multivariate extension of the ideas behind the conventional scalar rank histogram. It tabulates the frequencies, over n forecast occasions, of the rank of the MST length for each ensemble, within the group of such lengths that is obtained by substituting an observation for each of its ensemble members in turn. In raw form it is unable to distinguish ensemble bias from ensemble underdispersion, or to discern the contributions of forecast variables with small variance. The use of scaled and debiased MST histograms to diagnose attributes of ensemble forecasts is illustrated, both for synthetic Gaussian ensembles and for a small sample of actual ensemble forecasts. Also presented are adjustments to χ2 critical values for evaluating rank uniformity, for both MST histograms and scalar rank histograms, given serial correlation in the forecasts. Abstract The minimum spanning tree (MST) histogram is a multivariate extension of the ideas behind the conventional scalar rank histogram. It tabulates the frequencies, over n forecast occasions, of the rank of the MST length for each ensemble, within the group of such lengths that is obtained by substituting an observation for each of its ensemble members in turn. In raw form it is unable to distinguish ensemble bias from ensemble underdispersion, or to discern the contributions of forecast variables with small variance. The use of scaled and debiased MST histograms to diagnose attributes of ensemble forecasts is illustrated, both for synthetic Gaussian ensembles and for a small sample of actual ensemble forecasts. Also presented are adjustments to χ2 critical values for evaluating rank uniformity, for both MST histograms and scalar rank histograms, given serial correlation in the forecasts.Keywords
This publication has 16 references indexed in Scilit:
- Interpretation of Rank Histograms for Verifying Ensemble ForecastsMonthly Weather Review, 2001
- Skill and relative economic value of the ECMWF ensemble prediction systemQuarterly Journal of the Royal Meteorological Society, 2000
- Calibrated Probabilistic Quantitative Precipitation Forecasts Based on theMRF EnsembleWeather and Forecasting, 1998
- Short-Range Ensemble Forecasting of Quantitative PrecipitationMonthly Weather Review, 1997
- Verification of Eta–RSM Short-Range Ensemble ForecastsMonthly Weather Review, 1997
- A Method for Producing and Evaluating Probabilistic Forecasts from Ensemble Model IntegrationsJournal of Climate, 1996
- A System Simulation Approach to Ensemble PredictionMonthly Weather Review, 1996
- The ECMWF Ensemble Prediction System: Methodology and validationQuarterly Journal of the Royal Meteorological Society, 1996
- Forecast verification: Its Complexity and DimensionalityMonthly Weather Review, 1991
- A General Framework for Forecast VerificationMonthly Weather Review, 1987