Improving forecasting performance by combining forecasts: The example of road‐surface temperature forecasts
Open Access
- 1 September 1996
- journal article
- research article
- Published by Wiley in Meteorlogical Applications
- Vol. 3 (3) , 257-265
- https://doi.org/10.1002/met.5060030307
Abstract
A recent paper by J. E. Thornes reported the results of a comparative evaluation of location‐specific, road‐surface temperature forecasts (RSTFs) formulated by two organisations, the UK Meteorological Office (MO) and Oceanroutes (OR). The present paper broadens the scope of this competition, by considering the possibility of combining the MO and OR forecasts. Combining forecasts can improve forecasting performance when one set of forecasts contains information – in this case, information about observed road‐surface temperatures – not contained in the other set of forecasts. Both simple averaging and regression modelling are examined in this study as methods of combining these RSTFs, with the former consisting of averaging the MO and OR forecasts and the latter consisting of regressing these two forecasts on the observed temperatures.The simple average forecasts outperform the MO or OR forecasts, both when these RSTFs are evaluated as forecasts of a continuous variable and when they are evaluated as forecasts of a binary (i.e. frost/no frost) variable. Combining via regression modelling leads to further modest improvements in forecasting performance (based on in‐sample results). Overall, simple averaging captures a substantial fraction of the benefits that can be realised by combining the MO and OR forecasts for this small sample of road‐surface temperature data. Several issues related to the formulation and evaluation of combined forecasts, as well as some practical implications of the results, are briefly discussed.Keywords
This publication has 14 references indexed in Scilit:
- The Finley Affair: A Signal Event in the History of Forecast VerificationWeather and Forecasting, 1996
- The ECMWF Ensemble Prediction System: Methodology and validationQuarterly Journal of the Royal Meteorological Society, 1996
- Screening probability forecasts: contrasts between choosing and combiningInternational Journal of Forecasting, 1995
- Equitable Skill Scores for Categorical ForecastsMonthly Weather Review, 1992
- The Critical Success Index as an Indicator of Warning SkillWeather and Forecasting, 1990
- Diagnostic Verification of Temperature ForecastsWeather and Forecasting, 1989
- Combining forecasts: A review and annotated bibliographyInternational Journal of Forecasting, 1989
- Comparative Evaluation of Weather Forecasting Systems: Sufficiency, Quality, and AccuracyMonthly Weather Review, 1988
- Real-Time Short-Term Forecasting of Precipitation at an Australian Tropical StationWeather and Forecasting, 1988
- A General Framework for Forecast VerificationMonthly Weather Review, 1987