Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration

Abstract

Parameter constancy and a model's mean square forecast error are two commonly used measures of forecast performance. By explicit consideration of the information sets involved, this paper clarifies the roles that each plays in analyzing a model's forecast accuracy. Both criteria are necessary for "good" forecast performance, but neither (nor both) is sufficient. Further, these criteria fit into a general taxonomy of model evaluation statistics, and the information set corresponding to a model's mean square forecast error leads to a new test statistic, forecast-model encompassing. Two models of U.K. money demand illustrate the various measures of forecast accuracy.