Out-of-Sample Forecast Tests Robust to the Choice of Window Size
Journal of Business and Economic StatisticsPublished 1 July 2012
Barbara Rossi, Atsushi Inoue
Citations394
SJR quartileQ1
SJR score4.17
SNIP2.29
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
This paper proposes new methodologies for evaluating out-of-sample forecasting performance that are robust to the choice of the estimation window size. The methodologies involve evaluating the predictive ability of forecasting models over a wide range of window sizes. We show that the tests proposed in the literature may lack the power to detect predictive ability and might be subject to data snooping across different window sizes if used repeatedly. An empirical application shows the usefulness of the methodologies for evaluating exchange rate models' forecasting ability.
Keywords
Decision SciencesEconomics, Econometrics and Finance
EconometricaA Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix
17,123 Citations1987Whitney K. Newey, Kenneth D. West
Wiley series in probability and statisticsConvergence of Probability Measures
13,920 Citations1999Patrick Billingsley
National Bureau of Economic ResearchA Simple, Positive Semi-Definite, Heteroskedasticity and AutocorrelationConsistent Covariance Matrix
12,765 Citations1986Whitney K. Newey, Kenneth D. West
National Bureau of Economic ResearchComparing Predictive Accuracy
5,308 Citations1994Francis X. Diebold, Roberto S. Mariano
Journal of Business and Economic StatisticsComparing Predictive Accuracy
4,759 Citations1995Francis X. Diebold, Roberto S. Mariano
EconometricaTests for Parameter Instability and Structural Change With Unknown Change Point
4,273 Citations1993Donald W. K. Andrews
Journal of International EconomicsEmpirical exchange rate models of the seventies
4,150 Citations1983Richard Meese, Kenneth Rogoff
Journal of EconometricsApproximately normal tests for equal predictive accuracy in nested models
2,442 Citations2006Todd E. Clark, Kenneth D. West
International Journal of ForecastingTesting the equality of prediction mean squared errors
1,996 Citations1997David I. Harvey, Stephen J. Leybourne +1 more
Journal of the Operational Research SocietyForecasting Economic Time Series
1,017 Citations1979Stephen J. Taylor, Clive W. J. Granger +1 more
Journal of Business and Economic StatisticsTests for Forecast Encompassing
723 Citations1998David I. Harvey, Stephen J. Leybourne +1 more
Journal of International Money and FinanceEmpirical exchange rate models of the nineties: Are any fit to survive?
719 Citations2005Yin‐Wong Cheung, Menzie Chinn +1 more
Journal of Political EconomyInternational Financial Adjustment
628 Citations2007Pierre‐Olivier Gourinchas, Hélène Rey
The Review of Economic StudiesEconometric Evaluation of Linear Macro-Economic Models
604 Citations1986Yock Y. Chong, David F. Hendry
Evaluation of Economic Forecasts
537 Citations2016
Journal of Applied EconometricsForecast comparisons in unstable environments
462 Citations2010Raffaella Giacomini, Barbara Rossi
Journal of EconometricsSelection of estimation window in the presence of breaks
458 Citations2006M. Hashem Pesaran, Allan Timmermann
A new set of cross-validation methods for selection of a single estimation window and weighting or pooling methods for combination of forecasts based on estimation windows of different lengths are proposed.
National Bureau of Economic ResearchInternational Financial Adjustment
447 Citations2005Pierre‐Olivier Gourinchas, Hélène Rey
Journal of ForecastingOn the limitations of comparing mean square forecast errors
398 Citations1993Michael P. Clements, David F. Hendry
National Bureau of Economic ResearchExchange Rate Models Are Not as Bad as You Think
397 Citations2007Charles Engel, Nelson C. Mark +1 more
Econometric TheoryConvergence to Stochastic Integrals for Dependent Heterogeneous Processes
353 Citations1992Bruce E. Hansen
Exchange Rates and International Macroeconomics
300 Citations1983Jacob A. Frenkel
Handbook of statistics8 Forecast evaluation and combination
269 Citations1996Francis X. Diebold, Jose A. Lopez
A number of forecast evaluation topics of particular relevance in economics and finance are described, including methods for evaluating direction-of-change forecasts, probability forecasts and volatility forecasts.
Econometric TheorySome Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes
260 Citations1988Jeffrey M. Wooldridge, Halbert White
RePEc: Research Papers in EconomicsUsing out-of-sample mean squared prediction errors to test the Martingale difference hypothesis
252 Citations2004Todd E. Clark, Kenneth D. West
Econometric ReviewsEvaluating Direct Multistep Forecasts
250 Citations2005Todd E. Clark, Michael W. McCracken
International Economic ReviewIMPROVING FORECAST ACCURACY BY COMBINING RECURSIVE AND ROLLING FORECASTS*
202 Citations2009Todd E. Clark, Michael W. McCracken
Journal of EconometricsProperties of optimal forecasts under asymmetric loss and nonlinearity
187 Citations2006Andrew J. Patton, Allan Timmermann
Macroeconomic DynamicsARE EXCHANGE RATES REALLY RANDOM WALKS? SOME EVIDENCE ROBUST TO PARAMETER INSTABILITY
157 Citations2005Barbara Rossi
Research Portal (King's College London)Choice of Sample Split in Out-of-Sample Forecast Evaluation ∗
143 Citations2012Peter Reinhard Hansen, Allan Timmermann
Stochastic Limit Theory
133 Citations2021James Davidson
Journal of EconometricsThe power of tests of predictive ability in the presence of structural breaks
113 Citations2004Todd E. Clark, Michael W. McCracken
Journal of Empirical FinanceNonlinear prediction of exchange rates with monetary fundamentals
107 Citations2003Min Qi, Yangru Wu
Macroeconomic DynamicsOUT-OF-SAMPLE TESTS FOR GRANGER CAUSALITY
99 Citations2001John C. Chao, Valentina Corradi +1 more
Oxford Bulletin of Economics and StatisticsSelecting a Nonlinear Time Series Model using Weighted Tests of Equal Forecast Accuracy*
90 Citations2003Dick van Dijk, Philip Hans Franses
RePEc: Research Papers in EconomicsAn Out of Sample Test for Granger Causality
80 Citations2000John C. Chao, Valentina Corradi +1 more
Journal of International Money and FinanceSome linear and nonlinear thoughts on exchange rates
79 Citations1991Menzie Chinn
Econometric TheoryREAL-TIME ECONOMETRICS
62 Citations2005M. Hashem Pesaran, Allan Timmermann
The role of automated systems in reducing the effect of data snooping is highlighted and some of the possible ways advanced in the literature for dealing with them are discussed.
International Economic ReviewMODEL COMPARISONS IN UNSTABLE ENVIRONMENTS
26 Citations2016Raffaella Giacomini, Barbara Rossi
Journal of Applied EconometricsTESTS OF EQUAL FORECAST ACCURACY FOR OVERLAPPING MODELS
18 Citations2013Todd E. Clark, Michael W. McCracken
SSRN Electronic JournalReality Checks and Nested Forecast Model Comparisons
16 Citations2010Todd E. Clark, Michael W. McCracken
