Does Statistical Significance Help to Evaluate Predictive Performance of Competing Models?

Journal of Economics and Financial Analysis

Levent Bulut¹ 

[1] Georgia State University

关键词: Model comparison;    Predictive accuracy;    Point-forecast criterion;    The Clark and West test;    Monte-Carlo methods;    Forecast comparison.;   

DOI  :  10.1991/jefa.v1i1.a1

学科分类：社会科学、人文和艺术（综合）

来源: Tripal Publishing House

【 摘 要 】

In Monte Carlo experiment with simulated data, we show that as a point forecast criterion, the Clark and West's (2006) unconditional test of mean squared prediction errors does not reflect the relative performance of a superior model over a relatively weaker one. The simulation results show that even though the mean squared prediction errors of a constructed superior model is far below a weaker alternative, the Clark- West test does not reflect this in their test statistics. Therefore, studies that use this statistic in testing the predictive accuracy of alternative exchange rate models, stock return predictability, inflation forecasting, and unemployment forecasting should not weight too much on the magnitude of the statistically significant Clark-West tests statistics.

【 授权许可】

CC BY-NC-ND