TY - JOUR
T1 - ROC-based model estimation for forecasting large changes in demand
AU - Schneider, Matthew J.
AU - Gorr, Wilpen L.
N1 - Publisher Copyright:
© 2014 International Institute of Forecasters.
PY - 2015/4/1
Y1 - 2015/4/1
N2 - Forecasting for large changes in demand should benefit from an estimation that differs from that used for estimating mean behaviors. We develop a multivariate forecast model whose continuous forecasts are used as test statistics in decision rules to make binary (yes/no) forecasts for large changes in time series data. The model is fit based upon a penalty function that maximizes the partial area under the ROC curve (PAUC) along a relevant range of false positive rates, and can be used by managers who wish to take action on the small percentage of products whose demand is likely to change the most in the next time period. We apply the model to a crime dataset and compare the results to OLS, as a basis for comparisons, as well as to models that have shown themselves to be promising for large-change demand forecasting, including logistic regression, quantile regression, synthetic data from a Bayesian model, and a power loss model. Using the PAUC metric, our proposed forecasting model's out-of-sample performance shows statistical significance, a 35% improvement over OLS, and at least a 20% improvement over other competing methods. We suggest that managers with large numbers of time series (e.g., for product demand) should use our method to forecast large changes preemptively, in conjunction with magnitude-based methods for forecasting the expected demand.
AB - Forecasting for large changes in demand should benefit from an estimation that differs from that used for estimating mean behaviors. We develop a multivariate forecast model whose continuous forecasts are used as test statistics in decision rules to make binary (yes/no) forecasts for large changes in time series data. The model is fit based upon a penalty function that maximizes the partial area under the ROC curve (PAUC) along a relevant range of false positive rates, and can be used by managers who wish to take action on the small percentage of products whose demand is likely to change the most in the next time period. We apply the model to a crime dataset and compare the results to OLS, as a basis for comparisons, as well as to models that have shown themselves to be promising for large-change demand forecasting, including logistic regression, quantile regression, synthetic data from a Bayesian model, and a power loss model. Using the PAUC metric, our proposed forecasting model's out-of-sample performance shows statistical significance, a 35% improvement over OLS, and at least a 20% improvement over other competing methods. We suggest that managers with large numbers of time series (e.g., for product demand) should use our method to forecast large changes preemptively, in conjunction with magnitude-based methods for forecasting the expected demand.
KW - Forecasting exceptions
KW - Large changes
KW - Management by exception
KW - PAUC maximization
KW - ROC curves
UR - http://www.scopus.com/inward/record.url?scp=84921316049&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84921316049&partnerID=8YFLogxK
U2 - 10.1016/j.ijforecast.2014.07.002
DO - 10.1016/j.ijforecast.2014.07.002
M3 - Article
AN - SCOPUS:84921316049
SN - 0169-2070
VL - 31
SP - 253
EP - 262
JO - International Journal of Forecasting
JF - International Journal of Forecasting
IS - 2
ER -