Pub Date : 2026-04-07Epub Date: 2025-06-11DOI: 10.1111/jtsa.12843
Thomas Grundy, Rebecca Killick, Ivan Svetunkov
In many organizations, accurate forecasts are essential for making informed decisions in a variety of applications, from inventory management to staffing optimization. Whatever forecasting model is used, changes in the underlying process can lead to inaccurate forecasts, which will be damaging to decision-making. At the same time, models are becoming increasingly complex, and identifying change through direct modeling is problematic. We present a novel framework for online monitoring of forecasts to ensure they remain accurate. By utilizing sequential changepoint techniques on the forecast errors, our framework allows for the real-time identification of potential changes in the process caused by various external factors. We show theoretically that some common changes in the underlying process will manifest in the forecast errors and can be identified faster by identifying shifts in the forecast errors than within the original modeling framework. Moreover, we demonstrate the effectiveness of this framework on numerous forecasting approaches through simulations and show its effectiveness over alternative approaches. Finally, we present two concrete examples, one from Royal Mail parcel delivery volumes and one from NHS A&E admissions relating to gallstones.
{"title":"Online Detection of Forecast Model Inadequacies Using Forecast Errors","authors":"Thomas Grundy, Rebecca Killick, Ivan Svetunkov","doi":"10.1111/jtsa.12843","DOIUrl":"https://doi.org/10.1111/jtsa.12843","url":null,"abstract":"<p>In many organizations, accurate forecasts are essential for making informed decisions in a variety of applications, from inventory management to staffing optimization. Whatever forecasting model is used, changes in the underlying process can lead to inaccurate forecasts, which will be damaging to decision-making. At the same time, models are becoming increasingly complex, and identifying change through direct modeling is problematic. We present a novel framework for online monitoring of forecasts to ensure they remain accurate. By utilizing sequential changepoint techniques on the forecast errors, our framework allows for the real-time identification of potential changes in the process caused by various external factors. We show theoretically that some common changes in the underlying process will manifest in the forecast errors and can be identified faster by identifying shifts in the forecast errors than within the original modeling framework. Moreover, we demonstrate the effectiveness of this framework on numerous forecasting approaches through simulations and show its effectiveness over alternative approaches. Finally, we present two concrete examples, one from Royal Mail parcel delivery volumes and one from NHS A&E admissions relating to gallstones.</p>","PeriodicalId":49973,"journal":{"name":"Journal of Time Series Analysis","volume":"47 3","pages":"715-726"},"PeriodicalIF":1.0,"publicationDate":"2026-04-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jtsa.12843","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147683647","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2026-04-07Epub Date: 2025-06-04DOI: 10.1111/jtsa.12841
Claudia Kirch, Stefanie Schwaar
In this paper, we propose a new test for the detection of a change in a non-linear (auto-)regressive time series as well as a corresponding estimator for the unknown time point of the change. To this end, we consider an at-most-one-change model and approximate the unknown (auto-)regression function by a neural network with one hidden layer. It is shown that the test has asymptotic power of one for a wide range of alternatives, not restricted to changes in the mean of the time series. Furthermore, we prove that the corresponding estimator converges to the true change point with the optimal rate