Blog | 08 Jan 2021
Machine learning is a helpful forecasting tool, but challenges remain
Hopes have risen in recent years over the potential contribution of machine learning in economic forecasting. But the pandemic has posed a major challenge, with well-publicised hiccups with the algorithms used in marketing, inventory management and a range of other fields. How has the field of macroeconomics fared?
Prior to the pandemic, the evidence suggested that machine-learning solutions are well-suited to short-term macroeconomic problems, at least during periods of relative stability. One example is GDP ‘nowcasts’ – high-frequency, short-term forecasts of GDP ahead of publication of the official data. Estimates derived using machine learning proved significantly more accurate than conventional statistical methods in pre-coronavirus years.
The pandemic recession put a dent in the performance of such forecasts, however. In doing so, it shone a spotlight on some of the limitations of machine learning in macroeconomics.
A fundamental problem is that the algorithms currently in use still cannot capture the underlying structure of economies, including the long-run relationships and second-round effects common in macroeconomics. This limits their use in scenario analysis – such as the generation of alternative outlooks for the global economy, based on the future evolution of the Covid-19 pandemic – and hence their usefulness to businesses in the development of appropriate contingency plans.
The pandemic has also highlighted the importance of human involvement. During the pandemic, we have turned to non-traditional indicators of economic activity, including mobility trends, restaurant bookings and measures of lockdown stringency. While such indicators are both informative about the current state of key sectors of the economy and more timely than traditional metrics, the limited data sets involved present a major challenge for machine learning and other statistical approaches.
The Oxford Economics approach is to combine our economists’ expectations for the very near term, based in part on interpretation of these alternative sources of data, with state-of-the-art macroeconomic modelling. The usefulness of such an approach is illustrated by back-testing analysis.
The starting point in the back-testing exercise was our Global Economic Model in February, during the early stages of the pandemic. We then imposed in our model the actual outturns in Q1 and Q2 2020 for consumption and services trade – two of the areas most directly affected by public health restrictions – and our economists’ expectations of the Q3 2020 outturns for these variables prior to their official release.
We found that the simulated recovery path (which doesn’t incorporate official outturns for the most recent quarter) broadly matches our very latest baseline forecast (which does incorporate the very latest official data releases). The similarities extend to the medium term, implying comparable levels of economic scarring from the pandemic.
Overall, it is clear that machine learning has a role to play in enhancing short-term forecasting efforts. But experience during the pandemic confirms that machine learning should be viewed as a tool to be used in conjunction with the careful analysis of an experienced economist using a structural model. This informs the modelling approach that we employ today at Oxford Economics.
Tags:
You may be interested in
Post
Taiwan earthquake hit local chip production, but only temporarily
Taiwan was hit by the 7.2 magnitude earthquake on 3 April, the strongest in 25 years. However, the economic impact seems to be manageable so far, thanks to sparse population close to the epicentre, improving building codes and stronger disaster management and awareness in the past two decades.
Find Out MorePost
The macro impact of the AI boom in Taiwan and South Korea
The launch of ChatGPT in November 2022 made 2023 a leap forward for artificial intelligence (AI). The big battle for the future AI winners heated up and many tech companies revealed their future investment plans during the latest earnings season. A global race to build the most powerful AI chips has begun, which will potentially revolutionise the global tech sector.
Find Out MorePost
AI may eventually widen the gaps between city economies
Artificial Intelligence (AI) is shifting the impact of automation towards highly-skilled, intellectual occupations, meaning that cities that are highly reliant on those occupations are more likely to be exposed. However, these cities could in fact benefit from significant gains in productivity, further deepening the gap between successful cities and other places.
Find Out More