Insights into accuracy of social scientists' forecasts of societal change
Article
Grossman, I., Rotella, A., Hutcherson, C., Sharpinskyi, K., Varnum, M., Achter, S., Dhami, M. and The Forecasting Collaborative 2023. Insights into accuracy of social scientists' forecasts of societal change. Nature Human Behaviour. https://doi.org/10.1038/s41562-022-01517-1
Type | Article |
---|---|
Title | Insights into accuracy of social scientists' forecasts of societal change |
Authors | Grossman, I., Rotella, A., Hutcherson, C., Sharpinskyi, K., Varnum, M., Achter, S., Dhami, M. and The Forecasting Collaborative |
Abstract | How well can social scientists predict societal change, and what processes underlie their predictions? To answer these questions, we ran two forecasting tournaments testing accuracy of predictions of societal change in domains commonly studied in the social sciences: ideological preferences, political polarization, life satisfaction, sentiment on social media, and gender-career and racial bias. Following provision of historical trend data on the domain, social scientists submitted pre-registered monthly forecasts for a year (Tournament 1; N=86 teams/359 forecasts), with an opportunity to update forecasts based on new data six months later (Tournament 2; N=120 teams/546 forecasts). Benchmarking forecasting accuracy revealed that social scientists’ forecasts were on average no more accurate than simple statistical models (historical means, random walk, or linear regressions) or the aggregate forecasts of a sample from the general public (N=802). However, scientists were more accurate if they had scientific expertise in a prediction domain, were interdisciplinary, used simpler models, and based predictions on prior data. |
Keywords | forecasting; expert judgment; well-being; political polarization; prejudice; metascience |
Publisher | Nature Research |
Journal | Nature Human Behaviour |
ISSN | 2397-3374 |
Electronic | 2397-3374 |
Publication dates | |
Online | 09 Feb 2023 |
Publication process dates | |
Deposited | 13 Dec 2022 |
Submitted | 26 Jun 2022 |
Accepted | 19 Dec 2022 |
Accepted author manuscript | |
Copyright Statement | This version of the article has been accepted for publication, after peer review (when applicable) and is subject to Springer Nature’s AM terms of use (https://www.nature.com/nature-portfolio/editorial-policies/self-arch...), but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: http://dx.doi.org/10.1038/s41562-022-01517-1 |
Additional information | Cite this article |
Web address (URL) | https://www.nature.com/articles/s41562-022-01517-1 |
Digital Object Identifier (DOI) | https://doi.org/10.1038/s41562-022-01517-1 |
Language | English |
https://repository.mdx.ac.uk/item/8q307
Download files
71
total views21
total downloads0
views this month0
downloads this month