{"id":839,"date":"2015-05-11T11:19:37","date_gmt":"2015-05-11T11:19:37","guid":{"rendered":"https:\/\/rulesofreason.wordpress.com\/?p=839"},"modified":"2015-05-11T11:19:37","modified_gmt":"2015-05-11T11:19:37","slug":"why-political-scientists-should-continue-to-fail-to-predict-elections","status":"publish","type":"post","link":"http:\/\/re-design.dimiter.eu\/?p=839","title":{"rendered":"Why political scientists should continue to (fail to) predict elections?"},"content":{"rendered":"

The results<\/a> from the British elections last week already claimed the heads<\/a> of three party leaders. But together with Labour, the Liberal Democrats and UKIP, there was another group that lost big time in the elections: pollsters and electoral prognosticators. Not only were polls and predictions way off the mark<\/a> in terms of the actual vote shares and seats received by the different parties. Crucially, their major expectation of a hung parliament<\/a> did not materialize as the Conservatives cruised into a small but comfortable majority of the seats. Even more remarkably, all polls and predictions were wrong, and they were all wrong pretty much in the same way. Not pretty<\/strong>.<\/p>\n

This calls for reflection\u00a0upon\u00a0the\u00a0exploding number of electoral forecasting models which sprung up\u00a0during the build-up to the 2015 national elections in the UK. Many of these models were offered by political scientists and promoted by academic institutions (for example, here<\/a>, here<\/a>, and here<\/a>). At some point, it became pass\u00e9 to be a major political science institution in the country and not have an electoral forecast. The field became so crowded that the elections were branded as \u2018a nerd feast\u2019 and the competition of predictions as \u2018the battle of the nerds\u2019. The feast is over and everyone lost. It is the time of the scavengers.<\/p>\n

The massive failure of British polls and predictions has already led to a frenzy of often vicious attacks on the pollsters and prognosticators coming from politicians, journalists<\/a> and pundits<\/a>, in the UK and\u00a0beyond<\/a>. A formal inquiry<\/a> has been launched. The unmistakable smell of schadenfreude is hanging in the air. Most disturbingly, some respected political scientists have voiced a hope that the failure puts a stop to the game of predicting voting results altogether and dismissed electoral predictions as unscientific.<\/p>\n

\"mudde\"<\/a> \"afonso\"<\/a><\/p>\n

This is wrong.<\/strong> Political scientists should continue to build predictive models of elections. This work has scientific merit and it has public value. Moreover, political scientists have a mission to participate in the game of electoral forecasting. Their mission is to emphasize the large uncertainties surrounding all kinds of electoral predictions. They should not be in the game in order to win, but to correct on others’ too eager attempts to mislead the public with predictions offered with a false sense of precision and certainty.<\/p>\n

The rising number of electoral forecasts done by political scientists has more than a little bit to do with a certain jealousy of Nate Silver<\/a> \u2013 the American forecaster who gained international fame and recognition<\/a> with his successful predictions of the US presidential elections. (By the way, this time round, Nate Silver got it just as wrong<\/a> as the others). For once, there was something sexy about political science work, but the irony was, political scientists were not part of it. And if Nate, who is not a professional political scientist, can do it, so can we \u2013 academic experts with life-long experience in the study of voting and elections and hard-earned mastery of sophisticated statistical techniques. So the academia was drawn into this forecasting thing.<\/p>\n

And that\u2019s fine. Political scientists should be in the business of electoral forecasting because this business is important and because it is here to stay.<\/strong> News outlets have an insatiable appetite for election stories as voting day draws near, and the release of polls and forecasts provides a good excuse to indulge in punditry and sometimes even meaningful discussion. So predictions will continue to be offered and if political scientists move away somebody else will take their place. And the newcomers cannot be trusted to have the public interest at heart.<\/p>\n

Election forecasts are important because they feed into the electoral campaign and into the strategic calculations of political parties and of individual voters. Voting is rarely an act of na\u00efve expression of political preferences. Especially in an electoral system that is highly non-proportional, as the one in the UK, voters and parties have a strong incentive to behave strategically in view of the information that polls and forecasts provide. (By the way, ironically, the one prognosis that political scientists got relatively right<\/a> \u2013 the exit poll \u2013 is the one that probably matters the least as it only serves to satisfy our impatience to wait a few more hours for the official electoral results.)<\/p>\n

Hence, political scientists as servants of the public interest have a mission to offer impartial and professional electoral forecasts based on state of the art methodology and deep substantive knowledge. They must also discuss, correct and when appropriate trash the forecasts offered by others.<\/p>\n

And they have one major point to make \u2013 all predictions have a much larger degree of uncertainty than what prognosticators want (us) to believe.<\/strong> It is a simple point that experience has been proven right times and again. But it is one that still needs to be pounded over and over as pollsters, forecasters and the media get easily carried away.<\/p>\n

It is in this sense that commentators are right: predictions, if not properly bracketed by valid estimates of uncertainty, are unscientific<\/a> and pure charlatanry. \u00a0And it is in this sense that most forecasts offered by political scientists at the latest British elections were a failure. They did not properly gauge the uncertainty of their estimates and as a result misled the public. That they didn\u2019t predict the result is less damaging than the fact they pretended they could.<\/p>\n

Since the bulk of the data doing the heavy-lifting\u00a0in most electoral predictive models is poll data, the failure of prediction can be traced to a failure of polling. But pollsters cannot be blamed for the fact that prognosticators did not adjust the uncertainty estimates of their predictions. The tight sampling margins of error reported by pollsters might be appropriate to characterize the uncertainty of polling estimates (under certain assumptions) of public preferences at a point in time, but they are invariably too low when it comes to making predictions from these estimates. Predictions have other important sources of uncertainty in addition to sampling error and by not taking these into account prognosticators are fooling themselves and others. Another point forecasters should have known: combining different polls reduces sampling margins of error, but if all polls are biased (as they proved to be in the British case), the predictions could still be seriously off the mark.<\/p>\n

Offering predictions with wide margins of uncertainty is not sexy.<\/strong> Correcting others for the illusory precision of their forecasts is tedious and risks being viewed as pedantic. But this is the role political scientists need to play<\/strong> in the game of electoral forecasting, and being tedious, pedantic and decidedly unsexy is the price they have to pay<\/strong>.<\/p>\n","protected":false},"excerpt":{"rendered":"

The results from the British elections last week already claimed the heads of three party leaders. But together with Labour, the Liberal Democrats and UKIP, there was another group that lost big time in the elections: pollsters and electoral prognosticators. Not only were polls and predictions way off the mark in terms of the actual vote shares and seats received by the different parties. Crucially, their major expectation of a hung parliament did not materialize as the Conservatives cruised into a small but comfortable majority of the seats. Even more remarkably, all polls and predictions were wrong, and they were all wrong pretty much in the same way. Not pretty. This calls for reflection\u00a0upon\u00a0the\u00a0exploding number of electoral forecasting models which sprung up\u00a0during the build-up to the 2015 national elections in the UK. Many of these models were offered by political scientists and promoted by academic institutions (for example, here, here, and here). At some point, it became pass\u00e9 to be a major political science institution in the country and not have an electoral forecast. The field became so crowded that the elections were branded as \u2018a nerd feast\u2019 and the competition of predictions as \u2018the battle of the nerds\u2019. The feast is over and everyone lost. It is the time of the scavengers. The massive failure of British polls and predictions has already led to a frenzy of often vicious attacks on the pollsters and prognosticators coming from politicians, journalists and pundits, in the UK and\u00a0beyond. A formal inquiry has…<\/p>\n

Continue readingWhy political scientists should continue to (fail to) predict elections?<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[40,44,46],"tags":[104,218,219,496,504,505,528,628,683],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7g3hj-dx","jetpack-related-posts":[{"id":837,"url":"http:\/\/re-design.dimiter.eu\/?p=837","url_meta":{"origin":839,"position":0},"title":"Immigration from Central and Eastern Europe fuels support for Eurosceptic parties in the UK","date":"May 4, 2015","format":false,"excerpt":"Combining political, demographic and economic data for the local level in the UK, we find that the presence of immigrants from Central and Eastern Europe (CEE) is related to higher voting shares cast for parties with Eurosceptic positions at the 2014 elections for the European Parliament. Evidence across Europe supports\u2026","rel":"","context":"In "EU governance"","img":{"alt_text":"Data source: Standard Eurobarometer (59 to 82).","src":"http:\/\/eurosearch.files.wordpress.com\/2015\/05\/figure-1-importance-of-immigration.png?w=350&h=200&crop=1","width":350,"height":200},"classes":[]},{"id":1028,"url":"http:\/\/re-design.dimiter.eu\/?p=1028","url_meta":{"origin":839,"position":1},"title":"Government positions from party-level Manifesto data (with R)","date":"January 31, 2019","format":false,"excerpt":"In empirical research in political science and public policy, we often need estimates of the political positions of governments (cabinets) and the salience of different issues for different governments (cabinets). Data on policy positions and issue salience is available, but typically at the level of political parties. One prominent source\u2026","rel":"","context":"In "Measurement"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":647,"url":"http:\/\/re-design.dimiter.eu\/?p=647","url_meta":{"origin":839,"position":2},"title":"New data source for political science researchers","date":"December 19, 2012","format":false,"excerpt":"Political Data Yearbook Interactive\u00a0is a new source for data on election results, turnout and government composition for all EU and some non-European countries. It is basically an online version of the yearbooks that ECPR printed as part of the European Journal for Political Research for many years now. The interactive\u2026","rel":"","context":"In "Data visualization"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":577,"url":"http:\/\/re-design.dimiter.eu\/?p=577","url_meta":{"origin":839,"position":3},"title":"Hedging the bets: The US election outcome in the Dutch press","date":"November 7, 2012","format":false,"excerpt":"This is a guest post by Markus Haverland,\u00a0Professor\u00a0at\u00a0Erasmus University Rotterdam and author of a recent book on research methods. *** Causal knowledge about the world proceeds by testing hypotheses. The context of discovery precedes the context of justification. We all know that journalists and pundits often do it the other\u2026","rel":"","context":"In "Humour"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":307,"url":"http:\/\/re-design.dimiter.eu\/?p=307","url_meta":{"origin":839,"position":4},"title":"No use for big data in electioneering, according to Hollywood","date":"February 8, 2012","format":false,"excerpt":"Over the last year two major Hollywood movies that touch upon the use of big data and sophisticated data analysis hit the big screen. Which, of course, is two more than the mean (or was that the median). Moneyball shows how crunching numbers helps win baseball games and Margin Call\u2026","rel":"","context":"In "Humour"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":427,"url":"http:\/\/re-design.dimiter.eu\/?p=427","url_meta":{"origin":839,"position":5},"title":"Hyperlinks","date":"April 5, 2012","format":false,"excerpt":"How much money do university professors around the world get The Netherlands is doing OK which should make me happy Sperm do calculus\u00a0And so should you Common-pool resources management in Hawai\u00a0Would love to go for a field study A discussion of political science efforts to predict US presidential elections\u00a0Could be\u2026","rel":"","context":"In "Hyperlinks"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/re-design.dimiter.eu\/wp-content\/uploads\/2012\/04\/stamen-map.png?resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/839"}],"collection":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=839"}],"version-history":[{"count":0,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/839\/revisions"}],"wp:attachment":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=839"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=839"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=839"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}