{"id":180,"date":"2011-11-29T09:30:47","date_gmt":"2011-11-29T09:30:47","guid":{"rendered":"http:\/\/rulesofreason.wordpress.com\/?p=180"},"modified":"2011-11-29T09:30:47","modified_gmt":"2011-11-29T09:30:47","slug":"predicting-the-votes-of-judges","status":"publish","type":"post","link":"http:\/\/re-design.dimiter.eu\/?p=180","title":{"rendered":"Predicting the votes of judges"},"content":{"rendered":"<p>Here is a (short) and interesting <a href=\"http:\/\/www.plosone.org\/article\/info%3Adoi%2F10.1371%2Fjournal.pone.0027188#pone.0027188-Brams1\" target=\"_blank\">paper<\/a> that uses an innovative approach to predict the votes of the US Supreme Court:<\/p>\n<blockquote><p>Successful attempts to predict judges&#8217; votes shed light into how legal decisions are made and, ultimately, into the behavior and evolution of the judiciary. Here, we investigate to what extent it is possible to make predictions of a justice&#8217;s vote based on the other justices&#8217; votes in the same case. For our predictions, we use models and methods that have been developed to uncover hidden associations between actors in complex social networks. We show that these methods are more accurate at predicting justice&#8217;s votes than forecasts made by legal experts and by algorithms that take into consideration the content of the cases. We argue that, within our framework, high predictability is a quantitative proxy for stable justice (and case) blocks, which probably reflect stable a priori attitudes toward the law. We find that U.S. Supreme Court justice votes are more predictable than one would expect from an ideal court composed of perfectly independent justices. Deviations from ideal behavior are most apparent in divided 5\u20134 decisions, where justice blocks seem to be most stable. Moreover, we find evidence that justice predictability decreased during the 50-year period spanning from the Warren Court to the Rehnquist Court, and that aggregate court predictability has been significantly lower during Democratic presidencies. More broadly, our results show that it is possible to use methods developed for the analysis of complex social networks to quantitatively investigate historical questions related to political decision-making.<\/p><\/blockquote>\n<p>While I have my reservations\u00a0whether &#8220;trying to predict the behavior of judges, one can get insights into how legal decisions are truly made&#8221;, exercises in predicting outcomes are interesting in their own right. And this paper appears to hit the target: its predictive success rate is 83% vs. the less-than-70% success rate of existing approaches based on expert opinions and statistical models of case characteristics. Note however that each individual vote is predicted with information about how the other judges have voted on that same case which, if the votes are announced simultaneously, doesn&#8217;t provide you with any leverage in actually <em>predicting<\/em> the outcome of a case.<\/p>\n<p>P.S. What is this penchant that the <em>real<\/em> scientific journals (e.g.<a href=\"http:\/\/www.plosone.org\/static\/information.action\" target=\"_blank\">PLoS<\/a>) have for social science research based on\u00a0agent-based modeling or network theory?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Here is a (short) and interesting paper that uses an innovative approach to predict the votes of the US Supreme Court: Successful attempts to predict judges&#8217; votes shed light into how legal decisions are made and, ultimately, into the behavior and evolution of the judiciary. Here, we investigate to what extent it is possible to make predictions of a justice&#8217;s vote based on the other justices&#8217; votes in the same case. For our predictions, we use models and methods that have been developed to uncover hidden associations between actors in complex social networks. We show that these methods are more accurate at predicting justice&#8217;s votes than forecasts made by legal experts and by algorithms that take into consideration the content of the cases. We argue that, within our framework, high predictability is a quantitative proxy for stable justice (and case) blocks, which probably reflect stable a priori attitudes toward the law. We find that U.S. Supreme Court justice votes are more predictable than one would expect from an ideal court composed of perfectly independent justices. Deviations from ideal behavior are most apparent in divided 5\u20134 decisions, where justice blocks seem to be most stable. Moreover, we find evidence that justice predictability decreased during the 50-year period spanning from the Warren Court to the Rehnquist Court, and that aggregate court predictability has been significantly lower during Democratic presidencies. More broadly, our results show that it is possible to use methods developed for the analysis of complex social networks to quantitatively investigate&#8230;<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"http:\/\/re-design.dimiter.eu\/?p=180\">Continue reading<span class=\"screen-reader-text\">Predicting the votes of judges<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[5,25,30],"tags":[87,366,436,517,626],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7g3hj-2U","jetpack-related-posts":[{"id":616,"url":"http:\/\/re-design.dimiter.eu\/?p=616","url_meta":{"origin":180,"position":0},"title":"The most successful party family in Europe?!","date":"December 5, 2012","format":false,"excerpt":"\"The populist radical right constitutes the most successful party family in postwar Western Europe.\" (Cas Mudde, Stein Rokkan Lecture published in the latest issue of the European Journal of Political Research) I hope this is a typo or some other type of unintentional misunderstanding. How can the populist radical right\u2026","rel":"","context":"In &quot;Voting and elections&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1020,"url":"http:\/\/re-design.dimiter.eu\/?p=1020","url_meta":{"origin":180,"position":1},"title":"Immigration and voting for the radical right in Andalusia","date":"December 11, 2018","format":false,"excerpt":"I wrote a short text for the European Politics and Policy (EUROPP) blog on the link between immigration presence and voting for Vox, a relatively young radical right party, in the Spanish region of Andalusia.\u00a0 Full text is here, see also this post from 2015 about a similar link with\u2026","rel":"","context":"In &quot;Immigration and asylum policy&quot;","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/re-design.dimiter.eu\/wp-content\/uploads\/2018\/12\/and_vox2_europp.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":177,"url":"http:\/\/re-design.dimiter.eu\/?p=177","url_meta":{"origin":180,"position":2},"title":"What makes a video go viral?","date":"November 28, 2011","format":false,"excerpt":"Internet Marketing expert Dr Brent Coker\u00a0claims to have developed an\u00a0algorithm that can predict which ad movies will go viral on YouTube. I don't plan a career move to advertising but was nevertheless intrigued by the claim\u00a0from a research methods & design perspective. Unfortunately, there is very little information available (yet?)\u00a0and\u2026","rel":"","context":"In &quot;Advertising research&quot;","img":{"alt_text":"","src":"https:\/\/i2.wp.com\/img.youtube.com\/vi\/YRRK3zIW9x0\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":839,"url":"http:\/\/re-design.dimiter.eu\/?p=839","url_meta":{"origin":180,"position":3},"title":"Why political scientists should continue to (fail to) predict elections?","date":"May 11, 2015","format":false,"excerpt":"The results from the British elections last week already claimed the heads of three party leaders. But together with Labour, the Liberal Democrats and UKIP, there was another group that lost big time in the elections: pollsters and electoral prognosticators. Not only were polls and predictions way off the mark\u2026","rel":"","context":"In &quot;Risk and probability&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":767,"url":"http:\/\/re-design.dimiter.eu\/?p=767","url_meta":{"origin":180,"position":4},"title":"Predicting movie ratings with IMDb data and R","date":"March 2, 2014","format":false,"excerpt":"It's Oscars season again so why not explore how predictable (my) movie tastes are. This has literally been a million dollar problem\u00a0and obviously I am not gonna solve it here, but it's fun and slightly educational to do some number crunching, so why not. Below, I will proceed from a\u2026","rel":"","context":"In &quot;Data visualization&quot;","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/re-design.dimiter.eu\/wp-content\/uploads\/2014\/03\/figure9.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":193,"url":"http:\/\/re-design.dimiter.eu\/?p=193","url_meta":{"origin":180,"position":5},"title":"Social science in the courtroom","date":"December 2, 2011","format":false,"excerpt":"Everyone who is interested in\u00a0the sociology of science, causal inferences from observational data,\u00a0employment gender discrimination, judicial sagas, or academic spats should read the latest issue of Sociological Methods & Research. The whole issue is devoted to the Wal-Mart Stores,Inc. v. Dukes et al. case - \"the largest class-action employment discrimination\u2026","rel":"","context":"In &quot;Observational studies&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/180"}],"collection":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=180"}],"version-history":[{"count":0,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/180\/revisions"}],"wp:attachment":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=180"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=180"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=180"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}