{"id":253,"date":"2012-01-27T13:56:56","date_gmt":"2012-01-27T13:56:56","guid":{"rendered":"http:\/\/rulesofreason.wordpress.com\/?p=253"},"modified":"2012-01-27T13:56:56","modified_gmt":"2012-01-27T13:56:56","slug":"unit-of-analysis-vs-unit-of-observation","status":"publish","type":"post","link":"http:\/\/re-design.dimiter.eu\/?p=253","title":{"rendered":"Unit of analysis vs. Unit of observation"},"content":{"rendered":"<p>Having graded another batch of 40\u00a0student research proposals, the distinction between &#8216;unit of analysis&#8217; and &#8216;unit of observation&#8217; proves to be, yet again,\u00a0one of the trickiest for the students to master.<\/p>\n<p>After several years of experience, I think <em>I<\/em> have a good grasp of the difference between the two, but it obviously remains a challenge to explain it to students. King, Keohane and Verba (1994) [KKV] introduce the difference in the context of descriptive inference where it serves the argument that what often goes under the heading of a &#8216;case study&#8217; often actually has many observations (p.52, see also 116-117). But, admittedly the book is somewhat unclear about the distinction and unambiguous definitions are not provided.<\/p>\n<p>In my understanding, the\u00a0unit of analysis (a case) is at the level at which you pitch the conclusions. The unit of observation is at the level at which you collect the data. So, the unit of observation and the unit of analysis <em>can be the same<\/em> but they need not be. In the context of quantitative research, units of observation could be students and units of analysis classes, if classes are compared. Or students can be both the units of observation and analysis if students are compared. Or students can be the units of analyses and grades\u00a0the unit of observations if several observations (grades) are available per student. So it all depends on the design. Simply put, the unit of observation is the row in the data table but the unit of analysis can be at a higher level of aggregation.<\/p>\n<p>In the context of qualitative research, it is more difficult to draw the difference between the two,\u00a0also because the difference\u00a0between analysis and observation is in general less clear-cut. In some sense, the same unit (case)\u00a0traced over time provides distinct observations but I am not sure to what extent these snap-shots would be regarded as distinct &#8216;observations&#8217; by qualitative researchers.\u00a0<\/p>\n<p>But more importantly, I start to feel that the distinction between units of analysis and units of observation\u00a0creates more confusion rather than more clarity. For the purposes of research design instruction, we would be better off if the term &#8216;case&#8217; did not exist at all\u00a0so we could\u00a0simply speak about observations\u00a0(single observation vs. single case study, observation selection vs. case selection, etc.) Of course, language policing never works so we seem to be\u00a0stuck in an unfortunate but unavoidable ambiguity.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Having graded another batch of 40\u00a0student research proposals, the distinction between &#8216;unit of analysis&#8217; and &#8216;unit of observation&#8217; proves to be, yet again,\u00a0one of the trickiest for the students to master. After several years of experience, I think I have a good grasp of the difference between the two, but it obviously remains a challenge to explain it to students. King, Keohane and Verba (1994) [KKV] introduce the difference in the context of descriptive inference where it serves the argument that what often goes under the heading of a &#8216;case study&#8217; often actually has many observations (p.52, see also 116-117). But, admittedly the book is somewhat unclear about the distinction and unambiguous definitions are not provided. In my understanding, the\u00a0unit of analysis (a case) is at the level at which you pitch the conclusions. The unit of observation is at the level at which you collect the data. So, the unit of observation and the unit of analysis can be the same but they need not be. In the context of quantitative research, units of observation could be students and units of analysis classes, if classes are compared. Or students can be both the units of observation and analysis if students are compared. Or students can be the units of analyses and grades\u00a0the unit of observations if several observations (grades) are available per student. So it all depends on the design. Simply put, the unit of observation is the row in the data table but the unit of analysis can&#8230;<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"http:\/\/re-design.dimiter.eu\/?p=253\">Continue reading<span class=\"screen-reader-text\">Unit of analysis vs. Unit of observation<\/span><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[33,43],"tags":[116,289,371,562,669,670],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p7g3hj-45","jetpack-related-posts":[{"id":206,"url":"http:\/\/re-design.dimiter.eu\/?p=206","url_meta":{"origin":253,"position":0},"title":"Is unit homogeneity a sufficient assumption for causal inference?","date":"December 6, 2011","format":false,"excerpt":"Is unit homogeneity a sufficient condition (assumption) for causal inference from observational data? Re-reading King, Keohane and Verba's bible on research design\u00a0[lovingly known to all exposed\u00a0as KKV] I\u00a0think\u00a0they regard unit homogeneity and conditional independence as alternative assumptions for causal inference. For example: \"we provide an overview here of what is\u2026","rel":"","context":"In &quot;Causality&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":74,"url":"http:\/\/re-design.dimiter.eu\/?p=74","url_meta":{"origin":253,"position":1},"title":"The decline of the death penalty","date":"October 18, 2011","format":false,"excerpt":"I just finished reading\u00a0'The Decline of the Death Penalty and the Discovery of Innocence' (link, link to book's website)\u00a0by Frank Baumgartner, Suzana De Boef and Amber Boydstun. It is a fine study of the rise of the 'innocence' frame and the decline of the use of capital punishment in the\u00a0US\u00a0(I\u2026","rel":"","context":"In &quot;Death penalty policy&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":116,"url":"http:\/\/re-design.dimiter.eu\/?p=116","url_meta":{"origin":253,"position":2},"title":"Course on Research Design","date":"November 1, 2011","format":false,"excerpt":"I am teaching again the Research Design class for the MSc in Public Administration at Leiden University. It is a rather challenging course since the\u00a0 background of the students is so diverse (from Religious Studies to Psychology to International Relations) and because most of the students have\u00a0very little\u00a0training and a\u00a0certain\u00a0dislike\u00a0for\u2026","rel":"","context":"In &quot;Teaching&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":919,"url":"http:\/\/re-design.dimiter.eu\/?p=919","url_meta":{"origin":253,"position":3},"title":"Intuitions about case selection are often wrong","date":"September 5, 2017","format":false,"excerpt":"Imagine the following simple setup: there are two switches (X and Z) and a lamp (Y). Both switches and the lamp are 'On'. You want to know what switch X does, but you have only one try to manipulate the switches. Which one would you choose to switch off: X,\u2026","rel":"","context":"In &quot;Comparative research and configurational methods&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1035,"url":"http:\/\/re-design.dimiter.eu\/?p=1035","url_meta":{"origin":253,"position":4},"title":"The problem with scope conditions","date":"September 12, 2019","format":false,"excerpt":"Posing arbitrary scope conditions to causal arguments leads to the same problem as subgroup analysis: the 'results' are too often just random noise.","rel":"","context":"In &quot;Causality&quot;","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/re-design.dimiter.eu\/wp-content\/uploads\/2019\/09\/significant.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":282,"url":"http:\/\/re-design.dimiter.eu\/?p=282","url_meta":{"origin":253,"position":5},"title":"Writing with the rear-view mirror","date":"February 2, 2012","format":false,"excerpt":"Social science research is supposed to work like this: 1) You want to explain a certain case or a class of phenomena; 2) You develop a theory and derive a set of hypotheses; 3) You test the hypotheses with data; 4) You conclude about the plausibility of\u00a0the theory; 5) You\u00a0write\u00a0a\u00a0paper\u2026","rel":"","context":"In &quot;Academic publishing&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/253"}],"collection":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=253"}],"version-history":[{"count":0,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=\/wp\/v2\/posts\/253\/revisions"}],"wp:attachment":[{"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=253"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=253"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/re-design.dimiter.eu\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=253"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}