Communicating Uncertainty in Official Economic Statistics: An Appraisal Fifty Years after Morgenstern

Manski, Charles F.. "Communicating Uncertainty in Official Economic Statistics: An Appraisal Fifty Years after Morgenstern." Journal of Economic Literature 53 (2015): 631-53. DOI: 10.1257/jel.53.3.631, available at http://www.aeaweb.org/articles.php?doi=10.1257/jel.53.3.631.
Federal statistical agencies in the United States and analogous agencies elsewhere commonly report official economic statistics as point estimates, without accompanying measures of error. Users of the statistics may incorrectly view them as error free or may incorrectly conjecture error magnitudes. This paper discusses strategies to mitigate misinterpretation of official statistics by communicating uncertainty to the public. Sampling error can be measured using established statistical principles. The challenge is to satisfactorily measure the various forms of nonsampling error. I find it useful to distinguish transitory statistical uncertainty, permanent statistical uncertainty, and conceptual uncertainty. I illustrate how each arises as the Bureau of Economic Analysis periodically revises GDP estimates, the Census Bureau generates household income statistics from surveys with nonresponse, and the Bureau of Labor Statistics seasonally adjusts employment statistics. I anchor my discussion of communication of uncertainty in the contribution of Oskar Morgenstern (1963a), who argued forcefully for agency publication of error estimates for official economic statistics. (JEL B22, C82, E23)