The Spread of Evidence-Poor Medicine via Flawed Social-Network Analysis
- 18 January 2011
- journal article
- Published by Walter de Gruyter GmbH in Statistics, Politics and Policy
- Vol. 2 (1)
- https://doi.org/10.2202/2151-7509.1024
Abstract
The chronic widespread misuse of statistics is usually inadvertent, not intentional. We find cautionary examples in a series of recent papers by Christakis and Fowler that advance statistical arguments for the transmission via social networks of various personal characteristics, including obesity, smoking cessation, happiness, and loneliness. Those papers also assert that such influence extends to three degrees of separation in social networks. We shall show that these conclusions do not follow from Christakis and Fowler's statistical analyses. In fact, their studies even provide some evidence against the existence of such transmission. The errors that we expose arose, in part, because the assumptions behind the statistical procedures used were insufficiently examined, not only by the authors, but also by the reviewers. Our examples are instructive because the practitioners are highly reputed, their results have received enormous popular attention, and the journals that published their studies are among the most respected in the world. An educational bonus emerges from the difficulty we report in getting our critique published. We discuss the relevance of this episode to understanding statistical literacy and the role of scientific review, as well as to reforming statistics education.Comment: 16 pp, 2 figureKeywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Homophily and Contagion Are Generically Confounded in Observational Social Network StudiesSociological Methods & Research, 2011
- The Spread of Evidence-Poor Medicine via Flawed Social-Network AnalysisStatistics, Politics and Policy, 2011
- Social network determinants of depressionMolecular Psychiatry, 2010
- The Collective Dynamics of Smoking in a Large Social NetworkNew England Journal of Medicine, 2008
- The Spread of Obesity in a Large Social Network over 32 YearsNew England Journal of Medicine, 2007
- Why Most Published Research Findings Are FalsePLoS Medicine, 2005
- Incomplete Simultaneous Discrete Response Model with Multiple EquilibriaThe Review of Economic Studies, 2003
- Peer Effects with Random Assignment: Results for Dartmouth RoommatesSSRN Electronic Journal, 2000
- Epidemiology Faces Its LimitsPublished by American Association for the Advancement of Science (AAAS) ,1995
- The Real and Unrealized Contributions of Quantitative SociologyAmerican Sociological Review, 1989