Is uncertainty in complex disease epidemiology resolvable?
© Maziak; licensee BioMed Central. 2015
Received: 8 September 2014
Accepted: 28 April 2015
Published: 9 May 2015
The imposed limitations on what we can know about nature have been long recognized. Yet in the field of epidemiology a futile search for lifestyle-related risk factors for common chronic diseases continues unabated. This has led to the production of a growing body of evidence about potential lifestyle risk factors that tend to be marginal, contradictory, irreproducible, or hard to interpret. While epidemiologists are calling for a more refined methodology, I argue that our limitation in studying complex diseases is insurmountable. This is because the study of lifestyle-related small risks requires accurate measurement of multiple behaviors-exposures over a long period of time. It is also because in complex systems such as population’s health, the effect of rich interactions between its parts cannot be predicted based on traditional causal models of epidemiology. Within complex systems, understanding the interactions between system components can be more important than the contribution of each to disease risk.
In quantum physics, mathematics, and the science of complexity, scientists have long known the limitation to what can we learn by observing and probing natural phenomena. Whether this uncertainty is an inherent property of nature or a human limitation has little bearing on the fact that some aspects of life, it seems, can never be known for sure. This is mostly due to our limited ability to measure their attributes with adequate certainty, or to predict complex interactions involved in their occurrence [1,2]. Epidemiology, as the science of determinants of population health is likely to be facing such uncertainty, especially in its quest to uncover lifestyle risks of complex diseases.
We are confronted regularly with new results of epidemiological studies about lifestyle risks to common chronic ailments such as cardiovascular, cancer, psychiatric and neurodegenerative diseases. Most of these risks tend to be marginal, contradictory, irreproducible, or hard to interpret . For example, try to search the literature to know whether wine, fish, coffee, salt, fat, red meat, or more specifically certain vitamins, nutrients or anti-oxidants are good or bad for you. For you as a whole human being and over your lifespan, not for organs or systems within your body. Or try to figure out what are the environmental risk factors for childhood asthma, and what you can do to minimize your children’s chances of getting the disease [4-8]. If you get confused by what you find out, may I remind you that this problem is at least decades old; i.e. following epidemiology’s remarkable successes of the 1950s and 1960s in uncovering major risk factors for chronic diseases such as smoking, obesity, and high blood pressure [9,10].
This situation is threatening to erode the public trust in scientific research [11,12], but on a more fundamental level it casts serious doubts about the ability of epidemiology as a science to dissect complex interactions of low-magnitude risks . Epidemiologists’ traditional response to these challenges has focused on calling for more refined methods, quality control, reliance on objective measures, and better statistical models to deal with measurement errors and uncertainty around models’ predictions [8,13-15]. While these are steps in the right direction for the science in general, I argue that they are of limited value for the study of complex diseases and lifestyle risk factors for reasons beyond the known limitations of observational epidemiology . I base this opinion on two main factors; 1- our inherent inability to measure simultaneously and accurately multiple attributes of human behavior/exposures, and 2- the unpredictability of the role of individual components within complex interactions affecting population’s health. Below, I will discuss these briefly.
Most of the risk factors relevant to the study of complex diseases are lifestyle-related behaviors and exposures that require long time to produce small effects on disease’s risk. The smaller the risk and the more complex the causal universe, the more likely that measurement errors can lead to unpredictable and subsequently inconsistent results [8,13]. This situation applies to many chronic diseases, such as cancer, cardiovascular, psychiatric and neurodegenerative disease, for which the search for new lifestyle risk factors is a main focus of epidemiological research. As such, in order to produce robust predictions of these ailments, we need to measure precisely multiple behaviors/exposures over a long period of time (years, even decades). Apart from the technical futility of even trying to achieve this, the intensive probing resulting from such examination, will likely influence those under-investigation leading to biased estimates.
The previous point can be illustrated using one of the recent innovative approaches to measure lifestyle-related behaviors and exposures known as Ecological Momentary Assessment (EMA) . Briefly, EMA is a framework that attempts to overcome the inadequacy of self-report, by providing real-time monitoring of behaviors/exposures . Several technological advances have been adapted recently (phone apps, personal monitors, and biosensors) for real time recording of physical activity, food intake, stressors, drugs, or environmental exposures . Such means undoubtedly have the potential to correlate better with important risks implicated in complex diseases than the crude recall techniques traditionally used (e.g. questionnaires). However, it is well recognized that EMA studies, even those that measure limited sets of behaviors, often place more burden on participants compared to more traditional means of assessment. This is because they generally require participants to periodically interrupt their daily activities to complete the measures . The influence of assessment itself on the behavior assessed has been long recognized (reactive self-monitoring), even for the monitoring of simple behaviors [20,21]. As such, applying EMA to a multitude of behaviors/exposures involved in complex disease epidemiology will likely involve a substantial disruption of daily routine of participants. In the long term, compliance with demanding study procedures will likely decline, bringing the participants back to their usual routine at the expense of maintaining the fidelity of study protocol. In essence, the more the study participants abide by the study protocol, the less they become representative of similar individuals outside of the study sample (population), and vice versa.
Imagine an investigator wanting to measure accurately common factors implicated in the etiology of chronic diseases such as food intake, physical activity, and stress. As these attributes are repetitive, frequent, and diverse in nature and range, their continuous monitoring over a long period even using the most advanced gadgets will likely involve substantial intrusion on the daily routine of study participants (e.g. instrument charging, calibration, carrying, data input/download/export, etc.). Ease of measurement and perceived importance moreover, may lead study participants to differentially follow the study protocol for different attributes resulting in variable data quality. Incorporating physiological/biological assessments, or complementing monitoring with observations have been proposed to help deal with such limitations . However, many of the behaviors invoked in complex disease epidemiology such as dietary habits and physical activity, do not have valid biological markers. Even if such markers do exist, the long period of monitoring required to study lifestyle risks of chronic disease will likely influence their assessment in a variety of ways including, natural development of tests and reagents, changing of quality standards, interactions due to acute and chronic conditions facing study subjects, changes due to aging (e.g. decline in kidney and liver functions), and finally market forces that can drive certain providers of testing materials out of business.
The second factor underlying my doubt about the ability of epidemiology to further the study of complex disease relates to the unpredictability of the role of individual components within complex interactions affecting population’s health. Much of the epidemiology of complex disease is built around a probabilistic causal paradigm, where the presence of a risk factor predicts an increase in the probability of the disease outcome. Accordingly, models commonly used in the epidemiology of chronic disease tend to produce fixed and one directional risk estimates. In real life however, this one-directional relationship is rarely the case, as complex interactions and feedback loops prevail . Low physical activity leads to obesity, while obesity will limit physical activity, and such dynamic interaction cannot be sorted out based on the dichotomous causal/reverse-causal simplification. Population health from this perspective, represents a complex system, defined as “a collection of individual agents with freedom to act in ways that are not always totally predictable, and whose actions are interconnected so that one agent’s actions changes the context for other agents” . Such systems are characterized by being non-linear with feedback loops, which allows for self-organization, and for small changes to have large effects that cannot be understood by looking at individual components [22-25]. For example, the collapse of inner city communities, with associated health burdens can be driven by a decision to reduce fire services, and subsequently can be prevented by modest interventions . Applying predictive research models to such situations would have likely identified several proxies (e.g. poverty, housing conditions, insurance, access to care, social deprivation), and have made hence complex, and mostly unrealistic recommendations for interventions. Accordingly, we need a paradigm shift to address the rich and dynamic interactions between humans and their ever changing environments.
One of the main spheres that illustrate the inadequacy of our current epidemiological methods and concepts to our changing environments is the “online world”. Increasingly we became more connected, but perhaps more isolated, which is changing the notion of population, community, and peers beyond the traditional definitions used in health research. Much of religion, politics, and culture are taking place online nowadays and they are shaping a new sense of community and identity that defies classical geopolitical boundaries and have profound effect on people’s lifestyle and health choices. While the complexity of such systems can be a deterrent for researchers, what looks complex and unpredictable at one level, can be simple and predictable at another. For example, it can be hard to predict day-to-day climate or market behavior, while things become rather simple on a larger scale, such as seasons and economic cycles . Picking the right level/scale therefore, can reveal much more about factors influencing complex diseases than applying multi-level frameworks currently trendy in epidemiology .
It seems that epidemiology has reached its boundaries for what it can achieve in terms of complex diseases and their lifestyle risk factors, and that more studies with better design or measurement will unlikely lead to breakthroughs that can justify their cost. For such breakthroughs to happen, new approaches and paradigms, such as complexity theory, need to be adapted to the study of human health. Within complex systems, context and understanding the interactions between system components can be more important than quantifying the contribution of each component to disease risk. Thus, multi-disciplinary approaches involving social sciences can be beneficial in providing context information about lifestyle risk factors, while studies connecting disease trends to broader political-economic drivers influencing human activity, nutrition, and exposures, can provide pathways for solutions within the built, work, and recreational environments . Within such framework, we need perhaps to start talking about ecological plausibility rather than biological plausibility, in recognition of interconnectedness between parts of complex systems beyond the sum of those parts. The challenges of measurement and complexity of human life for the epidemiology of complex disease will unlikely be resolved from within, but require new paradigms and tools. I fully understand that I am advancing several complex issues without entertaining the depth and breadth of the literature about them. My aim here is modest; to stimulate a healthy debate about the science of epidemiology of complex diseases and lifestyle risk factors.
- Watson P. The modern mind: an intellectual history of the 20th century. 1st ed. New York, NY: Harper Perennial, Publishers; 2002.Google Scholar
- Rickles D, Hawe P, Shiell A. A simple guide to chaos and complexity. J Epidemiol Community Health. 2007;61:933–7.View ArticlePubMed CentralPubMedGoogle Scholar
- Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2, e124.View ArticlePubMed CentralPubMedGoogle Scholar
- Boffetta P, McLaughlin JK, Vecchia CL, Tarone RE, Lipworth L, Blot WJ. False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Inst. 2008;100:988–95.View ArticlePubMed CentralPubMedGoogle Scholar
- Sesso HD, Buring JE, Christen WG, Kurth T, Belanger C, MacFadyen J, et al. Vitamins E and C in the prevention of cardiovascular disease in men. JAMA. 2008;300:2123–33.View ArticlePubMed CentralPubMedGoogle Scholar
- Lippman SM, Klein EA, Goodman PJ, Lucia MS, Thompson IM, Ford LG, et al. Effect of selenium and vitamin E on risk of prostate cancer and other cancers. JAMA. 2009;301:39–51.View ArticlePubMed CentralPubMedGoogle Scholar
- Neuhouser ML, Wassertheil-Smoller S, Thomson C, Aragaki A, Anderson GL, Manson JE, et al. Multivitamin use and risk of cancer and cardiovascular disease in the Women’s Health Initiative cohorts. Arch Intern Med. 2009;169:294–304.View ArticlePubMedGoogle Scholar
- Maziak W. The triumph of the null hypothesis: epidemiology in an age of change. Int J Epidemiol. 2009;38:393–402.View ArticlePubMed CentralPubMedGoogle Scholar
- Doll R, Hill AB. Lung cancer and other causes of death in relation to smoking; a second report on the mortality of British doctors. Br Med J. 1956;2:1071–81.View ArticlePubMed CentralPubMedGoogle Scholar
- Kannel WB, Dawber TR, Kagan A, Revotskie N, Stokes J. Factors of risk in the development of coronary heart disease – six-year follow-up experience: the Framingham Study. Ann Intern Med. 1961;55:33–50.View ArticlePubMedGoogle Scholar
- Teicholz N. The Government’s Bad Diet Advice. NYT. 2015. http://www.nytimes.com/2015/02/21/opinion/when-the-government-tells-you-what-to-eat.html?_r=0. Accessed 2 March 2015.
- Nagler RH. Adverse outcomes associated with media exposure to contradictory nutrition messages. J Health Commun. 2014;19:24–40.View ArticlePubMed CentralPubMedGoogle Scholar
- Buchanan AV, Weiss KM, Fullerton SM. Dissecting complex disease: the quest for the Philosopher’s Stone? Int J Epidemiol. 2006;35:62–71.Google Scholar
- Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007;4, e297.View ArticlePubMed CentralPubMedGoogle Scholar
- Young SS, Karr A. Deming, data and observational studies. Significance. 2011;8:116–20.Google Scholar
- Taubes G. Epidemiology faces its limits. Science. 1995;269:164–9.View ArticlePubMedGoogle Scholar
- Moskowitz DS, Young SN. Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. J Psychiatry Neurosci. 2006;31:13.PubMed CentralPubMedGoogle Scholar
- Weis BK, Balshaw D, Barr JR, Brown D, Ellisman M, Lioy P, et al. Personalized exposure assessment: promising approaches for human environmental health research. Environ Health Perspect. 2005;113:40–8.View ArticleGoogle Scholar
- Robbins ML, Kubiak T. Ecological monetary assessment in behavioral medicine: research and practice. In: Mostofsky DI, editor. The handbook of behavioral medicine. 2014. p. 429–46.View ArticleGoogle Scholar
- Gunthert KC, Wenze SJ. Daily diary methods. In: Mehl MR, Conner TS, editors. Handbook of research methods for studying daily life. New York, NY: The Guilford Press; 2012. p. 144–59.Google Scholar
- Kazdin AE. Reactive self-monitoring: the effects of response desirability, goal setting, and feedback. J Consult Clin Psychol. 1974;42:704–16.View ArticlePubMedGoogle Scholar
- Pearce N, Merletti F. Complexity, simplicity, and epidemiology. Int J Epidemiol. 2006;35:515–9.View ArticlePubMedGoogle Scholar
- Fullilove RE, Edgoose JC, Fullilove MT. Chaos, criticality, and public health. J Natl Med Assoc. 1997;89:311–6.PubMed CentralPubMedGoogle Scholar
- Diez Roux AV. Complex systems thinking and current impasses in health disparities research. Am J Public Health. 2011;101:1627–34.View ArticlePubMed CentralPubMedGoogle Scholar
- Finegood DT. The importance of systems thinking to address obesity. Nestle Nutr Inst Workshop Ser. 2012;73:123–37. discussion 139–41.View ArticlePubMedGoogle Scholar
- Maziak W, Ward KD, Stockton MB. Childhood obesity: are we missing the big picture? Obes Rev. 2008;9(1):35–42.PubMedGoogle Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.