- Analytic perspective
- Open Access
Data harmonization and federated analysis of population-based studies: the BioSHaRE project
Emerging Themes in Epidemiologyvolume 10, Article number: 12 (2013)
Individual-level data pooling of large population-based studies across research centres in international research projects faces many hurdles. The BioSHaRE (Biobank Standardisation and Harmonisation for Research Excellence in the European Union) project aims to address these issues by building a collaborative group of investigators and developing tools for data harmonization, database integration and federated data analyses.
Eight population-based studies in six European countries were recruited to participate in the BioSHaRE project. Through workshops, teleconferences and electronic communications, participating investigators identified a set of 96 variables targeted for harmonization to answer research questions of interest. Using each study’s questionnaires, standard operating procedures, and data dictionaries, harmonization potential was assessed. Whenever harmonization was deemed possible, processing algorithms were developed and implemented in an open-source software infrastructure to transform study-specific data into the target (i.e. harmonized) format. Harmonized datasets located on server in each research centres across Europe were interconnected through a federated database system to perform statistical analysis.
Retrospective harmonization led to the generation of common format variables for 73% of matches considered (96 targeted variables across 8 studies). Authenticated investigators can now perform complex statistical analyses of harmonized datasets stored on distributed servers without actually sharing individual-level data using the DataSHIELD method.
New Internet-based networking technologies and database management systems are providing the means to support collaborative, multi-center research in an efficient and secure manner. The results from this pilot project show that, given a strong collaborative relationship between participating studies, it is possible to seamlessly co-analyse internationally harmonized research databases while allowing each study to retain full control over individual-level data. We encourage additional collaborative research networks in epidemiology, public health, and the social sciences to make use of the open source tools presented herein.
The benefits of harmonizing and pooling research databases are numerous. Integrating harmonized data from different populations allows achieving sample sizes that could not be obtained with individual studies [1–4], improves the generalizability of results [3–5], helps ensure the validity of comparative research [6, 7], encourages more efficient secondary usage of existing data , and provides opportunities for collaborative and multi-centre research [9–12]. Governments, funders, and researchers alike have been stressing the importance of harmonization and collaborative use of data and samples in the population health and biobanking fields over the past half-decade [13–21]. However, managing and harmonizing very large amounts of data from different sources is a significant challenge [20, 22–24]. Further, ethical, legal, and consent-related restrictions associated with sharing or pooling of individual-level data represent a common dilemma faced by international research projects and networks [25, 26]. Web-based networking technologies and new database management systems are at the forefront of providing solutions to some of these dilemmas [27–32]. When combined with strong collaboration between partners, such tools allow us to interconnect distributed databases through database federation systems and assure secure and effective analysis of complex datasets across research centres while retaining individual-level data within host institutions of participating studies.
BioSHaRE (Biobank Standardisation and Harmonisation for Research Excellence in the European Union) is a Seventh Framework Programme (FP7) funded project whose aim is developing data harmonization tools and standardized IT systems for existing biobanks and cohorts across Europe, and apply them to conduct pan-European epidemiological research . As a core project of BioSHaRE, the Healthy Obese Project (HOP) piloted retrospective data harmonization and database federation tools to effectively assess the compatibility of collected data and to safely federate research databases in order to conduct obesity-related research, with a focus on the characterization of metabolically healthy obese individuals [34, 35]. Since ‘healthy obesity’ is rather rare, researchers need a large numbers of subjects to explore its determinants and consequences. To investigate subgroups, even larger numbers are needed, making the HOP a good case study for harmonization and co-analysing data from several large population-based studies.
The data harmonization and database federation methodology and infrastructure developed and piloted under BioSHaRE’s HOP is founded on the DataSHaPER (DataSchema and Harmonization Platform for Epidemiological Research) harmonization approach [22, 37] and on information technology tools developed by OBiBa (Open Source Software for BioBanks) . These have been recently integrated into a platform to support retrospective harmonization and integration of data  by the Maelstrom Research team . The current paper presents the stepwise data harmonization and database federation process employed for the HOP (Table 1) and the information technology tools developed to support it . Resources described in this paper are currently being used by BioSHaRE to harmonize, integrate and jointly analyse data collected by eight population-based cohorts across Europe. Additional studies are joining the project and making use of these tools on a regular basis. The infrastructure described in this paper is helping to create a collaborative environment for BioSHaRE investigators. It aims to facilitate: (1) transforming data collected by existing studies into a common format through the use of processing algorithms; (2) interconnecting harmonized databases located in different countries and institutions across Europe; and (3) achieving combined statistical analyses of these datasets without pooling or sharing individual-level data.
Study recruitment and documentation
The first step in the data harmonization and database federation process was to recruit studies to participate in the project. To be eligible to participate in the HOP, studies needed to collect comprehensive health outcome, socio-demographic, behavioural, physical and biochemical measures, and allow remote access to aggregated data for statistical analyses. Studies were also required to make study metadata (i.e. questionnaires, data codebooks, standard operating procedures) and ethical and legal documents/policies available to the BioSHaRE coordinating group. A preliminary scan of consents, data access, and IP policies was conducted by the Public Population Project in Genomics and Society (P3G)  to assess the potential for each study to participate. Study investigators then submitted formal requests to participate in the project to their respective research ethics or data access committees. Next, key characteristics of participating studies were documented using a standardized online description form found on the Mica-powered BioSHaRE website (see “What is Mica?” below) . These characteristics included general study design, number of participants, participant characteristics, methods of recruitment, number and type of biological samples collected, and data and sample access conditions. Cataloguing such information helped in better understanding the level of heterogeneity across study designs as well as potential sample sizes available for analyses. Table 2 lists the eight studies participating in the HOP to date.
What is Mica?
Mica  is a software application developed to create web portals for individual epidemiological studies or for study consortia. Features supported by Mica include a standardized study catalogue, data dictionary browsers, online data access request forms, and communication tools (e.g. forums, events, news). When used in conjunction with the Opal software, Mica also allows authenticated users to perform distributed queries on the content of study databases hosted on remote servers and retrieve summary statistics and contingency tables.
Harmonized variable selection and definition
In the second step of the process, HOP investigators convened to select and define a set of ‘target’ variables required to answer specific obesity-related research questions. This set of variables, or DataSchema , acted as a template for the retrospective harmonization process by defining the common format measures to be derived using data of participating studies. In order to allow multiple studies to participate in a collaborative endeavour while ensuring validity of the scientific output, the development of a DataSchema requires a balance between uniformity (e.g. exact same question wording and data collection procedures) and acceptance of certain level of heterogeneity across studies (e.g. slightly different wording or procedures). Two workshops (March and June 2012) bringing together BioSHaRE investigators from across Europe and Canada were organized to identify and define target variables making up the HOP DataSchema. Each workshop respectively focused on selecting variables to answer the following research questions: (1) What is the prevalence of obese individuals not showing increased metabolic or cardiovascular risk in each study (i.e. the ‘healthy obese’)?; and (2) What are the lifestyle and behavioural risk factors associated with ‘healthy obesity’? Following the workshops, the DataSchema went through iterative rounds of revisions through teleconferences and electronic communication to arrive at a consensus on target variables (e.g. weight), definitions (e.g. measured weight), and format (e.g. weight in Kg). For certain areas of information, international standards and classifications were used to define target variables and thereby facilitate international comparison of key concepts. For example, education-related DataSchema variables were developed using UNESCO’s International Standard Classification of Education , while the ‘current occupation’ variable was developed using the International Labour Organization’s International Standard Classification of Occupations . Once finalized, DataSchema variables were annotated in a designated section of the Mica-powered BioSHaRE website (see https://www.bioshare.eu/content/healthy-obese-project-dataschema). To date, 96 variables including anthropometric and biochemical measures, history of obesity-related disease outcomes, socio-demographic status, and lifestyle and risk factors make up HOP DataSchema. New variables, including constructs covering the physical activity domain, will be added to the DataSchema over the course of the project.
Study variable identification and harmonization potential assessment
As a third step, using study questionnaires, standard operating procedures, and data dictionaries, harmonization team research assistants identified study-specific data covering DataSchema variables and formally assessed the potential for each study to generate each of these variables (96 variables across 8 studies). This step consisted of comparing the full definition and format of a DataSchema variable to study-specific questions, collection procedures and data formats to determine their compatibility. For example, in order for a given study to generate the ‘weight’ DataSchema variables, this variable needed to be objectively measured by a doctor, nurse or technician rather than self-reported by the participant. Not all studies could generate all of the 96 targeted variables. When assessing the harmonization potential, there were two reasons for which a particular study could not generate a specific DataSchema variable: either because the study simply did not collect information on the construct measured by a particular targeted variable or because the information the study collected on this construct was deemed incompatible with the DataSchema variable definition (e.g. self-reported weight). Harmonization potential assessment allowed determining which DataSchema variables could be generated by each study and identifying what study-specific data needed to be extracted from central study data repositories to be used in the remainder of the harmonization exercise. The overall harmonization potential assessment showed that 73% of all matches evaluated (96 DataSchema variables for each of the 8 studies) were considered compatible. Some domains of information proved to be more problematic to harmonize than others. For example, the 30 nutritional habit variables showed a harmonization potential of only 37% for all matches evaluated. On the other hand, the nine variables covering disease history and medication use (i.e. stroke, diabetes, high blood pressure, myocardial infarction) were considered compatible with DataSchema formats 97% of the time.
What is Opal?
Opal  is an software application used to manage study data and includes a software infrastructure enabling data harmonization and data integration across studies. As such, Opal supports the development and implementation of processing algorithms required to transform study-specific data into a common harmonized format. Moreover, when connected to a Mica-web interface, Opal allows users to seamlessly and securely search distributed datasets across several Opal instances.
Harmonized data federation, dissemination and analysis
The fifth and last step in the process aimed to co-analyse harmonized datasets while addressing ethical and legal restrictions associated with pooling individual-level data. To achieve this, the Opal and Mica software applications were used in parallel to create a federated infrastructure that allows researchers to jointly analyse harmonized data while retaining individual-level data within their respective host institutions. Hence, once harmonized datasets were generated on local Opal servers in each host institution, these servers were securely connected via encrypted remote connections (using HTTPS).
Two types of analyses are made available through this framework (see Figure 2). Firstly, once logged on to a password protected section of the Mica-based BioSHaRE.eu website, investigators can securely execute queries allowing them to retrieve data summaries, descriptive statistics (frequencies, min, max, mean, standard deviation), or contingency tables of the harmonized databases hosted on each of the geographically-dispersed Opal servers. Multiple investigators can run such distributed queries simultaneously and in real time on the different Opal servers. Secondly, and to support more complex federated data analyses such as multiple linear regressions, logistic regressions, Poisson regressions, or for undertaking a simple analysis such as executing a t-test, the Opal-Mica framework is fully compatible with the DataSHIELD method (see “What is DataSHIELD?” below) [28, 45]. When a joint analysis is to be undertaken using data from several sources, statistical efficiency and flexibility is often best served by working directly with individual-level data rather than by meta-analysing summarised results from each study . However, important ethico-legal constraints, intellectual property considerations, and/or the physical size of the data to be analysed, often prevent or delay the sharing of individual-level data . Based on parallelized analysis and modern distributed computing, DataSHIELD enables the analysis of harmonized individual-level data without the need to physically pool them [28, 45].
What is DataSHIELD?
DataSHIELD (www.datashield.org) acts as an interface module between the Opal software application and the R software environment . Under DataSHIELD, a central analysis computer (i.e. the computer from which analysis is carried out) coordinates a parallelized simultaneous analysis of the individual-level data on all the data computers (i.e. the secure servers where the individual-level data are stored) by sending blocks of code, in the form of simple analytic commands, to each data computer. These request each server to undertake a particular analysis and to return non-disclosive summary statistics to the analysis computer, that is data which cannot possibly lead to the identification of the individuals to which they relate. For analyses such as the fitting of a generalized linear model, DataSHIELD works iteratively. After each iteration, summary statistics (typically the score vector and information matrix) are returned by each data computer to the analysis computer and the estimates of the model are refined; the process ends when the estimates converge. This enables global updating of the estimated model parameters taking full account of the data from all studies simultaneously. In this way, it is possible to fit a mathematical model as if the individual-level data from all studies were pooled centrally on the analysis computer while - in reality – the data never leave their studies of origin, and all that does leave are the non-disclosive summary statistics.
IT requirement for DataSHIELD
The DataSHIELD approach places very few demands on the IT equipment required (Figure 2). The analysis computer can be a standard laptop or desktop running any R console  or a rich client such as RStudio  with DataSHIELD R packages. The data servers must each be running Opal and R. Using this framework, each Opal instance receives, controls and forwards requests from R running on the analysis computer to R running on the server. The controlled and secured web-based links between the analysis computer and the data computers do not need to carry heavy traffic, and DataSHIELD therefore demands no more than a standard wireless link to a broadband access point. It is also possible to channel communications through study firewall configurations to allow only for analyses from computers at specific IP addresses.
New Internet-based networking technologies and database management systems are providing the means to support collaborative, multi-centre research in an efficient and secure manner [27–32]. Since its inception in 2010, the BioSHaRE project works at harnessing such resources along with international expertise in order to facilitate cross-border collaborations in the biomedical sciences. The Healthy Obese Project has successfully served to pilot a suite of tools which facilitates: (1) transforming existing data collected by different studies into a common format through the use of processing algorithms; (2) interconnecting harmonized databases located across Europe via a federated web-based infrastructure; and (3) achieving joint statistical analyses of harmonized datasets without pooling or sharing individual-level data.
It must be noted that the data harmonization and database federation work conducted within the BioSHaRE project has required a high level of collaboration between different parties. Active involvement of study investigators, research centre staff, and the BioSHaRE coordinating group was pivotal for the software and information technologies to be of use. Though this initiative has proven to require a high level of coordination, the infrastructure that results from it has a number of strengths. First, using the Mica-Opal federated framework, studies retain all control over individual-level data since local Opal instances compute aggregate data before sending results to the central Mica web portal, or to the analysis computer running the DataSHIELD R packages. Since either Mica or the analysis computer act as brokers to securely fetch information from each Opal instance, investigators querying data therefore never connect directly to the servers hosting individual-level data. Secondly, once harmonized datasets are derived on each participating study’s server, they can be used and reused for multiple collaborative research projects. Third, allowing investigators to safely and remotely analyse data (i.e. produce summary statistics, contingency tables, logistic regressions) at their convenience and in real time limits the burden associated with filing multiple data access requests at multiple research centres, thereby saving principal investigators and study managers time and resources. Lastly, Opal-Mica federated infrastructure features such as encrypted remote connections (using HTTPS), user authentication, and control over user access and permissions (e.g. dataset visibility, import/export, data manipulation) effectively ensures that participant data privacy and confidentiality are respected across studies in a collaborative research context.
The HOP pilot project is helping to optimize the tools and methods presented herein and to add new data analysis features to these tools in the aim of constructing a more robust, efficient, scalable and automated framework to support secure analysis of harmonized data in BioSHaRE and other collaborative projects. Through this pilot project, we have shown that seamlessly and securely co-analysing internationally harmonized research databases is possible. We hope that the open source tools presented in this paper will be of interest to additional research networks in epidemiology, public health, and the social sciences in the future. Opal and Mica software as well as the DataSHIELD R packages are freely available to the research community under the GPL3 license at https://www.obiba.org.
Smith-Warner SA, Spiegelman D, Ritz J, Albanes D, Beeson WL, Bernstein L, Berrino F, van den Brandt PA, Buring JE, Cho E, et al: Methods for pooling results of epidemiologic studies: the pooling project of prospective studies of diet and cancer. Am J Epidemiol. 2006, 163 (11): 1053-1064. 10.1093/aje/kwj127
Thompson A: Thinking big: large-scale collaborative research in observational epidemiology. Eur J Epidemiol. 2009, 24 (12): 727-731. 10.1007/s10654-009-9412-1
Khoury MJ: The case for a global human genome epidemiology initiative. Nat Genet. 2004, 36 (10): 1027-1028. 10.1038/ng1004-1027
Hamilton CM, Strader LC, Pratt JG, Maiese D, Hendershot T, Kwok RK, Hammond JA, Huggins W, Jackman D, Pan H, et al: The PhenX toolkit: Get the most from your measures. Am J Epidemiol. 2011, 174 (3): 253-260. 10.1093/aje/kwr193
Noale M, Minicuci N, Bardage C, Gindin J, Nikula S, Pluijm S, Rodríguez-Laso A, Maggi S: Predictors of mortality: an international comparison of socio-demographic and health characteristics from six longitudinal studies on aging: the CLESA project. Exp Gerontol. 2005, 40 (1): 89-99.
Serra-Majem L, MacLean D, Ribas L, Brulé D, Sekula W, Prattala R, Garcia-Closas R, Yngve A, Lalonde M, Petrasovits A: Comparative analysis of nutrition data from national, household, and individual levels: results from a WHO-CINDI collaborative project in Canada, Finland, Poland, and Spain. J Epidemiol Community Health. 2003, 57 (1): 74-80. 10.1136/jech.57.1.74
Bath PA, Deeg D, Poppelaars J: The harmonisation of longitudinal data: a case study using data from cohort studies in The Netherlands and the United Kingdom. Ageing Soc. 2010, 30 (08): 1419-1437. 10.1017/S0144686X1000070X.
Sansone S-A, Rocca-Serra P, Field D, Maguire E, Taylor C, Hofmann O, Fang H, Neumann S, Tong W, Amaral-Zettler L: Toward interoperable bioscience data. Nat Genet. 2012, 44 (2): 121-126. 10.1038/ng.1054
Schad PA, Mobley LR, Hamilton CM: Building a biomedical cyberinfrastructure for collaborative research. Am J Prev Med. 2011, 40 (5): S144-S150. 10.1016/j.amepre.2011.01.018
Seminara D, Khoury MJ, O’Brien TR, Manolio T, Gwinn ML, Little J, Higgins JPT, Bernstein JL, Boffetta P, Bondy M, et al: The emergence of networks in human genome epidemiology: “challenges and opportunities”. Epidemiology. 2007, 18 (1): 1-8. 10.1097/01.ede.0000249540.17855.b7
Budin-Ljøsne I, Isaeva J, Knoppers BM, Tassé AM, Shen H-y, McCarthy MI, Harris JR: Data sharing in large research consortia: experiences and recommendations from ENGAGE. Eur J Hum Genet. Advance online publication 19 June 2013. doi:10.1038/ejhg.2013.131.
Bousquet J, Anto J, Sunyer J, Nieuwenhuijsen M, Vrijheid M, Keil T: Pooling birth cohorts in allergy and asthma: European union-funded initiatives – a MeDALL, CHICOS, ENRIECO, and GA < sup > 2</sup > LEN joint paper. Int Arch Allergy Immunol. 2013, 161 (1): 1-10. 10.1159/000343018.
Harris JR, Burton P, Knoppers BM, Lindpaintner K, Bledsoe M, Brookes AJ, Budin-Ljosne I, Chisholm R, Cox D, Deschenes M, et al: Toward a roadmap in global biobanking for health. Eur J Hum Genet. 2012, 20: 1105-1111. 10.1038/ejhg.2012.96
Zika E, Paci D, Schulte in den Bäumen T, Braun A, RijKers-Defrasne S, Deschênes M, Fortier I, Laage-Hellman J, Scerri CA, Ibarreta D: Biobanks in Europe: prospects for harmonisation and networking. Luxembourg: European Union; 2010.
Gottweis H, Kaye J, Bignami F, Rial-Sebbag E, Lattanzi R, Macek M Jr: Biobanks for Europe: a challenge for governance. European Union: Luxembourg; 2012.
Bookman EB, McAllister K, Gillanders E, Wanke K, Balshaw D, Rutter J, Reedy J, Shaughnessy D, Agurs-Collins T, Paltoo D, et al: Gene-environment interplay in common complex diseases: forging an integrative model—recommendations from an NIH workshop. Genet Epidemiol. 2011, 35 (4): 217-225.
Khoury MJ, Lam TK, Ioannidis JPA, Hartge P, Spitz MR, Buring JE, Chanock SJ, Croyle R, Goddard KAB, Ginsburg GS, et al: Transforming epidemiology for 21st century medicine and public health. Cancer Epidemiol Biomarkers Prev. 2013, 22 (4): 508-516. 10.1158/1055-9965.EPI-13-0146
Walport M, Brest P: Sharing research data to improve public health. Lancet. 2011, 377 (9765): 537-539. 10.1016/S0140-6736(10)62234-9
Pisani E, AbouZahr C: Sharing health data: good intentions are not enough. Bull World Health Organ. 2010, 88: 462-466. 10.2471/BLT.09.074393
Bennett SN, Caporaso N, Fitzpatrick AL, Agrawal A, Barnes K, Boyd HA, Cornelis MC, Hansel NN, Heiss G, Heit JA, et al: Phenotype harmonization and cross-study collaboration in GWAS consortia: the GENEVA experience. Genet Epidemiol. 2011, 35 (3): 159-173. 10.1002/gepi.20564
Vickers AJ: Making raw data more widely available. BMJ. 2011, 342: d2323. 10.1136/bmj.d2323
Fortier I, Burton PR, Robson PJ, Ferretti V, Little J, L’Heureux F, Deschenes M, Knoppers BM, Doiron D, Keers JC, et al: Quality, quantity and harmony: the DataSHaPER approach to integrating data across bioclinical studies. Int J Epidemiol. 2010, 39 (5): 1383-1393. 10.1093/ije/dyq139
Howe D, Costanzo M, Fey P, Gojobori T, Hannick L, Hide W, Hill DP, Kania R, Schaeffer M, St Pierre S: Big data: the future of biocuration. Nature. 2008, 455 (7209): 47-50. 10.1038/455047a
Science Staff: Challenges and opportunities. Science. 2011, 331 (6018): 692-693.
Kaye J: From single biobanks to international networks: developing e-governance. Hum Genet. 2011, 130 (3): 377-382. 10.1007/s00439-011-1063-0
Knoppers B, Harris J, Tasse A, Budin-Ljosne I, Kaye J, Deschenes M, Zawati M: Towards a data sharing code of conduct for international genomic research. Genome Med. 2011, 3 (7): 46. 10.1186/gm262
Karr AF, Fulp WJ, Vera F, Young SS, Lin X, Reiter JP: Secure, privacy-preserving analysis of distributed databases. Technometrics. 2007, 49 (3): 335-345. 10.1198/004017007000000209.
Wolfson M, Wallace SE, Masca N, Rowe G, Sheehan NA, Ferretti V, LaFlamme P, Tobin MD, Macleod J, Little J, et al: DataSHIELD: resolving a conflict in contemporary bioscience—performing a pooled analysis of individual-level data without sharing the data. Int J Epidemiol. 2010, 39 (5): 1372-1382. 10.1093/ije/dyq111
Muilu J, Peltonen L, Litton JE: The federated database–a basis for biobank-based post-genome studies, integrating phenome and genome data from 600 000 twin pairs in Europe. Eur J Hum Genet. 2007, 15 (7): 718-723. 10.1038/sj.ejhg.5201850
Yuille M, van Ommen G-J, Bréchot C, Cambon-Thomsen A, Dagher G, Landegren U, Litton J-E, Pasterk M, Peltonen L, Taussig M, et al: Biobanking for Europe. Brief Bioinform. 2008, 9 (1): 14-24.
Ford D, Jones K, Verplancke J-P, Lyons R, John G, Brown G, Brooks C, Thompson S, Bodger O, Couch T, et al: The SAIL Databank: building a national architecture for e-health research and evaluation. BMC Health Serv Res. 2009, 9 (1): 157. 10.1186/1472-6963-9-157
El Emam K, Samet S, Arbuckle L, Tamblyn R, Earle C, Kantarcioglu M: A secure distributed logistic regression protocol for the detection of rare adverse drug events. J Am Med Inform Assoc. 2013, 20 (3): 453-461. 10.1136/amiajnl-2011-000735
Biobank standardisation and harmonisation for research excellence in the European union. [https://www.bioshare.eu/]
Karelis AD: Metabolically healthy but obese individuals. Lancet. 2013, 372 (9646): 1281-1283.
Denis GV, Obin MS: ‘Metabolically healthy obesity’: origins and implications. Mol Aspects Med. 2013, 34 (1): 59-70. 10.1016/j.mam.2012.10.004
R Core Team: R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2013.
Fortier I, Doiron D, Little J, Ferretti V, L’Heureux F, Stolk RP, Knoppers BM, Hudson TJ, Burton PR: Is rigorous retrospective harmonization possible? Application of the DataSHaPER approach across 53 large studies. Int J Epidemiol. 2011, 40 (5): 1314-1328. 10.1093/ije/dyr106
Open Source Software for BioBanks. [http://www.obiba.org/]
Doiron D, Raina P, Ferretti V, L’Heureux F, Fortier I: Facilitating collaborative research: implementing a platform supporting data harmonization and pooling. Norsk Epidemiologi. 2012, 21 (2): 221-224.
Maelstrom Research. [http://maelstrom-research.org]
Knoppers B, Fortier I, Legault D, Burton P: Population genomics: the public population project in genomics (P3G): a proof of concept?. Eur J Hum Genet. 2008, 16 (6): 664-665. 10.1038/ejhg.2008.55
ISCED: International Standard Classification of Education. [http://www.uis.unesco.org/Education/Pages/international-standard-classification-of-education.aspx]
International Standard Classification of Occupations (ISCO). [http://www.ilo.org/public/english/bureau/stat/isco/]
Jones E, Sheehan N, Masca N, Wallace S, Murtagh M, Burton P: DataSHIELD–shared individual-level analysis without sharing the data: a biostatistical perspective. Norsk epidemiologi. 2012, 21 (2): 231-239.
Sutton AJ, Kendrick D, Coupland CAC: Meta-analysis of individual- and aggregate-level data. Stat Med. 2008, 27 (5): 651-669. 10.1002/sim.2916
Gomatam S, Karr AF, Reiter JP, Sanil AP: Data dissemination and disclosure limitation in a world without microdata: A risk-utility framework for remote access analysis servers. Stat Sci. 2005, 20 (2): 163-177. 10.1214/088342305000000043.
RStudio: Integrated development environment for R: RStudio: Integrated development environment for R. Boston, MA: (Version 0.97.551) [Computer software]; 2012 [http://www.rstudio.org/]
This work was supported by the European Union Seventh Framework Programme (FP7/2007-2013) [grant number 261433]. We would also like to thank the following staff in research centres across Europe who have made this work possible (in alphabetical order): Anusha Appanvel (Helmholtz Zentrum München – German Research Center for Environmental Health, Augsburg, Germany), Clemens Egger (European Academy of Bolzano/Bozen (EURAC), Bolzano, Italy), Tero Hiekkalinna (National Institute for Health and Welfare, Helsinki, Finland), Sveinung Marvik (Norwegian University of Science and Technology, Trondheim, Norway), Christopher Newby (University of Leicester, Leicester, UK), Marja-Liisa Nuotio (National Institute for Health and Welfare, Helsinki, Finland), Chao Pang (University Medical Center Groningen, Groningen, The Netherlands), Eva Reischl (Helmholtz Zentrum München – German Research Center for Environmental Health, Augsburg, Germany), Morris Swertz (University Medical Center Groningen, Groningen, The Netherlands).
The authors declare that they have no competing interests.
DD, VF, PB, YM, AG, IF contributed to the conception, design and drafting of the manuscript. BW, MP, RS, AM contributed to coordination of the Healthy Obese Project and to the drafting of the manuscript. LF, CM, MW, RH, KK, HH contributed to the acquisition and interpretation of the study-specific data and to the drafting of the manuscript. All authors read and approved the final manuscript.
Vincent Ferretti and Isabel Fortier contributed equally to this work.