- Research article
- Open Access
Effects of recall time on cause-of-death findings using verbal autopsy: empirical evidence from rural South Africa
Emerging Themes in Epidemiology volume 13, Article number: 10 (2016)
Verbal autopsy (VA) is a widely used technique for assigning causes to non-medically certified deaths using information gathered from a close caregiver. Both operational and cultural factors may cause delays in follow-up of deaths. The resulting time lag—from death to VA interview—can influence ways in which terminal events are remembered, and thus affect cause-of-death assignment. This study investigates the impact of recall period on causes of death determined by VA.
A total of 10,882 deaths from the Agincourt Health and Demographic Surveillance System (HDSS) with complete VAs, including recall period, were incorporated in this study. To measure seasonal effect, cause specific mortality fractions (CSMFs) were calculated and compared by every cause for VAs undertaken within six months of death and those undertaken from six to 12 months of death. All causes were classified into eight broad categories and entered in a multiple logistic regression to explore outcome by recall period in relation to covariates.
The majority of deaths (83 %) had VAs completed within 12 months. There was a tendency towards longer recall periods for deaths of those under one year or over 65 years of age. Only the acute respiratory, diarrhoeal and other unspecified non-communicable disease groups showed a CSMF ratio significantly different from unity at the 99 % confidence level between the two recall periods. Only neonatal deaths showed significantly different OR for recall exceeding 12 months (OR 1.69; p value = 0.004) and this increased when adjusting for background factors (OR 2.58; p value = 0.000).
A recall period of up to one year between death and VA interview did not have any consequential effects on the cause-of-death patterns derived, with the exception of neonatal causes. This is an important operational consideration given the planned widespread use of the VA approach in civil registration, HDSS sites and occasional surveys.
Accurate and timely data on mortality by demographic factors, both nationally and sub-nationally, are essential for developing, monitoring, and evaluating health policies and programmes . Health and Demographic Surveillance Systems (HDSSs) can be effective responses to the lack of systematic registration of vital statistics, particularly in resource-limited settings [2–4]. HDSSs can provide necessary evidence through routine update rounds for monitored populations, including documenting causes of death reliably using verbal autopsy (VA) . Surveys of recent deaths can also be undertaken in unregistered populations using VA . In both approaches, an important question arises as to the time that can reasonably elapse between a death occurring and a VA being undertaken.
To undertake VAs, fieldworkers visit households during HDSS update rounds or in the context of other surveys, usually interviewing the person most knowledgeable about the illness or events preceding a death . In HDSSs, updating and verifying existing data or recording new events such as pregnancy outcomes, in- and out-migrations and other socio-economic features as well as birth and death events are carried out via regular update rounds. These rounds may be annual, or more frequent. VA is a widely used technique for assigning cause to non-certified deaths. It elicits most probable cause of death using a standardised interview instrument following detection of a death, with the data usually then processed automatically to assign likely causes of death [5, 8–10].
There are operational and cultural factors which may cause delays in following-up deaths, and these can be associated with the nature of the death. Longer recall times may influence ways in which original events are remembered, and thus affect responses to specific questions in a VA interview, hence influencing conclusions on causes of death [11, 12].
Since evidence on the effect of recall and its consequences on VA processes is limited , this study aims to investigate the effect of recall period on causes of death determined by VA, in order to make recommendations about realistic recall periods for undertaking VAs.
Study setting and data collection
Empirical data on VA recall was sourced from the Agincourt HDSS in rural norteast South Africa, which is described in detail elsewhere , and was a founder member of the INDEPTH Network . It continuously surveys around 90,000 inhabitants living in approximately 16,000 households across 31 villages. From 1992 to 2011, routine visits by trained fieldworkers successfully completed 11,187 VAs with next of kin or other caregivers. Standardised interviews in the local language (Shangaan) were used to elicit signs, symptoms and circumstances of the terminal illness as well as individual health-related behaviour. The collected VA data were transformed into the WHO 2012 VA standard  and processed using the automated InterVA-4 probabilistic model (version 4.02)  which assigns up to three likely causes for each death and is the most widely-used VA tool. A summary of mortality in the Agincourt population from the same dataset is presented in a recent report .
The Agincourt HDSS has undertaken annual update rounds since its inception in 1992. Following a baseline census the same year, the annual census round and the VA interviews have been undertaken strictly between August and November (although some VAs continue into December to finish off) which causes the dominant short-period of five months during the dry season. Deaths identified during the update rounds are followed up by specially trained field workers who conduct a VA interview with the closest available caregiver. As a consequence of Agincourt’s annual cycle of operation, there is a usual range from about four weeks (recognised mourning period during which no interview is conducted) to around one year between death and the VA interview, but this can extend to a longer period in a minority of cases, for example if deaths are missed in update rounds.
For the 12,209 deaths in the Agincourt HDSS between 1992 and 2011, a total of 11,187 (91.6 %) had valid VAs completed, as previously reported . The Agincourt HDSS database also has archived information on the deceased’s background and characteristics, but only 10,882/11,187 (97.3 %) had records on the period between death and VA interview, which thus defined the overall dataset for these analyses. Update rounds at the Agincourt follow periodic routine and enhanced by on-site supervision and quality control which occur at five levels; individual-checks (daily), cross-checks (weekly) and random-checks that covers all survey tools and collected data. This is regularly followed by quality checkers and data validation checks to evade and correct associated errors .
Relevant individual background characteristics were utilised to adjust for cultural factors that may influence reporting deaths in these communities. The context of death and individuals’ characteristics such as age, education and race; which defines the cultural interpretations of symptomatology of particular illnesses have been reported to influence recall accuracy . Such factors are important to consider and account for in the analysis. Age at death was categorised into five groups [0–11 months (infant), 1–14 years (child), 15–49 years (reproductive age), 50–64 years (adult) and 65+ years (elderly)]. At the time of the Mozambican civil war there was a substantial refugee influx of ethnic Shangaan people from Mozambique into the Agincourt area; they and their direct descendents in Agincourt are referred to as former Mozambican refugees, irrespective of formal nationality. Three levels of education were defined by numbers of years of study the VA respondent has completed (none, 1–7 and 8–15 years). The year of death (1992–2011) and place of death (home, hospital/health facility or other) were also recorded.
Although true cause of death is assumed independent of any time lag, the annual cycle of documenting and following up deaths in the Agincourt population would probably lead to confounding between time of year and recall period, which could be important for causes of death subject to seasonal variation. A variable for season was created which put deaths in the drier months (May to September inclusive) into one category, compared with the wetter months (October to April inclusive), based on meteorological data.
Output from the InterVA-4 model consists of up to three likelihoods per case attributed to different causes, and for individuals where these do not total 100 %, an indeterminate residual, as previously described . Deaths due to any specific cause or cause group can then be determined by summing likelihoods; regression models can use the individual likelihoods as weights in models with multiple records per case.
To investigate the seasonal effect, cause specific mortality fractions (CSMF) for every cause of death in the WHO 2012 VA cause list were calculated separately for VAs undertaken within six months of death and those undertaken from six to 12 months of death. All maternal causes were aggregated into a single category because of small numbers. CSMF ratios for the two time periods and their 99 % confidence intervals were calculated for each cause using the Katz adjusted log method in view of the small numbers involved for some causes .
To explore the VA assessment of causes of death by recall period in relation to covariates, all causes were classified into eight broader categories for analysis. Both HIV and pulmonary tuberculosis (TB) commonly co-exist in this population with high degree of symptoms-overlap, especially in younger adults, justifying their combination into one category . Acute respiratory infections were retained as a single category, while all remaining infectious causes, neoplasms, other NCDs (including the few maternal deaths), neonatal deaths and external causes were defined as separate categories. Cases with contradictory or insufficient information for the InterVA-4 model, as well as the residual fractions, were classified as ‘indeterminate’, forming the eighth category. The time between death and VA was stratified into four groups to define the recall period: less than three months, three to five months, six to eleven months and over one year. Logistic regression modelling was used to calculate adjusted odds ratios associated with different recall periods for the eight cause categories, using cause likelihood for each fractional death as a weight, individual ID number to identify all records belonging to an individual, and appropriate covariates as independent factors.
A total of 10,882 deaths with a completed VA, including data on the period between death and VA interview, were processed. The median recall was 7 months, ranging from the first month after death to 48 months.
Figure 1 summarises the distribution of all deaths by the recall month (number of completed months from death to VA), showing that the majority of deaths (83 %) had VAs done within 12 months. This reflects the practice in the Agincourt HDSS of undertaking most VAs during the course of an annual update round and hence no more than 12 months since a death.
Following its establishment in 1992, mortality in the Agincourt HDSS increased steadily as the South African HIV/AIDS epidemic took hold, with decreases only in recent years as anti-retroviral therapy became available, as shown in Fig. 2.
Both figures shed light on strategically important operational aspects during these routine annual rounds of VAs in Agincourt. As evident in the first figure, VAs were less frequently undertaken in the first month after death, giving respect to families in the immediate aftermath of a death. The corollary of this is that some deaths occurring around the time of the annual update round are followed up just over a year later. The age distribution of recall also shown in Fig. 1 showed a tendency towards longer recall periods for deaths of those who were under one year or over 65 years. Figure 2 also shows that recall period was significantly confounded with season, with the majority of recalls under six months relating to deaths in the dry season.
Cause specific mortality fraction ratios for recall periods of less than six months versus 6–11 months are shown in Table 1. The acute respiratory, diarrhoeal and other unspecified NCD groups showed a CSMF ratio significantly different from unity at the 99 % CI level between the two recall periods.
The logistic regression analysis assessed patterns of mortality by the broader categories according to recall period. Table 2 presents the crude and adjusted odds ratios (OR) of all cause categories across the recall periods, with the shortest recall period (<3 months) as the reference group. A consistent trend was seen across all the infectious categories, which accounted for 45 % of all deaths. The crude OR for each category was significantly different for recall periods over one year, but these differences did not persist when adjusted for background factors. Neither the neoplasm nor other NCD categories showed significant differences in crude or adjusted ORs. The odds of neonatal deaths were significantly higher with recall exceeding 12 months (OR 1.69; p value = 0.004) compared to the 3 months period and this association increased when adjusting for background factors (OR 2.58; p value = 0.000), for reasons that are not entirely clear. Both external causes and the indeterminate category mirrored the trend shown across the infectious categories; adjusting for background factors reduced differences by recall period.
Although the question as to what might constitute appropriate recall periods for VA interviews has been asked, there is little evidence available on the impact of recall on cause of death outcomes. These analyses from a large dataset covering a long period of time with a wide range of actual VA recall periods go some way to addressing this issue. However, proving that different recall periods have superior performance is difficult with statistical tools; at most and in the absence of a reference standard, one can show that recall periods have equal effects on the VA assessment. Results show very minimal recall effects associated with VAs undertaken anytime during the first year after death, and only small effects during the second year.
Published reports suggest that longer recall periods do not influence reporting of a death event and can be as reliable as short intervals [21, 22]. Using broader categories of the complete WHO 2012 list of VA causes of death, this study attempted to more closely examine the effects of VA recall periods in order to inform best operational practices in HDSSs and mortality surveys.
Minimal recall effects were consistently seen across all cause categories, with the exception of neonatal causes. With most research focusing on recall ability in relation to specific causes such as neonatal deaths [23, 24], operational elements within HDSSs are currently scarce and seen relevant for assessing the overall conclusions on causes of death. The basis for the difference among neonatal causes is not easy to interpret, but may be associated with reluctance to disclose neonatal deaths. Neonatal deaths missed in annual update rounds may therefore be more likely to be discovered in subsequent rounds, consequently have a longer recall period, and therefore contribute to the finding that neonatal causes are associated with longer recall.
Although some categories of causes showed significantly different odds ratios when recall exceeded one year (Table 2), these differences were not seen in the multivariable model, other than for neonatal deaths. It is likely therefore that these recall effects were not independently associated with those cause categories.
Mortality associated with HIV and TB is the leading cause group in this population, and its assessment has been reported to be highly influenced by cultural, environmental as well as operational aspects in other settings [25–27]. Although AIDS-associated stigma has seen a substantial decline in recent years, fear might negatively affect VA outcomes, though our findings do not indicate any specific recall-linked effects.
Seasonal variations in the various underlying aetiologies of respiratory and diarrhoeal infections are very plausible, highlighting the importance of multivariate analysis to adjust for potential confounding in order to correctly interpret these data. To evade associated limitations, a prospectively designed study that randomised identified deaths to a range of VA recall periods could have been implemented in principle, however, this would have been complex and costly, and probably not justifiable. Such a study would certainly not have been done over a twenty year period covering over 10,000 deaths, and we believe that the pragmatic advantages of using this large and rich existing dataset outweigh the theoretical advantages of a more elegantly designed trial.
VA is becoming an increasingly widely used approach to document uncertified deaths [8, 14] and this study contributes important information about recall effects. With exception for the neonatal causes, our findings clearly show that a recall period of up to one year between death and a VA interview do not have any consequential effects on the cause of death patterns derived. This is an important operational consideration for the widespread used of the VA approach in civil registration, HDSS sites and occasional surveys.
Hill K, Lopez AD, Shibuya K, Jha P, Group MoVEw. Interim measures for meeting needs for health sector data: births, deaths, and causes of death. Lancet. 2007;370(9600):1726–35.
Mahapatra P, Shibuya K, Lopez AD, Coullare F, Notzon FC, Rao C, et al. Civil registration systems and vital statistics: successes and missed opportunities. Lancet. 2007;370(9599):1653–63.
Setel PW, Macfarlane SB, Szreter S, Mikkelsen L, Jha P, Stout S, et al. A scandal of invisibility: making everyone count by counting everyone. Lancet. 2007;370(9598):1569–77.
Tran TK, Eriksson B, Nguyen CT, Horby P, Bondjers G, Petzold M. DodaLab: an urban health and demographic surveillance site, the first three years in Hanoi, Vietnam. Scand J Public Health. 2012;40(8):765–72.
Fottrell E, Byass P. Verbal autopsy: methods in transition. Epidemiol Rev. 2010;32(1):38–55.
Godefay H, Abrha A, Kinsman J, Myleus A, Byass P. Undertaking cause-specific mortality measurement in an unregistered population: an example from Tigray Region, Ethiopia. Glob Health Action. 2014;7:25264.
Kahn K, Collinson MA, Gómez-Olivé FX, Mokoena O, Twine R, Mee P, et al. Profile: agincourt health and socio-demographic surveillance system. Int J Epidemiol. 2012;41(4):988–1001.
Baiden F, Bawah A, Biai S, Binka F, Boerma T, Byass P, et al. Setting international standards for verbal autopsy. Bull World Health Organ. 2007;85(8):570–1.
Bauni E, Ndila C, Mochamah G, Nyutu G, Matata L, Ondieki C, et al. Validating physician-certified verbal autopsy and probabilistic modeling (InterVA) approaches to verbal autopsy interpretation using hospital causes of adult deaths. Popul Health Metr. 2011;9:49.
Soleman N, Chandramohan D, Shibuya K. Verbal autopsy: current practices and challenges. Bull World Health Organ. 2006;84(3):239–45.
Byass P, D’Ambruoso L, Ouédraogo M, Qomariyah SN. Assessing the repeatability of verbal autopsy for determining cause of death: two case studies among women of reproductive age in Burkina Faso and Indonesia. Popul Health Metr. 2009;7:6.
Hussain-Alkhateeb L, Fottrell E, Petzold M, Kahn K, Byass P. Local perceptions of causes of death in rural South Africa: a comparison of perceived and verbal autopsy causes of death. Glob Health Action. 2015;8:28302.
Sankoh O, Byass P. The INDEPTH Network: filling vital gaps in global epidemiology. Int J Epidemiol. 2012;41(3):579–88.
Leitao J, Chandramohan D, Byass P, Jakob R, Bundhamcharoen K, Choprapawon C, et al. Revising the WHO verbal autopsy instrument to facilitate routine cause-of-death monitoring. Glob Health Action. 2013;6:21518.
Byass P, Chandramohan D, Clark SJ, D’Ambruoso L, Fottrell E, Graham WJ, et al. Strengthening standardised interpretation of verbal autopsy data: the new InterVA-4 tool. Glob Health Action. 2012;5:19281.
Kabudula CW, Tollman S, Mee P, Ngobeni S, Silaule B, Gómez-Olivé FX, et al. Two decades of mortality change in rural northeast South Africa. Glob Health Action. 2014;7:25596.
Streatfield PK, Khan WA, Bhuiya A, Alam N, Sié A, Soura AB, et al. Cause-specific mortality in Africa and Asia: evidence from INDEPTH health and demographic surveillance system sites. Glob Health Action. 2014;7:25362.
Kahn K, Tollman SM, Collinson MA, Clark SJ, Twine R, Clark BD, et al. Research into health, population and social transitions in rural South Africa: data and methods of the Agincourt Health and Demographic Surveillance System1. Scand J Public Health. 2007;35(69 suppl):8–20.
Fagerland MW, Lydersen S, Laake P. Recommended confidence intervals for two independent binomial proportions. Stat Methods Med Res. 2015;24(2):224–54.
Tollman SM, Kahn K, Sartorius B, Collinson MA, Clark SJ, Garenne ML. Implications of mortality transition for primary health care in rural South Africa: a population-based surveillance study. Lancet. 2008;372(9642):893–901.
Lulu K, Berhane Y. The use of simplified verbal autopsy in identifying causes of adult death in a predominantly rural population in Ethiopia. BMC Public Health. 2005;5:58.
Ronsmans C, Vanneste AM, Chakraborty J, Van Ginneken J. A comparison of three verbal autopsy methods to ascertain levels and causes of maternal deaths in Matlab, Bangladesh. Int J Epidemiol. 1998;27(4):660–6.
Freeman JV, Christian P, Khatry SK, Adhikari RK, LeClerq SC, Katz J, et al. Evaluation of neonatal verbal autopsy using physician review versus algorithm-based cause-of-death assignment in rural Nepal. Paediatr Perinat Epidemiol. 2005;19(4):323–31.
Snow RW, De Azevedo IB, Forster D, Mwankuyse S, Bomu G, Kassiga G, et al. Maternal recall of symptoms associated with childhood deaths in rural East Africa. Int J Epidemiol. 1993;22(4):677–83.
Doctor HV, Weinreb AA. Estimation of AIDS adult mortality by verbal autopsy in rural Malawi. AIDS. 2003;17(17):2509–13.
Fottrell E, Tollman S, Byass P, Golooba-Mutebi F, Kahn K. The epidemiology of ‘bewitchment’as a lay-reported cause of death in rural South Africa. J Epidemiol Community Health. 2011;66:704–9.
Sayles JN, Wong MD, Kinsler JJ, Martins D, Cunningham WE. The association of stigma with self-reported access to medical care and antiretroviral therapy adherence in persons living with HIV/AIDS. J Gen Intern Med. 2009;24(10):1101–8.
LHA: conceived of the study, study design, data analysis and, drafted the manuscript. MP: contributed to the study design, oversaw the data analysis and contributed to preparation of manuscript. MC: contributed to study design and helped to draft the manuscript. ST: contributed to study design and preparation of the manuscript. KK: contributed to study design and helped to draft the manuscript. PB: conceived of the study, study design, led data analysis and helped to draft the manuscript. All authors read and approved the final manuscript.
The Agincourt health and socio-demographic surveillance system has been supported by the The Wellcome Trust, UK (Grants 058893/Z/99/A; 069683/Z/02/Z; 085477/Z/08/Z; 085477/B/08/Z), and the University of the Witwatersrand and Medical Research Council, South Africa. Verbal autopsy strengthening under the Health and Aging Study in Africa: Longitudinal Studies of INDEPTH communities (HAALSI) was funded by NIA of the NIH (P01 AG041710).
The authors declare that they have no competing interests.
Availability of data and materials
The data that support the findings of this study are available from [Agincourt Health & Population Unit AHPU] but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Agincourt Health & Population Unit.
The study data were obtained from the Agincourt HDSS where on-going ethical clearance has been granted by the University of Witwatersrand’s Committee for Research on Human Subjects (Nos. M960720 & M110138). The principle of informed consent was fully respected with the right for refusal or withdrawal from interviews at both individual and household levels. As required by the ethical committee, community consent from civic and traditional leadership was secured at the start of surveillance in 1992 and is reaffirmed from time to time, as well as obtaining informed verbal consent at individual and household level at each annual follow-up visit. No primary data collection nor specific additional ethical clearance was required for this study.
This study was funded by the European Community Marie Curie Actions IPHTRE (#295168).