Skip to main content

Cost-effectiveness analysis of the diarrhea alleviation through zinc and oral rehydration therapy (DAZT) program in rural Gujarat India: an application of the net-benefit regression framework

Abstract

Background

This study evaluates the cost-effectiveness of the DAZT program for scaling up treatment of acute child diarrhea in Gujarat India using a net-benefit regression framework.

Methods

Costs were calculated from societal and caregivers’ perspectives and effectiveness was assessed in terms of coverage of zinc and both zinc and Oral Rehydration Salt. Regression models were tested in simple linear regression, with a specified set of covariates, and with a specified set of covariates and interaction terms using linear regression with endogenous treatment effects was used as the reference case.

Results

The DAZT program was cost-effective with over 95% certainty above $5.50 and $7.50 per appropriately treated child in the unadjusted and adjusted models respectively, with specifications including interaction terms being cost-effective with 85–97% certainty.

Discussion

Findings from this study should be combined with other evidence when considering decisions to scale up programs such as the DAZT program to promote the use of ORS and zinc to treat child diarrhea.

Background

Cost effectiveness analysis (CEA) is useful for evaluating productive efficiency in the health sector [1]. Applications of CEA in countries with strong health technology assessment programs often follow a general continuum from modeling studies to evaluations alongside clinical trials, which can inform revisions to make models more comprehensive [2]. Less attention has been paid to CEA applied to quasi-experimental study designs.

Methods have been developed which combine econometric and economic evaluation techniques by transforming incremental cost-effectiveness ratios into net-benefit statistics for use in regression analysis [3]. Net-benefit regression allows analysts to control for variables that may confound cost-effectiveness, particularly for non-identical groups, handle censored data, calculate confidence intervals parametrically, and to evaluate cost-effectiveness according to subgroups. This method contrasts with more commonly used methods for estimating CEA, which assume that costs and consequences across population groups, geographic areas, and other factors of interest are homogenous for individual study arms or phases.

The growing number of programs being implemented at scale without a contemporaneous comparison arm represents a trend in evaluation efforts from demonstration of efficacy and effectiveness to delivery of interventions integrated within existing health systems. This trend increases the relevance of cost-effectiveness analyses of before and after studies [4,5,6,7,8,9]; however, these studies are not well established in the literature. The opportunity exists to expand methods for conducting CEAs alongside programs at scale [10] to include approaches which adjust for heterogeneity across study phases and populations and provide a more unbiased measure of cost-effectiveness.

To contribute to the growing body of evidence on the cost-effectiveness of treating child diarrhea with zinc and oral rehydration salts (ORS) in low- and middle-income countries (LMICs), we conducted a cost effectiveness analysis of the diarrhea alleviation through zinc and oral rehydration Therapy (DAZT) program in Gujarat India using net-benefit regression. The objective of the DAZT program was to scale-up coverage of these interventions, and reduce the irrational prescription of more expensive antibiotics and antidiarrheal medicines. Zinc and ORS were delivered through the public and private sectors through a wide variety of channels to maximize market impact. Program evaluation took a before and after study design across 2010–2013, which allowed for the evaluation of zinc itself as an intervention, as well as evaluation of the health systems delivery strategy.

Study hypothesis and rationale

This study complimented findings from another analysis which explored the economic costs to caregivers of diarrhea management [11]. The hypothesis of the present study was that the DAZT program was cost-effective in delivering zinc and ORS to treat child diarrhea episodes relative to status quo conditions in rural Gujarat existing before the program was initiated when very few children with diarrhea were given zinc. This comparator was chosen to represent the decision about scaling up the program to other districts faced by decision makers. Data suggested that the coverage of zinc and ORS to treat diarrhea among children increased in the intervention districts [12], in addition to lowering the economic burden borne by caregivers across the span of the program [11]. Consistent with other interventions delivered at the community level [13, 14], we expected that program costs were distributed thinly enough across beneficiaries of the program to make economic costs per person good value for money when considered alongside health benefits.

Methods

Study setting

The DAZT program introduced zinc and promoted ORS in Gujarat, India for treatment of child diarrhea through both the public and private sectors, utilizing a variety of community and facility based strategies (Additional file 1: Table S1) [12, 15]. The study area consisted of six districts in northeastern Gujarat (Banas Kantha, Dohad, Panch Mahals, Patan, Sabar Kantha, and Surendranagar, population 13 million [16]) and was chosen for its low coverage of zinc, availability of non-governmental organization partners, and priorities set by the Indian Government.

Program evaluation

Evaluation of the DAZT program consisted of household surveys spanning 2 years to represent the program at maturity, comparing 4200–5080 caregivers and their 2–59 month old children between the start and finish of the study. These surveys assessed only each household’s youngest child, and the latest episode per child occurring in the last 2 weeks. Data from 613 surveys with complete data on length of diarrhea episode were sufficient to perform cost-effectiveness analysis in terms of increases in coverage.

Power calculation

The main trial was powered to detect differences in coverage of ORS across trial phases [17,18,19]. For our NBR analysis, power was computed to detect meaningful differences in between a ceiling ratio (λ), or a policy maker’s valuation of a correctly treated episode, and an Incremental Cost-Effectiveness Ratio (ICER) [20], translated to incremental net-benefit (Box1). Participants included in this analysis were restricted to those individuals for whom data on date of recovery were available to allow for consideration of disease duration and recovery during analyses. Power was calculated based on Glick et al. [21] to account for different sample sizes across study phases, and different standard deviations in costs and effects across phases. Alternative hypotheses were tested against a null hypothesis of no difference of cost-effectiveness from λ.

Values for incremental cost and its standard deviations for each study phase were taken from a cluster randomized controlled trial on zinc conducted in Haryana India [22]. Values for incremental coverage were taken from the expected level of scale up of ORS coverage from current levels in the study area. The expected correlation between incremental cost and effect was assumed to be 0.2 based on convention for sociological studies (Ahmed S, personal communication), given an absence of covariance data [21]. The standard Z score for 95% confidence was used for a two-tailed alpha (1.96), with sensitivity analyses on 99, 90, and 80% confidence. Sensitivity analyses were conducted on effectiveness, cost, ceiling ratios (varied between $0.50 and $13.50), and correlation coefficient. Given the available sample size, power calculations indicate that the study had sufficient power to detect a significant difference in incremental cost-effectiveness from λ across major parameterizations including half, twice, and no incremental costs; half, twice, and no incremental effects; correlation coefficients between effects and costs from 0 to 0.7, Z statistics for type 1 and 2 error, and maximum valuations for the treatment of an episode of diarrhea.

Costs and effects

Economic costs were assessed from the societal perspective, consisting of those to the caregiver and program costs borne by the non-governmental organizations (NGOs) and the government. Program costs were calculated according to Saving Newborn Lives (SNL) costing guidelines for capital and recurrent costs [24], with data drawn from program records. Costs to caregivers were assessed according to caregiver report through the household surveys, and included direct medical costs, direct non-medical costs (transportation), and indirect costs (wages lost) [25]. Cost-effectiveness according to a caregiver’s perspective was assessed in sensitivity analysis.

Program costs were combined for public sector and private sector activities across starting point, midpoint, and endpoint surveys; and were divided evenly across the caregivers interviewed at the endpoint survey (Table 1). Allocation of program costs across caregivers was scaled to the population of children in the study area (n = 1,188,634), length of the recall period of the survey (cost/child/2 week period). Costs to caregivers were derived from an accompanying study, and declined from $4.04 to $2.49 per child with diarrhea during the program [11]. Program costs components included capital costs (start-up and sustainability, furniture and equipment, and training), and recurrent costs (personnel, vehicles, buildings, zinc and supplies). Annualized capital costs were considered for the number of years that they were in use—2 years for starting point and midpoint costs, and 1 year for endpoint costs. Recurrent costs were considered for starting point, midpoint, and endpoint phases. Salary costs for service providers were derived per year from the provider assessment survey (Table 2 shows these in more detail).

Table 1 Program and provider costs associated with the DAZT program by year
Table 2 Public sector personnel costs attributed to the DAZT program by year

Capital components were annualized using factors from the WHO-CHOICE study discounted at 3% as the rate for a risk-free investment [26] and recommendations for economic evaluation in LMICs [27]. In the absence of other data, items were assumed to last the duration of the program. Currency was inflated to 2014 base year United States dollars using consumer price indices from the International Monetary Fund (IMF), and converted using mid-year exchange rates from [28].

In the absence of data on mortality and long-term sequelae from diarrhea, outcomes were assessed in terms of episodes correctly treated with zinc and ORS. Episodes were assessed according to caregiver report of those beginning or resolving within the 2 weeks prior to survey.

Cost-effectiveness according to net-benefit regression

All children included in the baseline and endline surveys of the study were included. For each child, the net-benefit statistic was calculated by multiplying the variable representing whether a child with diarrhea was treated with zinc (Ei) by the monetary valuation of an increase in coverage by one individual with diarrhea (λ), then subtracting the economic costs associated with that individual (Ci).

$$ E\left( {y = NMB_{i} } \right) = \lambda \times E_{i} - C_{i} $$
(1)

The net-benefit statistic was used as the dependent variable in a series of simple and multivariable linear regressions. In these formulations, the coefficient on the treatment variable (δ) represented incremental net-benefit of the program relative to the initial survey. Simple linear regression on δ alone, representing study phase, was conducted to show that the incremental net-benefit is the same when calculated in this approach as when calculated in the standard deterministic approach.

$$ E\left( {y = NMB_{i} } \right) = \alpha + \delta t_{i} + \varepsilon_{i} $$
(2)

Multiple linear regression was then conducted to evaluate net-benefit when controlling for covariates (xij).

$$ E\left( {y = NMB_{i} } \right) = \alpha + \sum\limits_{j = 1}^{p} {\beta_{j} x_{ij} \,+\, } \delta t_{i} + \varepsilon_{i} $$
(3)

Finally, incremental net-benefit for subgroups was calculated by interacting each parameter with the treatment variable (γ).

$$ E\left( {y = NMB_{i} } \right) = \alpha + \sum\limits_{j = 1}^{p} {\beta_{j} x_{ij} \,+\, } \delta t_{i} + t_{i} \sum\limits_{j = 1}^{p} {\gamma_{j} x_{ij} \,+\, } \varepsilon_{i} $$
(4)

Different values of λ were tested in sensitivity analysis, including the extreme case of 0 to test negative costs as the response variable. An effects-only regression to represent the scenario where λ equals infinity was not conducted as the outcome is binary and logistic regression coefficients would not be comparable to other model specifications.

Cost-effectiveness acceptability curves

Cost effectiveness acceptability curves (CEACs) were constructed to depict the probability that the DAZT intervention was cost-effective according to different levels of λ according to established methods [3].

Regression modeling

Models were tested according to assumptions of linear regression to inform the appropriate econometric approach. Despite skewness apparent in the residual in quantile–quantile plots, ordinary least squares (OLS) estimation was deemed appropriate given that it produces unbiased estimates due to asymptotic normality. Breusch Pagan/Cook Weisberg tests indicated that the residuals did not have constant variance at different points along the regression line, and visual inspection of residual versus fitted plots confirmed heteroskedasticity. Therefore robust standard errors were used to ensure accurate measurement of p-values. Variance inflation factors indicated that there was no collinearity between covariates.

The importance of highly influential points, meaning those with the greatest potential for altering the slope of the regression line, was checked by calculating DFBETAs for adjusted models with interaction terms. Individuals with the top 10 DFBETA scores were excluded in sensitivity analysis, as using the 2/√n threshold excluded well over 10% of the data. Comparison of AIC/BIC scores indicated that omitting these points slightly improved model fit, although no difference was seen in the significance of the coefficient on the treatment variable. Since these extreme cases were considered important to the analysis to make results comparable to the CEA according to bootstrapping, reference case calculations were performed on the full dataset of children with diarrhea and known date of recovery.

Covariates for the model were chosen according to those collected in the study that were relevant for an adapted form of the Andersen and Newman conceptual framework for treatment seeking [29], with hypotheses about the direction of each variable shown in Additional file 2: Table S2. Three main models were specified; (1) using a linear regression with endogenous treatment effects approach based on a conceptual framework (Fig. 1—developed from [10], with hypotheses tied to the literature in Additional file 2: Table S2), (2), using the full set of covariates, and (3) using the set of covariates used in a related study [30]. The approach using linear regression with endogenous treatment effects was used as the reference case, which used probit regression in the reduced form equation and linear regression in the structural equation. Rationale for this choice was that treatment seeking from private providers was expected to be endogenous with a bidirectional relationship with costs, and statistical evidence using a Heckman test confirmed this expectation at λ = $0 [31]. Having blood in the stool was chosen as the instrumental variable since it was correlated with seeking care from a private provider, and was not expected to be correlated with the error term of the structural equation. Sensitivity analyses were performed testing education as a continuous variable, and collapsing treatment seeking into a single dichotomous variable. Specification using automatic selection procedures was ruled out since extensive arguments exist against both ‘significance testing approaches’ [32,33,34,35] and ‘change in estimate approaches’ [33, 36, 37]. In addition, automatic selection approaches including bivariable regressions and stepwise backwards selection revealed different sets of explanatory variables for the model at different levels of λ making this approach meaningless in the absence of a consensus value for λ.

Fig. 1
figure 1

Conceptual framework

To construct a wealth index for assessing the effect of assets on net-benefit, principal components analysis was performed according to standard methods [38, 39], using the component with the highest eigenvalue to construct a scale for classifying caregivers into quintiles. Descriptive statistics and regression analyses were calculated in Stata 13, with program costing and acceptability curves calculated in Microsoft Excel.

Results

Descriptive statistics and program costs

Survey participants were 18 and 21 months old at the starting point and endpoint surveys respectively, and had diarrhea for a mean of 3 days at the time of interview. Initially, less than 1% of children received appropriate diarrhea treatment, and only 22% of their caregivers had more than primary education. Among the 39% of caregivers that sought care outside of the home, 78% went to private providers (Table 3).

Table 3 Descriptive statistics of the sample of children under 5 with diarrhea from six districts of Gujarat: continuous variables

Program costs totaled $3.56 per child in recurrent costs, and $0.26 per child in annualized capital costs. Capital costs were higher in the public sector, which was responsible for block, district, and state level training workshops to launch the program, and for the initial seed supply of ORS and zinc. The largest component of costs to the private sector were for subcontracts to other NGOs and a pharmaceutical company for training pharmaceutical representatives in zinc use and the short messaging service (SMS) system to monitor sales, and managing of ‘DAZT corners’.

Sample statistics for costs and health outcomes are presented in Table 4. Cost per average person in the sample decreased by $0.12, and diarrhea episodes correctly treated with zinc and ORS increased by 17% leading to a tradeoff between higher costs and greater effectiveness.

Table 4 Sample statistics from deterministic economic evaluation

Regression outputs

The program was cost-effective above λ > $5.50 with 95% certainty for all simple linear specifications tested (Fig. 2; Table 5). Adjusting the model for the set of covariates retained in the linear regression with endogenous treatment effects approach revealed a threshold of $7.50 per correctly treated episode above which the program was cost-effective with 95% certainty (Fig. 3; Table 6), and $10 for the specification with the full set of covariates (Additional file 3: Table S3). When interaction terms were added to the model using the linear regression with endogenous treatment effects approach, the program was cost-effective with above 85% certainty across levels of λ (Fig. 4; Table 7). These results were robust to sensitivity analysis using the caregiver’s perspective (Additional file 3: Table S3). Since seeking treatment from a private provider was endogenous, the linear regression with endogenous treatment effects model with interaction terms should be considered the reference case and least prone to bias. These results were variable in other approaches to choosing and defining independent variables, although many of the acceptability curves were meaningless. Including education as a continuous variable and categorizing treatment seeking as a single dichotomous variable had little effect on results (Additional file 4: Figure S1, Additional file 5: Table S4, Additional file 6: Figure S2, Additional file 7: Figure S3, Additional file 8: Figure S4, Additional file 9: Figure S5, Additional file 10: Figure S6).

Fig. 2
figure 2

Unadjusted cost-effectiveness acceptability curves

Table 5 Unadjusted net benefit of the DAZT program relative to (baseline) conditions before the program using ORS and zinc coverage as the effectiveness measure
Fig. 3
figure 3

Adjusted cost-effectiveness acceptability curves using a linear regression with endogenous treatment effects approach to defining covariates

Table 6 Adjusted net benefit of the DAZT program relative to (baseline) conditions existing before the program using a linear regression with endogenous treatment effects approach to defining covariates and ORS and zinc coverage as the effectiveness measure
Fig. 4
figure 4

Adjusted cost-effectiveness acceptability curves with interaction terms using a linear regression with endogenous treatment effects approach to defining covariates

Table 7 Net benefit of the DAZT program relative to (baseline) conditions existing before the program

Discussion

Net-benefit regression provides a useful framework for evaluating the cost-effectiveness of the DAZT program while adjusting for confounding variables (Additional file 11: Table S5). Reference case results indicate that the program was cost-effective with 85% certainty relative to conditions at the initial survey across levels of λ. Claxton has argued that 51% certainty about cost-effectiveness is sufficient to maximize net-benefit to society [40], although decision makers may be risk averse about making an incorrect decision, in which case a threshold closer to 95% would be more appropriate. Expected Value of Perfect Information (EVPI) analysis could be used to evaluate the level of uncertainty that should be acceptable to decision makers.

Subgroup effects were observed, but should not be emphasized as hypotheses about subgroups were not specified before this analysis [41], and data dredging is never recommended [42]. In addition, zinc is inexpensive, microbes do not develop resistance to zinc [43], and there are often costs associated with rationing medicine [44]; reducing the risks of, and supporting the case for widespread use. It is unlikely that policy will be made to allocate zinc according to sociodemographic variables [45], and treating sociodemographic groups differently can lead to problems with human rights and discrimination [42]. For these reasons, we did not emphasize results from sub-group analysis, despite this being a methodological functionality of net-benefit regression.

Currently, there is a lack of cost-effectiveness analyses evaluating interventions on PubMed in the Indian context indicating key gaps in the evidence base. Therefore results from this study are likely to be considered in an ad-hoc fashion by program managers and policy makers instead of being used in a more structured sector-wide decision making process [47]. In addition, this analysis is limited to cost-effectiveness, not cost-utility analysis, making it more useful to the diarrhea community than more general decision makers in the health sector. As the evidence base of economic evaluation strengthens in India, results may be useful for its newly formed health technology assessment organization [48], pharmaceutical pricing negotiations, regulation of insurance, providing bargaining power to public health centers and procurement agencies, promotion of India’s generic drug industry, and education and research purposes among other things [49]. A database of pharmacoeconomic studies has been proposed for India, in which this study could be included [49].

The proliferation of large scale public health programs in the developing world evaluated without control groups provides increasing opportunities to conduct net-benefit regression when undertaking economic evaluation. In addition, this methodology is useful for randomized trials that fail to produce a balanced allocation of covariates. However, the application of net-benefit regression in a LMIC context is relatively new, particularly with regard to maternal, newborn and child health programs. Hounton and colleagues have conducted two studies [50, 51] to evaluate public health interventions in a LMIC context, including programs for skilled attendance at childbirth and community based insurance in Burkina Faso.

Consistent with WHO recommendations [52], zinc has been found to be cost-effective for treatment of non-severe child diarrhea based on modeled evidence from Tanzania [53], and an evaluation of a social franchise platform from Myanmar [54]. Findings from hospital based efficacy trials have demonstrated mixed results; indicating a trend towards costs savings and cost-effectiveness while failing to achieve statistical significance [56, 57] and in a further trial not achieving cost-effectiveness [55]. However, these studies have been small in scale and in two instances zinc was provided with copper [55, 56]. Our study contributes to the evidence base about the use of zinc in real world sector-wide conditions, suggesting that may be cost-effective for scaling up coverage depending on how much decision makers value scaling up coverage of zinc and ORS by one appropriately treated patient. These findings are consistent with previous evidence in favor of the cost-effectiveness of close to client treatment of child diarrhea with zinc and ORS in a community setting [53, 54]. However, scaling up requires a variety of supply and demand side factors for effectiveness to be achieved in other areas such as manufacturing capacity, supply chains, absorptive capacity, and measures to stimulate care seeking and reduce demand for antibiotics [58,59,60]. Decisions will also be affected by contextual factors beyond diarrhea considerations.

Evidence on the cost-effectiveness of zinc for child diarrhea is particularly relevant in the Indian context where the government has set policy for a national program to provide zinc to all affected children over 3 months old [61], and diarrhea was the third leading killer of children under 5 years old nationwide in 2010 [62]. With diarrhea falling from the second to fourth largest killer of children worldwide in 2 years [63, 64], this study adds to needed evidence to expedite progress in addressing this solvable problem.

Limitations

As data were not collected describing the date that diarrhea resolved past the administration of the survey, and imputation was not done to estimate these values, the analysis was conducted on only 53% of diarrhea episodes in the sample. It was not possible to determine whether the 47% of episodes for which complete duration was not assessed were acute or persistent, although only one case in the subset evaluated in complete case analysis could be classified as persistent. However, adequate power existed to detect a meaningful difference in cost-effectiveness in complete case analysis, and limiting the analysis to the acute cases clearly defined by the survey was deemed appropriate as it is consistent with other analyses of this program [65].

The evidence base on which we designed the conceptual framework was limited as net-benefit regression has not been done previously on this research question. As a result, rationale for each variable included was based on literature evaluating treatment seeking or cost of treatments. In addition, rationale for hypotheses for each variable was developed after the specifications for the dissertation draft of this model were estimated. Other variables that have been found to be associated with these outcomes but that were not measured in our survey included breastfeeding [66], perceived severity of the diarrhea episode [67, 68], distance to health provider [69, 70], birth order [70, 71], antenatal care of the mother from trained providers [71], expected cost according to perceived diarrhea status [66], timing of careseeking [66], and frequency of episodes [66]. Further research may be conducted to determine the association of these covariates with net-benefit and their influence on incremental results. Specifications were not defined fully in advance of estimating models. While preliminary results did not affect hypotheses we formulated based on literature, the fact that we did not prespecify them or anticipate some of the challenges to specification is not ideal when estimating econometric models, recognizing that both statistical theory and improving model fit are considered in applied econometrics [72]. After analysis on our study was completed, new guidelines were released, which advocate the use of a societal perspective and health systems perspective as the reference case [73] and could be estimated from our data. During this project, methods were identified that could be used to extrapolate deaths averted from coverage levels to which our results could be compared [10]. Other endogeneity tests exist, and further work should be done on a similar dataset that was collected in Uttar Pradesh during the course of this program.

This study’s uncontrolled before and after study design limits measurement of impact. Imbalances between before and after phases were controlled for through the regression approach; however, no mathematical adjustment can control for unobserved characteristics in uncontrolled study designs. In the case of this study, secular trends may have influenced results such as patterns of zinc availability that would have occurred in the absence of the program due to the national recommendation. To some extent these effects may have been countered by secular trends in costs, which may have been expected to increase given current trends of economic development in Gujarat. Therefore, we did not present analyses using episodes averted as the effectiveness measure, despite having sufficient power to do so. Authors can provide results showing that the program was cost-effective using this denominator on request. To protect against contamination to the extent possible, the program was monitored for the influence of similar program activities in DAZT areas. However, the Hawthorne effect may have magnified effects relative to the impact of the program without evaluation activities taking place. To some extent these effects may have been countered by secular trends in costs, which may have been expected to increase given current trends of economic development in Gujarat. Given that the Government of India approved zinc for use in pediatric diarrhea in 2006, evidence from cluster randomized trials suggested both effectiveness and cost-effectiveness [22, 46], and the objective of this study was to evaluate zinc when delivered at scale, our study design was appropriate for these conditions.

The fact that this analysis evaluates cost-effectiveness analysis defined in natural units limits capacity to compare results to cost-utility analyses of other interventions. However, outcomes measured in terms of natural units are often used in net-benefit regression [3, 50, 51], and outputs of this analysis are important in other ways. The finding that controlling for confounders and sets of those included had an effect on cost-effectiveness, with different model specifications producing heterogeneous results, challenges the robustness of conclusions from calculations performed according to non-stratified non-regression based methods.

Conclusions

This study evaluated the cost-effectiveness of the DAZT program to treat child diarrhea in Gujarat India. The main finding from this study was that the program was cost-effective with 95% certainty above $5.50 and $7.50 per appropriately treated child in the unadjusted and adjusted models respectively, with specifications including interaction terms being cost-effective with 85–97% certainty. Further work is needed to evaluate if programs such as DAZT are cost-effective at scale in improving population health, which provide cost-utility estimates for comparison to other interventions.

Abbreviations

AIC:

Akaike’s information criterion

ASHA:

accredited social health activist

AWW:

Anganwadi worker

BIC:

Bayesian information criterion

CEA:

cost-effectiveness analysis

CEAC:

cost-effectiveness acceptability curves

DAZT:

diarrhea alleviation through zinc and ORS therapy program

ICER:

incremental cost-effectiveness ratio

IMF:

International Monetary Fund

LMIC:

low and middle income country

NGO:

non-Governmental Organization

OLS:

ordinary least squares

ORS:

oral rehydration salts

SMS:

short messaging service

SNL:

saving newborn lives

UNICEF:

United Nations Children’s Fund

WHO:

World Health Organization

WHO-CHOICE:

World Health Organization CHOosing Interventions that are Cost-Effective

References

  1. Palmer S, Torgerson DJ. Economics notes: definitions of efficiency. Br Med J. 1999;318(7191):1136.

    Article  CAS  Google Scholar 

  2. Sculpher M, et al. Whither trial-based economic evaluation for health care decision making? Health Econ. 2006;15:677–87.

    Article  PubMed  Google Scholar 

  3. Hoch JS, Briggs AH, Willan AR. Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. Health Econ. 2002;11:415–30.

    Article  PubMed  Google Scholar 

  4. Tan-Torres Edejer T, et al. Cost effectiveness analysis of strategies for child health in developing countries. BMJ. 2005;331(7526):1177.

    Article  Google Scholar 

  5. Franco R, et al. Cost-effectiveness analysis of a state funded programme for control of severe asthma. BMC Public Health. 2007;7(1):82.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Manasyan A, et al. Cost-effectiveness of essential newborn care training in urban first-level facilities. Pediatrics. 2011;127(5):e1176–81.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Jones AE, Troyer JL, Kline JA. Cost-effectiveness of an emergency department based early sepsis resuscitation protocol. Crit Care Med. 2011;39(6):1306.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Hedden L, et al. Incremental cost-effectiveness of the pre-and post-bevacizumab eras of metastatic colorectal cancer therapy in British Columbia, Canada. Eur J Cancer. 2012;48(13):1969–76.

    Article  PubMed  Google Scholar 

  9. Borghi J, et al. Protocol for the evaluation of a pay for performance programme in Pwani region in Tanzania: a controlled before and after study. Implement Sci. 2013;8(1):1–12.

    Article  Google Scholar 

  10. Shillcutt SD, et al. Protocol for the economic evaluation of the diarrhea alleviation through zinc and oral rehydration salt therapy at scale through private and public providers in rural Gujarat and Uttar Pradesh, India. Implement Sci. 2015;19:164.

    Google Scholar 

  11. Shillcutt SD, et al. Economic costs to caregivers of diarrhea treatment among children under 5 in rural Gujarat India: findings from an uncontrolled before and after evaluation of the diarrhea alleviation through zinc and oral rehydration salts treatment program at scale. Health Policy Plan. 2016;31(10):1411–22.

    Article  PubMed  Google Scholar 

  12. Lamberti LM, et al. An external effectiveness evaluation of the diarrhea alleviation through Zinc and ORS treatment program in Gujarat and Uttar Pradesh, India. J Glob Health. 2015;5(2):020409.

    Article  PubMed  PubMed Central  Google Scholar 

  13. LeFevre AE, et al. Economic evaluation of a community-based newborn care intervention implemented through two service delivery strategies in Sylhet district, Bangladesh: a cluster randomized controlled trial. Bull WHO. 2013;91:736–45.

    PubMed  PubMed Central  Google Scholar 

  14. Lewycka S, et al. Effect of women’s groups and volunteer peer counselling on rates of mortality, morbidity, and health behaviours in mothers and children in rural Malawi (MaiMwana): a factorial, cluster-randomised controlled trial. Lancet. 2013;381(9879):1721–35.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Walker CLF, et al. Appropriate management of acute diarrhea in children among public and private providers in Gujarat, India: a cross-sectional survey. Glob Health Sci Pract. 2015;3:230–41.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Government of India, Census of India 2011. 2011, Ministry of Home Affairs, Office of the Registrar General and Census Commissioner: Yojana.

  17. DAZT. Baseline cross sectional survey-Internal report. Baltimore: Johns Hopkins University; 2011.

  18. DAZT. Enhancing the uptake of ORS and zinc in targeted areas of India, Midline cross sectional survey internal report. Baltimore: Johns Hopkins University; 2012.

  19. DAZT, Endline community household survey-Gujarat study protocol. Baltimore: Johns Hopkins University; 2013.

  20. Shillcutt SD, et al. Cost-effectiveness in low- and middle-income countries: a review of debates surrounding decision rules. Pharmacoeconomics. 2009;27(11):903–17.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Glick HA. Sample size and power for cost-effectiveness analysis (Part 1). Pharmacoeconomics. 2011;29(3):189–98.

    Article  PubMed  Google Scholar 

  22. Bhandari N, Mazumder S, Taneja S, Dube B, Agarwal RC, Mahalanabis D, Fontaine O, Black RE, Bhan MK. Effectiveness of zinc supplementation plus oral rehydration salts compared with oral rehydration salts alone as a treatment for acute diarrhea in a primary care setting: a cluster randomized trial. Pediatrics. 2008;121(5):e1279–85.

    Article  PubMed  Google Scholar 

  23. Glick HA. Sample size and power for cost-effectiveness analysis (Part 2): the effect of maximum willingness to pay. Pharmacoeconomics. 2011;29(4):287–96.

    PubMed  Google Scholar 

  24. SNL. Saving newborn lives initiative: project costing guidelines. Washington DC: Save the Children; 2004.

  25. Drummond MF, et al. Methods for the economic evaluation of health care programs. 3rd ed. Oxford: Oxford University Press; 2005.

    Google Scholar 

  26. Gold MR, et al. Cost effectiveness in health and medicine. New York: Oxford University Press; 1996.

    Google Scholar 

  27. Edejer TT, et al., eds. WHO guide to cost-effectiveness analysis. Geneva: World Health Organisation; 2003.

  28. Kumaranayake L. The real and the nominal? Making inflationary adjustments to cost and other economic data. Health Policy Plan. 2000;15(2):230–4.

    Article  CAS  PubMed  Google Scholar 

  29. Andersen R, Newman JF. Societal and individual determinants of medical care utilization in the United States. The Milbank Memorial Fund Quarterly. Health and Society, 1973: p. 95–124.

  30. Rheingans R, et al. Determinants of household costs associated with childhood diarrhea in 3 South Asian settings. Clin Infect Dis. 2012;55(suppl 4):S327–35.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Nagler J. Notes on simultaneous equations and two stage least squares estimates. 1999.

  32. Dales LG, Ury HK. An improper use of statistical significance testing in studying covariables. Int J Epidemiol. 1978;7(4):373–6.

    Article  CAS  PubMed  Google Scholar 

  33. Greenland S, Neutra R. Control of confounding in the assessment of medical technology. Int J Epidemiol. 1980;9(4):361–7.

    Article  CAS  PubMed  Google Scholar 

  34. Greenland S. Modeling and variable selection in epidemiologic analysis. Am J Public Health. 1989;79(3):340–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Rothman KJ. Epidemiologic methods in clinical trials. Cancer. 1977;39(S4):1771–5.

    Article  CAS  PubMed  Google Scholar 

  36. Miettinen O. Confounding and effect-modification. Am J Epidemiol. 1974;100(5):350–3.

    Article  CAS  PubMed  Google Scholar 

  37. Maldonado G, Greenland S. Simulation study of confounder-selection strategies. Am J Epidemiol. 1993;138(11):923–36.

    Article  CAS  PubMed  Google Scholar 

  38. Filmer D, Pritchett LH. Estimating wealth effects without expenditure data-or tears: an application to educational enrolments in states of India. Demography. 2001;38:115–32.

    CAS  PubMed  Google Scholar 

  39. Vyas S, Kumaranayake L. Constructing socio-economic status indices: how to use principal components analysis. Health Policy Plan. 2006;21(6):459–68.

    Article  PubMed  Google Scholar 

  40. Claxton K. The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. J Health Econ. 1999;18(3):341–64.

    Article  CAS  PubMed  Google Scholar 

  41. Oxman AD, Guyatt GH. A consumer’s guide to subgroup analyses. Ann Intern Med. 1992;116(1):78–84.

    Article  CAS  PubMed  Google Scholar 

  42. Ramaekers BL, Joore MA, Grutters JP. How should we deal with patient heterogeneity in economic evaluation: a systematic review of national pharmacoeconomic guidelines. Value Health. 2013;16(5):855–62.

    Article  PubMed  Google Scholar 

  43. Sabot O, et al. Scaling up oral rehydration salts and zinc for the treatment of diarrhoea. BMJ. 2012;344:e940.

    Article  PubMed  Google Scholar 

  44. Jha P, Laxminarayan R. Choosing health: An entitlement for all Indians. Center for Global Health Research; 2009.

  45. Grutters JP, et al. Acknowledging patient heterogeneity in economic evaluation. Pharmacoeconomics. 2013;31(2):111–23.

    Article  PubMed  Google Scholar 

  46. Mazumder S, et al. Effectiveness of zinc supplementation plus oral rehydration salts for diarrhoea in infants aged less than 6 months in Haryana state, India. Bull World Health Organ. 2010;88(10):754–60.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Baltussen R, Niessen L. Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Eff Resour Alloc. 2006;4(1):14.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Hass B, et al. Health technology assessment and its role in the future development of the Indian healthcare sector. Perspect Clin Res. 2012;3(2):66.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Gupta SK, et al. Proposed pharmacoeconomics guidelines for India (PEG-I). New Delhi: International Society of Pharmacoeconomics and Outcomes Research India Chapter; 2013.

    Google Scholar 

  50. Hounton S, Newlands D. Applying the net-benefit framework for assessing cost-effectiveness of interventions towards universal health coverage. Cost Eff Resour Alloc. 2012;10(1):8.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Hounton S, Newlands D. Applying the net-benefit framework for analyzing and presenting cost-effectiveness analysis of a maternal and newborn health intervention. PLoS ONE. 2012;7(7):e40995.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. WHO. The treatment of diarrhoea: a manual for physicians and other senior health workers. Geneva: World Health Organization; 2005. p. 1–50.

  53. Robberstad B, et al. Cost-effectiveness of zinc as adjunct therapy for acute childhood diarrhoea in developing countries. Bull WHO. 2004;82(7):523–31.

    PubMed  PubMed Central  Google Scholar 

  54. Bishai D, et al. Cost-effectiveness of using a social franchise network to increase uptake of oral rehydration salts and zinc for childhood diarrhea in rural Myanmar. Cost Eff Res Alloc. 2015;13(1):3.

    Article  Google Scholar 

  55. Patel AB, Badhoniya N, Dibley MJ. Zinc and copper supplementation are not cost-effective interventions in the treatment of acute diarrhea. J Clin Epidemiol. 2013;66(1):52–61.

    Article  PubMed  Google Scholar 

  56. Patel AB, Dhande LA, Rawat MS. Economic evaluation of zinc and copper use in treating acute diarrhea in children: a randomized control trial. Cost Eff Res Alloc. 2003;1(1):7.

    Article  Google Scholar 

  57. Gregorio GV, et al. Zinc supplementation reduced cost and duration of acute diarrhea in children. J Clin Epidemiol. 2007;60(6):560–6.

    Article  PubMed  Google Scholar 

  58. Gitanjali B, Weerasuriya K. The curious case of zinc for diarrhea: unavailable, unprescribed, and unused. J Pharmacol Pharmacother. 2011;2(4):225–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Government of India. Zinc dispersible tablets for management of diarrhoea in infants and children. 2008. http://www.pib.nic.in/newsite/erelease.aspx?relid=37161. Accessed 15 June 2014.

  60. USAID, Enhancing zinc use for diarrhoea management in India. Washington DC: United States Agency for International Development; 2011.

  61. Government of India, Policy on use of zinc in the national programme for management for diarrhoea. New Delhi; 2006.

  62. Million Death Study Collaborators. Causes of neonatal and child mortality in India: nationally representative mortality survey. Lancet. 2010;376(9755):1853.

    Article  Google Scholar 

  63. UN, Levels & trends in child mortality: report 2011, estimates developed by the UN inter-agency group for child mortality estimation. Geneva: United Nations; 2011.

  64. UN, Levels & trends in child mortality: report 2013, estimates developed by the UN inter-agency group for child mortality estimation. Geneva: United Nations; 2013.

  65. Fischer-Walker CL, et al. Appropriate Management of Acute Diarrhea in Children Among Public and Private Providers in Gujarat, India: A Cross-Sectional Survey. Glob Health Sci Pract. 2015;3(2):230–41.

    Article  Google Scholar 

  66. Gao W, et al. Care-seeking pattern for diarrhea among children under 36 months old in rural Western China. PLoS ONE. 2012;7(8):e43103.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  67. Sreeramareddy CT, et al. Care seeking behaviour for childhood illness-a questionnaire survey in western Nepal. BMC Int Health Human Rights. 2006;6(1):7.

    Article  Google Scholar 

  68. Taffa N, Chepngeno G. Determinants of health care seeking for childhood illnesses in Nairobi slums. Trop Med Int Health. 2005;10(3):240–5.

    Article  PubMed  Google Scholar 

  69. Sreeramareddy CT, Sathyanarayana T, Kumar HH. Utilization of health care services for childhood morbidity and associated factors in India: a national cross-sectional household survey. PLoS ONE. 2012;7(12):e51904.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  70. Malhotra N, Choy N. Disparities in the treatment of childhood diarrhoea in India. 2010. http://works.bepress.com/nisha_malhotra1/1.

  71. Ahmed S, Sobhan F, Islam A. Neonatal morbidity and care-seeking behaviour in rural Bangladesh. J Trop Pediatrics. 2001;47(2):98–105.

    Article  CAS  Google Scholar 

  72. Wooldridge JM. Introductory econometrics: a modern approach. 4th ed. Mason: South-Western Cenage Learning; 2009.

    Google Scholar 

  73. Sanders GD, et al. Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA. 2016;316(10):1093–103.

    Article  PubMed  Google Scholar 

Download references

Authors’ contributions

CFW is the Principal Investigator of the DAZT Evaluation. AL and SM are leading economic evaluation activities. CFW and ST led efforts to determine DAZT impact including household and provider surveys. AL and SS conceived the idea for this paper. AL, SM, CFW, and ST designed the data collection instruments. SM and ST oversaw training, data collection, entry and management. SS conducted the analyses and wrote the first draft of this manuscript with editing and proof reading from all other authors. All authors read and approved the final manuscript.

Acknowledgements

The DAZT Program was a partnership between the Micronutrients Initiative, Family Health International-360, UNICEF, the US Fund for UNICEF, and Johns Hopkins Bloomberg School of Public Health that was made possible only through the generous support of the Bill and Melinda Gates Foundation (BMGF). The BMGF had no role in the data collection or analysis of this study. Alan Sorkin provided stewardship from the conception of the idea through the analysis, and the Johns Hopkins Biostatistics Center provided technical support.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

All data used in this analysis are available upon request from the corresponding author.

Consent for publication

All authors read and approved the final manuscript for publication.

Ethical approval

The Johns Hopkins School of Public Health Internal Review (IRB) Board determined that the proposed activity described in our request form involved secondary data analysis of an existing, deidentified, de-linked, not publicly available dataset from the SAS office in Delhi, and neither the primary researcher nor his project adviser, were involved in the original data collection. Thus, the proposed activity did not qualify as human subjects research as defined by Department of Health and Human Services regulations 45 CFR 46.102, and did not require IRB oversight.

Funding

This work was supported by the Bill and Melinda Gates Foundation. The sponsor of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report. The corresponding author had full access to all of the data in the study and had final responsibility for the decision to submit for publication.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amnesty E. LeFevre.

Additional files

Additional file 1: Table S1. DAZT intervention components according to activity in Gujarat.

Additional file 2: Table S2. Hypotheses about variables.

12962_2017_70_MOESM3_ESM.docx

Additional file 3: Table S3. Adjusted net benefit of the DAZT program relative to (baseline) conditions existing before the program using the full set of covariates and ORS and zinc coverage as the effectiveness measure 1.

Additional file 4: Figure S1. Adjusted cost-effectiveness acceptability curves using the full set of covariates.

12962_2017_70_MOESM5_ESM.docx

Additional file 5: Table S4. Net benefit of the DAZT program relative to (baseline) conditions existing before the program—multivariable regression with interaction terms with full set of covariates and with ORS and zinc coverage as the effectiveness measure.

12962_2017_70_MOESM6_ESM.docx

Additional file 6: Figure S2. Adjusted cost-effectiveness acceptability curves with interaction terms using the full set of covariates.

12962_2017_70_MOESM7_ESM.docx

Additional file 7: Figure S3. Adjusted cost-effectiveness acceptability curves with interaction terms using an instrumental variable approach to defining covariates from a caregiver’s perspective.

12962_2017_70_MOESM8_ESM.docx

Additional file 8: Figure S4. Adjusted cost-effectiveness acceptability curves with interaction terms using the full set of covariates from the caregiver’s perspective.

12962_2017_70_MOESM9_ESM.docx

Additional file 9: Figure S5. Cost-effectiveness acceptability curves: Rheingans selection of variables [30].

12962_2017_70_MOESM10_ESM.docx

Additional file 10: Figure S6. Cost-effectiveness acceptability curves: Rheingans selection of variables adjusted with interaction terms.

12962_2017_70_MOESM11_ESM.docx

Additional file 11: Table S5. Net benefit of the DAZT program relative to status quo—multivariable regression with interaction terms with Rheingans et al. [30] set of interaction terms: ORS and zinc coverage as effectiveness measure.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shillcutt, S.D., LeFevre, A.E., Fischer-Walker, C.L. et al. Cost-effectiveness analysis of the diarrhea alleviation through zinc and oral rehydration therapy (DAZT) program in rural Gujarat India: an application of the net-benefit regression framework. Cost Eff Resour Alloc 15, 9 (2017). https://doi.org/10.1186/s12962-017-0070-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12962-017-0070-y

Keywords