- Open Access
Balancing efficiency, equity and feasibility of HIV treatment in South Africa – development of programmatic guidance
Cost Effectiveness and Resource Allocationvolume 11, Article number: 26 (2013)
South Africa, the country with the largest HIV epidemic worldwide, has been scaling up treatment since 2003 and is rapidly expanding its eligibility criteria. The HIV treatment programme has achieved significant results, and had 1.8 million people on treatment per 2011. Despite these achievements, it is now facing major concerns regarding (i) efficiency: alternative treatment policies may save more lives for the same budget; (ii) equity: there are large inequalities in who receives treatment; (iii) feasibility: still only 52% of the eligible population receives treatment.
Hence, decisions on the design of the present HIV treatment programme in South Africa can be considered suboptimal. We argue there are two fundamental reasons to this. First, while there is a rapidly growing evidence-base to guide priority setting decisions on HIV treatment, its included studies typically consider only one criterion at a time and thus fail to capture the broad range of values that stakeholders have. Second, priority setting on HIV treatment is a highly political process but it seems no adequate participatory processes are in place to incorporate stakeholders’ views and evidences of all sorts.
We propose an alternative approach that provides a better evidence base and outlines a fair policy process to improve priority setting in HIV treatment. The approach integrates two increasingly important frameworks on health care priority setting: accountability for reasonableness (A4R) to foster procedural fairness, and multi-criteria decision analysis (MCDA) to construct an evidence-base on the feasibility, efficiency, and equity of programme options including trade-offs. The approach provides programmatic guidance on the choice of treatment strategies at various decisions levels based on a sound conceptual framework, and holds large potential to improve HIV priority setting in South Africa.
With 5.7 million HIV-positive people, South Africa is the country with the largest HIV epidemic worldwide . In recent years, the country has gradually expanded its eligibility criteria for treatment initiation in line with the World Health Organization (WHO) guidelines [2–6]. It is now rapidly scaling up its treatment programme aiming to cover all HIV-infected people with a CD4 cell count of ≤350 μl patients with a TB co-infection, and HIV-infected pregnant women irrespective of CD4 cell count [4, 7]. The treatment programme has achieved significant results: it is the largest programme of its kind in the world, with approximately 1.8 million people on HIV treatment .
Despite these achievements, the present HIV programme is not optimal in three important areas. First, there are concerns about whether the current treatment strategy is most efficient. Research suggests that alternative policies such as universal testing and immediate treatment of all HIV-infected patients (UTT)  and targeting specific risk groups [10, 11], would be more efficient than the present programme. Second, concerns exist regarding the equity of the distribution of ART across population groups – recent reviews show that e.g. men and children have less access to treatment than women [8, 12]. Third, there are concerns about the programme feasibility given the severely limited capacity of the health system. In 2011, 3.4 million people were eligible for treatment in South Africa, and despite the achievements in scaling up the treatment programme, yet only 52% of them received it . This “treatment gap” is related to funding constraints, but also due to staff shortages , and it will increase with more people surviving on treatment [13, 14]. National health authorities acknowledge these concerns  but have not yet developed and implemented treatment guidelines that address these. This results in ad-hoc priority setting practices (where some clinicians treat patients on a first-come first-serve basis while others give preference to the most severely ill) and waiting lists in parts of the country .
In this paper, we argue that the above observations are related to suboptimal decisions on the design of the present HIV treatment programme. We argue there are two fundamental reasons to this. First, while there is a rapidly growing evidence-base to guide priority setting decisions on HIV treatment, its included studies typically consider only one criterion at a time and thus fail to capture the broad range of values that stakeholders have. Second, priority setting on HIV treatment is a highly political process but it seems no adequate participatory processes are in place to incorporate stakeholders’ views and evidences of all sorts.
In the paper, we first outline the scientific evidence-base on HIV treatment priority setting in South Africa, in terms of efficiency, equity and feasibility. We continue by proposing an alternative approach based on the combination of two innovative and increasingly important frameworks for health care priority setting: accountability for reasonableness (A4R) to foster fair priority setting processes, and multi-criteria decision analysis (MCDA) to foster rational priority setting.
The WHO has recently also recognised the need to trade-off the mentioned efficiency, equity and feasibility concerns , resulting in “Programmatic guidelines on HIV treatment” issued in July 2013 . This paper contributes to these guidelines by providing a practical lead way for making these difficult priority setting decisions at various decision levels, based on a firm conceptual framework.
Present approaches to HIV treatment priority setting
Present studies on HIV treatment in South Africa priority setting typically focus on one of the following criteria.
Lately, a wide range of mathematical modelling studies have analysed the population health effects as well as costs and cost-effectiveness (or efficiency) of early versus late onset of treatment, many incorporating the transmission benefits of ART [11, 18–30]. Although models agree that HIV incidence can be substantially reduced through expanded access to ART, models differ substantially on predicted impact and cost-effectiveness of such an intervention [9, 31]. In addition, there is a growing interest in tailoring HIV treatment guidelines to most efficiently target programmes [10, 11].
Generally speaking, equity in health care pertains to judgements about distributive equality and the notion that every individual should have a “fair chance to live a full healthy life” . Yet, with severely constrained resources as in HIV treatment in South Africa, difficult ethical choices need to be made on whom is prioritized for treatment. Only a few studies give normative guidance on this subject. More specifically, Cleary et al. use the concept of “communitarian claims” in which an individual is viewed as having a claim on health care due to being a member of a community or society—and by extension, society has some obligation to provide the care . Claim strength is said to be affected by the severity of disease (sicker patients would be prioritized for moral reasons) or the individual capacity to benefit (patients with a better prognosis would be prioritized as this would lead to better clinical outcomes). Another claim stems from the impact of the programme on population health (patients would be prioritized whose treatment contributes most to reduction of the epidemic). Obviously, these above factors lead to conflicting recommendations on treatment initiation, particularly regarding whether this should be early or late in the course of disease. Other factors influencing claims include the “social context” of those in need. Kimmel et al.,  showed that professionals in South Africa support prioritizing individual patients based on treatment adherence, pregnancy status, and severity of illness.
Scholars take different positions when it comes to claim strength in the use of antiretrovirals for treatment or for prevention. Brock and Wikler argue that “the strongest moral imperative directs us to giving priority to saving the most lives (..) even if this means lowering the priority given to the goal of universal access to treatment, to provide maximum protection from HIV infection” . In response, Macklin and Cowan reason that “it is unethical to deliberately watch patients with treatable HIV/AIDS worsen and die (..) if medication for treatment are diverted to preexposure prophylaxis” . Alternatively, Singh proposes that a state’s “minimum core obligation” be used as a guiding principle in HIV programmes. This would protect the interest of all people, and as a consequence, antiretrovirals should not be exclusively used for treatment but also for prevention of HIV among, e.g. vulnerable young women .
Feasibility refers to constraints at the personal and health system level that may impede the implementation of HIV treatment programmes. A recent study in South Africa assessed the human and financial resources requirement for different HIV treatment strategies  but overall there is little systematic guidance on how these constraints can be considered.
Fundamental weaknesses of present approaches
The above overview shows a rapidly growing evidence-base on the efficiency, equity and feasibility of HIV treatment in South Africa. Yet, we argue there are two fundamental weaknesses to the current approaches that hamper policy makers in their ability to guide priority setting decisions.
Firstly, the HIV treatment programme in South Africa is not fully rational, with rational referring to “evidence-based allocation decisions in health taking into account all relevant decision-making criteria” . The current programme is largely based on international guidelines and does not adequately account for aspects of efficiency, equity, and feasibility – these are not well documented, difficult to trade-off and therefore typically considered one at a time. For example, cost-effectiveness analyses consistently show that UTT is a highly efficient intervention but thereby ignore the severe health system capacity constraints of such a strategy, other than the budget . As another example, the use of pre-exposure prophylaxis (PrEP) has shown to be effective and cost-effective to prevent HIV acquisition, but the community may prioritise to treat those people who are in greatest need of ART for their own health (even when this is less cost-effective). It is obvious that studies that fail to simultaneously consider efficiency, equity and feasibility concerns also fail to fully inform priority setting decisions . Underlying reason is that studies are typically not multidisciplinary (they stem from either clinical medicine, epidemiology, health economics or ethics), nor interdisciplinary (little effort has been made to take into account community views) .
Second, HIV treatment priority setting is a highly political process but in the seemingly absence of fair participatory processes, stakeholders’ views are typically not incorporated. The legitimacy of decision-making in health refers to the use of “generally considered fair conditions for distributive decision-making in health” [38–40] corresponding to “the belief that authorities, institutions, and social arrangements are appropriate, proper, and just” . Experience shows that there is often justifiable disagreement among stakeholders on which values to use in priority setting decisions [41, 42]. Ethicists have realized there are no absolute truths on principles to guide priority setting decisions, and argue that decision-makers must rely instead on a fair process (i.e. procedural fairness) to establish fair decisions [43, 44]. In contrast, the studies – as referred to above – typically rely on the assumption of ideal policy-makers, and that the mere provision of quantified evidence to policy makers leads to justified priority setting decisions.
The resulting picture is that of an ad-hoc priority setting process on HIV treatment (Figure 1, left panel).
An alternative approach
Here we propose an alternative approach to provide a better evidence base and include a fairer policy process to improve HIV treatment priority setting in South Africa. It is based upon two innovative and increasingly important frameworks to health care priority setting: the ethical framework on accountability for reasonableness (A4R) that fosters fair priority setting, and multi-criteria decision analysis (MCDA) that fosters rational priority setting [37, 45–56]. We believe that the integration of the two frameworks in a single approach holds large potential to improve fair and rational priority setting (Figure 1, right panel) . Pilot studies show that decision makers support the principles of both frameworks [54, 58].
Accountability for reasonableness
A4R is generally considered as a leading conceptual framework on the ethics of health care priority setting. Based on justice theories of democratic deliberation, it aims to strengthen the fairness of priority setting decisions [43, 44]. Central to the framework is the acceptance that people may justifiably disagree on what reasons to consider when priorities are made. In order to narrow the scope of controversy, A4R relies on “fair deliberative procedures that yield a range of acceptable answers” . Therefore, A4R provides structure for decision-makers to establish priorities for their specific contexts, while taking into account limited resources and regulatory conditions. Its central notion of democratic learning presumes that a continuous participatory process will lead to better knowledge and consensus building on criteria for decisions, and thus also strengthening agreement on - or at least acceptance of - decisions. A4R does not replace any other guideline, planning or decision making process, but adds procedural principles to support their implementation. The A4R framework consists of four conditions.
Relevance. Priority-setting decisions should be based on evidence, reasons and principles accepted by the stakeholders as relevant for meeting health needs fairly in their contexts. Closely linked to this condition is the inclusion of a broad range of stakeholders in the decision-making process. Having a wide range of stakeholders participating in the deliberation would help include the full range of relevant reasons and facilitate the implementation of the decisions made.
Publicity. Decision makers should make the process of priority setting transparent including the reasons behind the decisions. This gives the general public an opportunity to understand the values of the choices involved and a possibility to assess whether the relevant procedures are being followed. Publicity is important because it facilitates comparison from case to case to ensure consistency, it invokes appeal and may improve trust.
Appeals/Revision. The appeals condition is a mechanism that provides the public with an opportunity to dispute and challenge decisions. Thus, it also offers the decision makers an option to revise decisions in the light of further arguments. An appeals mechanism enriches decision-making process because initial agreement on reasons can be reassessed in light of new evidence.
Leadership/enforcement. There must be public or voluntary regulation of the decision-making process to ensure that relevance, publicity and appeals mechanisms are enforced and that decisions are considered as fair. Proper enforcement of fairness in decision making will ensure that decisions are acceptable and can be supported by all concerned. Activities based on such decisions are also likely to be more effective and sustainable.
Many authors propose A4R as a guiding framework on the fairness of HIV treatment [33, 35, 41, 42]. Yet, it has been criticised for being of limited practical use, i.e. for not detailing the 'Relevance conditions’, and how to include relevant evidence in the deliberation process [57, 59]. Given the importance of A4R as conceptual framework in health care priority setting, there is an urgent need to put it into operation.
Multi-criteria decision analysis
MCDA is theoretically grounded in multi-attribute utility theory  and sets programme priorities by referring to a comprehensive set of explicit criteria and guides decision makers in understanding the trade-offs between values that may be conflicting . As such, it could be used in studies on priority setting of HIV treatment, to simultaneously consider efficiency, equity and feasibility concerns.
MCDA is routinely used in other disciplines like agriculture [61, 62], as a response to the observed inability of people to effectively analyze multiple streams of dissimilar information, but knows relatively few applications in health. An example of the use of MCDA, in HIV treatment is a study by Cleary et al.,  in South Africa – who used mathematical programming techniques to trade-off equity and efficiency concerns. They estimated the health effects at different budget levels in the absence of any equity constraint (“health maximization”), and in the presence of two equity constraints: “equal treatment to all”, and “decent minimum”. The conclusion was that “health maximization” could achieve sizeable health gains but this would leave a quarter of those eligible for treatment without care. “Equal treatment” and a “decent minimum” would be more equitable but lead to less profound health gains. Other studies have used MCDA to set priorities in HIV/AIDS control in Thailand [51, 53] and Indonesia [63, 64].
A core component of any MCDA is the performance matrix which scores all programme options in terms of their performance on relevant criteria. Table 1 shows a hypothetical performance matrix for the evaluation of HIV treatment programmes. Each row describes a programme option (on how to deliver HIV treatment, when to initiate treatment, and who gets targeted for treatment) and each column describes the performance of the options against the criteria “feasibility”, “efficiency”, and “equity”. For example, mobile-clinic based treatment does not perform well on “efficiency” (as mobile clinics are relatively costly), but good on “equity” (as it is a way to reach remote areas and provide treatment to all). The matrix in Table 1 is highly simplified ― in reality, more criteria may be included which makes it adjustable to context. The matrix also quantifies the detailed performance on all criteria as well as trade-offs. For example, per programme option, the matrix may detail the number of life-years averted, among which population groups these occur, the expected costs, and required health system capacity―this allows a quantification of the trade-offs. In addition, in a real life application, the programme options in the performance matrix include coverage levels and can be combined.
There are several ways to interpret the performance matrix. In a qualitative inspection, any decision maker simply makes implicit judgments on the weights of the various criteria. Alternatively, in a quantitative inspection, any decision maker weighs the different criteria on the basis of their relative importance, and multiplies the scores by the weights to obtain weighted averages for all programmes. Programmes can subsequently be rank-ordered according to these weighted averages, somehow representing social welfare . Table 1 shows hypothetical criteria weights at the bottom row, and weighted averages in the utter right column, to illustrate the latter; here facility-based treatment would be ranked first in the choice on 'how to deliver treatment’ .
The contours of an alternative approach
The integration of the two frameworks in a single approach holds large potential to improve fair and rational priority setting . While important frameworks on themselves, A4R should be informed by better evidence, and MCDA could be very useful in this regard if implemented in an accountable and transparent way.
The contours of an alternative approach, including five phases, are shown in Figure 2. A first phase involves the formation of a consultation panel consisting of all relevant stakeholders and this may include representatives from a broad range of parties, such as decision makers, community representatives, people living with HIV/AIDS, health professionals, etc., [48, 53]. The formation of this panel can be a gradual process starting with the present decision-making body.
In a second phase, the panel identifies the decision-making criteria on the basis of local values. This involves a deliberative process in which panel members put forward relevant criteria (reasons) for priority setting and discuss reasons, principles, and evidence that each view as relevant to making fair decisions about priorities. These criteria are discussed, and ultimately approved or rejected, by other panel members. The aim is to reach acceptance on a set of criteria that are considered reasonable by all panel members. Sometimes this will be through consensus or through democratic voting but other times through hierarchical decision making. Even these cases can be compatible with A4R when all values and criteria have been deliberated in a fair way, the rationales for the decisions are made available and appeals can be made when the priority setting decision is implemented.
This paper proposes the use of criteria under the general headings of “efficiency”, “equity”, and “feasibility”, but these criteria are obviously not predetermined. Instead, these specific criteria should be defined by the consultation panel as an outcome of stakeholders’ discussions on which values they find most important in HIV treatment.
A third phase concerns the construction of the performance matrix, and this is the core component of any MCDA. In this step, all programme options are scored in terms of their performance on the selected criteria. In a fourth phase, the panel interprets the performance matrix. This may or may not involve the weighing of the relevant criteria. The A4R framework stipulates that this phase always includes a component of deliberation to discuss these weights, to identify any other criteria (that may have been ignored in the previous phases or that cannot be quantified), and to address the reasonability of the final ranking ordering. Phase five is the phase of evaluating the priority setting decision arrived at, and relates to the transparency, appeal and enforcement conditions of A4R (as described above).
Health care priority setting is a continuous process, where ethical dilemmas and programme priorities may regularly need to be updated in the light of changes of available programme options, of programme characteristics in terms of efficiency, equity and feasibility, or of stakeholders’ preferences. Health care priority setting is therefore represented here as a cyclical process. The cycle also reflects that health care priority setting is a (democratic) interactive learning process, in which the consultation panel constantly refines the participatory process of identifying, elaborating and deciding on the inclusion of further relevant stakeholders, criteria and evidence.
Balancing efficiency, equity and feasibility in priority setting of HIV treatment is a major challenge, and we have shown that present approaches fall short in adequately doing so in South Africa. We propose an alternative approach that integrates two existing frameworks, and believe this provides a better evidence base and outlines a fairer policy process to improve HIV treatment priority setting in South Africa.
This approach is innovative in a number of ways. Most importantly, the programme integrates separate disciplines of thought on health care priority setting in a single framework. The scientific literature of health care priority setting –whether it is in low-, middle- or high-income countries– typically does not go beyond the boundaries of traditional disciplines like medicine, epidemiology, health economics and ethics. Our suggested approach unites insights and methods from these disciplines, and merges disease modelling, cost-effectiveness analysis, equity analysis and procedural fairness in one single approach. The potential of merging approaches from different disciplines has been named before by Peacock et al., who proposed a novel interdisciplinary framework combining MCDA, A4R, Participatory Action Research (PAR) and Programme Budgeting and Marginal Analysis (PMBA) . However, to the best of our knowledge, this novel framework has not been explicitly put in practice. Yet, at the same time, PBMA is reported to routinely take care of many of the aspects raised above .
The approach can be implemented at different political levels in South Africa including national, province, district and community level. Here it provides support for management and a strategy for quality improvement in regard to health care priority setting, including a heretofore missing evidence-base for these decisions. By combining the MCDA and A4R, the approach incorporates many elements that bring a large capacity for considerations. Its implementation results in policies that are grounded on evidence-based research and that encourage involvement from all stakeholders. More importantly it may lead to a greater understanding and acceptability also from those directly affected by policy changes .
The use of our proposed approach in different decision-making contexts may lead to the inclusion of different stakeholders, identification of different criteria and ultimately to the selection of different interventions. While this may reflect the presence of different values in these different contexts, it may possibly also reflect differences in the rigor of implementation of the approach. The development of checklists on stakeholders and criteria (as suggested by Tromp and Baltussen)  to consider may reduce these latter differences. The use of a more standardized approach including a priori defined criteria (and possibly even criteria weights) would ignore differences in values in different contexts, and the importance of the deliberative process.
The integration of A4R and MCDA also poses a number of challenges. First, whereas A4R can be considered as a continuous democratic governance approach based on reasons that any stakeholders brings into play, MCDA requires a higher level of competence for its interpretation. This may run the risk of leaving out some stakeholders and limit the influence of others. Yet, first experiences on the use of MCDA did not identify this as a barrier in the process . Second, the development of rigour evidence for health care priority setting, through MCDA, requires innovative research. Quantitative measures of equity and feasibility need to be developed, and measures of impact and efficiency need refinement. Also, mathematical models need to be developed that reflect the performance of treatment programmes in terms of efficiency and equity - these models could include measures of feasibility (as e.g. health workers availability) as health system capacity constraints. Yet, if the latter would be necessary in any health care priority setting process, MCDA runs the risk of needing a high level of expertise to provide credible evidence to the priority setting process. One way of addressing this is to allow, at least in the beginning of a process, more reliance on qualitative analysis within the consultation panel [67, 68].
UNAIDS (Joint United Nations Programme on HIV/AIDS: UNAIDS report on the global aids epidemic. Geneva: UNAIDS; 2012.
SANAC (South African National AIDS Council): National strategic plan for HIV & AIDS and STI. 2007–2011. South Africa: SANAC; 2007.
SANAC (South African National AIDS Council): The South African antiretroviral treatment guidelines. 2010. Available: . Accessed December 20, 2010–2010 http://www.sanac.org.za/resources/art-guidelines
SANAC (South African National AIDS Council): National Strategic Plan for HIV and AIDS, STIs and TB, 2012–2016. South Africa: SANAC; 2011.
SANAC (South African National AIDS Council): Statement by the presidency on the SANAC meeting. South Africa: SANAC; 2011.
Matsoso M: RE: Accelerating access to ART services and uptake. Development DoHaS: Cape Town Director General Health Republic of South Africa; 2012.
Department of Health, Republic of South Africa: The South African antiretroviral treatment guidelines. 2013. Available at: . 2013 http://www.doh.gov.za/docs/policy/2013/ART_Treatment_Guidelines_Final_25March2013.pdf
Johnson LF: Access to antiretroviral treatment in South Africa, 2004–2011. South African J HIV Med 2012, 13(1):22–27.
Hontelez JCLM, Bärnighausen T, Bakker R, Baltussen R, Tanser F, Hallett TB, Newell ML, De Vlas SJ: Expanded access to antiretroviral therapy leads to elimination of HIV in South Africa, even without universal test and treat. PLoS Med 2013. forthcoming
Delva W, Eaton JW, Meng F, et al.: HIV treatment as prevention: optimizing the impact of expanded treatment programmes. PLoS Med 2012, 9(7):e1001258. doi: 10.1371 10.1371/journal.pmed.1001258
Hallett TB, Baeten JM, Heffron R, et al.: Optimal uses of antiretrovirals for prevention in HIV-1 serodiscordant heterosexual couples in South Africa: a modelling study. PLoS Med 2011, 8(11):e1001123. 10.1371/journal.pmed.1001123
Michels C, Tromp N, Hontelez J, Baltussen R: Equity in access to antiretroviral therapy for HIV infected people in South Africa. 2013. NICHE working paper 2013.3
Barnighausen T, Bloom DE, Humair S: Human resources for treating HIV/AIDS: needs, capacities, and gaps. AIDS Patient Care STDS 2007, 21(11):799–812. 10.1089/apc.2007.0193
Hontelez JA, Newell ML, Bland RM, et al.: Human resources needs for universal access to antiretroviral therapy in South Africa: a time and motion study. Hum Resour Health 2012, 10(1):39. 10.1186/1478-4491-10-39
Kimmel AD, Daniels N, Betancourt TS, Wood R, Prosser LA: Decision maker priorities for providing antiretroviral therapy in HIV-infected South Africans: a qualitative assessment. AIDS Care 2012, 24(6):778–792. 10.1080/09540121.2011.630366
WHO World Health Organisation: WHO Consultation on the Strategic Use of Antiretrovirals (SUFA). 2nd Expert Panel towards Programmatic Guidance. 2012.
WHO (World Health Organisation): Consolidated guidelines on the use of antiretroviral drugs for treating and preventing HIV infection. Recommendations for a public health approach. 2013. Available at: http://www.who.int/hiv/pub/guidelines/arv2013/download/en/
Bendavid E, Brandeau ML, Wood R, Owens DK: Comparative effectiveness of HIV testing and treatment in highly endemic regions. Arch Intern Med 2010, 170(15):1347–1354. 10.1001/archinternmed.2010.249
Baggaley RF, Garnett GP, Ferguson NM: Modelling the impact of antiretroviral use in resource-poor settings. PLoS Med 2006, 3(4):e124. 10.1371/journal.pmed.0030124
Dodd PJ, Garnett GP, Hallett TB: Examining the promise of HIV elimination by 'test and treat’ in hyperendemic settings. AIDS 2010, 24(5):729–735. 10.1097/QAD.0b013e32833433fe
Kretzschmar ME, van der Loeff MF, Coutinho RA: Elimination of HIV by test and treat: a phantom of wishful thinking? AIDS 2012, 26(2):247–248. 10.1097/QAD.0b013e32834e1592
Powers KA, Ghani AC, Miller WC, et al.: The role of acute and early HIV infection in the spread of HIV and implications for transmission prevention strategies in Lilongwe, Malawi: a modelling study. Lancet 2011, 378(9787):256–268. 10.1016/S0140-6736(11)60842-8
Wagner BG, Kahn JS, Blower S: Should we try to eliminate HIV epidemics by using a 'Test and Treat’ strategy? AIDS 2010, 24(5):775–776. 10.1097/QAD.0b013e3283366782
Walensky RP, Paltiel AD, Losina E, et al.: Test and treat DC: forecasting the impact of a comprehensive HIV strategy in Washington DC. Clin Infect Dis 2010, 51(4):392–400. 10.1086/655130
Granich R, Kahn JG, Bennett R, et al.: Expanding ART for treatment and prevention of HIV in South Africa: estimated cost and cost-effectiveness 2011–2050. PLoS One 2012, 7(2):e30216. 10.1371/journal.pone.0030216
Granich RM, Gilks CF, Dye C, De Cock KM, Williams BG: Universal voluntary HIV testing with immediate antiretroviral therapy as a strategy for elimination of HIV transmission: a mathematical model. Lancet 2009, 373(9657):48–57. 10.1016/S0140-6736(08)61697-9
Hontelez JA, de Vlas SJ, Tanser F, et al.: The impact of the new WHO antiretroviral treatment guidelines on HIV epidemic dynamics and cost in South Africa. PLoS One 2011, 6(7):e21919. 10.1371/journal.pone.0021919
Rosen S, Long L, Sanne I, Stevens WS, Fox MP: The net cost of incorporating resistance testing into HIV/AIDS treatment in South Africa: a Markov model with primary data. J Int AIDS Soc 2011, 14: 24. 10.1186/1758-2652-14-24
Walensky RP, Wood R, Ciaranello AL, et al.: Scaling up the 2010 world health organization HIV treatment guidelines in resource-limited settings: a model-based analysis. PLoS Med 2010, 7(12):e1000382. 10.1371/journal.pmed.1000382
Walensky RP, Wood R, Fofana MO, et al.: The clinical impact and cost-effectiveness of routine, voluntary HIV screening in South Africa. J Acquir Immune Defic Syndr 2011, 56(1):26–35. 10.1097/QAI.0b013e3181fb8f24
Eaton JW, Johnson LF, Salomon JA, et al.: HIV treatment as prevention: systematic comparison of mathematical models of the potential impact of antiretroviral therapy on hiv incidence in South Africa. PLoS Med 2012, 9(7):e1001245. 10.1371/journal.pmed.1001245
Whitehead M: The concepts and principles of equity and health. Int J Health Serv 1992, 22(3):429–445. 10.2190/986L-LHQ6-2VTE-YRRN
Cleary SM, Mooney GH, McIntyre DE: Claims on health care: a decision-making framework for equity, with application to treatment for HIV/AIDS in South Africa. Health Policy Plan 2011, 26(6):464–470. 10.1093/heapol/czq081
Brock DW, Wikler D: Ethical challenges in long-term funding for HIV/AIDS. Health Aff (Millwood) 2009, 28(6):1666–1676. 10.1377/hlthaff.28.6.1666
Macklin R, Cowan E: Given financial constraints, it would be unethical to divert antiretroviral drugs from treatment to prevention. Health Aff (Millwood) 2012, 31(7):1537–1544. 10.1377/hlthaff.2012.0071
Singh J: Antiretroviral resource allocation for HIV prevention. AIDS 2013, 27(6):863–865. 10.1097/QAD.0b013e32835f2b30
Baltussen R, Niessen L: Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Effectiveness and Resource Allocation 2006, 4: 14. 10.1186/1478-7547-4-14
Daniels N: Accountability for reasonableness. BMJ 2000, 321(7272):1300–1301. 10.1136/bmj.321.7272.1300
Daniels N, Sabin J: Limits to health care: fair procedures, democratic deliberation, and the legitimacy problem for insurers. Philosophy & public affairs 1997, 26(4):303–350. 10.1111/j.1088-4963.1997.tb00082.x
Tyler TR: Psychological perspectives on legitimacy and legitimation. Annu Rev Psychol 2006, 57: 375–400. 10.1146/annurev.psych.57.102904.190038
Cleary S, Mooney G, McIntyre D: Equity and efficiency in HIV-treatment in South Africa: the contribution of mathematical programming to priority setting. Health Econ 2010, 19(10):1166–1180. 10.1002/hec.1542
Singh J: How to strategically roll out antiretroviral-based interventions for HIV treatment and prevention ethically and judiciously. Presentation at WHO Consultation on the Strategic Use of Antiretrovirals. Geneva Switzerland: 2nd Expert Panel towards Programmatic Guidance; 2012.
Daniels N, Sabin J: Setting limits fairly: Can we learn to share medical resources?. Oxford: Oxford University Press; 2002.
Klein R, William A: Setting priorities: what is holding us back – inadequate information or inadequate institutions? In The Global Challenge of Health Care Rationing. Edited by: Coulter A, Ham C. Buckingham: Open University Press; 2000:15–26.
Baeten SA, Baltussen RM, Uyl-de Groot CA, Bridges J, Niessen LW: Incorporating equity-efficiency interactions in cost-effectiveness analysis-three approaches applied to breast cancer control. Value Health 2010, 13(5):573–579. 10.1111/j.1524-4733.2010.00718.x
Baltussen R, Stolk E, Chisholm D, Aikins M: Towards a multi-criteria approach for priority setting: an application to Ghana. Health Econ 2006, 15(7):689–696. 10.1002/hec.1092
Baltussen R, ten Asbroek AH, Koolman X, Shrestha N, Bhattarai P, Niessen LW: Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Health Policy Plan 2007, 22(3):178–185. 10.1093/heapol/czm010
Baltussen R, Youngkong S, Paolucci F, Niessen L: Multi-criteria decision analysis to prioritize health interventions: capitalizing on first experiences. Health Policy 2010, 96(3):262–264. 10.1016/j.healthpol.2010.01.009
Chitama D, Baltussen R, Ketting E, Kamazima S, Nswilla A, Mujinja PG: From papers to practices: district level priority setting processes and criteria for family planning, maternal, newborn and child health interventions in Tanzania. BMC Womens Health 2011, 11: 46. 10.1186/1472-6874-11-46
Jehu-Appiah C, Baltussen R, Acquah C, et al.: Balancing equity and efficiency in health priorities in Ghana: the use of multicriteria decision analysis. Value Health 2008, 11(7):1081–1087. 10.1111/j.1524-4733.2008.00392.x
Youngkong S, Baltussen R, Tantivess S, Koolman X, Teerawattananon Y: Criteria for priority setting of HIV/AIDS interventions in Thailand: a discrete choice experiment. BMC Health Serv Res 2010, 10: 197. 10.1186/1472-6963-10-197
Youngkong S, Kapiriri L, Baltussen R: Setting priorities for health interventions in developing countries: a review of empirical studies. Trop Med Int Health 2009, 14(8):930–939. 10.1111/j.1365-3156.2009.02311.x
Youngkong S, Teerawattananon Y, Tantivess S, Baltussen R: Multi-criteria decision analysis for setting priorities on HIV/AIDS interventions in Thailand. Health Res Policy Systems 2012, 10: 6. 10.1186/1478-4505-10-6
Youngkong SBR, Tantivess S, Mohara A, Teerawattananon Y: Multi-criteria decision analysis for including health interventions in the universal health coverage benefit package in Thailand. Value Health 2012, 15(6):961–970. 10.1016/j.jval.2012.06.006
Mirelman A, Mentzakis E, Kinter E, et al.: Decision-making criteria among national policymakers in five countries: a discrete choice experiment eliciting relative preferences for equity and efficiency. Value Health 2012, 15(3):534–539. 10.1016/j.jval.2012.04.001
Guindo LA, Wagner M, Baltussen R, et al.: From efficacy to equity: Literature review of decision criteria for resource allocation and healthcare decisionmaking. Cost Effectiveness and Resource Allocation 2012, 10(9):1–13.
Bærøe K, Baltussen RL: Legitimate Healthcare Limit Setting in a Real-World Setting: Integrating Accountability for Reasonableness and Multi-Criteria Decision Analysis. Manuscript presented at the workshop 'The many faces of legitimacy. University of Oslo; 2012.
Kapiriri L, Martin DK: Successful priority setting in low and middle income countries: a framework for evaluation. Health Care Anal 2010, 18(2):129–147.
Peacock SS, Mitton C, Bate A, McCoy B, Donaldson C: Overcoming barriers to priority setting using interdisciplinary methods. Health Policy 2009, 92(2–3):124–132.
Peacock SJ, Richardson JR, Carter R, Edwards D: Priority setting in health care using multi-attribute utility theory and programme budgeting and marginal analysis (PBMA). Soc Sci Med 2007, 64(4):897–910. 10.1016/j.socscimed.2006.09.029
LPNMS (Land and Plant Nutrition Management Service): MCDA - Multi-Criteria Decision Analysis techniques, using the Aspiration-Led Decision Support (ALDS) approach. 2005. Website: Accessed 22 December 2005 http://www.fao.org/ag/agl/agll/infotech.htm
Linkov I, Varghese A, Jamil S, Seager T, Kiker G, Bridges T: Multi-criteria decision analysis: a framework for structuring remedial decisions at contaminated sites. In Comparative risk assessment and environmental decision making Edited by: Linkov I, Ramadan ABK. 2004, 15–54.
Tromp N, Prawiranegara R, Siregar A, Riparev H, Sunyaya D, Baltussen R: HIV/AIDS control in West-Java, Indonesia: how does the government set priorities?. 2013. NICHE working paper 2013.5
Tromp N, Prawiranegara R, Siregar A, Riparev HSD, Baltussen R: Criteria for priority setting of HIV/AIDS interventions in Indonesia. 2013. NICHE working paper 2013.4
Gibson J, Mitton C, Martin D, Donaldson C, Singer P: Ethics and economics: does programme budgeting and marginal analysis contribute to fair priority setting? J Health Serv Res Policy 2006, 11(1):32–37. 10.1258/135581906775094280
Tromp N, Baltussen R: Mapping of multiple criteria for priority setting of health interventions: an aid for decision makers. BMC Health Serv Res 2012, 12: 454. 10.1186/1472-6963-12-454
Patten S, Mitton C, Donaldson C: Using participatory action research to build a priority setting process in a Canadian regional health authority. Soc Sci Med 2006, 63(5):1121–1134. 10.1016/j.socscimed.2006.01.033
Dionne F, Mitton C, Macdonald T, Miller C, Brennan M: The challenge of obtaining information necessary for multi-criteria decision analysis implementation: the case of physiotherapy services in Canada. Cost Effectiveness and Resource Allocation 2013, 11(1):11. 10.1186/1478-7547-11-11
The authors declare that they have no competing interests.
All authors contributed to the development of the conceptual framework, read and approved the final manuscript.