Skip to main content

Cost-effectiveness of a novel smartphone application to mobilize first responders after witnessed OHCA in Belgium



EVapp (Emergency Volunteer Application) is a Belgian smartphone application that mobilizes volunteers to perform cardiopulmonary resuscitation (CPR) and defibrillation with publicly available automatic external defibrillators (AED) after an emergency call for suspected out of hospital cardiac arrest (OHCA). The aim is to bridge the time before the arrival of the emergency services.


An accessible model was developed, using literature data, to simulate survival and cost-effectiveness of nation-wide EVapp implementation. Initial validation was performed using field data from a first pilot study of EVapp implementation in a city in Flanders, covering 2.5 years of implementation.


Simulation of nation-wide EVapp implementation resulted in an additional yearly 910 QALY gained over the current baseline case scenario (worst case 632; best case 3204). The cost per QALY associated with EVapp implementation was comparable to the baseline scenario, i.e., 17 vs 18 k€ QALY−1.


EVapp implementation was associated with a positive balance on amount of QALY gained and cost of QALY. This was a consequence of both the lower healthcare costs for patients with good neurological outcome and the more efficient use of yet available resources, which did not outweigh the costs of operation.


Out-of-hospital cardiac arrest (OHCA) is a major health problem, with Belgian incidence rates of emergency medical services (EMS) attending OHCA of cardiac origin of approximately 82.8 per 100 000 person-years (86.4 on average in Europe) [1,2,3]. Important determinants of survival after OHCA are early cardiopulmonary resuscitation (CPR) as part of basic life support (BLS) and rapid defibrillation to restore spontaneous circulation [4, 5]. Delayed arrival time of the EMS has been associated with poor survival [6, 7]. Publicly available automated external defibrillators (AED) permit bystanders of OHCA or first responders, not trained in advanced life support (ALS), to provide early defibrillation prior to EMS arrival. A recent meta-analysis concluded that bystander AED use was associated with increased survival to hospital discharge (all rhythms OR: 1.73, shockable rhythms OR: 1.66) and favourable neurological outcome (all rhythms OR: 2.12, shockable rhythms OR: 2.37) [8]. In recent studies, high survival rates of 30–70% have been reported for OHCA patients defibrillated with a publicly accessible AED, early after collapse [9,10,11,12,13,14]. No associations were found between bystander AED use and favourable neurological outcome in case of cardiac arrest with non-shockable rhythm (OR: 0.76) [8]. Although some studies could not find any survival benefit from bystander defibrillation, comprehensive analysis of the data showed limitations such as very high median response time before arrival (> 10 min) [15] or a limited part of patients effectively resuscitated by public AED [16]. Larsen et al. modelled the ‘Chain of Survival’ concept [17], describing the effect of the time delay of access to CPR, defibrillation and ALS on survival as: survival = 67–2.3% minutes of delay of CPR-1.1% minutes of delay of defibrillation-2.1% minutes of delay of ALS [18]. The model is still particularly interesting to compare survival for different scenarios, similar outside the response time of the interventions. Previous studies have been conducted on the clinical benefits and cost-effectiveness of public access defibrillation (PAD) programs, aimed at increasing the use of AED, prior to EMS-arrival [19, 20]. Comparison of such programs is challenging, considering the high degree of heterogeneity in the types of programs implemented (e.g., static vs mobile AED use, strategy for activation, defibrillation by professionals, the public, or combinations of both) and the context within which they operate (baseline availability of public AED, overall chain of survival and level of care, geographic variations, socio-economic disparities) [20, 21]. Comparison is even more hampered by the large differences in interpretation of the Utstein definitions [22, 23] for standardized reporting on OHCA [24]. Although ‘bystander CPR' is defined, in scenarios that included community-response systems, firefighters and/or police personnel, the percentage of agreement that 'bystander CPR' had been performed ranged from 16–91% [24]. Nevertheless, previous civilian-based resuscitation initiatives, activating volunteers via a mobile phone application [25,26,27,28,29], have underscored the importance of increased rates of early BLS and/or use of public AED, even achieving survival to discharge rates of 40–50% [28].

In Belgium, EVapp is the first civilian-based initiative to increase survival after OHCA. The system is developed as an application for smartphones, based on the Android and iOS operating system, and connected with the operating software of EMS dispatchers in Belgium. EVapp maintains a database of qualified volunteers and an up-to-date overview of the publicly available AED. Publicly available AED in Belgium are registered in the Federal Public Service Database and professionals as well as lay responders are authorized to use an AED by law in patients with OHCA [2]. In case of an alert for OHCA at the 112-dispatch centre, EVapp volunteers are activated in parallel and at the same time of dispatchment of the EMS. The application compares the geographical position of all volunteers and the location of the registered public accessible AED to the position of the incoming emergency call of the suspected cardiac arrest. Activation is based on two principles: (1), the two closest volunteers are mobilized towards the victim, (2), the third and fourth closest volunteers are send to the victim via the closest public AED. The fifth closest volunteer is again send directly to the victim (Fig. 1). The application is programmed in such a way that volunteers present within a radius of 500 m from the suspected arrest first receive a warning alert. The smartphone application provides guidance to the geolocations of the suspected cardiac arrest and/or AED. If the desired amount of responses (> 3) within 500 m is not met, the radius is systematically increased to a maximum of 1500 m. In case no volunteers are found, not only their current geolocation is considered, but also their home and/or work addresses can be used for activation, as these addresses may imply a relatively high probability of being in the neighbourhood (static users). Those EVapp volunteers will also receive an alert on their mobile phone via a text message, which they can choose to accept or decline in case their 4G would not been activated.

Fig. 1
figure 1

Schematic representation of the EVapp-system

There is no immediate validation process implemented to evaluate if the volunteers that accepted the alert effectively reach the victim. Yet, the fact that 5 volunteers are alerted provides a margin of safety to avoid such situations. During the course of EVapp activation, performance parameters are being automatically registered by the software (Table 1). After each intervention, the volunteers receive a feedback form. This form offers to share their experience about the technical performance of the application (SMS function and locations), about the course of the intervention, the resuscitation attempt and the interactions with other volunteers and professional care providers.

Table 1 Important performance parameters automatically registered during each EVapp activation and inquired from the mobilized volunteers through the application

People who can submit a certificate of qualification for BLS (minimal 3 h of training in the last 5 years) can volunteer in the network. Volunteers eligible for participation are initially recruited through interaction with professional organisations (firemen, health workers) and through the local departments of the Red Cross organisation. Individual permission to join the network is requested through the EVapp website ( or after downloading the app. An EVapp administrator verifies if each volunteer has provided a valid certificate of qualification for BLS. Upon positive evaluation, volunteers are added to the EVapp database. In addition, as soon as the city or municipality is interested in setting up a citizen assistance network, a local steering committee is assembled. The steering committee can help to support recruitment by providing promotional material or organising events. It was preliminary estimated that for Belgium, comparably to The Netherlands, a country with an extensive civilian-based network of BLS-skilled volunteers and public AED [28, 30, 31], approximately 1% of the total population should be included in the EVapp volunteer database. Such amount of volunteers corresponds to approximately 3.7 volunteers per km2 in Belgium [32].

The aim of the current study was to simulate the potential increase in annual survival from witnessed OHCA of cardiac origin, and the decreased costs per QALY, associated with a more efficient use of the yet existing resources (i.e. BLS-trained volunteers and public AED), upon nation-wide EVapp implementation in Belgium. Early validation was performed by use of the first data obtained from a pilot study of EVapp implementation in the rural area of Hoogstraten in Flanders. Positive projections in this study and further validation may convince local policy makers to implement EVapp in their city or municipality.


Setting and perspectives

An accessible model was developed to evaluate cost-effectiveness and survival gain after OHCA, associated with EVapp implementation in Belgium. The study is reported with consideration of the reporting standard for health-economic evaluations (CHEERS) [33].

Survival from OHCA of non-cardiac origin, i.e., caused by an external agent, is very low, irrespective of the type and time of first response [34]. Early response moreover conservatively implies that the OHCA is witnessed. The target population in this study was therefore restricted to patients suffering from witnessed OHCA of cardiac origin in the Belgian population. With a total population of approximately 11.4 million people [32], this corresponded to around 6150 cases per year (approximately 86% of 11,000 cases were of cardiac origin, approximately 65% was witnessed) [2, 3].

The perspective of the study was the fact that early CPR and defibrillation, before the arrival of the EMS, would increase the amount of OHCA-survivors. This would lead to a total increase in the healthcare costs. It was prospected that the amount of survivors with good neurological outcome would increase ascendingly by the early intervention, meaning that overall a positive balance on the cost per QALY would be achieved.

Two different scenarios were directly compared, i.e., an estimate of the current survival and costs related to the baseline interventions after OHCA alert in Belgium, and a presumed second scenario consisting of nation-wide EVapp implementation. Possible interventions for both scenarios were grouped into three categories i.e., first response by either: (1), the emergency medical service (EMS), (2), bystanders or first-responders performing early CPR (present or activated), (3), bystanders or first-responders performing early CPR and defibrillation (present or activated). These scenarios are further referred to as ‘EMS’, ‘bCPR’ and ‘bCPR + AED’, respectively.

Healthcare related costs and productivity loss for OHCA-patients were evaluated in function of the neurological outcome, over a period of 6 years, i.e., the long-term mean survival after OHCA [35, 36]. Costs for EVapp implementation were included based on nation-wide implementation. Since EVapp aims to increase the use of available resources, major investments were generally not prospected.

Outcomes and measurement of effectiveness

The main health endpoints evaluated in this research were survival and neurological outcome after OHCA, depending on the type (and time) of first intervention after the alert. As core outcomes, both 30 day survival or survival to hospital discharge were included, in accordance with the updated Utstein guidelines [23] for reporting on OHCA. The study on bystander use of static AED by the Belgian healthcare knowledge-centre was used as the primary source to document the baseline scenario [2]. This study provided analysis of registered data from the MUGREG/ SMUREG (2015), a second-tier unit staffed with emergency physicians and specialised nurses [37] and a re-analysis of the Belgian data of the European EuReCa ONE study [3]. Other data was obtained by focussed search in the Web of Science database, using the keywords ‘out of hospital cardiac arrest’ and ‘survival’. Limited studies were available that can fully represent the scenario of nation-wide EVapp implementation in Belgium. A selection of studies was made for which the setting of the study was conceivably comparable or relevant for Belgium (i.e., level of care, demography, geography, EMS response time), or in which values regarding outcome were obtained from meta-analysis. A large population-based OHCA registry demonstrated that early defibrillation contributed to improved 1 month survival [38], while other studies found differences in outcome depending on the shock provider [10, 14, 39, 40]. In this model, the main focus was on the time-delay of intervention, i.e., no distinction was made between first-responders or EVapp mobilized volunteers to perform CPR or defibrillation. The established model of Larsen et al. [18] was particularly useful as outcome estimator between the different scenarios, controlling all factors apart from time-delay. Using this model, the delay in ALS was approximated by the median reported arrival time of the MUGREG/SMUREG of 12 min [37] for all responses. Delay in CPR and defibrillation was approximated by the average ambulance arrival time of 10 min [41] for the ‘EMS’ response in Belgium. Delay in CPR was instead approximated by 5 min for the ‘bCPR’ and ‘bCPR + AED’ response. For the latter response additionally, the delay in defibrillation was approximated by 6.5 min for the ‘bCPR + AED’ response (objective EVapp: response within 5–8 min). The results of other studies were included in the survival estimations in case the comparator of the study (survival after EMS response) was comparable to the baseline case for Belgium (10% survival for EMS arriving within 10 min) or in case odds ratios based on extensive meta-analysis or literature review had been calculated [8, 10, 42]. Different studies reported very high average survival rates for bystander defibrillation (of shockable rhythms) of 35–70% [9, 11,12,13,14]. Such high survival rates may represent a realistic best case survival estimate in case the time of intervention (both CPR and defibrillation) indeed decreases dramatically (< 8 min) [43]. For the ‘EMS’ and ‘bCPR’ response, the median case was obtained as the average of the worst- and best case value in absence of a third relevant value. The fraction of survivors with good neurological outcome (i.e., low cerebral performance category (CPC 1–2) [44]) after OHCA was around 85–92% in absence of community-based systems based on retrospective analysis of registries [20, 45, 46]. Based on meta-analysis, the odds ratio for favourable neurological outcome in case of bystander AED use was 2.1 for all rhythms and 2.4 for shockable rhythms [8]. When in this model the fraction of survivors with CPC 1–2 was evaluated at 85%, on average, the odds for good neurological outcome corresponded fairly with such ratios.

AED use by non-EMS personal in Belgium was reported in 7 of 105 OHCA cases (6.7%) [3], yet according to the (incomplete) data of the 2015 MUGREG/SMUREG registry report [37], this value was only around 0.22% (24/10,880) [2]. According to the EuReCa-one study, in cases where CPR was attempted, 47% on average was attempted by a bystander, with a range between 6.3% and 78% among countries [3]. The level of CPR-training in the Belgian general population is yet low to moderate [2]. The current fraction of bCPR in Belgium for witnessed OHCA was estimated at 33%. Based on recent initiatives to mobilize volunteers via mobile phone application [25, 26, 28, 47], responses of bCPR and bCPR + AED were assumed as 50 and 25%, respectively for the scenario of EVapp implementation.

As secondary outcome, QALYs were estimated over the average long-term survival after OHCA and by use of CPC-associated annual survival rates (0.9 for CPC 1–2 vs 0.8 for CPC 3–4) [20, 46]. The utility after OHCA had been rated as approximately 0.6–0.8 in general vs 0.8–0.9 for CPC 1–2 and 0.4 for CPC 3–4 [20, 48,49,50,51,52].

Resources and costs

AED devices

It has been estimated that around 10,000 AED-devices are operational in Belgium, corresponding to 0.9 per 1000 inhabitants [2]. The devices are predominantly deployed by private actors (70%) [2]. At first instance, systematic investments in publicly available AED were not foreseen in the model to achieve the objectives of early defibrillation (< 8 min post collapse). This assumption needs to be further validated.

Patients productivity loss

The mean age at OHCA was approximately 65 years [2, 3, 37], which is around the pension age for most employees in Belgium [53]. Total productivity loss was assumed for patients with CPC 3–5 outcome and calculated for the productive ages of 55–65 years, considering the OHCA distribution by age of (0.02 for age 0–17 years, 0.04 for age 18–34 years, 0.13 for age 35–49 years, 0.3 for age 50–64 years, 0.29 for age 65–75 years and 0.22 for age > 80 years) [54]. A uniform distribution within classes was assumed. Each productive year lost was appraised by the gross domestic product per capita in Belgium of 38.5 k€ y−1 [55].

Healthcare expenditures

Outcome-associated cost of care after OHCA has been estimated by Moran et al. for Ireland [20]. Accurate recent data did not seem publicly available for Belgium. In 2016, the national expenditures on healthcare were 4.2 k€ inhabitant−1 vs 3.7 k€ inhabitant−1 for Ireland and Belgium, respectively [56]. The inflation rate over the period 2016–2018 was 6.5% for Belgium [57]. The data provided by Moran et al. was considered the most accurate at this point to estimate Belgian healthcare expenditures after OHCA for 2020 and shortly following years.


Costs directly related to the implementation of EVapp are costs for insurance of the volunteers during the interventions (estimated 1% of the total population) and fixed costs for software development and maintenance, connection to the EMS dispatch systems, servers and general operating. The costs are charged to the municipality or city on the basis of the number of inhabitants (representative for the number of volunteers). The projection for Belgium amounted to 850 k€ y−1. Since specifically trained volunteers are recruited, the costs of training of the volunteers are costs already incurred. The cost projection related to the recruitment of the volunteers was negligible.

Model validation and pilot case in the city of Hoogstraten

The first region in which EVapp was implemented (01/03/2017) was Hoogstraten, a city in the Belgian province of Antwerp, at the border with The Netherlands. Implementation of EVapp in Hoogstraten was selected as pilot project to compensate for its generally lower EMS and ALS coverage (‘black spots’ where a mobile team of emergency physicians and nurses cannot reach the site of alert within 15 min) (Fig. 2) [58] and lower population density of approximately 200 inhabitants km−2 [59].

Fig. 2
figure 2

Overview of ‘blind spots’ (white background), where a mobile team of emergency physicians and nurses cannot reach the site of alert within 15 min to apply advanced life support. The upper region of Belgium (Flanders) is shown (taken from

All publicly available AED in the city were localized and registered in the EVapp database. This included the placement of new devices at the initiative of the city of Hoogstraten and efforts to make private AED’s publicly accessible.


Simulations of outcome and cost-effectiveness

The input values used for estimation of outcomes are summarized in Tables 2, 3 and 4.

Table 2 Estimation of survival to discharge and neurological outcome after witnessed OHCA of cardiac origin, depending on the type of first response
Table 3 Estimation of the response distributions for the baseline scenario (estimated current situation in Belgium) and scenario of nation-wide EVapp implementation
Table 4 Estimation of the overall outcomes after witnessed OHCA of cardiac origin for the baseline scenario (estimated current situation in Belgium) and scenario of nation-wide EVapp implementation

As a consequence of the increased survival, costs of care were increased in the EVapp scenario compared to the baseline scenario. The total costs and productivity loss for the baseline scenario in Belgium, following 6 years of long-term mean survival after OHCA, was 47,550 k€, compared to 58,540 k€ for the EVapp case (worst case: 61,290 k€; best case: 76,515 k€) (Fig. 3). The worst case scenario was calculated using the highest range of treatment costs combined with the lowest survival. The costs related to EVapp implementation only amounted to 1.1–1.5% of the total costs. It was estimated that the amount of QALY gained by implementation of EVapp, following 6 years of long-term mean survival after OHCA, was up to 910 QALY (worst case 630; best case 3200) (Fig. 3). This means a gain of around 35%, as the estimated amount of QALY for the baseline condition was estimated at around 2670 QALY. The cost per QALY for the baseline scenario was 18 k€ QALY−1 (worst case 13, best case 25 k€ QALY−1), for the EVapp scenario these were 17 k€ QALY−1 (worst case 11, best case 23 k€ QALY−1).

Fig. 3
figure 3

Estimation of cost of care, productivity loss and costs related to EVapp implementation (left axis) versus amount of QALYs gained (right axis) for the current baseline scenario in Belgium, compared to the scenario of nation-wide EVapp implementation in Belgium, following a 1 year cohort of witnessed OHCA victims during the average long-term survival after OHCA of approximately 6 years

Model validation and pilot study in the city of Hoogstraten

From 1/03/2017 to 20/12/2019, the EVapp-protocol was activated 20 times by the 112-dispatcher for (suspected) OHCA, which was a lower activation rate than what would be expected from historic data suggesting 18–19 cardiac arrests year−1 (Federal evaluation document, EVapp-project Hoogstraten, Haenen W, personal communication). Efforts were made to identify possible causes. No abnormal under-activation of the EVapp-system in the emergency dispatch centre could be found (1 case). Yet, there was a concomitant under-activation of EMS in generally compared to other regions in the province: the number of emergency activations per 10,000 citizens was 40.7 in the city of Hoogstraten compared to 55 in the entire province. A similar observation was found in the activation of pre-hospital MUG-intervention teams that included a doctor (9.8 per 10,000 in Hoogstraten compared to 10.8 for the whole province). Although this partly accounts for the relatively low activation rate, a more comprehensive explanation on such lower rates in Hoogstraten was not available at this point. A total of 97 volunteers (around 0.5% of the population) was reached soon after the launch of EVapp (July 2017) via different local recruitment strategies. From the moment this level of 0.5% was reached, at least one volunteer responded an alert in all EVapp activations. From September 2018, 0.7% of the population was enrolled in the system. From that moment onwards, at least two volunteers responded to EVapp-activation. Both percentages are concluded to be critical numbers in adequate volunteer coverage in a rural area. At the end of the initial test phase in December 2019, 277 volunteers skilled in BLS were member of the EVapp network in Hoogstraten, which corresponded to around 1.3% of the population and to an area density of 2.6 volunteers km−2. The city administration decided to extend the implementation for at least another 5 years in 2020. The amount of volunteers had increased to almost 280 and consisted of both professional caregivers as well as trained lay-person (Table 5). The amount of publicly available AED in December 2019 was 19, which corresponded to approximately 0.9 per 1000 inhabitants and 0.2 AED km−2. Based on the performance reports generated after each activation, starting from early implementation, the EMS had not arrived before a volunteer arrived in 20% of cases and in 30% of all cases, an AED was brought to the victim by volunteers (with a clear increased trend of higher numbers achieved in the latest alerts). Negative feedback reported by the volunteers was the following: (1), insufficient indication of the location (15% of cases) and (2), the wish to receive EVapp alerts also when mobile phones were in silent mode. Both problems were further acted upon during the pilot study. All volunteers reported that they would like to remain member of the EVapp network after attending an OHCA.

Table 5 Overview of the 277 volunteers enrolled in the EVapp system in Hoogstraten in August 2020, by profession or as lay-person


In this research, an accessible model was made to estimate the cost-effectiveness and clinical benefits from implementation of a mobile phone application to mobilize first responders after OHCA in Belgium. Via this application, BLS-skilled volunteers in the nearest vicinity of 1500 m around the victim are activated and mobilized to apply CPR and if possible, defibrillation by public AED. The intention of the application is that the interventions would take place within 8 min post-collapse. Critical data to accurately estimate cost-effectiveness of civilian-based resuscitation initiatives are currently lacking for Belgium [2]. In absence of such data, the literature was screened to retrieve potentially relevant figures from previous initiatives. The amount of studies finally selected was rather limited, due to the large heterogeneity, absence of clear specifications on the time-delay in which interventions had taken place and the still rather limited number of operational smart phone applications. Nevertheless, the estimated overall outcomes for both scenarios can be evaluated in a broader sense (i.e., baseline scenario in different countries without civilian-based systems or different PAD programs).

When civilian-based initiatives are not implemented, low values for survival after OHCA of around 10% are generally observed [1, 3, 21, 60,61,62]. The latter value is comparable to the estimated baseline case for Belgium (9–16%), where bystander or first-responder CPR before arrival of the EMS was considered for 33% of witnessed cases. High survival rates of 30–70% have been reported in recent studies in case of early defibrillation [9,10,11,12,13,14]. Although some of these values were for the particular case of witnessed OHCA and shockable rhythm, the overall survival rates for EVapp implementation of 12–30% for witnessed OHCA are very plausible, considering that overall survival rates of 20–50% have been observed or projected in other recent civilian-based systems [13, 28, 29, 38, 63]. Other mobile phone applications to mobilize volunteers to OHCA victims have been reported or are in development [25,26,27,28,29, 64]. Most data is available for the country of The Netherlands and the capital of Stockholm [26, 28, 65]. In the examples of Stockholm, activated volunteers arrived at the scene in 58% of cases [26]. The population density, percentage of volunteers and number of AED/ 1000 inhabitants were comparable to Belgium. The average distance to OHCA via AED pick-up was 1280 m, for an AED accessibility of approximately 2.5 AED km−2. For the rural area of Hoogstraten, different to the area surrounding the capital city of Stockholm, the AED accessibility was only 0.2 AED km−2 (0.9 AED/ 1000 inhabitants), and yet an AED was brought to the victim in 30% of cases during the phase of early implementation. The number of AED/ 1000 inhabitants in Belgium was considerably lower than for The Netherlands, where approximately around 5.7 AED/ 1000 inhabitants were available, of which 1.3/ 1000 inhabitants were registered at the end of 2019 [31, 66]. For a 6-min zone to function optimally, it was suggested that at least around 1.7 AED/ 1000 inhabitants should be available [66]. Sondergaard et al. investigated how the route distance to the nearest accessible AED was associated with probability of bystander defibrillation in public and residential locations by use of the nationwide Danish Cardiac Arrest Registry [67]. They found that the probability of bystander defibrillation decreased rapidly within the first 100 m route distance from OHCA to the nearest accessible AED in public areas, whereas the probability of bystander defibrillation was low for all distances in residential areas. The importance of such observations needs to be further addressed with regard to nation-wide implementation of EVapp.

Once operational, EVapp was estimated to lead to a comparable cost per QALY compared to the baseline scenario. The latter was based on a conservative increase of survivors of witnessed OHCA of cardiac origin of around 15% for the best case scenario. From an economic point of view, EVapp implementation lead to a cost of 17 k€ QALY−1 × 3576 QALY year−1 or 59 million euro year−1 including EVapp costs, compared to 18 k€ QALY−1 × 2668 QALY year−1 or 47 million euro year−1 for the baseline case scenario. These estimates underline the special cost-efficiency of EVapp to gain considerable QALY via a better use of yet available resources. Andersen et al. extensively evaluated the sensitivity and cost-effectiveness of PAD in the US [19]. They demonstrated a cost of around 50 k€ QALY−1 from a societal perspective and 12 k€ QALY−1 from a healthcare perspective. As the primer aim in this research was to increase the efficient use of yet available resources (public AED and BLS-trained volunteers), the cost of 17 k€ QALY−1 derived in this study is comparable to the healthcare perspective.

This study has several limitations. Literature data was used to estimate potential survival benefits and cost-effectiveness of a novel application to activate volunteers after OHCA in Belgium, based on similar initiatives and other regions. Since the system is new and regions differ in important characteristics that determine outcome of OHCA and success of community-based systems, the available literature can only provide a good estimate. The aim of this study was not to provide an inclusive overview of previous initiatives, but yet to make a fair first estimate of potential performance and costs. Studies were included in the model for which the comparator resembled the baseline scenario for Belgium or a very similar initiative was enrolled (i.e., SMS-based volunteer recruitment). Assumptions needed to be made when including previous data in the current model. Such limitations was attempted to be mitigated by evaluating a worst, medium and best case scenario, by early validation of the assumptions through a pilot study, and by discussing the results of this model in the light of a plethora of previous initiatives. Within these limitations, the estimated results were found to be plausible. A recent systematic review and meta-analysis of the clinical benefits of first responder/ bystander defibrillation reported that 77% of the 44 retrieved observational studies had a critical risk of bias [8]. The quality of the evidence was low for randomized trials and very low for observational studies, data of both types of studies have been included in this research. Cost-effectiveness of community-based OHCA-interventions was found to be most strongly influenced by the incidence of OHCA, the estimated effectiveness and the actual use of public AED [8]. Such data are currently not extensive and accurate available for Belgium. Nevertheless, the first validation of the estimates for Belgium was performed by effective implementation of EVapp in the city of Hoogstraten in Flanders. The initial results carefully confirmed that the objectives and potential of EVapp may indeed be effectively achieved in practice. Further validation of the model will be carried out as EVapp is further being enrolled in various rural and urban locations in Belgium.


In this study, it was estimated that nation-wide implementation of EVapp, a novel smartphone application to mobilize trained volunteers to nearby OHCA victims, would increase survival without major increase in costs. According to the best case estimates, the increase in survival for witnessed OHCA of cardiac origin was projected at 15% over the baseline scenario. This considerable increase in survival was not associated with a major increase in cost per QALY. The projections were made by use of literature data. At the moment, EVapp is being implemented in different regions in Belgium and a first successful implementation was confirmed within the rural city of Hoogstraten, a region with low population density. Further research will allow to further validate the modelled results, including different rural and urban regions.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Code availability

Not applicable.


  1. Berdowski J, Berg RA, Tijssen JGP, Koster RW. Global incidences of out-of-hospital cardiac arrest and survival rates: Systematic review of 67 prospective studies. Resuscitation. 2010;81:1479–87.

    Article  PubMed  Google Scholar 

  2. Van Brabandt H, Gerkens S, Fairon N, Dubois C, Van Der Auwera M, Vansimpsen C, Roberfroid D. Static automated external defibrillators for opportunistic use by bystanders: health technology assessment. Belgian Health Care Knowledge Centre. 2017.

  3. Gräsner J, Lefering R, Koster RW, Masterson S, Böttiger BW, Herlitz J, Wnent J, Tjelmeland IBM, Ortiz FR, Maurer H, et al. EuReCa one 27 Nations, one Europe, one registry. Resuscitation. 2016;105:188–95.

    Article  PubMed  Google Scholar 

  4. Hasselqvist-Ax I, Riva G, Herlitz J, Rosenqvist M, Hollenberg J, Nordberg P, Ringh M, Jonsson M, Axelsson C, Lindqvist J, Karlsson T, Svensson L. Early cardiopulmonary resuscitation in out-of-hospital cardiac arrest. N Engl J Med. 2015;372:2307–15.

    Article  CAS  PubMed  Google Scholar 

  5. Valenzuela TD, Roe DJ, Nichol G, Clark LL, Spaite DW, Hardman RG. Outcomes of rapid defibrillation by security officers after cardiac arrest in casinos. N Engl J Med. 2000;343:1206–9.

    Article  CAS  PubMed  Google Scholar 

  6. O’Keeffe C, Nicholl J, Turner J, Goodacre S. Role of ambulance response times in the survival of patients with out-of-hospital cardiac arrest. Emerg Med J. 2011;28:703–6.

    Article  PubMed  Google Scholar 

  7. Pell JP, Sirel JM, Marsden AK, Ford I, Cobbe SM. Effect of reducing ambulance response times on deaths from out of hospital cardiac arrest: Cohort study. Br Med J. 2001;322:1385–8.

    Article  CAS  Google Scholar 

  8. Holmberg MJ, Vognsen M, Andersen MS, Donnino MW, Andersen LW. Bystander automated external defibrillator use and clinical outcomes after out-of-hospital cardiac arrest: A systematic review and meta-analysis. Resuscitation. 2017;120:77–87.

    Article  PubMed  Google Scholar 

  9. Andersen LW, Holmberg MJ, Granfeldt A, Løfgren B, Vellano K, McNally BF, Siegerink B, Kurth T, Donnino MW. Neighborhood characteristics, bystander automated external defibrillator use, and patient outcomes in public out-of-hospital cardiac arrest. Resuscitation. 2018;126:72–9.

    Article  PubMed  Google Scholar 

  10. Bækgaard JS, Viereck S, Møller TP, Ersbøll AK, Lippert F, Folke F. The effects of public access defibrillation on survival after out-of-hospital cardiac arrest. Circulation. 2017;136:954–65.

    Article  PubMed  Google Scholar 

  11. Claesson A, Herlitz J, Svensson L, Ottosson L, Bergfeldt L, Engdahl J, Ericson C, Sandén P, Axelsson C, Bremer A. Defibrillation before EMS arrival in western Sweden. Am J Emerg Med. 2017;35:1043–8.

    Article  CAS  PubMed  Google Scholar 

  12. Karlsson L, Malta Hansen C, Wissenberg M, Møller Hansen S, Lippert FK, Rajan S, Kragholm K, Møller SG, Bach Søndergaard K, Gislason GH, Torp-Pedersen C, Folke F. Automated external defibrillator accessibility is crucial for bystander defibrillation and survival: A registry-based study. Resuscitation. 2019;136:30–7.

    Article  PubMed  Google Scholar 

  13. Kiyohara K, Nishiyama C, Kitamura T, Matsuyama T, Sado J, Shimamoto T, Kobayashi D, Kiguchi T, Okabayashi S, Kawamura T, Iwami T. The association between public access defibrillation and outcome in witnessed out-of-hospital cardiac arrest with shockable rhythm. Resuscitation. 2019;140:93–7.

    Article  PubMed  Google Scholar 

  14. Nehme Z, Andrew E, Bernard S, Haskins B, Smith K. Trends in survival from out-of-hospital cardiac arrests defibrillated by paramedics, first responders and bystanders. Resuscitation. 2019;143:85–91.

    Article  PubMed  Google Scholar 

  15. Van Alem AP, Vrenken RH, De Vos R, Tijssen JGP, Koster RW. Use of automated external defibrillator by first responders in out of hospital cardiac arrest: prospective controlled trial. Br Med J. 2003;327:1312–5.

    Article  Google Scholar 

  16. Bardy GH, Lee KL, Mark DB, Poole JE, Toff WD, Tonkin AM, Smith W, Dorian P, Packer DL, White RD, Longstreth WT, Anderson J, Johnson G, Bischoff E, Yallop JJ, McNulty S, Ray LD, Clapp-Channing NE, Rosenberg Y, Schron EB. Home use of automated external defibrillators for sudden cardiac arrest. N Engl J Med. 2008;358:1793–804.

    Article  CAS  Google Scholar 

  17. Cummins RO, Ornato JP, Thies WH, Pepe PE. Improving survival from sudden cardiac arrest: the “chain of survival” concept. A statement for health professionals from the Advanced Cardiac Life Support Subcommittee and the Emergency Cardiac Care Committee. American Heart Association Circulation. 1991;83:1832–47.

    Article  CAS  PubMed  Google Scholar 

  18. Larsen MP, Eisenberg MS, Cummins RO, Hallstrom AP. Predicting survival from out-of-hospital cardiac arrest: a graphic model. Ann Emerg Med. 1993;22:1652–8.

    Article  CAS  Google Scholar 

  19. Andersen LW, Holmberg MJ, Granfeldt A, James LP, Caulley L. Cost-effectiveness of public automated external defibrillators. Resuscitation. 2019;138:250–8.

    Article  PubMed  Google Scholar 

  20. Moran PS, Teljeur C, Masterson S, O’Neill M, Harrington P, Ryan M. Cost-effectiveness of a national public access defibrillation programme. Resuscitation. 2015;91:48–55.

    Article  PubMed  Google Scholar 

  21. Gul SS, Cohen SA, Becker TK, Huesgen K, Jones JM, Tyndall JA. Patient, neighborhood, and spatial determinants of out-of-hospital cardiac arrest outcomes throughout the chain of survival: a community-oriented multilevel analysis. Prehospital Emerg Care. 2019;5:1–12.

    Article  Google Scholar 

  22. Cummins RO, Chamberlain DA, Abramson NS, Allen M, Baskett PJ, Becker L, Bossaert L, Delooz HH, Dick WF, Eisenberg MS. Recommended guidelines for uniform reporting of data from out-of-hospital cardiac arrest: the Utstein Style. A statement for health professionals from a task force of the American Heart Association, the European Resuscitation Council, the Heart and Stroke Foundation of Canada, and the Australian Resuscitation Council. Circulation. 1991;84:960–75.

    Article  CAS  PubMed  Google Scholar 

  23. Perkins GD, Jacobs IG, Nadkarni VM, Berg RA, Bhanji F, Biarent D, Bossaert LL, Brett SJ, Chamberlain D, De Caen AR, Al E. Cardiac arrest and cardiopulmonary resuscitation outcome reports: update of the Utstein resuscitation registry templates for out-of-hospital cardiac arrest: a statement for healthcare professionals from a task force of the international liaison committee. Circulation. 2015;132:1286–300.

    Article  PubMed  Google Scholar 

  24. Maurer H, Masterson S, Tjelmeland IB, Gräsner JT, Lefering R, Böttiger BW, Bossaert L, Herlitz J, Koster RW, Rosell-Ortiz F, Perkins GD, Wnent J. When is a bystander not a bystander any more? A European survey. Resuscitation. 2019;136:78–84.

    Article  CAS  PubMed  Google Scholar 

  25. Andelius L, Malta Hansen C, Lippert FK, Karlsson L, Torp-Pedersen C, Kjær Ersbøll A, Køber L, Collatz Christensen H, Blomberg SN, Gislason GH, Folke F. Smartphone activation of citizen responders to facilitate defibrillation in out-of-hospital cardiac arrest. J Am Coll Cardiol. 2020;76:43–53.

    Article  PubMed  Google Scholar 

  26. Berglund E, Claesson A, Nordberg P, Djärv T, Lundgren P, Folke F, Forsberg S, Riva G, Ringh M. A smartphone application for dispatch of lay responders to out-of-hospital cardiac arrests. Resuscitation. 2018;126:160–5.

    Article  PubMed  Google Scholar 

  27. Lee SY, Do SS, Lee YJ, Song KJ, Hong KJ, Ro YS, Lee EJ, Kong SY. Text message alert system and resuscitation outcomes after out-of-hospital cardiac arrest: A before-and-after population-based study. Resuscitation. 2019;138:198–207.

    Article  PubMed  Google Scholar 

  28. Nas J, Thannhauser J, Herrmann JJ, van der Wulp K, van Grunsven PM, van Royen N, de Boer MJ, Bonnes JL, Brouwer MA. Changes in automated external defibrillator use and survival after out-of-hospital cardiac arrest in the Nijmegen area. Netherlands Hear J. 2018;26:600–5.

    Article  CAS  Google Scholar 

  29. Pijls RWM, Nelemans PJ, Rahel BM, Gorgels APM. A text message alert system for trained volunteers improves out-of-hospital cardiac arrest survival. Resuscitation. 2016;105:182–7.

    Article  PubMed  Google Scholar 

  30. Cbs. Bevolkingsteller. 2019. Accessed 28 Dec 2019.

  31. Jaarverslag 2019. In: HartslagNu. 2019. Accessed 15 Sep 2020.

  32. Statbel. Structure of the Population 2018. 2018. Accessed 16 Jul 2019.

  33. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E. Consolidated health economic evaluation reporting standards (CHEERS)-explanation and elaboration: a report of the ISPOR health economic evaluation publication guidelines good reporting practices task force. Value Heal. 2013;16:231–50.

    Article  Google Scholar 

  34. Christensen DM, Rajan S, Kragholm K, Søndergaard KB, Hansen OM, Gerds TA, Torp-Pedersen C, Gislason GH, Lippert FK, Barcella CA. Bystander cardiopulmonary resuscitation and survival in patients with out-of-hospital cardiac arrest of non-cardiac origin. Resuscitation. 2019;140:98–105.

    Article  CAS  PubMed  Google Scholar 

  35. Van Alem AP, Dijkgraaf MGW, Tijssen JGP, Koster RW. Health system costs of out-of-hospital cardiac arrest in relation to time to shock. Circulation. 2004;110:1967–73.

    Article  PubMed  Google Scholar 

  36. Næss A-C, Steen PA. Long term survival and costs per life year gained after out-of-hospital cardiac arrest. Resuscitation. 2004;60:57–64.

    Article  PubMed  Google Scholar 

  37. Depuijdt E, Schyns B. SMUREG-Manuel de l’utilisateur SMUR. In: SPF Santé Publique, Sécurité la Chaîne Aliment. Environ. 2016.

  38. Murakami Y, Iwami T, Kitamura T, Nishiyama C, Nishiuchi T, Hayashi Y, Kawamura T, Utstein Osaka Project. Outcomes of out-of-hospital cardiac arrest by public location in the public-access defibrillation era. J Am Heart Assoc. 2014;3:e000533.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Chia MYC, Kwa TPW, Wah W, Yap S, Doctor NE, Ng YY, Mao DR, Leong BSH, Gan HN, Tham LP, Cheah SO, Ong MEH. Comparison of outcomes and characteristics of emergency medical services (EMS)-witnessed, bystander-witnessed, and unwitnessed out-of-hospital cardiac arrests in Singapore. Prehospital Emerg Care. 2019;23:847–54.

    Article  Google Scholar 

  40. Suematsu Y, Zhang B, Kuwano T, Sako H, Ogawa M, Yonemoto N, Nonogi H, Kimura T, Nagao K, Yasunaga S, Saku K, Miura SI. Citizen bystander-patient relationship and 1 month outcomes after out-of-hospital cardiac arrest of cardiac origin from the All-Japan Utstein Registry: a prospective, nationwide, population-based, observational study. BMJ Open. 2019;9:e024715.

    Article  PubMed  PubMed Central  Google Scholar 

  41. FOD volksgezondheid. Advies 2009 PIT Paramedical Intervention Team. 2009. Accessed 25 Dec 2019.

  42. Balan P, Hsi B, Thangam M, Zhao Y, Monlezun D, Arain S, Charitakis K, Dhoble A, Johnson N, Anderson HV, Persse D, Warner M, Ostermayer D, Prater S, Wang H, Doshi P. The cardiac arrest survival score: a predictive algorithm for in-hospital mortality after out-of-hospital cardiac arrest. Resuscitation. 2019;144:46–53.

    Article  PubMed  Google Scholar 

  43. Blom MT, Beesems SG, Homma PCM, Zijlstra JA, Hulleman M, van Hoeijen DA, Bardai A, Tijssen JGP, Tan HL, Koster RW. Improved survival after out-of-hospital cardiac arrest and use of automated external defibrillators. Circulation. 2014;130:1868–75.

    Article  PubMed  Google Scholar 

  44. Edgren E, Hedstrand U, Kelsey S, Sutton-Tyrrell K, Safar P, BRCTI Study Group. Assessment of neurological prognosis in comatose survivors of cardiac arrest. Lancet. 1994;343:1055–9.

    Article  CAS  PubMed  Google Scholar 

  45. Girotra S, Van Diepen S, Nallamothu BK, Carrel M, Vellano K, Anderson ML, McNally B, Abella BS, Sasson C, Chan PS. Regional variation in out-of-hospital cardiac arrest survival in the United States. Circulation. 2016;133:2159–68.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Phelps R, Dumas F, Maynard C, Silver J, Rea T. Cerebral performance category and long-term prognosis following out-of-hospital cardiac arrest. Crit Care Med. 2013;41:1252–7.

    Article  PubMed  Google Scholar 

  47. Han KS, Lee SW, Lee EJ, Kwak MH, Kim SJ. Association between shockable rhythm conversion and outcomes in patients with out-of-hospital cardiac arrest and initial non-shockable rhythm, according to the cause of cardiac arrest. Resuscitation. 2019;142:144–52.

    Article  PubMed  Google Scholar 

  48. Gates S, Lall R, Quinn T, Deakin CD, Cooke MW, Horton J, Lamb SE, Slowther AM, Woollard M, Carson A, Smyth M, Wilson K, Parcell G, Rosser A, Whitfield R, Williams A, Jones R, Pocock H, Brock N, Black JJM, Wright J, Han K, Shaw G, Blair L, Marti J, Hulme C, McCabe C, Nikolova S, Ferreira Z, Perkins GD. Prehospital randomised assessment of a mechanical compression device in out-of-hospital cardiac arrest (PARAMEDIC): A pragmatic, cluster randomised trial and economic evaluation. Health Technol Assess (Rockv). 2017;21:1–175.

    Article  Google Scholar 

  49. Graf J, Mühlhoff C, Doig GS, Reinartz S, Bode K, Dujardin R, Koch K-C, Roeb E, Janssens U. Health care costs, long-term survival, and quality of life following intensive care unit admission after cardiac arrest. Crit Care. 2008;12:R92.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Nichol G, Stiell IG, Hebert P, Wells GA, Vandemheen K, Laupacis A. What is the quality of life for survivors of cardiac arrest? A prospective study. Acad Emerg Med. 1999;6:95–102.

    Article  CAS  Google Scholar 

  51. Petrie J, Easton S, Naik V, Lockie C, Brett SJ, Stümpfle R. Hospital costs of out-of-hospital cardiac arrest patients treated in intensive care; a single centre evaluation using the national tariff-based system. BMJ Open. 2015;5:e005797.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. de Vos R, de Haes HC, Koster RW, de Haan RJ. Quality of survival after cardiopulmonary resuscitation. Arch Intern Med. 1999;159:249–54.

    Article  Google Scholar 

  53. European Commission. Belgium-old-age pensions and benefits. In: Employment, Soc Aff Incl. 2019. Accessed 14 Jul 2019.

  54. McNally B, Robb R, Mehta M, Vellano K, Valderrama AL, Yoon PW, Sasson C, Crouch A, Perez AB, Merritt R, Kellermann A, Centers for Disease Control and Prevention, . Out-of-hospital cardiac arrest surveillance–-Cardiac Arrest Registry to Enhance Survival (CARES), United States, October 1, 2005–December 31, 2010. MMWR Surveill Summ. 2011;60:1–19.

    PubMed  Google Scholar 

  55. Trading economics. Belgium GDP per capita.2018. Accessed 14 Jul 2019.

  56. Eurostat. Current healthcare expenditure. In: Stat. Explain. 2016. Accessed 17 Dec 2019.

  57. Historische inflatie België. 2018. Accessed 18 Dec 2019.

  58. News4Med. Spreiding van MUG’s en PIT’s: nog te veel blinde vlekken. 2015. Accessed 28 Dec 2019.

  59. Stad Hoogstraten. Feiten en cijfers. 2018. Accessed 24 Dec 2019.

  60. Dyson K, Brown SP, May S, Smith K, Koster RW, Beesems SG, Kuisma M, Salo A, Finn J, Sterz F, Nürnberger A, Morrison LJ, Olasveengen TM, Callaway CW, Do SS, Gräsner JT, Daya M, Ma MHM, Herlitz J, Strömsöe A, Aufderheide TP, Masterson S, Wang H, Christenson J, Stiell I, Vilke GM, Idris A, Nishiyama C, Iwami T, Nichol G. International variation in survival after out-of-hospital cardiac arrest: a validation study of the Utstein template. Resuscitation. 2019;138:168–81.

    Article  PubMed  Google Scholar 

  61. Grunau B, Kawano T, Scheuermeyer F, Tallon J, Reynolds J, Besserer F, Barbic D, Brooks S, Christenson J. Early advanced life support attendance is associated with improved survival and neurologic outcomes after non-traumatic out-of-hospital cardiac arrest in a tiered prehospital response system. Resuscitation. 2019;135:137–44.

    Article  PubMed  Google Scholar 

  62. Schriefl C, Mayr FB, Poppe M, Zajicek A, Nürnberger A, Clodi C, Herkner H, Sulzgruber P, Lobmeyr E, Schober A, Holzer M, Sterz F, Uray T. Time of out-of-hospital cardiac arrest is not associated with outcome in a metropolitan area: a multicenter cohort study. Resuscitation. 2019;142:61–8.

    Article  CAS  PubMed  Google Scholar 

  63. Sun CLF, Karlsson L, Torp-Pedersen C, Morrison LJ, Brooks SC, Folke F, Chan TCY. In silico trial of optimized versus actual public defibrillator locations. J Am Coll Cardiol. 2019;74:1557–67.

    Article  PubMed  Google Scholar 

  64. Del Pozo A, Villalobos F, Rey-Reñones C, Granado E, Sabaté D, Poblet C, Calvet A, Basora J, Castro A, Flores G. Effectiveness of a network of automatically activated trained volunteers on the reduction of cardiopulmonary resuscitation manoueuvers initiation time: Study protocol. BMC Public Health. 2019.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Ringh M, Jonsson M, Nordberg P, Fredman D, Hasselqvist-Ax I, Håkansson F, Claesson A, Riva G, Hollenberg J. Survival after Public Access Defibrillation in Stockholm, Sweden–A striking success. Resuscitation. 2015;91:1–7.

    Article  PubMed  Google Scholar 

  66. Hartstichting. Mijlpaal bereikt: 170.000 burgerhulpverleners in Nederland. 2019. Accessed 28 Dec 2019.

  67. Sondergaard KB, Hansen SM, Pallisgaard JL, Gerds TA, Wissenberg M, Karlsson L, Lippert FK, Gislason GH, Torp-Pedersen C, Folke F. Out-of-hospital cardiac arrest: Probability of bystander defibrillation relative to distance to nearest automated external defibrillator. Resuscitation. 2018;124:138–44.

    Article  PubMed  Google Scholar 

Download references


Not applicable


Not applicable.

Author information

Authors and Affiliations



SV designed and directed the study, provided the field data and had the overall lead in the study. EM performed the scientific analysis and drafted the manuscript in close cooperation with the main author. Both authors read and approved the final manuscript.

Corresponding author

Correspondence to Steven Vercammen.

Ethics declarations

Ethics approval and consent to participate

Considering a literature based study was performed, there is no impact on ethical standards. The EVapp project was accepted by the National Council of Emergency Medical Care in Belgium (NRDGH), a council of the Federal government of Belgium. Not applicable.

Consent for publication

Not applicable.

Competing interests

SV is besides his engagement in the EVapp-project, co-owner in Prior-IT BV (Belgian registration 0607.954.626), the software company that developed the EVapp-software for the Belgian market. EM has no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Vercammen, S., Moens, E. Cost-effectiveness of a novel smartphone application to mobilize first responders after witnessed OHCA in Belgium. Cost Eff Resour Alloc 18, 52 (2020).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: