Skip to main content

Economic evaluations of medical devices in paediatrics: a systematic review and a quality appraisal of the literature

Abstract

Background

Although economic evaluations (EEs) have been increasingly applied to medical devices, little discussion has been conducted on how the different health realities of specific populations may impact the application of methods and the ensuing results. This is particularly relevant for pediatric populations, as most EEs on devices are conducted in adults, with specific aspects related to the uniqueness of child health often being overlooked. This study provides a review of the published EEs on devices used in paediatrics, assessing the quality of reporting, and summarising methodological challenges.

Methods

A systematic literature search was performed to identify peer-reviewed publications on the economic value of devices used in paediatrics in the form of full EEs (comparing both costs and consequences of two or more devices). After the removal of duplicates, article titles and abstracts were screened. The remaining full-text articles were retrieved and assessed for inclusion. In-vitro diagnostic devices were not considered in this review. Study descriptive and methodological characteristics were extracted using a structured template. The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 checklist was used to assess the quality of reporting. A narrative synthesis of the results was conducted followed by a critical discussion on the main challenges found in the literature.

Results

39 full EEs were eligible for review. Most studies were conducted in high-income countries (67%) and focused on high-risk therapeutic devices (72%). Studies comprised 25 cost-utility analyses, 13 cost-effectiveness analyses and 1 cost-benefit analysis. Most of the studies considered a lifetime horizon (41%) and a health system perspective (36%). Compliance with the CHEERS 2022 items varied among the studies.

Conclusions

Despite the scant body of evidence on EEs focusing on devices in paediatrics results highlight the need to improve the quality of reporting and advance methods that can explicitly incorporate the multiple impacts related to the use of devices with distinct characteristics, as well as consider specific child health realities. The design of innovative participatory approaches and instruments for measuring outcomes meaningful to children and their families should be sought in future research.

Introduction

Advancements in medical technology have led to the development of innovative medical devices that have enabled earlier and more accurate diagnoses, improved treatment outcomes, and helped people live longer and healthier lives. While the medical devices industry has been growing over the last decades [1], this sector has been dominated by the development of devices for adults with few devices being designed and marketed specifically for children [2].

The design and development of medical devices for pediatric populations is challenging namely due to the difficulty in running clinical trials due to highly stringent safety, privacy and ethical requirements - as children are regarded as a vulnerable population - a small market size, making it unattractive to industry and investors [3]. Few devices are submitted yearly for market approval with an explicit indication for pediatric use [4]. In the last decade, only 24% of class III life-saving devices that have been approved by the U.S. Food and Drug Administration (FDA) were for pediatric use– and most of those were designed for children aged 12 and above [5]. Given the lack of pediatric-tailored devices available in the marketplace, pediatricians often extrapolate known adult clinical outcomes and usability data to children, prescribing and using devices devised and approved for adults in pediatric patients, engaging in a so-called ‘off-label’ practice [6]. These procedures are deemed far from optimal, as they may involve considerable risks to the health and well-being of children. Indeed, several adverse events have already been reported [7,8,9,10]. To address these issues and compel the industry to advance in pediatric device innovation, specific programs, consortia, and financial incentives have been recently launched in the US [4, 11] and Europe [12]. As a result, new devices for the pediatric population are expected to be developed in the coming years.

Following this, there will be a growing demand for studies and tools to adequately review, synthesise and interpret the evidence on the value of these technologies, in line with providing high-quality and timely information to assist decisions regarding their adoption. By providing a ‘comparative analysis of both costs and outcomes of alternative health technologies’ (p. 22 [13]),, economic evaluations (EEs) are typically used to inform decisions on the adoption and use of new and emerging health technologies, often within the scope of Health Technology Assessment (HTA) processes.

Any formal and rigorous EE of a given health intervention should reflect the characteristics and context of the population who will benefit from it. When measuring costs and consequences within the pediatric population, additional issues should be considered in the evaluation process, given the specificities of the child’s life and health. These include child’s development trajectory, their dependent status, different patterns of health and disease, and health resource use compared to adults [14,15,16].

Besides, critical appraisals of EE studies of pediatric drugs and vaccines have detected specific methodological shortcomings, including a poor description of the analytical perspective adopted, a disregard for child-specific and lifelong health outcomes, omission of patient and caregiver productivity costs, and lack of transparency [14, 17, 18].

While these issues may also emerge in evaluating other health interventions, up to our knowledge, no such study has examined the existence of the referred challenges– and perhaps some extra ones– in EE studies of devices used in paediatrics. Thus, there is scope for conducting a review of the published literature, analysing research trends, and mapping methodological issues for informing discussions in light of new advances in the fields of health economics and outcomes research (HEOR) and decision science.

Seizing this research opportunity, this study aims to: (1) identify, review, and characterise published full EEs (comparing both costs and outcomes of two more alternatives) assessing devices used in paediatrics; (2) evaluate their quality of reporting; (3) summarise and critically discuss methodological gaps, with a narrative review, providing recommendations to prompt the generation of more robust and sound EEs focused on devices used in paediatrics. In vitro diagnostic devices (IVDs) are outside the scope of this review, as these are subject to a different EU regulatory framework [19].

Study findings may ultimately contribute to more informed, transparent, and legitimate HTA decisions on the funding, reimbursement, and use of devices for the pediatric population, that fully take into consideration child health realities and unique needs, as well as to a discussion on the relevance for methodological advancements in EE studies for this specific context. To the best of our knowledge, this review is the first specifically focused on EE studies of devices used in paediatrics.

Methods

The methods for this systematic review were based on the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) 2020 statement [20].

Information sources

A comprehensive search of the literature (including running the search protocol and collecting the studies) was conducted on 31st March 2022 on the following electronic databases: MEDLINE® In-Process & Other Non-Indexed Citations, MEDLINE® (from 1946) and EMBASE (from 1980), via the Ovid SP interface, Web of Science, Scopus, the Pediatric Economic Database Evaluation (PEDE) [21], the University of York’s Centre for Reviews and Dissemination (CRD) databases, including the HTA and the National Health Service Economic Evaluation (NHS EE) databases. The search was restricted to studies written in English, with no time constraints set in the search period. Reference lists from the retrieved studies were examined to identify additional studies deemed suitable to be included this review.

Search strategy

A structured search strategy was developed using the PubMed database, with no time limits and restricted to studies written in the English language. The same search strategy was applied to the other databases, with slight changes being performed considering each database-appropriate syntax. Detailed electronic search strategies for each database can be found in the Supplementary Electronic File 1. To achieve adequate sensitivity and identify additional studies, manual searches were also conducted.

Eligibility criteria

Studies were included if they met the following predetermined inclusion criteria: peer-reviewed journal articles reporting on studies assessing devices in paediatrics in the form of full EEs defined by Drummond et al. as a ‘comparative analysis of alternative courses of action in terms of both their costs and consequences, (p. 22 [13], ) as per stated by the authors or implied by the methods reported; conducted in the pediatric population (≤ 18 years of age). Additionally, the following exclusion criteria were applied: studies assessing health technologies not strictly classified as medical devices, according to the new EU regulation [19]; studies assessing drug-device combination products (e.g. drug eluting stents, metered-dose inhalers); studies assessing sexual/reproductive health devices (e.g. intrauterine devices, vaginal meshes); studies assessing the whole range of in vitro diagnostic (IVD) technologies (e.g. rapid diagnostics tests, enzyme immunoassays); studies assessing digital health technologies (e.g. wellness devices, telemedicine, e-health, mHealth software); studies assessing wearables or fitness tracking devices; studies that reported the use of a device as part of a health intervention, but wherein the main goal was not the assessment of a device (e.g. surgical techniques, newborn screening programs); studies evaluating devices in the adult population; RCTs or other clinical studies providing only efficacy and/or safety evidence or systematic reviews of clinical studies; studies written in a language other than English; study protocols not reporting results, as well as records presented only as abstracts, conference proceedings, case reports, posters, editorials, letters, notes or commentaries; studies with full-text not available. Also, partial EEs– as defined by Drummond and colleagues [13], i.e. ‘studies wherein the costs and consequences of two or more alternative health interventions are not compared’ (e.g. cost analysis, cost description and cost-outcomes description)– were excluded. Systematic literature reviews on EEs and HTA reports on devices were retrieved and analysed to check the completeness of the identified records. Questions regarding the applicability and interpretation of the inclusion and exclusion criteria were discussed with two co-authors (MO and RF).

Study selection

All the references identified through the searches were imported into reference management software ENDNOTE® X7 (Clarivate Analytics, Philadelphia, PA), and duplicates were removed. An initial screening training set of 10% of the sample was assessed to ensure the appropriateness of exclusion criteria and their consistent interpretation. Titles and abstracts of the retrieved studies were screened by one author (EM) and analysed against the predetermined inclusion and exclusion criteria. Lastly, full-text articles were obtained and thoroughly assessed for eligibility by two reviewers (EM and LSM). Disagreements on whether a specific study should be considered were resolved by a third investigator (MO).

Data collection and extraction

Data extraction was performed by one author (EM) and validated by a second author (LSM) using a data extraction form designed for this review and implemented in Microsoft Excel. Data collected pertained to: study publication details– the name of the first author, year and journal of publication, article title, first author, country of origin, the country where the study was developed; source of funding and author’s conflict of interest; study descriptive characteristics– a type of the device under assessment and comparators, targeted pediatric age group, study sample size, disease/health condition associated; information on the EE methods employed– a type of EE analysis (e.g. CUA, CEA, CBA), study perspective adopted, time horizon of the study, price year and currency, discount rate for costs, discount rate for outcomes, health outcome measure, direct and/or indirect costs, economic summary measure (e.g. ICER, average cost/QALY), type sensitivity analysis; other relevant information– key results of the study, authors’ conclusions, authors’ stated limitations. The completed Data Extraction Form used in this review can be found in the Electronic Supplementary File 2.

Study perspective refers to the point of view from which the study was conducted [13]. When the perspective was not stated by the authors, we could infer it by the type of costs reported. For instance, if both direct medical costs and indirect costs such as productivity losses were considered, we inferred that a societal perspective was adopted.

Data analysis and synthesis

Descriptive and methodological characteristics of the included studies were summarized in the form of a qualitative narrative synthesis, complemented with figures and summary tables. Information concerning the device under assessment and comparators, namely the device purpose and risk class were determined according to the new EU regulations for devices (EU 2017/745 and EU 2017/746) [22, 23].

Given the high incidence of CUA studies within our sample, and in light of the challenges concerning the measurement of health-related quality of life (HQROL) and health utilities in children [24, 25], we decided to conduct a distinct analysis for this group of studies, namely examining whether health utilities were prospectively measured, and if so, which method was used, whose health utilities were elicited and who provided the measurement.

Assessment of quality of reporting

The Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 checklist [26] was applied to evaluate studies’ quality of reporting. This checklist comprises 28 items grouped in six sections: (1) Title; (2) Abstract, (3) Introduction, (4) Methods, (5) Results, (6) Discussion, (7) Other relevant information (Source of Funding, Conflict of Interest). It should be noted that was updated in 2022, with new items being added to the previous checklist. These include for instance aspects related to stakeholder involvement and engagement or the reporting of a health economic analysis plan, among others. One reviewer (EM) completed the CHEERS checklist for each study, indicating “Y” (Yes) when the criteria were met, “N” (No) when they were unfulfilled and “NA” (Not applicable) when they were deemed not required for that type of study. The checklist results were then validated by a second author (LSM). Analyses were conducted to identify (1) the most frequently reported and unreported CHEERS items within our study sample and (2) the studies complying with the majority of the CHEERS items.

Results

Search results

Electronic searches yielded 1635 studies, of which 1457 remained after the removal of duplicates. Screening at the title and abstract level resulted in the exclusion of 1201 studies, leaving a total of 256 to be assessed at the full-text level. After full-text screening 32 full EEs were included. The analysis of the reference lists of systematic reviews of EEs and HTA reports led to the inclusion of 7 further studies. Overall, a total of 39 full EEs assessing devices in the pediatric population were included in this review. The results of the study selection process are depicted as a PRISMA flowchart Electronic Supplementary File 3 (See Fig. 1).

Fig. 1
figure 1

Number of publications according to purpose of the device assessed

Characteristics of studies

The 39 full EEs meeting the inclusion criteria were published between 1999 and 2021. Studies are fairly evenly distributed over the years, 64% (N = 25) being published in the last 10 years. Nearly 67% (N = 26) of the studies were undertaken in high-income countries, 18% (N = 7) in upper middle-income countries and 15% (N = 6) in low-income or lower-middle-income countries. Most of the studies focused on devices used for therapeutic (N = 18, 46%) or life-support purposes (N = 10, 26%) (Fig. 2). Cochlear implants being the type of device most frequently reported (n = 13, 33%). Higher-risk devices– those classified as EU Class IIb and EU Class III– were assessed in 28 studies (72%) (see Fig. 3). The majority of the EE studies pertained to the medical speciality/area of pediatric otorhinolaryngology (N = 13, 33%), followed by neonatology with ten studies (26%) and pediatric cardiology with six (16%). Fourteen studies (36%) did not report the source of funding. Twelve studies (28%) did not report a statement about conflicts of interest. A categorization of each full EE study by type of device, the purpose of the device, EU risk class and targeted pediatric group can be found in Table 1. The summary statistics of the descriptive characteristics of the studies Electronic Supplementary File 3.

Fig. 2
figure 2

Number of publications according to EU device risk class of the device assessed

Fig. 3
figure 3

Aggregated results of study quality of reporting by CHEERS item

Table 1 EE Studies by type of device assessed, purpose of device, EU risk class and targeted pediatric group. Medical Device Risk Classification according to the new EU Medical Device Regulation

Methodological approaches

Of the 39 studies, 25 were classified as Cost-Utility Analysis (CUA), 13 as Cost-Effectiveness Analysis (CEA) and 1 as Cost-Benefit Analysis (CBA). The majority of studies (N = 24, 62%) studies adopted an explicit decision-analytic modelling framework: 13 used Markov models, 9 used decision trees and 2 used a combination of decision tree analysis + Markov models.

Study perspectives varied widely across the studies. In 8 studies the study perspective was not explicitly stated. The perspective most adopted was the health system perspective/third-party payer (N = 16). Four studies addressed a governmental perspective, accounting for non-health sector costs, such as education costs. Seven studies adopted a societal perspective, wherein productivity costs borne by the family/patient were included along with the health system and non-health systems expenditures. A hospital perspective was adopted in three studies. Five studies adopted more than one perspective (health system perspective/third-party payer and societal).

Time horizon was reported in 33 (85%) studies. Almost half of the studies (N = 16, 41%) adopted a lifetime horizon. Twelve studies adopted a shorter timeframe (≤ 1 year).

Eight studies (21%) did not report any discount rate neither for future costs nor for future health outcomes, five of which had considered a time horizon less or equal to one year. In fifteen studies (38%), costs and outcomes were discounted at the same rate: 3% (N = 8), 3.5% (N = 3), 5% (N = 3) and 6% (N = 1).

Of the 25 CUA studies, only 7 measured health utilities as part of the EE, with parents, health care providers or representatives of the general population used as evaluator proxies. Health utilities were obtained directly either by applying direct preference elicitation approaches, namely the Time Trade-Off (TTO) approach and/or the Visual Analog Scale (VAS) in [27, 28] or indirectly by using multi-attribute utility instruments (MAUIs), specifically the Health Utility Index Mark II (HUI-II) in [29], the Health Utility Index Mark III (HUI-III) in [30], the Sintonen HRQOL-15D in [31]. One study [32] used two direct approaches (TTO, VAS) and one indirect approach (HUI-III) to mitigate possible selection or recruitment bias. When health utilities were not measured within the study (18 out of 25), they were obtained from previous literature (N = 14) or health care providers opinion (N = 2). Surprisingly, none of the studies used generic childhood multi-attribute health status classification instruments, such as the EQ-5D-Y [33] or the Child Health Utility 9D (CHU-9D) [34]. A detailed summary statistics of the methodological characteristics of the studies can be found in Electronic Supplementary File 5.

Quality of reporting assessment

CHEERS 2022 checklist results for assessing studies’ quality of reporting can be found in the Electronic Supplementary File 6. It can be observed that the CHEERS items less frequently reported were ‘Health economic analysis plan’, ‘study perspective’, ‘discount rate’, ‘Currency: price and conversion’, ‘analytic and assumptions’, ‘characterizing heterogeneity’, ‘characterizing distributional effects’, ‘effects of uncertainty’, ‘effects of engagement with patients’, ‘source of funding’ and ‘conflict of interest’. Figure 3 depicts the aggregated results of study quality of reporting by CHEERS item. In addition, results show that 19 studies fulfilled more than 75% of CHEERS items, of which 14 were published in the last ten years. None of the studies complied with the recently added items to the CHEERS 2022 checklist.

Discussion

This review aimed at identifying and reviewing existing literature of EE studies on medical devices used in pediatrics, examining their scope and methodological approaches employed, as well as assessing their quality of reporting. On the grounds that systematic reviews are the vehicle for providing information on what is known and where knowledge gaps exist, it can be concluded that there is a great deal yet to be learned on this topic.

The 39 articles meeting the criteria for inclusion show a slight increase in the number of publications in the recent years. Most studies were conducted within North American and European settings– in particular in US and UK– wherein conventional EE methods are well-established and/or formally used for guiding funding and reimbursement decisions of new health technologies [35, 36]. This highlights a clear gap in the literature for evidence that can be applied to low- and middle- income countries (LIMC), wherein the highest burden of pediatric disease lies [37].

Nearly 87% of the studies were published in clinical journals. This high percentage may be related to the lower publication standards for EE studies in clinical journals when compared with health economics journals, as argued in previous research [38]. Also, it may reflect the growing interest of the medical community in the results of the EEs to guide clinical adoption decisions.

The vast majority of studies focused on higher-risk (EU class III) therapeutic devices, in particular active implantable devices, such as cochlear implants. As devices increase in risk and complexity, approval requirements are more rigorous and thus more evidence regarding safety and therapeutic benefit is needed to be submitted to regulatory agencies. As a result, more EE studies are expected to be available for higher-risk devices. Also, while pediatric class IIb and class III devices involve a higher risk and are in general more costly, they also offer substantial therapeutic benefit to children and improvements in quality of life [40].

The perspective taken in an EE study provides a framework for analysis and determines what costs and outcomes to include and how to value them [41]. In our review, the study perspective was stated in more than 50% of the articles. In studies that adopt the societal perspective, ideally all types of costs should be considered, including indirect costs. Yet, of the 6 studies that stated that a societal perspective was used, only 3 included indirect costs (such as parents’ productivity losses). Moreover, because several child health conditions may require a delivery of care in non-medical settings such as the home, schools, and the community, identifying the impacts of resource consumption within these settings provides a more comprehensive assessment of the potential added value delivered by the use of the device, which could be used to inform societal resource allocation decision-making. For instance, cochlear implants in children have shown to result in substantial improvements in children education performance [42] or social participation [43]. Implicit in the discussion above, is the need to evaluate costs and consequences of the use of a device along a time horizon that extends over the child lifetime. Yet, only in nearly half of the included studies was a lifetime horizon considered.

Also, nearly 30% of the studies did not report the potential for any conflict of interest and around 36% of the studies did not declare the funding source. Missing details on these two important pieces of information may introduce bias, thereby hindering the credibility and transparency of the results reported in EE studies.

CUA was the type of EE analysis most often employed, representing 64% of all studies. This may reflect increasing attention to guidelines developed by several national HTA and reimbursement agencies [44,45,46], commonly favouring the use of CUA for capturing health outcomes in terms of QALYs. Yet, only in 7 of the 25 CUAs, health state utilities were prospectively measured, with proxies being used in all of them. These findings are not surprising, especially in light of the broadly discussed practical and methodological challenges on measuring health utilities in children, particularly in very young children and those with developmental limitations [25, 47,48,49]. The use of direct utility valuing approaches such as time trade-off (TTO) or standard gamble (SG) for assessing utility weights is not straightforward, as young children are unlikely to fully grasp the concept of time in a way that would allow them to trade risks against the time spent in different health states [50]. In these cases, parents can be used as proxy evaluators, yet their ability to report on more subjective outcomes, such as dimensions of quality of life related to their child’s mood or emotional state, is often disputed [51, 52]. In appreciation of both benefits and limitations of parent proxy and child self-reports, dyad approaches - including both parents and children - for assessing child’s health state have been proposed [53].

Interestingly, none of the studies used generic childhood multi-attribute utility instruments (MAUIs) - such as the EQ-5D-Y [33] or the Child Health Utility 9D (CHU-9D) [34]– as a means of quantifying child health state utilities for the calculation of QALYs within the context of a CUA. The lack of utilization of these instruments may be attributed to various reasons, including concerns about their psychometric performance and validation [54], limited use of these tools in clinical studies to generate data for EEs and HTA reports [54], issues about the appropriateness of existing value set utilities and methodology employed [55], and a concern on whether these tools capture all outcomes relevant to child health and well-being [56].

Within CUA studies, QALYs were the most frequent health outcome measured reported. QALYs provide a means of combining ‘the effects of health interventions on mortality and morbidity into a single index [57], allowing for far-reaching comparisons across multiple disease areas. Despite being routinely used as a standard criterion to evaluate new and innovative health interventions, the QALY approach has been debated in recent years [58,59,60]. An implicit theoretical assumption of the QALY approach is that QALYs are of equal social value, regardless of the characteristics of the recipient, such as their age or pre- or post-intervention health status. This ‘egalitarian’ nature of QALYs [61] may therefore penalize children in funding decisions, as budgets for childcare are not usually ‘ring-fenced’, with decisions on how to spend scarce health budgets typically spanning both adult and child interventions. Literature has shown that society tends to place a greater weight upon a QALY gained by a child than by an adult [62], fuelling the normative discussion of whether decision makers should consider the QALYs gained by children as deserving a special consideration compared to QALYs gained by adults [63]. In addition, the pediatric population is not homogeneous and is divided in several age groups (neonates, infants, adolescents, etc.), making the estimation of health state utilities very challenging.

Recent studies [64,65,66] have forewarned that, compared to other health technologies, medical devices require a more flexible and tailored approach to economic evaluation. Several methodological challenges have been identified and include the existence of a ‘learning curve effect’, broad organisational impacts, the continuous improvement and rapid incremental innovation; multiple cost components or high variations in pricing [67]. None of the studies measured the extent to which these devices’ distinctive characteristics had an impact on the cost-effectiveness results, let alone acknowledged as critical aspects to explicitly incorporate within an EE. Indeed, it could be suggested that these considerations were omitted in the reviewed EE studies, because of the presumed low impact on the ICER result. Yet, this would require a quantification of their impact, which was not provided within these studies. Although not all device specific characteristics may be applicable to every type of device [68], it is worth to discuss their pertinence in the context of pediatric devices and how can they be incorporated in future EEs.

Learning effects are commonly observed in surgical interventions of therapeutic implantable devices [69]. For instance, Varabyova et al. [70] measured the effect of device operator learning on two health outcomes: in-hospital mortality and hospital length of stay (LOS) for adult patients undergoing endovascular aneurysm repair (EVAR). The authors used Bayesian hierarchical regression models with random effects at the hospital level to estimate the learning curves. A substantial learning effect in EVAR in terms of the improvement in both mortality and LOS was observed. In the same study, a general methodological framework on how to integrate the effect of learning into an EE was proposed. This approach could be extended to the economic assessment of implantable devices routinely used in pediatrics, including cochlear implants, cardiac occulders, pacemakers, implantable cardioverter defibrillators (ICDs).

Moreover, most of devices are also often subject to incremental innovation [71] - product modifications aimed at easing the delivery of a procedure or convenience of use and/or increasing its performance in terms of health outcomes - examples being software upgrades or enhanced battery life. As incremental innovation is a continuous process [72], it makes it difficult to determine when the ‘improvements’ would actually take place and whether this would have an impact on the costs and/or outcomes of a given technology. In this case, consideration of post-market real world data could be useful to adjust initial assumptions with regard to cost-effectiveness results.

Organizational impact refers to the impact of the introduction of new devices mainly at the hospital or health provider level [73]. Heavy and large medical equipment, such as those used in diagnostic imaging technologies, such as computerized tomography [6] or magnetic resonance imaging (MRI) scanners, are associated with a substantial initial investment. Additionally, life-support devices, such as extracorporeal membrane oxygenation (ECMO) machines or continuous positive airway pressure (CPAP) devices, require special training for health care professionals and a redefinition of care pathways may be needed. To quantify potential impacts associated with the integration of a new equipment at a hospital level, modelling techniques, such as discrete event simulation (DES) could be used.

At a broader level, there is a need to go beyond the conventional EE approaches that only consider effectiveness or a health outcome as the unique measure for quantifying the value of a health technology. It has been recognized that these approaches do not to capture in a simultaneous and structured way all the relevant dimensions of value, such as wider innovation, patient convenience, equity aspects or the socioeconomic impact [74]. In the scope of child health, other aspects are deemed relevant to incorporate in an EE study, such as changes in parent/caregiver productivity and earnings, child educational attainment and future employment [75]. Also of importance is the need to collect the views and perspectives of those of are directly and indirectly impacted by the use of the technology. Increased stakeholder involvement in child health EE studies, including the children themselves, their parents and close family relatives can improve the real-world value and applicability of EE studies on child interventions. In response to the issues raised above, Multiple Criteria Decision Analysis (MCDA) has emerged as a reliable alternative or supplementary approach to traditional EE methods, with several studies supporting its use within HTA processes [76,77,78]. Framed within the field of decision analysis, MCDA offers a structured approach to understand the relative value of health technologies, by considering an explicit set of criteria under a fully transparent process, incorporating a wide range of stakeholder views and preferences [79]. Although MCDA holds promise in the context of HTA, a recent study [81] showed that there is still a need to develop research and clearer methodological guidelines to promote quality and scientific rigor in the use of MCDA in HTA.

This review presents a number of limitations that are worth to be discussed. First, this study only included published literature in peer-reviewed scientific journals and did not consider grey literature, which may have introduced some evidence selection bias. Second, despite having applied comprehensive search strategies to maximize search sensitivity we cannot exclude the possibility of having missed some potentially relevant studies, in particular given the scarcity of search filters focused on medical device interventions. Restricting our search to English-written publications may also have an impact on the results. Third, we did not consider for inclusion in this review partial EEs, which could have enabled a far-reaching understanding of the types of costs, outcomes and risks that are considered when evaluating devices in pediatrics. Yet, as partial EEs only describe the costs and consequences of alternatives alone, without comparing between them, these types of studies are seldom deemed appropriate for informing priority-setting and resource allocation decisions. Fourth, we used the CHEERS 2022 checklist to assess for the quality of reporting of the included studies. Despite being increasingly used to produce transparent and standardized quality assessment of EE studies, checklists are not without limitations [81]. As previous research has shown, completing checklists for appraising the quality of EEs can be difficult and highly subjective [82], potentially hindering the interpretation of the results obtained. Thus, it is possible that we may have underestimated or overestimated the reporting quality of the studies included in this review. Moreover, as the CHEERS checklist does not provide an official scoring or grading scheme (for instance, set cut-off points or a definition of categories for rating the quality of reporting), summing the number of criteria achieved was assumed a suitable approach to differentiate the reporting quality of the studies.

The EE studies included in our review may also be subject publication and outcome reporting biases, which can affect the validity of the study findings. Publication bias occurs when the publishing of research findings is influenced by the direction or strength of the evidence [83] and outcome reporting bias, on the other hand, occurs when only a subset of outcomes, typically those most favourable, are reported [84]. None of the studies included in this review mentioned or assessed the potential occurrence of these biases Given the unique challenges that pediatric populations present to controlled clinical trials, such as small sample sizes, reluctance to test interventions on children, difficulties obtaining informed consent, and limited funding for pediatric research clinical studies and EE studies conducted in pediatric populations may be particularly susceptible to publication and outcome reporting biases [85]. To minimize the potential for such biases, measures such as mandatory registration of all pediatric clinical studies at inception (including non-trial research), increased access to additional documentation on study protocols and methodology, publication of negative or non-significant results, or the use of publication checklists to ensure reporting standards have been met may be implemented [86].

Implications for research and policy

Building on the findings of this review, a number of opportunities can be drawn to improve current approaches to the economic evaluation of devices in pediatrics. There is an evident need go beyond conventional EE approaches and to advance in sound methods that can capture in a structured way all the relevant dimensions of value related to child health. To this end, more research should be developed in understanding how to effectively engage the children themselves and their parents, through innovative participatory approaches and novel preference elicitation methods, resulting in a better incorporation of child health realities and experiences. Also, efforts should be directed to advance in the understanding of device-specific characteristics and how these can be included into formal economic assessments. Moreover, it would be important to create specific methodological and reporting guidelines for conducting EEs on devices for pediatrics, and that could consider for different HTA decision contexts. Enhanced inclusion of experts in child health could provide a more meaningful assessment, especially in light of the lack of high-quality clinical evidence. On the policy domain, HTA agencies and organizations should enforce strict requirements on the submission of EE studies, namely on specifying how particular methodological challenges were dealt with, thereby increasing transparency and legitimacy in HTA decision-making processes.

Conclusion

Increasingly EE studies are used in the context of the allocation of scarce healthcare resources to inform decisions on the funding, reimbursement, and use of new and emerging health technologies. Determining the economic value of devices in the pediatric population is not a straightforward, as it comprises various challenges, from the ones posed by device-distinctive characteristics and impacts on users and organizations, to the ones associated with applying conventional economic evaluation methods, which are not well calibrated for children. Lack of adequate consideration of these aspects may affect the validity of reported cost-effectiveness estimates, which can lead to suboptimal decisions on the adoption of devices for children. Our study shows that more effort is needed to advance on methods that can adequately deal with these challenges so that allocation decisions maximize social welfare and achieve efficiency within health systems worldwide, where all members of society, particularly the more vulnerable ones can benefit.

Data availability

All data generated or analysed during this study are included in this published article and its supplementary information files.

References

  1. van den Heuvel R, Kapadia A, Stirling C, Zhou J. Medical devices 2030. KPMG Int. 2018.

  2. Humes HD, Westover AJ. Experience with Pediatric Medical device development. Front Pediatr. 2020;8:79.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Samuels-Reid JH, Blake ED. Pediatric medical devices: a look at significant US legislation to address unmet needs. Expert Rev Med Devices. 2014;11(2):169–74.

    Article  CAS  PubMed  Google Scholar 

  4. Ulrich LC, Joseph FD, Lewis DY, Koenig RL. FDA’s pediatric device consortia: national program fosters pediatric medical device development. Pediatrics. 2013;131(5):981–5.

    Article  PubMed  Google Scholar 

  5. Weber C. Solving Unmet needs with innovative Pediatric Medical devices. IEEE Pulse. 2021;12(1):24–7.

    Article  PubMed  Google Scholar 

  6. Section On C, Cardiac S, Section On O. Off-label use of Medical devices in Children. Pediatrics. 2017;139(1):e20163439.

    Article  Google Scholar 

  7. Breinholt JP, Nugent AW, Law MA, Justino H, Mullins CE, Ing FF. Stent fractures in congenital heart disease. Catheter Cardiovasc Interv. 2008;72(7):977–82.

    Article  PubMed  Google Scholar 

  8. Magee AG, Huggon IC, Seed PT, Qureshi SA, Tynan M. Transcatheter coil occlusion of the arterial duct: results of the European registry. Eur Heart J. 2001;22(19):1817–21.

    Article  CAS  PubMed  Google Scholar 

  9. McElhinney DB, Bergersen L, Marshall AC. In situ fracture of stents implanted for relief of pulmonary arterial stenosis in patients with congenitally malformed hearts. Cardiol Young. 2008;18(4):405–14.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Cecchin F, Atallah J, Walsh EP, Triedman JK, Alexander ME, Berul CI. Lead extraction in pediatric and congenital heart disease patients. Circulation: Arrhythmia Electrophysiol. 2010;3(5):437–44.

    Google Scholar 

  11. Espinoza J, Cooper K, Afari N, Shah P, Batchu S, Bar-Cohen Y. Innovation in Pediatric Medical devices: Proceedings from the West Coast Consortium for Technology & Innovation in Pediatrics 2019 Annual Stakeholder Summit. JMIR Biomed Eng. 2020;5(1):e17467.

    Article  Google Scholar 

  12. Castro H, Tringali M, Cleemput I, Devriese S, Leoni O, Lettieri E. Advancing MCDA and HTA into coverage decision-making. Multi-criteria decision analysis to support Healthcare decisions. Springer International Publishing; 2017. pp. 119–46.

  13. Drummond MF, Schupler MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. 4th Edition ed: Oxford University Press; 2015. 464 p.

  14. Denburg AE, Giacomini M, Ungar WJ, Abelson J. The problem is small enough, the problem is big enough’: a qualitative study of health technology assessment and public policy on drug funding decisions for children. Int J Equity Health. 2020;19(1):45.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Lamsal R, Zwicker JD. Economic evaluation of interventions for children with neurodevelopmental disorders: opportunities and challenges. Appl Health Econ Health Policy. 2017;15(6):763–72.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Ungar WJ, Gerber A. The Uniqueness of Child Health and Challenges to Measuring Costs and Consequences. Economic Evaluation in Child Health2009.

  17. Lipstein EA, Brinkman WB, Fiks AG, Hendrix KS, Kryworuchko J, Miller VA, et al. An emerging field of research: challenges in pediatric decision making. Med Decis Mak. 2015;35(3):403–8.

    Article  Google Scholar 

  18. Ungar WJ. Paediatric health economic evaluations: a world view. Healthc Q. 2007;10(1):134–40. 42– 5; discussion 45– 6.

    Article  Google Scholar 

  19. Migliore A. On the new regulation of medical devices in Europe. Expert Review of Medical Devices.

    Article  CAS  PubMed  Google Scholar 

  20. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ (Clinical Res ed). 2021;372:n71.

    Google Scholar 

  21. Ungar WJ, Santos MT. The Pediatric Economic database evaluation (PEDE) project: establishing a database to study trends in pediatric economic evaluation. Med Care. 2003;41(10):1142–52.

    Article  PubMed  Google Scholar 

  22. Ivlev I, Jablonsky J, Kneppo P. Multiple-criteria comparative analysis of magnetic resonance imaging systems. Int J Med Eng Inf. 2016;8(2):124–41.

    Article  Google Scholar 

  23. Broekhuizen H, Groothuis-Oudshoorn CGM, Hauber AB, Jansen JP, Ijzerman MJ. Estimating the value of medical treatments to patients using probabilistic multi criteria decision analysis standards, technology, and modeling. BMC Med Inf Decis Mak. 2015;15(1).

  24. Sung L, Stavros P, Ungar WJ. Measurement of Health utilities in Children. Economic Evaluation in Child Health. Oxford University Press; 2010. pp. 77–90.

  25. Thorrington D, Eames K. Measuring Health Utilities in Children and adolescents: a systematic review of the literature. PLoS ONE. 2015;10(8):e0135672.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement. Eur J Health Econ. 2013;14(3):367–72.

    Article  PubMed  Google Scholar 

  27. Summerfield AQ, Lovett RE, Bellenger H, Batten G. Estimates of the cost-effectiveness of pediatric bilateral cochlear implantation. Ear Hear. 2010;31(5):611–24.

    Article  PubMed  Google Scholar 

  28. Perez-Martin J, Artaso MA, Diez FJ. Cost-effectiveness of pediatric bilateral cochlear implantation in Spain. Laryngoscope. 2017;127(12):2866–72.

    Article  PubMed  Google Scholar 

  29. Brown KL, Wray J, Wood TL, Mc Mahon AM, Burch M, Cairns J. Cost utility evaluation of extracorporeal membrane oxygenation as a bridge to transplant for children with end-stage heart failure due to dilated cardiomyopathy. J Heart Lung Transpl. 2009;28(1):32–8.

    Article  Google Scholar 

  30. Barton GR, Stacey PC, Fortnum HM, Summerfield AQ. Hearing-impaired children in the United Kingdom, IV: cost-effectiveness of pediatric cochlear implantation. Ear Hear. 2006;27(5):575–88.

    Article  PubMed  Google Scholar 

  31. Carter R, Hailey D. Economic evaluation of the cochlear implant. Int J Technol Assess Health Care. 1999;15(3):520–30.

    Article  CAS  PubMed  Google Scholar 

  32. Cheng AK, Rubin HR, Powe NR, Mellon NK, Francis HW, Niparko JK. Cost-utility analysis of the cochlear implant in children. JAMA. 2000;284(7):850–6.

    Article  CAS  PubMed  Google Scholar 

  33. Wille N, Badia X, Bonsel G, Burström K, Cavrini G, Devlin N, et al. Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Quality of life research: an international journal of quality of life aspects of treatment. care Rehabilitation. 2010;19(6):875–86.

    Google Scholar 

  34. Stevens K. Developing a descriptive system for a new preference-based measure of health-related quality of life for children. Qual life Research: Int J Qual life Aspects Treat care Rehabilitation. 2009;18(8):1105–13.

    Article  Google Scholar 

  35. Angelis A, Lange A, Kanavos P. Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries. Eur J Health Econ. 2018;19(1):123–52.

    Article  PubMed  Google Scholar 

  36. Mathes T, Jacobs E, Morfeld JC, Pieper D. Methods of international health technology assessment agencies for economic evaluations–a comparative analysis. BMC Health Serv Res. 2013;13:371.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Liu L, Oza S, Hogan D, Chu Y, Perin J, Zhu J, et al. Global, regional, and national causes of under-5 mortality in 2000–15: an updated systematic analysis with implications for the Sustainable Development Goals. Lancet. 2016;388(10063):3027–35.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Jefferson T, Demicheli V, Vale L. Quality of systematic reviews of economic evaluations in health care. JAMA. 2002;287(21):2809–12.

    Article  PubMed  Google Scholar 

  39. Hwang TJ, Kesselheim AS, Bourgeois FT. Postmarketing trials and pediatric device approvals. Pediatrics. 2014;133(5):e1197–202.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Byford S, Raftery J. Perspectives in economic evaluation. BMJ (Clinical Res ed). 1998;316(7143):1529–30.

    Article  CAS  Google Scholar 

  41. Mukari SZ, Ling LN, Ghani HA. Educational performance of pediatric cochlear implant recipients in mainstream classes. Int J Pediatr Otorhinolaryngol. 2007;71(2):231–40.

    Article  PubMed  Google Scholar 

  42. Punch R, Hyde M. Social participation of children and adolescents with cochlear implants: a qualitative analysis of parent, teacher, and child interviews. J Deaf Stud Deaf Educ. 2011;16(4):474–93.

    Article  PubMed  Google Scholar 

  43. NICE (National Institute of Health and Care Excellence). NICE health technology evaluations - the manual. London: NICE; 2022.

    Google Scholar 

  44. PBAC (Pharmaceutical Benefits Advisory Committee). Guidelines for preparing a submissions to the Pharmaceutical Benefits Advisory Committee. Canberra: Health AGDo; 2016.

    Google Scholar 

  45. CADTH (Canadian Agency for Drugs and. Technologies in Health). Guidelines for the economic evaluation of health technologies. Ottawa: CADTH; 2017.

    Google Scholar 

  46. Petrou S. Methodological issues raised by preference-based approaches to measuring the health status of children. Health Econ. 2003;12(8):697–702.

    Article  PubMed  Google Scholar 

  47. Griebsch I, Coast J, Brown J. Quality-adjusted life-years lack quality in pediatric care: a critical review of published cost-utility studies in child health. Pediatrics. 2005;115(5):e600–14.

    Article  PubMed  Google Scholar 

  48. Keren R, Pati S, Feudtner C. The generation gap: differences between children and adults pertinent to economic evaluations of health interventions. PharmacoEconomics. 2004;22(2):71–81.

    Article  PubMed  Google Scholar 

  49. Boye KS, Matza LS, Feeny DH, Johnston JA, Bowman L, Jordan JB. Challenges to time trade-off utility assessment methods: When should you consider alternative approaches? 2014. p. 437– 50.

  50. Eiser C, Varni JW. Health-related quality of life and symptom reporting: similarities and differences between children and their parents. Eur J Pediatr. 2013;172(10):1299–304.

    Article  PubMed  Google Scholar 

  51. Prosser LA, Hammitt JK, Keren R. Measuring health preferences for use in cost-utility and cost-benefit analyses of interventions in children: theoretical and methodological considerations. PharmacoEconomics. 2007;25(9):713–26.

    Article  PubMed  Google Scholar 

  52. Ungar WJ, Boydell K, Dell S, Feldman BM, Marshall D, Willan A, et al. A parent-child dyad approach to the assessment of health status and health-related quality of life in children with asthma. PharmacoEconomics. 2012;30(8):697–712.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Rowen D, Keetharuth AD, Poku E, Wong R, Pennington B, Wailoo A. A review of the Psychometric performance of selected child and adolescent preference-based measures used to Produce Utilities for Child and Adolescent Health. Value Health: J Int Soc Pharmacoeconomics Outcomes Res. 2021;24(3):443–60.

    Article  Google Scholar 

  54. Hill H, Rowen D, Pennington B, Wong R, Wailoo A. A review of the methods used to Generate Utility values in NICE technology assessments for children and adolescents. Value Health: J Int Soc Pharmacoeconomics Outcomes Res. 2020;23(7):907–17.

    Article  Google Scholar 

  55. Stevens KJ. Working with children to develop dimensions for a preference-based, generic, pediatric, health-related quality-of-life measure. Qual Health Res. 2010;20(3):340–51.

    Article  PubMed  Google Scholar 

  56. Prosser LA, Hammitt JK, Keren R. Measuring Health preferences for Use in cost-utility and cost-benefit analyses of interventions in children. PharmacoEconomics. 2007;25(9):713–26.

    Article  PubMed  Google Scholar 

  57. Kind P, Lafata JE, Matuszewski K, Raisch D. The use of QALYs in clinical and patient decision-making: issues and prospects. Value Health. 2009;12:S27–30.

    Article  PubMed  Google Scholar 

  58. McGregor M, Caro JJ. QALYs: are they helpful to decision makers? PharmacoEconomics. 2006;24(10):947–52.

    Article  PubMed  Google Scholar 

  59. Pettitt D, Raza S, Naughton B, Roscoe A, Ramakrishnan A, Ali A et al. The limitations of QALY: a literature review. J Stem Cell Res Therapy. 2016;6(4).

  60. Asim O, Petrou S. Valuing a QALY: review of current controversies. Expert Rev PharmacoEcon Outcomes Res. 2005;5(6):667–9.

    Article  PubMed  Google Scholar 

  61. Culyer AJ. The morality of efficiency in health care—some uncomfortable implications. Health Econ. 1992;1(1):7–18.

    Article  CAS  PubMed  Google Scholar 

  62. Brazier J, Ratcliffe J, Salomon JA, Tsuchiya A. Measuring and valuing Health benefits for economic evaluation. Oxford University Press; 2007.

  63. Petrou S. Should Health gains by children be given the same value as Health gains by adults in an economic evaluation Framework? Economic Evaluation in Child Health. Oxford University Press; 2010.

  64. Kirisits A, Redekop WK. The economic evaluation of medical devices: challenges ahead. Appl Health Econ Health Policy. 2013;11(1):15–26.

    Article  PubMed  Google Scholar 

  65. Drummond M, Tarricone R, Torbica A. Economic evaluation of Medical devices. Oxford University Press; 2018.

  66. Tallarico S, Aloini D, Dulmin R, Lazzini S, Mininno V, Pellegrini L. Health Technology Assessment of medical devices. Overcoming the critical issues of current assessment. J Multi-Criteria Decis Anal. 2022;29(1–2):150–72.

    Article  Google Scholar 

  67. Tarricone R, Torbica A, Drummond M. Challenges in the Assessment of Medical devices: the MedtecHTA Project. Health Econ. 2017;26(Suppl 1):5–12.

    Article  PubMed  Google Scholar 

  68. Basu R, Eggington S. Intrinsic properties of medical devices: considerations for economic evaluation. Expert Rev Pharmacoecon Outcomes Res. 2019;19(6):619–26.

    Article  PubMed  Google Scholar 

  69. Govindarajulu US, Stillo M, Goldfarb D, Matheny ME, Resnic FS. Learning curve estimation in medical devices and procedures: hierarchical modeling. Stat Med. 2017;36(17):2764–85.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Varabyova Y, Blankart CR, Schreyögg J. The role of learning in Health Technology assessments: an empirical Assessment of Endovascular Aneurysm repairs in German hospitals. Health Econ (United Kingdom). 2017;26:93–108.

    Article  Google Scholar 

  71. Gelijns AC, Russo MJ, Hong KN, Brown LD, Ascheim DD, Moskowitz AJ. Dynamics of device innovation: implications for assessing value. Int J Technol Assess Health Care. 2013.

  72. Ciani O, Armeni P, Boscolo PR, Cavazza M, Jommi C, Tarricone R. De Innovatione: the concept of innovation for medical technologies and its implications for healthcare policy-making. Health Policy Technol. 2016;5(1):47–64.

    Article  Google Scholar 

  73. Tarricone R, Callea G, Ogorevc M, Prevolnik Rupel V. Improving the methods for the economic evaluation of Medical devices. Health Econ. 2017;26(Suppl 1):70–92.

    Article  PubMed  Google Scholar 

  74. Brouwer W, van Exel J, Baker R, Donaldson C. The new myth. PharmacoEconomics. 2008;26(1):1–4.

    Article  PubMed  Google Scholar 

  75. Ungar WJ, Prosser LA, Burnett HF. Values and evidence colliding: health technology assessment in child health. Expert Rev PharmacoEcon Outcomes Res. 2013;13(4):417–9.

    Article  PubMed  Google Scholar 

  76. Devlin NJ, Sussex J, Office of Health Economics. Incorporating multiple criteria in HTA: Methods and Processes. London; 2011.

  77. Marsh K, Lanitis T, Neasham D, Orfanos P, Caro J. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. PharmacoEconomics. 2014;32(4):345–65.

    Article  PubMed  Google Scholar 

  78. Thokala P, Duenas A. Multiple Criteria Decision Analysis for Health Technology Assessment. Value Health. 2012;15(8):1172–81.

    Article  PubMed  Google Scholar 

  79. Angelis A, Kanavos P. Multiple criteria decision analysis (MCDA) for evaluating new medicines in Health Technology Assessment and beyond: the Advance Value Framework. Soc Sci Med. 2017;188:137–56.

    Article  PubMed  Google Scholar 

  80. Oliveira MD, Mataloto I, Kanavos P. Multi-criteria decision analysis for health technology assessment: addressing methodological challenges to improve the state of the art. Eur J Health Econ. 2019;20(6):891–918.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Watts RD, Li IW. Use of checklists in Reviews of Health economic evaluations, 2010 to 2018. Value Health. 2019;22(3):377–82.

    Article  PubMed  Google Scholar 

  82. Walker DG, Wilson RF, Sharma R, Bridges J, Niessen L, Bass EB, et al. Best practices for conducting economic evaluations in Health Care: a systematic review of Quality Assessment Tools. Rockville: Agency for Healthcare Research and Quality (US); 2012.

    Google Scholar 

  83. Dickersin K, Min Y-I, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA. 1992;267(3):374–8.

    Article  CAS  PubMed  Google Scholar 

  84. Ayorinde AA, Williams I, Mannion R, Song F, Skrybant M, Lilford RJ, et al. Assessment of publication bias and outcome reporting bias in systematic reviews of health services and delivery research: a meta-epidemiological study. PLoS ONE. 2020;15(1):e0227580.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  85. Crockett LK, Okoli GN, Neilson CJ, Rabbani R, Abou-Setta AM, Klassen TP. Publication of Randomized clinical trials in Pediatric Research: a follow-up study. JAMA Netw open. 2018;1(1):e180156.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Bradley SH, DeVito NJ, Lloyd KE, Richards GC, Rombey T, Wayant C, et al. Reducing bias and improving transparency in medical research: a critical overview of the problems, progress and suggested next steps. J R Soc Med. 2020;113(11):433–43.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Funding

EM was financially supported under an individual PhD grant (reference: SFRH/BD/137955/2018) attributed by the Portuguese Foundation for Science and Technology (FCT) and in collaboration with the MEDI-VALUE FCT project (PTDC/EGE-OGE/29699/2017). MO contribution is made within the scope of the MEDI-VALUE FCT project (PTDC/EGE-OGE/29699/2017). The funding institutions had no role in the study design, data collection, data analysis, data interpretation, or writing of the report. All authors had full access to all the data and had final responsibility for the decision to submit the publication.

Author information

Authors and Affiliations

Authors

Contributions

EM conceptualised the review and conducted electronic database searches. EM reviewed titles and abstracts and conducted full-text screening to select the studies included in this review according to previously defined eligibility criteria. LSM validated the screening process. EM performed the data extraction and analysed the quality of reporting of the included studies using the Consolidated Health Evaluation Reporting Standards (CHEERS) checklist. LSM revised the data extraction form and the CHEERS checklist results. EM analysed the results and took the lead in writing the manuscript. MO and RF supervised the work. All authors contributed to discussing the findings and conclusions, reviewed the paper, and approved the final manuscript as submitted.

Corresponding author

Correspondence to Edgar Mascarenhas.

Ethics declarations

Ethics approval and consent to participate

Not applicable; literature-based research involving no human subjects, human material, or human data.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mascarenhas, E., Miguel, L.S., Oliveira, M. et al. Economic evaluations of medical devices in paediatrics: a systematic review and a quality appraisal of the literature. Cost Eff Resour Alloc 22, 33 (2024). https://doi.org/10.1186/s12962-024-00537-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12962-024-00537-0

Keywords