Abstract
Background
Breast, cervical and colorectal cancers are the three most frequent cancers in women, while lung, prostate and colorectal cancers are the most frequent in men. Much attention has been given to the economic evaluation of pharmaceuticals for treatment of cancer by the National Institute for Health and Care Excellence (NICE) in the UK and similar authorities internationally, while economic analysis developed for other types of anti-cancer interventions, including radiotherapy and surgery, are less common.
Objectives
Our objective was to review methods used in published cost-effectiveness studies evaluating radiotherapy for breast, cervical, colorectal, head and neck and prostate cancer, and to compare the economic evaluation methods applied with those defined in the guidelines used by the NICE technology appraisal programme.
Methods
A systematic search of seven databases (MEDLINE, EMBASE, CDSR, NHSEED, HTA, DARE, EconLit) as well as research registers, the NICE website and conference proceedings was conducted in July 2012. Only economic evaluations of radiotherapy interventions in individuals diagnosed with cancer that included quality-adjusted life-years (QALYs) or life-years (LYs) were included. Included studies were appraised on the basis of satisfying essential, preferred and UK-specific methods requirements, building on the NICE Reference Case for economic evaluations and on other methods guidelines.
Results
A total of 29 studies satisfied the inclusion criteria (breast 14, colorectal 2, prostate 10, cervical 0, head and neck 3). Only two studies were conducted in the UK (13 in the USA). Among essential methods criteria, the main issue was that only three (10 %) of the studies used clinical-effectiveness estimates identified through systematic review of the literature. Similarly, only eight (28 %) studies sourced health-related quality-of-life data directly from patients with the condition of interest. Other essential criteria (e.g. clear description of comparators, patient group indication and appropriate time horizon) were generally fulfilled, while most of the UK-specific requirements were not met.
Conclusion
Based on this review there is a dearth of up-to-date, robust evidence on the cost effectiveness of radiotherapy in cancer suitable to support decision making in the UK. Studies selected did not fully satisfy essential method standards currently recommended by NICE.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Few studies were found that examine the cost effectiveness of radiotherapy for breast, cervical, colorectal, head and neck and prostate cancer, and only two analyses were conducted in the UK. |
Additional, high-quality evidence is required to inform decision making on the effectiveness and cost-effectiveness of radiotherapy in cancer. |
Many recent publications identified in the review did not satisfy essential methods requirements. Forthcoming economic evaluations of radiotherapy in cancer should adhere to such requirements to better inform decision makers. |
1 Introduction
Economic evaluations are increasingly used to inform decisions about the efficient allocation of healthcare resources. To date, these methods have mainly been applied to evaluate pharmaceutical interventions. Less evidence is available for other types of intervention, such as medical devices, surgical techniques and public health interventions, and decision making in these cases appears more challenging [1, 2]. The National Institute for Health and Care Excellence (NICE) in the UK represents an independent organisation tasked with assessing the clinical and cost effectiveness of health technologies and, to date, has mainly focused on new pharmaceutical and biopharmaceutical products. However, the scope of their responsibilities continues to expand and now includes diagnostics, public health interventions and social care.
NICE has issued a Reference Case for cost effectiveness in technnology appraisal, which specifies the methods standards considered to be consistent with a UK National Health Service (NHS) objective of improving population health given limited resources and a fixed budget. An element that distinguishes NICE from most other agencies is the explicit statement of a cost-effectiveness threshold, in terms of cost per quality-adjusted life-year (QALY) gained (£20,000–30,000), to classify interventions as good value for money.
Cancer is a leading cause of morbidity and mortality worldwide. An estimated 12.7 million new cases of cancer were diagnosed worldwide in 2008, with 7.6 million cancer-specific deaths (around 13 % of all deaths) [3]. Breast, cervical and colorectal cancers are the three most frequent cancers in women, while lung, prostate and colorectal cancers are the most frequent in men [3]. Much attention has been given to the economic evaluation of pharmaceuticals for treatment of cancer by NICE and similar authorities internationally. This contrasts markedly with the level of economic analysis developed for other types of anti-cancer interventions, including radiotherapy and surgery. For example, of the 35 NICE appraisals of breast cancer interventions, 28 (80 %) were technology appraisals of pharmaceuticals and seven (20 %) were non-pharmaceuticals.
Originally undertaken to inform the UK Department of Health, the aim of this review was to assess the quality of published economic evaluation studies of radiotherapy in breast, cervical, prostate, head and neck and colorectal cancers. Critical assessment of the studies was in terms of their reporting and conduct, including whether or not they adhered to methods standards for economic evaluation. There was also an assessment of whether the studies would provide relevant evidence for decisions in a UK setting.
2 Methods
Five systematic literature reviews were undertaken of the published evidence on the economic evaluation of radiotherapy in breast, cervical, prostate, head and neck, or colorectal cancer in July 2012. To identify relevant evidence, the following databases were searched: MEDLINE, EMBASE, Cochrane Database of Systematic Reviews (CDSR), NHS Economic Evaluation Database (NHSEED), Health Technology Assessment (HTA), Database of Abstracts of Reviews of Effects (DARE), and EconLit. Additionally, the Cost-Effectiveness Analysis (CEA) registry (https://research.tufts-nemc.org/cear4/), the NICE website (www.nice.org.uk), recent conference proceedings and reference lists of the included studies and existing reviews were also searched (see Appendix 1, with breast cancer as an example).
Citations retrieved by the searches were filtered by title and abstract, and the full manuscripts were retrieved if they satisfied the inclusion criteria. Studies were included in the review if they assessed the cost effectiveness of a radiotherapy intervention in individuals with breast, colorectal, cervical, head and neck or prostate cancer, and presented results in the form of either an incremental cost per QALY gained or an incremental cost per life-year (LY) gained. No language, publication or date restrictions were applied to the searches. Evidence was reviewed by a single researcher (MB) in close consultation with another author (HW) and, where there was any uncertainty, the issues were discussed within the review team until a consensus was achieved.
A data extraction template was designed to include relevant information from the studies identified including setting, patient population, intervention and comparators, type of economic analysis (e.g. model-based vs. based on a clinical study) and results. Included studies were appraised on the basis of satisfying essential, preferred and UK-specific methods requirements. The checklist draws heavily on the NICE Reference Case for economic evaluations. In addition, it draws on the authors’ experience of undertaking economic evaluations, working with decision makers to use economic evaluations to inform decisions and authors’ knowledge of the published literature on checklists and methods guidelines issued by other decision-making organisations. The aim was to review the report and conduct of included economic evaluations, focusing on the quality of each study to inform decision making. As such, the checklist is concise and designed as a decision aid, clearly distinguishing where essential and preferred requirements are met, as explained below. Those methods standards for economic evaluation that are generally recommended as best practice for undertaking a high-quality study were considered as essential requirements, and include the following seven:
-
1.
Comparators clearly defined and justified: the study should provide a transparent and detailed description of the interventions considered, justifying the choice of comparators with relevance to, for example, clinical practice or best practice. For example NICE guidelines [4] state that, in order to define the decision problem “a definition and justification of the technologies being compared” (page 31) is needed. Similarly, the Canadian guidelines issued by the Canadian Agency for Drugs and Technologies in Health (CADTH) [5] state that “it is crucial to select the appropriate comparators for the analysis, as the choice will be important in determining the cost-effectiveness of the intervention” (page 16). Other guidelines, for example those of the Academy of Managed Care Pharmacy (AMCP) [6] in the USA and the Pharmaceutical Management Agency (PHARMAC) [7] in New Zealand, specify which comparator to use in the analysis (for example, “the treatment that most prescribers would replace in New Zealand,” page 8).
-
2.
Patient group/indication clearly described: a clear description of the characteristics of the patient group receiving the interventions should be provided. For example, NICE states that the decision problem is supported by “a definition and justification of the relevant patient group (s) to be treated” (page 31). Some guidelines (e.g. NICE, CADTH, those issued by the Pharmaceutical Benefits Advisory Committee [PBAC] [8] in Australia) also highlight the importance of defining potential subgroups.
-
3.
Effectiveness evidence based on a systematic review: evidence of a full literature search and, where appropriate, a synthesis of evidence on health effects informed by systematic review, are recommended by most economic guidelines (e.g. CADTH, PBAC, NICE, AMCP, the Healthcare Insurance Board (CVZ) [9] in the Netherlands). This ensures the data used represent all the relevant published evidence available at the time of the study, and helps to minimise bias. Data synthesis methods such as meta-analysis are recommended as appropriate. For example, the NICE reference case states that “evidence on outcomes should be obtained from a systematic review, defined as the systematic location, inclusion, appraisal and synthesis of evidence to obtain a reliable and valid overview of the data related to a clearly formulated question…. Synthesis of outcome data through meta-analysis is appropriate provided there are sufficient relevant and valid data that use measures of outcome that are comparable.”
-
4.
Data for measurement of health-related quality of life (HRQoL) reported directly by patients and/or carers: it is generally recommended (e.g. NICE, Spanish guidelines [10], PHARMAC) that information on changes in HRQoL should be reported directly by patients with the condition under analysis, or by their carers when it is not possible to obtain these data directly from patients. The NICE reference case states that the “measurement of changes in HRQL should be reported directly from patients.”
-
5.
Appropriate time horizon: the time horizon should be long enough to reflect all important differences in costs or outcomes between the interventions being compared. In the case of cancer, a lifetime horizon is typically the most appropriate, as the interventions could potentially have an effect on survival duration.
-
6.
Relevant one-way sensitivity analyses: this is necessary to capture the full range of uncertainty that is relevant for key (model) inputs. In some circumstances, alternative scenarios and worst/best cases should be considered. Essentially, all guidelines for economic evaluation recommend the use of at least a one-way sensitivity analysis for key uncertain parameters.
-
7.
Probabilistic sensitivity analysis (PSA) used to quantify full uncertainty: PSA is considered the most appropriate technique to analyse joint uncertainty in all parameters. Although only NICE recommends PSA for submissions, this is also encouraged by other agencies (AMCP, CADTH, CVZ).
Two methods features are more controversial but preferred for economic evaluation in many settings:
-
(1)
CEA using QALYs: although the use of a CEA based on QALYs is often stated as the preferred option to account for the impact of an intervention on HRQoL and survival duration using a consistent generic measure of outcome, this is not always seen as mandatory by all international agencies.
-
(2)
Preference data for valuation of HRQoL health states by a representative sample of the public: although some agencies (e.g. NICE, CADTH) recommend that the valuation of HRQoL should be based on the preferences of a representative sample of the general public, this is not always seen as mandatory, and valuation from patients, carers or health professionals are accepted alternatives by some agencies.
Finally, a secondary objective of the review was to assess the relevance of the studies identified from a UK decision-making perspective. The NICE Reference Case defines five areas of methods that can be considered specific to decision making in the NHS:
-
(1)
Comparators used in the UK NHS at the time each study was undertaken
-
(2)
Decision problem and analysis relating to a UK setting
-
(3)
Cost perspective of UK NHS and personal social services costs
-
(4)
Discount rate of 3.5 % per annum for costs and outcomes
-
(5)
Cost per QALY below the NICE threshold value (£20,000–30,000 per QALY).
The last point assesses if the intervention(s) analysed would be considered cost effective in the UK context
3 Results
3.1 Results of the Review
A flow diagram of the results of the searches is presented in Fig. 1. A total of 3,358 titles and abstracts were initially identified (breast 794, colorectal 623, prostate 707, cervical 325, head and neck 909). After excluding duplicates and studies that did not meet inclusion criteria, 116 full papers were retrieved (breast 18, colorectal 18, prostate 37, cervical 13, head and neck 30). Of these, 29 satisfied the inclusion criteria and were included in the review (breast 14 [11–24], colorectal 2 [25, 26], prostate 10 [11, 27–35], cervical 0, head and neck 3 [11, 29, 36]).
Of the studies, 13 (45 %) were undertaken in the USA, and only two (7 %) studies were set in the UK. A total of 14 (48 %) of the studies selected were published a decade or more before this review. Most analyses expressed cost effectiveness in terms of incremental costs per QALY. There was some variation in the interventions considered in the analyses (especially for breast and prostate cancer). Study characteristics and the main results for each study are presented in Table 1. To judge the relevance of these findings to the UK setting and to assess the quality of the studies included, the numbers of studies that met essential, preferred and UK-specific requirements were examined. Figure 2 illustrates findings for each study included.
3.2 Essential Requirements
Among the seven criteria that were defined as essential requirements, four were met in the majority of studies; these were comparators clearly defined, patient group/indication clearly defined, appropriate time horizon and relevant one-way sensitivity analyses. In 27 (93 %) of the studies, the interventions/comparators of the analysis were clearly defined. The two studies without a clear description of the interventions compared were both in prostate cancer (Neymark et al. [27] and Basu and Meltzer [31]). These studies focused on methods as opposed to generating results to inform decision making. As such, the failure to specify the options being compared can perhaps be understood.
The interventions compared could be grouped into eight broad categories: radiotherapy techniques in early-stage breast cancer patients following conserving surgery; post-mastectomy radiotherapy versus no radiotherapy in breast cancer patients; the comparison of alternative radiotherapy techniques in patients with breast cancer; radiotherapy options for colorectal cancer; radiotherapy versus surgery in early prostate cancer; different radiotherapy techniques in patients with prostate cancer; radiotherapy plus hormone therapies in locally advanced prostate cancer and palliative treatments; and comparison of radiotherapy techniques for head and neck cancer. Only in the methods paper by Basu and Meltzer [31] was there no clear description of the patient population (defined only as prostate cancer patients). In the other studies, patients’ general characteristics were reported, at least in terms of disease severity. Given the potential impact of radiotherapy on mortality risk, the most appropriate time horizon is likely to be patients’ lifetime. A long-term time horizon (longer than 10 years) was used in 23 (79 %) studies, while six (21 %) studies [12, 26, 31, 27, 32, 38] adopted a relatively short time horizon of between 1 and 8 years or did not clearly specify the time horizon of the analysis. Finally, one-way sensitivity analyses were conducted in the majority of studies (24 [83 %]), and the impact of variations in key parameters on cost-effectiveness results was reported.
Other accepted requirements for methods standards were not generally met. First, clinical data were obtained from a systematic review of the literature in only 3 of the 29 (10 %) studies (Hummel et al. [28] for prostate cancer; Konski and Watkins-Bruner [32] for both prostate and head and neck). In one study [15], data were obtained from a published meta-analysis; 13 studies (45 %) obtained clinical data from a single study (generally a clinical trial), while the remaining analyses were informed by data from various sources either selectively chosen by the authors or not fully described.
The data for measurement of HRQoL were reported directly by patients and/or carers in 5 of 26 studies (19 %). In three studies, HRQoL was not considered. In 7 of 26 (27 %) cases, data were taken from a mixture of patients’ and experts’ judgements. In the remaining 14 of 26 (54 %) cases, data were taken from previously published analyses and it was not possible to tell who was involved in the measurement task.
Finally, PSA was performed in only 10 of 29 studies. Six of the 19 studies without a PSA were conducted before 2001 when this technique was not commonly used, but the remaining 13 studies were published more recently.
3.3 Preferred Requirements
QALYs were used as the main outcome measure in 26 of 29 cases (90 %). The inclusion of HRQoL preference data valued by a representative sample of the public was rare, with only 3 of 26 (10 %) analyses [12, 25, 28] using these general population weights. In most cases (14 of 26, 54 %), little detail on sources of valuation of HRQoL data was provided and it is unclear whether these were taken from the general public.
3.4 UK-Specific Requirements
Only two studies were conducted in the UK (Hummel et al. [28] for prostate cancer and Prescott et al. [12] for breast cancer). Therefore, the UK NHS and personal social service costs and the UK setting were used in these analyses. Prescott et al. [12] adopted a 3.5 % per annum discount rate both for costs and for benefits while, in the Hummel et al. [12] study, the NICE discount rate of 6 % for costs and 1.5 % for benefits was used as they based their analysis on an earlier NICE Reference Case (2001). The majority of studies (24 of 29 [83 %]) used comparators relevant to the UK, even though they were not developed for UK decision makers specifically. Exceptions include studies by Lundqvist et al. [11] (both for prostate and for head and neck cancer) and Konski et al. [29] (who assessed the cost effectiveness of proton-pump therapy, which are not frequently used in the UK), and two studies on colorectal cancer [25, 26], which considered interventions whose use in the NHS currently varies widely.
As a number of the costs for the analyses were not undertaken using British pounds sterling, the currency for the cost-effectiveness estimates were converted using standard currency conversion exchange rates (year 2012). NICE’s cost-effectiveness threshold value was applied to the studies to assess the value for money on the interventions in the UK NHS. Incremental cost-effectiveness ratios were not inflated since the objective of the analysis was to assess whether these estimates were below the £20,000–30,000 threshold at the time of each study. The main intervention under analysis would be considered cost effective in 16 (55 %) studies using a £20,000 threshold and 19 (65 %) studies using a £30,000 threshold (Suh et al. [19], Konski et al. [35] and Lundqvist et al. [11] for prostate are those studies with cost-effectiveness ratios between £20,000 and £30,000). On the basis of the NICE threshold values, the following results could be synthesised: in the case of breast cancer, whole breast radiotherapy following breast conservation would be considered cost effective compared with no radiotherapy, but further studies are required to identify a very low-risk group of patients who derive minimal benefit and can, therefore, safely avoid radiotherapy. Post-mastectomy radiotherapy would be considered cost effective compared with no radiotherapy in patients at higher risk of recurrence. However, the definition of this level of risk is not clear. For colorectal cancer, preoperative radiotherapy followed by surgery compared with surgery alone would be considered cost effective. For prostate cancer, brachytherapy and 3-dimensional (3D) conformal radiation would be considered cost effective compared with traditional radiotherapy, but intensity-modulated radiotherapy would be cost effective compared with 3D conformal radiation; radiotherapy plus hormone therapy would be considered cost effective compared with radiotherapy alone in locally advanced patients; single or multi-fraction radiotherapy appears cost effective compared with palliative treatments (pain medication or chemotherapy) in hormone-refractory metastatic prostate cancer patients. Finally, for head and neck cancer, accelerated fractionated radiotherapy with concomitant boost, and hyper fractionated radiotherapy would be considered cost effective compared with standard fractionated radiotherapy in patients with local advanced disease.
4 Discussion
The objective of this review was to identify and summarise the evidence on the cost effectiveness of radiotherapy for various cancers, and to assess methods quality in those studies based on the NICE Reference Case. We observed substantial heterogeneity in the methods used. Overall, three key methods requirements considered essential for a good-quality evaluation (effectiveness evidence based on a systematic review, data for measurement of HRQoL reported directly by patients and/or carers, use of PSA to quantify the uncertainty) were generally not fulfilled. One of these criteria, the failure to use PSA or equivalent using individual-patient data from trials to characterise fully evidential and other forms of uncertainty, may reflect that a proportion of these studies was undertaken prior to the general use of these methods. Although there are also few examples in the later studies, it may be expected these methods will be more commonly used in the future.
The failure of a large proportion of studies (18 of 26 [69 %]) to source HRQoL measurements from patients probably reflects, in part, evidential weaknesses in the underlying clinical data being used by the economic evaluations in this review. In other words, when these studies were undertaken, few HRQoL data were collected in trials, particularly generic preference-based instruments suitable for estimating QALYs. More recently, methods to ‘map’ HRQoL weights from disease-specific instruments or clinical measures have been developed (Hernàndez Alava et al. [36]), and it may be expected they will be used in future studies where there are no direct estimates of suitable HRQoL weights. Where HRQoL weights are not available to estimate QALYs, use of high-quality mapping strategies can provide an informative approach to address the gap [43].
Arguably the most concerning method limitation is the failure of most studies (26 of 29 [90 %]) to incorporate the full extent of the available evidence on clinical effectiveness into economic analyses using systematic review. A general principle of evidence-based medicine, as well as economic evaluation, is not to be selective with evidence. However, in the review, many studies (12 of 29 [41 %]) used a single source of clinical-effectiveness evidence such as a randomised trial. It is possible that single clinical studies represent the only clinical evidence available in some cases, but this was not discussed explicitly in the papers. Where more than one clinical study has been identified through a systematic review, evidence on effectiveness for economic evaluation should be synthesised using, for example, meta-analysis. At the very least, a range of scenarios should be considered in the economic analysis using those different sources of clinical evidence. However, in this review, a minority of studies used meta-analysis or scenario analysis to bring in a fuller range of clinical evidence.
In terms of relevance for UK decision makers, only two studies were conducted in the UK and fully met the NICE UK-specific requirements. It is difficult to judge the relevance of the results of studies conducted in other jurisdictions, especially due to differences in clinical practice and sometimes in methods criteria specified by reimbursement and pricing agencies. Although most studies included interventions that were relevant to UK clinical practice at the time of publication, they might be dated due to improvements in clinical techniques and less important for current policy making. Radiotherapy techniques used in the cancer areas investigated have evolved rapidly over the last decade and many newer techniques are currently being evaluated in clinical trials. In addition, the clinical evidence in many of the studies is old and a number of new trials describing novel radiotherapy interventions have been reported, or are currently ongoing (e.g. CRO7 trial, SUPREMO trial, TARGIT-A trial, Warde et al. [37–40]).
Essential and preferred methods requirements were mainly taken from the NICE Reference Case, supported by other guidelines (e.g. AMCP, CADTH, PBAC). NICE represents an oft-cited independent, centralised authority where decision making is informed by CEA. A strength of NICE is the provision of an explicit cost-effectiveness threshold to judge the value for money of the intervention considered. Another point that is not explicitly defined in the NICE Reference Case but is of considerable importance is the impact of heterogeneity in the cost effectiveness of treatments across different subgroups of patients. In the case of cancer, the identification of specific types of patients in whom radiotherapy is cost effective appears a key issue. For example, in the case of breast cancer, an on-going meta-analysis by the Early Breast Cancer Trialists’ Collaborative Group (EBCTCG) [41] of over 10,000 women treated in clinical trials with and without radiotherapy, has shown that, overall, breast radiotherapy reduces any cancer recurrence by 50 % [38]. However, although the relative advantage for breast radiotherapy is constant, the absolute benefit for individuals varies depending on their risk of recurrence and this, in turn, drives the cost effectiveness of radiotherapy in these patients. It is likely that, in a very low-risk group of patients, radiotherapy would not be cost effective. The same can be stated of prostate cancer, in which the relative merits of radiotherapy versus watchful waiting for low-risk disease has not been tested but is unlikely to demonstrate improvements in disease-specific survival up to 10 years of follow-up, since a comparison of radical prostatectomy and watchful waiting has shown no survival benefit [42].
In conclusion, based on this review, there is a dearth of up-to-date, robust evidence on the effectiveness and cost effectiveness of radiotherapy in cancer. The number of published economic evaluations of radiotherapy using QALYs or LYs saved appears quite low. For example, only two studies were found for colorectal cancer, three for head and neck cancer and none for cervical cancer. Some essential methodological standards were generally not met, especially in the identification of the clinical evidence. Consequently, the full uncertainty associated with the clinical benefits of the interventions was rarely captured. Finally, few of the studies were based in the UK, and international costs of interventions and healthcare use do not generally transfer to the UK. As new, relevant evidence becomes available, additional cost-effectiveness evaluations should be undertaken to inform decision makers for current and future clinical practice in this important area.
References
Trueman P, Anokye NK. Applying economic evaluation to public health interventions: the case of interventions to promote physical activity. J Public Health. 2013;35(1):32–9.
Sorenson C, Tarricone R, Siebert M, Drummond M. Applying health economics for policy decision making: do devices differ from drugs? Europace. 2011;13(Suppl 2):54–8.
GLOBOCAN 2008. Estimated cancer incidence, mortality, prevalence and disability-adjusted life years (DALYs). www.globocan.iarc.fr. Accessed 06 May 2013.
National Institute for Health and Clinical Excellence (NICE). Guide to the Methods of Technology Appraisals (June 2008). http://www.nice.org.uk/media/B52/A7/TAMethodsGuideUpdatedJune2008.pdf.
Canadian Agency for Drugs and Technologies in Health (CADTH). Guidelines for the Economic Evaluation of Health Technologies: Canada (3rd Edition, 2006). http://www.ispor.org/peguidelines/source/HTAGuidelinesfortheEconomicEvaluationofHealthTechnologies-Canada.pdf.
Academy of managed care pharmacy. The AMCP Format for Formulary Submissions (Version 3.0, October 2009). http://www.amcp.org/data/jmcp/1007_121%2019%2009(3).pdf.
PHARMAC (Pharmaceutical Management Agency). Prescription for Pharmacoeconomic Analysis: Methods for Cost-utility Analysis (May 2007). http://www.pharmac.health.nz/assets/pfpa-final.pdf.
Pharmaceutical Benefits Advisory Committee, Department of Health and Ageing, Australian Government. Guidelines for Preparing Submissions to the Pharmaceutical Benefits Advisory Committee (December 2008). http://www.ispor.org/peguidelines/source/Australia-Guidelines-for-preparing-submissions-to-the-Pharmaceutical-Benefits-Advisory-Committee-2008.pdf.
The Health Care Insurance Board (CVZ). Guidelines for Pharmacoeconomic Research in the Netherlands (April 2006). http://www.ispor.org/peguidelines/source/PE_guidelines_english_Netherlands.pdf.
Lopez-Bastida J, Oliva J, Antonanzas F, et al. Spanish recommendations on economic evaluation of health technologies. Eur J Health Econ. 2010;11(5):513–20.
Lundkvist J, Ekman M, Ericsson SR, Jonsson B, Glimelius B. Proton therapy of cancer: potential clinical advantages and cost-effectiveness. Acta Oncol. 2005;44(8):850–61.
Prescott RJ, Kunkler IH, Williams LJ, King CC, Jack W, van der Pol M, et al. A randomised controlled trial of postoperative radiotherapy following breast-conserving surgery in a minimum-risk older population. The PRIME trial. Health Technol Assess. 2007;11(31):1–149.
Hayman JA, Hillner BE, Harris JR, Weeks JC. Cost-effectiveness of routine radiation therapy following conservative surgery for early-stage breast cancer. J Clin Oncol. 1998;16(3):1022–9.
Hayman JA, Lash KA, Tao ML, Halman MA. A comparison of two methods for estimating the technical costs of external beam radiation therapy. Int J Radiat Oncol Biol Phys. 2000;47(2):461–7.
Lee JH, Glick HA, Hayman JA, Solin LJ. Decision-analytic model and cost-effectiveness evaluation of postmastectomy radiation therapy in high-risk premenopausal breast cancer patients. J Clin Oncol. 2002;20(11):2713–25.
Marks LB, Hardenbergh PH, Winer ET, Prosnitz LR. Assessing the cost-effectiveness of postmastectomy radiation therapy. Int J Radiat Oncol Biol Phys. 1999;44(1):91–8.
Patrice JR, Patrice SJ, Hayman JA, Steinberg JS, Taghian AG. Cost-effectiveness of routine radiation therapy when added to tamoxifen following conservative surgery in older women with early-stage breast cancer. Int J Radiat Oncol Biol Phys. 2007;69(3):S91–2.
Sher DJ, Wittenberg E, Suh WW, Taghian AG, Punglia RS. Partial-breast irradiation versus whole-breast irradiation for early-stage breast cancer: a cost-effectiveness analysis. Int J Radiat Oncol Biol Phys. 2009;74(2):440–6.
Suh WW, Hillner BE, Pierce LJ, Hayman JA. Cost-effectiveness of radiation therapy following conservative surgery for ductal carcinoma in situ of the breast. Int J Radiat Oncol Biol Phys. 2005;61(4):1054–61.
Dunscombe P, Samant R, Roberts G. A cost-outcome analysis of adjuvant postmastectomy locoregional radiotherapy in premenopausal node-positive breast cancer patients. Int J Radiat Oncol Biol Phys. 2000;48(4):977–82.
Samant RS, Dunscombe P, Roberts G. A cost-outcome analysis of adjuvant postmastectomy locoregional radiotherapy in high-risk postmenopausals breast cancer patients. Int J Radiat Oncol Biol Phys. 2001;50(5):1376.
Alvegard TA, Borg S, Ferras-Nunez J, Franzen S, Genell A, Malmstrom PO, et al. The cost-effectiveness of post-operative radiotherapy after breast conservation surgery in stage I–II breast cancer in Sweden. J Clin Oncol. 2005;23(16):79S.
Liljegren G, Karlsson G, Bergh J, Holmberg L. The cost-effectiveness of routine postoperative radiotherapy after sector resection and axillary dissection for breast cancer stage I. Results from a randomized trial. Ann Oncol. 1997;8(8):757–63.
Lievens Y, Kesteloot K, van den Bogaert W. Economic consequence of local control with radiotherapy: cost analysis of internal mammary and medial supraclavicular lymph node radiotherapy in breast cancer. Int J Radiat Oncol Biol Phys. 2005;63(4):1122–31.
van den Brink M, van den Hout WB, Stiggelbout AM, Klein KE, Marijnen CA, van de Velde CJ, et al. Cost-utility analysis of preoperative radiotherapy in patients with rectal cancer undergoing total mesorectal excision: a study of the Dutch Colorectal Cancer Group. J Clin Oncol. 2004;22(2):244–53.
Dahlberg M, Stenborg A, Pahlman L, Glimelius B. Swedish Rectal CT. Cost-effectiveness of preoperative radiotherapy in rectal cancer: results from the Swedish Rectal Cancer Trial. Int J Radiat Oncol Biol Phys. 2002;54(3):654–60.
Neymark N, Adriaenssen I, Gorlia T, Caleo S, Bolla M, Neymark N, et al. Estimating survival gain for economic evaluations with survival time as principal endpoint: a cost-effectiveness analysis of adding early hormonal therapy to radiotherapy in patients with locally advanced prostate cancer. Health Econ. 2002;11(3):233–48.
Hummel S, Paisley S, Morgan A, Currie E, Brewer N. Clinical and cost-effectiveness of new and emerging technologies for early localised prostate cancer: a systematic review. Health Technol Assess. 2003;7(33):1–157.
Konski A, Speier W, Hanlon A, Beck JR, Pollack A, Konski A, et al. Is proton beam therapy cost effective in the treatment of adenocarcinoma of the prostate? J Clin Oncol. 2007;25(24):3603–8.
Samant RS, Dunscombe PB, Roberts GH, Samant RS, Dunscombe PB, Roberts GH. A cost-outcome analysis of long-term adjuvant goserelin in addition to radiotherapy for locally advanced prostate cancer. Urol Oncol. 2003;21(3):171–7.
Basu A, Meltzer D. Implications of spillover effects within family for medical cost-effectiveness analysis. J Health Econ. 2005;24(4):751–73.
Konski A, Watkins-Bruner D. The RTOG outcomes model: economic end points and measures. Expert Opin Pharmacother. 2004;5(3):513–9.
Konski A, Konski A. Cost-effectiveness of intensity-modulated radiation therapy. Expert Rev Pharmacoecon Outcomes Res. 2005;5(2):137–40.
Konski A, Sherman E, Krahn M, Bremner K, Beck JR, Watkins-Bruner D, et al. Economic analysis of a phase III clinical trial evaluating the addition of total androgen suppression to radiation versus radiation alone for locally advanced prostate cancer (Radiation Therapy Oncology Group protocol 86-10). Int J Radiat Oncol Biol Phys. 2005;63(3):788–94.
Konski A, Watkins-Bruner D, Feigenberg S, Hanlon A, Kulkarni S, Beck JR, et al. Using decision analysis to determine the cost-effectiveness of intensity-modulated radiation therapy in the treatment of intermediate risk prostate cancer. Int J Radiat Oncol Biol Phys. 2006;66(2):408–15.
Hernàndez Alava M, Wailoo A, Wolfe F, Michaud K. A comparison of direct and indirect methods for the estimatio of health utilities from clinical outcomes. HEDS Discussion paper, No 12.12; 2012.
Higgins KM. What treatment for early-stage glottic carcinoma among adult patients: CO2 endolaryngeal laser excision versus standard fractionated external beam radiation is superior in terms of cost utility? Laryngoscope. 2011;121(1):116–34.
Kunkler IH, Canney P, Dunlop J, Anderson N, Aird E, Denvir M, et al. MRC supremo (Selected use of postoperative radiotherapy after mastectomy) (Big 2-04/EORTC 22051)- A Phase III multicentre international randomised trial assessing the role of adjuvant chest wall irradiation in ‘intermediate risk’ operable breast cancer following mastectomy and axillary surgery. Annals of Oncology Conference: IMPAKT Breast Cancer Conference Brussels Belgium Conference Start: 20090507 Conference End: 20090509 Conference Publication: (var pagings) 2009;20(pp ii28).
Vaidya JS, Joseph DJ, Tobias JS, Bulsara M, Wenz F, Saunders C, et al. Targeted intraoperative radiotherapy versus whole breast radiotherapy for breast cancer (TARGIT-A trial): an international, prospective, randomised, non-inferiority phase 3 trial. Lancet. 2010;376(9735):91–102.
Warde P, Mason M, Ding K, Kirkbride P, Brundage M, Cowan R, et al. NCIC CTG PR.3/MRC UK PR07 investigators. Combined androgen deprivation therapy and radiation therapy for locally advanced prostate cancer: a randomised, phase 3 trial. Lancet. 2011;378(9809):2104–11.
Early Breast Cancer Trialists’ Collaborative Group. Comparisons between different polychemotherapy regimens for early breast cancer: meta analyses of long-term outcome among 100,000 women in 123 randomised trials. Lancet. 2012;379:432–44.
Wilt TJ, Brawer MK, Jones KM, Barry MJ, Aronson WJ, Fox S, et al. Prostate Cancer. Intervention versus Observation Trial (PIVOT) Study Group. Radical prostatectomy versus observation for localized prostate cancer. N Engl J Med. 2012;367(3):203–13.
Longworth L, Rowen D. Mapping to obtain EQ-5D utility values for use in NICE Health Technology Appraisals. Value Health. 2013;16(1):202–10.
Acknowledgment/funder:
The research described in this article was funded by the Department of Health in England under the Policy Research Unit in Economic Evaluation of Health and Care Intervention (EEPRU) based at the University of York and the University of Sheffield. The views expressed are not necessarily those of the Department. The sponsors had no involvement in the analysis or interpretation of the data or findings presented here or the decision to submit the article for publication. We are grateful to our clinical advisors, who provided excellent input along the different stages of the research.
Conflict of Interest
The authors have no conflicts of interest to declare
Authors’ contributions to the paper
M. Barbieri is the lead author of the paper and the reviewer of all the articles included in the systematic review. H. Weatherly contributed in the preparation of the manuscript and was involved in the review for discussion of included/excluded papers. R. Ara, H. Basarir and M. Sculpher were involved in the preparation of the manuscript and in the discussion of the main issues of the review. R. Adams, H. Ahmed, C. Coles, T. Guerrero-Urbano, C. Nutting, and M. Powell provided clinical expertise in the different areas of cancer care. M. Barbieri is the guarantor for the overall content of the study.
Author information
Authors and Affiliations
Corresponding author
Appendix 1: Search strategy for breast cancer
Appendix 1: Search strategy for breast cancer
BREAST CANCER: RADIOTHERAPY
MEDLINE® In-Process & Other Non-Indexed Citations and MEDLINE®: Ovid. 1946 to March Week 3 2012
4th April 2012
————————————————————
-
1.
exp Breast Neoplasms/
-
2.
((breast$ or mamma$) adj25 (tumo?r$ or carcinoma$ or adenocarcinoma$ or sarcoma$ or oncolog$ or cancer$ or neoplas$ or malignan$ or metastasis or polyp$ or lesion$ or growth$)).tw.
-
3.
exp BREAST/
-
4.
(tumo?r$ or carcinoma$ or adenocarcinoma$ or sarcoma$ or oncolog$ or cancer$ or neoplas$ or malignan$ or metastasis or metastases or polyp$ or lesion$ or growth$).tw.
-
5.
3 and 4
-
6.
(breast adj mass).tw.
-
7.
(cystosarcoma adj phylloides).tw.
-
8.
(intraductal adj carcinoma).tw.
-
9.
(paget adj nipple adj disease).tw.
-
10.
or/1–2,5–9
-
11.
exp Radiotherapy/
-
12.
radiotherap$.tw.
-
13.
(radiation adj3 (therap$ or treatment$)).tw.
-
14.
(radioimmunotherap$ or rit).tw.
-
15.
Brachytherapy/
-
16.
brachytherap$.tw.
-
17.
3d-crt.tw.
-
18.
imrt.tw.
-
19.
igrt.tw.
-
20.
tomotherap$.tw.
-
21.
radiosurger$.tw.
-
22.
srs.tw.
-
23.
sbrt.tw.
-
24.
iort.tw.
-
25.
scprt.tw.
-
26.
exp Chemoradiotherapy/
-
27.
chemoradiotherap$.tw.
-
28.
chemo-radiotherap$.tw.
-
29.
ccrt.tw.
-
30.
or/11–29
-
31.
10 and 30
-
32.
exp “Costs and Cost Analysis”/
-
33.
Economics/
-
34.
exp economics, hospital/
-
35.
exp economics, medical/
-
36.
exp economics, dental/
-
37.
Economics, nursing/
-
38.
exp Models, Economic/
-
39.
Economics, Pharmaceutical/
-
40.
exp “Fees and Charges”/
-
41.
exp Budgets/
-
42.
budget$.tw.
-
43.
ec.fs.
-
44.
cost$.ti.
-
45.
(cost$ adj2 (effective$ or utilit$ or benefit$ or minimi$)).ab.
-
46.
(economic$ or pharmacoeconomic$ or pharmaco-economic$).ti.
-
47.
(price$ or pricing$).tw.
-
48.
(financial or finance or finances or financed).tw.
-
49.
(fee or fees).tw.
-
50.
(value adj2 (money or monetary)).tw.
-
51.
quality-adjusted life years/
-
52.
(qaly or qalys).af.
-
53.
(quality adjusted life year or quality adjusted life years).af.
-
54.
or/32–53
-
55.
letter.pt.
-
56.
editorial.pt.
-
57.
historical article.pt.
-
58.
or/55–57
-
59.
54 not 58
-
60.
Animals/
-
61.
Humans/
-
62.
60 and 61
-
63.
60 not 62
-
64.
59 not 63
-
65.
31 and 64
Embase: Ovid. 1974 to 2012 April 03
4th April 2012
————————————————————
-
1.
exp breast tumor/
-
2.
((breast$ or mamma$) adj25 (tumo?r$ or carcinoma$ or adenocarcinoma$ or sarcoma$ or oncolog$ or cancer$ or neoplas$ or malignan$ or metastasis or polyp$ or lesion$ or growth$)).tw.
-
3.
exp breast/
-
4.
(tumo?r$ or carcinoma$ or adenocarcinoma$ or sarcoma$ or oncolog$ or cancer$ or neoplas$ or malignan$ or metastasis or metastases or polyp$ or lesion$ or growth$).tw.
-
5.
3 and 4
-
6.
(breast adj mass).tw.
-
7.
(cystosarcoma adj phylloides).tw.
-
8.
(intraductal adj carcinoma).tw.
-
9.
(paget adj nipple adj disease).tw.
-
10.
or/1–2,5–8
-
11.
exp radiotherapy/
-
12.
exp radiotherapy/
-
13.
radiotherap$.tw.
-
14.
(radiation adj3 (therap$ or treatment$)).tw.
-
15.
(radioimmunotherap$ or rit).tw.
-
16.
brachytherapy/
-
17.
brachytherap$.tw.
-
18.
3d-crt.tw.
-
19.
imrt.tw.
-
20.
igrt.tw.
-
21.
tomotherap$.tw.
-
22.
radiosurger$.tw.
-
23.
srs.tw.
-
24.
sbrt.tw.
-
25.
iort.tw.
-
26.
scprt.tw.
-
27.
exp chemoradiotherapy/
-
28.
chemoradiotherap$.tw.
-
29.
chemo-radiotherap$.tw.
-
30.
ccrt.tw.
-
31.
tomotherapy/
-
32.
exp radiosurgery/
-
33.
or/11–32
-
34.
10 and 33
-
35.
“cost benefit analysis”/
-
36.
“cost-effectiveness analysis”/
-
37.
economics/
-
38.
health economics/
-
39.
pharmacoeconomics/
-
40.
fee/
-
41.
budget/
-
42.
budget$.tw.
-
43.
cost$.ti.
-
44.
(cost$ adj2 (effective$ or utilit$ or benefit$ or minimi$)).ab.
-
45.
(economic$ or pharmacoeconomic$ or pharmaco-economic$).ti.
-
46.
(price$ or pricing$).tw.
-
47.
(financial or finance or finances or financed).tw.
-
48.
(fee or fees).tw.
-
49.
(value adj2 (money or monetary)).tw.
-
50.
health care quality/
-
51.
quality adjusted life year/
-
52.
(qal or qalys).tw.
-
53.
(quality adjusted life year or quality adjusted life years).tw.
-
54.
or/35–53
-
55.
letter.pt.
-
56.
editorial.pt.
-
57.
historical article.pt.
-
58.
or/55–57
-
59.
54 not 58
-
60.
animals/
-
61.
humans/
-
62.
60 and 61
-
63.
60 not 62
-
64.
59 not 63
-
65.
34 and 64
Cochrane Database of Systematic Reviews (CDR): Wiley Interscience. 1996-present
NHS Economic Evaluation Database (NHS EED): Wiley Interscience. 1995-present
Health Technology Assessment Database (HTA): Wiley Interscience. 1995-present
Database of Abstracts of Reviews of Effects (DARE)): Wiley Interscience. 1995-present
10th April 2012
————————————————————
- ID:
-
Search
- #1:
-
MeSH descriptor Breast Neoplasms explode all trees
- #2:
-
(breast* OR mamma*):ti,ab,kw
- #3:
-
MeSH descriptor Breast explode all trees
- #4:
-
(#2 OR #3)
- #5:
-
(tumor* or tumour* or carcinoma* or adenocarcinoma* or sarcoma* or oncolog* or cancer* or neoplas* or malignan* or metastasis or metastases or polyp* or lesion* or growth*):ti,ab,kw
- #6:
-
(#4 AND #5)
- #7:
-
(breast mass):ti,ab,kw
- #8:
-
(cystosarcoma phylloides):ti,ab,kw
- #9:
-
(intraductal carcinoma):ti,ab,kw
- #10:
-
(paget nipple disease):ti,ab,kw
- #11:
-
(#1 OR #6 OR #7 OR #9 OR #10)
- #12:
-
MeSH descriptor Radiotherapy explode all trees
- #13:
-
(radiotherap*):ti,ab,kw
- #14:
-
(radiation therap*):ti,ab,kw
- #15:
-
(radiation treatment*):ti,ab,kw
- #16:
-
(radioimmunotherap* or rit):ti,ab,kw
- #17:
-
MeSH descriptor Brachytherapy explode all trees
- #18:
-
(brachytherap*):ti,ab,kw
- #19:
-
(3d-crt or imrt or igrt or tomotherap* or radiosurger* or srs or sbrt or iort or scprt):ti,ab,kw
- #20:
-
MeSH descriptor Chemoradiotherapy explode all trees
- #21:
-
(chemoradiotherap* or chemo-radiotherap* or ccrt):ti,ab,kw
- #22:
-
(#12 OR #13 OR #14 OR #15 OR #16 OR #17 OR #18 OR #19 OR #20 OR #21)
- #23:
-
(#11 AND #22)
EconLit: Ovid. 1961 to February 2012
4th April 2012
————————————————————
-
1.
((breast$ or mamma$) adj25 (tumo?r$ or carcinoma$ or adenocarcinoma$ or sarcoma$ or oncolog$ or cancer$ or neoplas$ or malignan$ or metastasis or polyp$ or lesion$ or growth$)).tw.
-
2.
(breast adj mass).tw.
-
3.
(cystosarcoma adj phylloides).tw.
-
4.
(intraductal adj carcinoma).tw.
-
5.
(paget adj nipple adj disease).tw.
-
6.
or/1–5
-
7.
radiotherap$.tw.
-
8.
(radiation adj3 (therap$ or treatment$)).tw.
-
9.
(radioimmunotherap$ or rit).tw.
-
10.
brachytherap$.tw.
-
11.
3d-crt.tw.
-
12.
imrt.tw.
-
13.
igrt.tw.
-
14.
tomotherap$.tw.
-
15.
radiosurger$.tw.
-
16.
srs.tw.
-
17.
sbrt.tw.
-
18.
iort.tw.
-
19.
scprt.tw.
-
20.
chemoradiotherap$.tw.
-
21.
chemo-radiotherap$.tw.
-
22.
ccrt.tw.
-
23.
or/7–22
-
24.
6 and 23
Conference Proceedings Index (CPI): Web of Science. 1990-present
10th April 2012
————————————————————
-
#9. #8 AND #7
-
#8. TS=(economics or pharmacoeconomics or fee or budget* or cost* or pharmaco-economics or price* or pricing* or financial or finance or finances or financed or fee or fees or value money or value monetary or health care quality or quality adjusted life year* or qaly or qalys)
-
#7. #6 AND #5
-
#6. TS=(radiotherap* or radiation therap* or radiation treatment* or radioimmunotherap* or rit or brachytherap* or 3d-crt or imrt or igrt or tomotherap* or radiosurger* or srs or sbrt or iort or scprt or chemoradiotherap* or chemo-radiotherap* or ccrt)
-
#5. #4 OR #3
-
#4. TS=(breast mass or cystosarcoma phylloides or intraductal carcinoma or paget nipple disease)
-
#3. #2 AND #1
-
#2. TS=(tumor* or tumour* or carcinoma* or adenocarcinoma* or sarcoma* or oncolog* or cancer* or neoplas* or malignan* or metastasis or metastases or polyp* or lesion* or growth*)
-
#1. TS=(breast* or mamma*)
Searching the Cost-effectiveness Registry (https://research.tufts-nemc.org/cear4/Home.aspx)
10th April 2012
Searched for “breast cancer”
165 results, scanned titles for relevance, all relevant references were already in the database.
NICE website search
11th April 2012
Breast Cancer (early & locally advanced) (CG80) http://www.nice.org.uk/_gs/searchtracker/GUIDANCE/12132
Interstitial laser therapy for breastcancer (IPG89) http://www.nice.org.uk/_gs/searchtracker/GUIDANCE/11035
Endoscopic mastectomy and endoscopic wide local excision forbreast cancer (IPG296) http://www.nice.org.uk/_gs/searchtracker/GUIDANCE/12081
Endoscopic axillary lymph node retrieval for breast cancer (IPG147) http://www.nice.org.uk/_gs/searchtracker/GUIDANCE/11026
Brachytherapy as the sole method of adjuvant radiotherapy for breast cancerafter local excision (IPG268) http://publications.nice.org.uk/brachytherapy-as-the-sole-method-of-adjuvant-radiotherapy-for-breast-cancer-after-local-excision-ipg268
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.
About this article
Cite this article
Barbieri, M., Weatherly, H.L.A., Ara, R. et al. What is the Quality of Economic Evaluations of Non-Drug Therapies? A Systematic Review and Critical Appraisal of Economic Evaluations of Radiotherapy for Cancer. Appl Health Econ Health Policy 12, 497–510 (2014). https://doi.org/10.1007/s40258-014-0115-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40258-014-0115-8