Abstract
Background
Electronic patient-reported outcomes (ePROs) assess patients’ health status and quality of life, improving patient care and treatment effects, yet little is known about their use and adherence in routine patient care.
Aims
We evaluated the adherence of invasive breast cancer and ductal carcinoma in situ (DCIS) patients to ePROs follow-up and whether specific patient characteristics are related to longitudinal non-adherence.
Methods
Since November 2016, the Breast Center at Charité – Universitätsmedizin Berlin has implemented an ongoing prospective PRO routine program, requiring patients to complete ePROs assessments and consent to email-based follow-up in the first 12 months after therapy starts. Frequencies and summary statistics are presented. Multiple logistic regression models were performed to determine an association between patient characteristics and non-adherence.
Results
Out of 578 patients, 239 patients (41.3%, 95%CI: 37.3–45.5%) completed baseline assessment and all five ePROs follow-up during the first 12 months after therapy. On average, above 70% of those patients responded to the ePROs follow-up assessment. Adherence to the ePROs follow-up was higher during the COVID-19 pandemic than in the time periods before (47.4% (111/234) vs. 33.6% (71/211)). Factors associated with longitudinal non-adherence were younger age, a higher number of comorbidities, no chemotherapy, and a low physical functioning score in the EORTC QLQ-C30 at baseline.
Conclusions
The study reveals moderate adherence to 12-month ePROs follow-up assessments in invasive early breast cancer and DCIS patients, with response rates ranging from 60 to 80%. Emphasizing the benefits for young patients and those with high disease burdens might further increase adherence.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The utilization of digital health technologies on smartphones, tablets, and computers for the purposes of symptom monitoring and assessing quality of life throughout the follow-up period has increased rapidly [1]. In oncological care, electronic patient-reported outcomes (ePROs) have been extensively studied to enable patients to self-report symptoms and quality of life, as well as to monitor patients during oncological treatment [2,3,4,5,6]. It is important to note that the ePROs are valuable resources when reviewed and used by healthcare professionals, highlighting the crucial role of professional interpretation and utilization. Patient-reported outcomes (PROs) refer to any report of a patient’s health status that comes directly from the patient without interpretation by a clinician or anyone else [7]. The European Organization for Research and Treatment of Cancer’s Quality of Life Questionnaire (EORTC QLQ-C30) [8] is one of the widely used instruments assessing PROs in oncological research. Numerous studies have demonstrated that continuously monitoring ePROs not only enhances the accuracy of symptom assessment and functional status of patients [2, 9, 10], but also leads to improved patient-clinician communication [11]. However, despite these advantages, the widespread integration of ePROs into routine clinical practice remains limited, and the precise factors influencing their adoption and efficacy in clinical settings are not fully understood.
Adherence rates in clinical cancer trials that measured ePROs ranged from 65% to more than 90% [12, 13]. For example, 83% of breast cancer patients responded when assessing ePROs during adjuvant radiotherapy [14], and more than 90% of advanced and metastatic cancer patients completed ePROs [15]. However, in non-clinical trial settings, decreasing adherence in follow-up ePROs assessments was reported, with lower rates around 40–60% [16, 17], depending on the number of follow-up assessments and the presence of reminder systems [18].
While numerous studies have demonstrated the advantages of using ePROs in clinical care [17, 19], their integration into routine clinical settings has progressed slower than anticipated. A systematic review examining factors influencing adherence to ePROs in patients with chronic diseases revealed that symptom severity, comorbidity, marital status, electronic health literacy and satisfaction with using ePROs may be associated with higher adherence, although the evidence was inconclusive for any identified factors [20]. Therefore, there remains limited understanding of the factors influencing patient adherence over a long follow-up period. This study aims to evaluate these factors by employing process and outcome measures to analyze adherence to ePROs over time among breast cancer (including ductal carcinoma in situ (DCIS)) patients in the PRO routine program at the Breast Center of the Charité – Universitätsmedizin Berlin [18]. Identifying the factors associated with non-adherence can facilitate the identification of patients who may require additional education about the benefits of ePROs. Additionally, we aim to evaluate the impact of the COVID-19 pandemic on patient adherence to ePROs follow-up.
In this study, several key outcome measures are used to assess patient adherence and response rates to ePROs assessments:
-
12-month adherence: Patients who completed all five follow-up ePRO assessments during the first 12 months following their treatment and the baseline assessment.
-
Non-adherence: Patients who missed at least one of the follow-up ePRO assessments during the first 12 months following their treatment or the baseline assessment.
-
Response rate: The percentage of patients who returned the questionnaires for each time point of the follow-up ePRO assessment.
Methods
Since November 2016, the Breast Center at Charité – Universitätsmedizin Berlin has implemented an ongoing prospective PRO routine program, using the International consortium for Health Outcome Measurement (ICHOM) breast cancer data set [18]. This program has received ethics approval from the Charité Ethics Commission (EA 4/127/16). The PRO routine program is offered to every new patient visiting the breast center. Patients complete baseline assessments on a tablet computer in the clinic before their appointment and have the option to consent to further participation in an e-mail-based follow-up. The ePRO follow-up is initiated at the time of their initial surgery or start of chemotherapy, whichever comes first, by the study team. During the first 12 months after therapy, patients are followed up five times. However, patients who undergo breast conserving surgery have an additional assessment at 2 weeks (Additional Table S1). Patients receive an email with a link to the questionnaires and up to three automated reminders if the assessment is not completed. After 12 months, patients are followed up on a half-yearly basis, and after 5 years, on a yearly basis. However, in this study, we only assessed adherence during the first year of follow-up.
Study sample
Between November 2016 and October 2022, a total of 4,867 patients from the breast cancer clinic were registered in the PRO Routine system. However, 4,231 (86.9%) patients were excluded because they did not meet inclusion criteria for this analysis. Among the excluded patients, 81% did not receive a targeted diagnosis such as fibroadenoma, cysts, mastopathy, or abscesses. Further exclusion criteria are detailed in Fig. 1. Patients who registered for our PRO Routine assessment, were diagnosed with breast cancer or DCIS, and underwent surgery at the Charité Breast Center between November 2016 and December 31st, 2021 were included in this study. The follow-up period for analyzing the collected ePROs ended on December 31st, 2022.
In addition to the more general questions regarding adherence, we sought to assess the impact of the COVID-19 pandemic on adherence to ePRO follow-up. Consequently, we divided patients into two cohorts based on the onset of the first lock-down in Germany (March 22nd, 2020): one comprising patients before the pandemic (n = 211), and the other during the pandemic, spanning from March 22nd, 2020, to December 31st, 2020 (n = 234). We aimed to compare adherence levels between these two periods. Patients with overlapped follow-up periods before and during the pandemic were excluded from this subgroup analysis (n = 133).
Given the exploratory nature of this study, we did not provide a formal power statement.
Data collection
Demographic data and medical history were collected electronically with self-reported baseline patient questionnaires at the time of registration to the PRO Routine program, e.g., age, weight, height, comorbidities, history of cancer, family history of breast or ovarian cancer, previous breast surgery, family status, and education. Tumor stage was classified using the 8th edition of the TNM classification (TNM8) [21]. Education was classified into three groups: low (secondary school graduation or less), high (high school graduation or more) or medium (anything in between). We assessed PROs using the EORTC QLQ-C30 (version 3.0) [8]. This instrument consists of nine multi-item scales: five functional scales (physical, role, cognitive, emotional, and social functioning); three symptoms scales (fatigue, pain, and nausea/vomiting); six single-item scales (dyspnoea, insomnia, appetite loss, constipation, diarrhea, and financial difficulties); and a global health status/QoL scale. The total score is calculated by averaging items within scales and transforming them to the range from 0 to 100. High values of a functional scale represent a good functioning, whereas high values of a symptom scale or item represent a high symptom burden.
Statistical analysis
Frequencies and summary statistics were presented separately by adherence and non-adherence groups. Multiple logistic regression models were performed to determine the association between patient characteristics and non-adherence. Factors included age at the registration [in years], education level [low, medium, high], marital status [single, married/partnership, divorced/separated/widowed], number of comorbidities [< 2 and ≥ 2 comorbidities], self-assessment of difficulty filling out the baseline questionnaires (scores range 1–6 = very difficult), preference for paper-based PRO assessment at baseline [yes, no], first breast cancer disease [yes, no], type of surgery [breast conserving surgery, mastectomy with reconstruction, mastectomy without reconstruction], chemotherapy [yes, no], and continuous variables of the EORTC QLQ C-30 at baseline. Adjusted odds ratio (aOR) with 95% confidence intervals (CIs) was reported. The Akaike information criterion (AIC) was considered when comparing the model selection, and the Hosmer–Lemeshow test was performed for goodness of fit for the final model. Missing data is assumed to be completely at random; hence, no imputation method is applied given the low rate of missing data. Furthermore, binary variables indicating better or worsening scores for each subscales of the EORTC QLQ C-30 at baseline were generated using cut-points derived from reference values in Germany [22]. A generalized linear model employing a binomial family and a log link function was conducted to estimate relative risk (RR) and 95%CI to explore the association between binary variables of the EORTC QLQ C-30 and adherence. Statistical testing was done within an exploratory framework at a two-sided significance level of α = 0.05. All the statistical tests were performed using Stata IC15 (StataCorp, 2017, College Station, TX, USA).
Results
A total of 578 patients with invasive breast cancer (525, 90.8%) and DCIS (53, 9.2%) participated in the analysis of adherence to e-mail-based ePRO follow-up during 12 months post-therapy as part of the PRO routine program at the Breast Center of Charité – Universitätsmedizin Berlin (Fig. 1). The program includes an ePRO assessment at baseline and five subsequent follow-ups during the initial 12 months post-therapy (Supplementary Information Table S1).
Table 1 provides an overview of the patients’ characteristics. The mean age at registration was 54 years (range: 23–88 years). Most of the participants had attained a high level of education and were either married or in partnerships. Among the cohort, 68% (393/578) underwent breast-conserving surgery, and 45.0% (260/578) received chemotherapy. The median follow-up time was 25 months (interquartile range (IQR): 13–40 months).
12-month adherence and response rate of using ePROs after therapy
The 12-month adherence and response rate of using ePROs post-therapy were investigated among 578 patients. Among the cohort, 239 patients (41.3%, 95%CI: 37.3–45.5%) completed all questionnaires during the 12-month follow-up period. Notably, 45.9% of patients who underwent mastectomy with reconstruction maintained adherence, while 41.0% of those who underwent breast-conserving surgery did so (Fig. 2a). Furthermore, patients who received adjuvant chemotherapy exhibited the highest adherence rate (52.0%, 51/98 cases), followed by those who received neoadjuvant chemotherapy (51.2%) (Fig. 2b).
In terms of response rate trends throughout the follow-up period, almost 70% of patients completed their initial ePRO assessment at 6 weeks, with this rate progressively increasing to 75–80% over the subsequent 12-month period. Notably, except for patients who underwent mastectomy without reconstruction, the average response rates remained consistently above 70% throughout the entire 12-month follow-up period (Supplementary Information Fig. S1).
Patient characteristics associated with non-adherence
To identify factors linked with non-adherence to ePRO follow-up over a 12-month period, we performed both bivariate (Supplementary Information Table S2) and multivariable analysis. Our final model demonstrated adequate fit (goodness-of-fit test: p-value = 0.389). The results showed that with every ten-year increase in age, the odds of non-adherence decreased by 18% (aOR = 0.82, 95% CI: 0.68–0.97). Furthermore, patients who were divorced, separated, or widowed had 2.14 times higher odds of non-adherence (95%CI: 1.25–3.77) compared to those who were married or in a partnership. Patients who underwent breast-conserving surgery or mastectomy without reconstruction exhibited higher likelihoods of non-adherence compared to those who received mastectomy with reconstruction (aOR = 1.18, 95% CI: 0.75–1.85, and aOR = 1.73, 95% CI: 0.80–3.75, respectively). Moreover, patients who did not undergo chemotherapy were more likely to be non-adherent compared to those who received any chemotherapy. Additionally, a ten-point increase in baseline EORTC QLQ C-30 physical functioning score was associated with a 23% decrease in the odds of non-adherence (aOR = 0.77, 95% CI: 0.67–0.87). Notably, patients followed up for 12 months before the COVID-19 pandemic presented higher rates of non-adherence compared to those followed up during the pandemic (aOR = 1.47, 95% CI: 0.96–2.25) (Fig. 3).
Additionally, upon categorizing patients based on reference values derived from the EORTC QLQ C-30 scores at baseline, our findings suggest that patients exhibiting higher scores in physical functioning, role functioning, and social functioning, as well as better symptom scores in fatigue, pain, dyspnoea, and financial difficulties at baseline, were more likely to adhere to the follow-up ePROs (Supplementary Information Table S3).
Impact of the COVID-19 pandemic on the 12-month adherence to ePRO follow-up
For subgroup analysis, we categorized patients into two groups: those who completed their 12-month ePRO follow-up before 22nd of March 2020 (the first lock-down in Germany) (before COVID-19, n = 211 cases), and those who completed ePRO follow-up after this date (during COVID-19, n = 234 cases) A total of 133 cases were excluded from the subgroup analysis due to overlapped follow-up periods between the time before and during the COVID-19 pandemic.
The 12-month adherence rate was lower before the COVID-19 pandemic compared to during the pandemic (33.6% [71/211] vs. 47.4% [111/234]). Particularly noteworthy is the increase in 12-month adherence among patients who underwent mastectomy with reconstruction during the COVID-19 pandemic, showing a rise of 26.2%, while a slight decline was observed in those who underwent mastectomy without reconstruction (Fig. 4a). Furthermore, patients who received chemotherapy demonstrated higher adherence rates overall during the COVID-19 pandemic compared to before the pandemic, especially in those who received adjuvant chemotherapy (63.9% vs. 35.1%) and those who underwent both neoadjuvant and post-neoadjuvant chemotherapy (53.9% vs. 25.0%) (Fig. 4b).
Furthermore, the response rate at each follow-up time was higher during the COVID-19 pandemic than before the pandemic in the patients who underwent breast-conserving surgery and mastectomy without reconstruction, with the difference ranging from 5 to 10%. However, after the 6-month follow-up, the response rate in patients who underwent mastectomy without reconstruction reversed during the COVID-19 pandemic (Supplementary Information Fig. S2).
Discussion
Our study reports the results of ePRO follow-up collections in the routine care of invasive early breast cancer and DCIS patients, focusing on adherence in a real-world setting. Adherence to 12-month ePRO follow-up assessments was moderate, with response rates for each follow-up visit ranging between 60 and 80%, comparable to previous publications from real-world settings [16, 18, 23].
It is noteworthy that our study was conducted in a real-world setting, assessing ePROs in clinical routine. Thus, our observed 40% complete adherence rate for the 12-month period (where every questionnaire is answered) is in line with other studies. We also noted a gradual decrease in participation over time in long-term follow-up. Participation rates for ePROs in clinical trial settings are reported to be notably higher (65–75%) [2, 10, 12, 24], although data on complete adherence for long-term follow-up are rarely reported, bringing our average adherence rate fairly close to that of a clinical trial setting.
Factors that may enhance adherence in clinical trial settings include active encouragement from the study team and the use of systems providing two-way communication platforms between caregivers and patients [2, 12, 14]. In addition, some studies allow patients to access their PRO results in real-time and provide recommendations, patient education, or alarm systems [2, 14, 25]. All of these aspects could encourage patients to be more adherent to ePROs. While our electronic questionnaire software currently lacks the capability to provide direct feedback or display PRO scores to patients, we are actively working on methods to provide feedback to participating patients along with specific recommendations based on their ePRO results.
Although the delivery method of questionnaires via email yielded satisfactory response rates for each follow-up visit in our study compared to other studies [26, 27], limitation exist, such as uncertainty regarding email receipt and automated reminder emails potentially being overlooked. Direct patient contact, such as telephone call, may further increase response rates [26] but requires additional resources often unavailable in routine care settings.
Furthermore, our finding that younger patients were more likely to non-adherence compared to older patients contrasts with a previous study associating non-adherence to ePROs with older age [28]. However, this aligns with a previous report from the PRO routine project indicating that younger patients exhibit the lowest rate of agreeing to participate in follow-up ePROs [18]. Being younger and healthier might be connected to the assumption of a reduced individual benefit in answering follow-up ePROs, even though it has been reported that younger patients in better health are more willing to participate in electronic surveys than older patients in worse health [29]. Moreover, younger patients undergoing intensive cancer treatments may experience technology fatigue, as evidenced by a recent study where patients with poor adherence perceived ePROs as less reflective of their current health status when the assessments were complex or difficult to understand, and reporting symptoms frequently was perceived as exhausting [28].
While previous studies attributed non-adherence to factors such as low levels of education and preference for paper-based questionnaires [19, 30, 31], we could not confirm these associations. In addition, low adherence has been linked to a limited ability to use digital technology [28, 30], yet our findings indicate the opposite. This discrepancy might be attributed to the email-based nature of our ePRO follow-up, conducted under the condition of consent for participation, and the setting of a tertiary care center at a large university in a metropolitan area.
In line with previous studies [19, 29, 32], we also observe an association between low physical functioning scores of the EORTC QLQ C-30 at baseline and non-adherence in follow-up. Low scores of physical functioning have been reported to correlate with the severity of illness and early decease [32].
Adherence and response rates varied according to the type of surgery, with the lowest rate observed in patients who underwent mastectomy without reconstruction. This phenomenon might be attributable to the relatively small number of patients in this cohort and the likelihood that they have either more advanced disease or poorer overall health compared to those treated with breast-conserving surgery [33]. Patients who underwent mastectomy without reconstruction exhibited a higher tumor stage and lower average physical functioning score at baseline (60% tumor stage 2 or 3) compared to patients who underwent other operations in our sample.
Our findings support to the notion that a higher disease burden or presence of more comorbidities may reduce completion rates of ePRO follow-up assessments. However, the notably high response rates observed in patients who underwent breast-conserving surgery and mastectomy with reconstruction align well with findings from previous studies [34, 35]. Additionally, not receiving chemotherapy emerges as a factors associated with non-adherence, contrary to a previous study which found no differences in adherence based on chemotherapy receipt [34]. This discrepancy may stem from the increased frequency of clinic interactions among chemotherapy patients, leading to reinforced engagement with ePROs by the treatment team.
In our analysis, adherence rates were lower compared to other studies that have evaluated ePROs [16, 36]. Nonetheless, considering our study’s limitations, the adherence rates in the PRO Routine follow-up program remain statistically acceptable[37]. Nevertheless, it is imperative for researchers and healthcare providers to recognize the lower adherence to ePRO in purely observational settings within clinical routines, as it may compromise the completeness of ePRO data due to a high rate of missing data. To encourage both patient participation and enhance patient monitoring, we advocate for the incorporation of features such as real-time feedback, such as PRO-reports, and alarm systems for ePRO systems in routine care.
Medical institutions aiming to implement ePROs in real-world settings for long-term follow-up should augment patient education regarding the benefits of utilizing ePROs, coupled with direct assessment of an individual's ePRO progress. This approach serves to enhance patient motivation and engagement with ePRO assessments. Providing visual feedback on ePRO assessment, along with recommendations for self-management of symptoms, may further bolster patient engagement. To better understand dropout, patients should have the option to provide comments on ePROs at each follow-up, as well as the opportunity to articulate reasons for declining further follow-up. Subsequently, clinicians can target specific factors associated with non-adherence to minimize missing data in subsequent statistical analysis.
Unfortunately, we were unable to assess the extent to which physicians utilized ePRO results during the patient visits, nor do we possess information regarding the potential burden on patients to complete ePROs at each follow-up. Additionally, the reasons for dropping out were not systematically evaluated. As our data were prospectively collected as part of routine care, we conducted a nonrandomized, single-institution study encompassing patients receiving various types of therapy. These limitations have to be taken into consideration.
Since during the COVID-19 pandemic the amount of online surveys conducted increased significantly, a study suggests lower response rates due to survey fatigue [38]. Despite an initial enrollment decrease in our PRO routine program during the COVID-19 pandemic, we observed a notable increase in adherence, similar to the findings of a recent study [17]. Possible explanations for this phenomenon include heightened concerned among patients regarding their health status and increased time spent at home during the pandemic [17]. Moreover, this unexpected discovery stimulates reflection on variables that may have contributed to increased adherence, as well as potential to utilize these findings in current practice. Lessons from the pandemic can be used to guide current attempts for improving adherence through the use of digital health technology, as they indicate the possibility and effectiveness of alternate methods to patient care. We can learn how to use digital health technology more effectively to overcome hurdles to adherence, such as limited access to healthcare facilities, or how the usage of PROs affects both patients and physicians. Furthermore, the study highlighted the importance of patient empowerment and education in increasing adherence to ePROs follow-up, underlining the need for personalized support and communication. Additionally, the need of proactive monitoring and early action in sustaining ePRO adherence is highlighted, emphasizing the need for health care provider feedback when using ePROs to detect problems or worsening outcomes in routine care practices.
Conclusions
The implementation of an ePRO follow-up assessment at the Charité Breast Center represents a significant step in patient care for breast diseases. However, concerns persist regarding patient adherence rates at long-term follow-up, potentially compromising the completeness of ePRO data. Consequently, healthcare providers should plan to provide enough resources to optimize follow-up rate when employing ePROs in real-world settings for long-term monitoring. Incorporating additional features such as real-time PRO reports accessible to patients and alarm-based monitoring systems might enhance adherence. Moreover, targeted efforts to convey the benefits of participating in an ePRO program, particularly among younger patients and those with a high disease burden, are imperative to enhance adherence rates.
Data availability
The data and the analysis code used in this study are available from the corresponding author upon reasonable request.
References
Singh K, Landman AB (2017) Chapter 13 - mobile health. In: Sheikh A, Cresswell KM, Wright A, et al (eds). Key advances in clinical informatics. Academic Press, pp 183-196. https://doi.org/10.1016/B978-0-12-809523-2.00013-3
Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P et al (2016) Symptom Monitoring With Patient-Reported Outcomes During Routine Cancer Treatment: A Randomized Controlled Trial. J Clin Oncol 34:557–565. https://doi.org/10.1200/JCO.2015.63.0830
Bennett AV, Jensen RE, Basch E (2012) Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin 62:337–347. https://doi.org/10.3322/caac.21150
Jensen RE, Snyder CF, Abernethy AP, Basch E, Potosky AL, Roberts AC et al (2014) Review of electronic patient-reported outcomes systems used in cancer clinical care. J Oncol Pract 10:e215-222. https://doi.org/10.1200/JOP.2013.001067
Mody GN, Stover AM, Wang M, King-Kallimanis BL, Jansen J, Henson S et al (2021) Electronic patient-reported outcomes monitoring during lung cancer chemotherapy: A nested cohort within the PRO-TECT pragmatic trial (AFT-39). Lung Cancer 162:1–8. https://doi.org/10.1016/j.lungcan.2021.09.020
Perez-Alfonso KE, Sanchez-Martinez V (2021) Electronic patient-reported outcome measures evaluating cancer symptoms: a systematic review. Semin Oncol Nurs 37:151145. https://doi.org/10.1016/j.soncn.2021.151145
US Food and Drug Administration (2009) Guidance for industry - patient-reported outcome measures: Use in medical product development to support labeling claims. https://www.fda.gov/media/77832/download. Accessed 15 Apr 2024
Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ et al (1993) The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85:365–376. https://doi.org/10.1093/jnci/85.5.365
Basch E, Schrag D, Henson S, Jansen J, Ginos B, Stover AM et al (2022) Effect of electronic symptom monitoring on patient-reported outcomes among patients with metastatic cancer: a randomized clinical trial. JAMA 327:2413–2422. https://doi.org/10.1001/jama.2022.9265
Denis F, Yossi S, Septans AL, Charron A, Voog E, Dupuis O et al (2017) Improving survival in patients treated for a lung cancer using self-evaluated symptoms reported through a web application. Am J Clin Oncol 40:464–469. https://doi.org/10.1097/COC.0000000000000189
Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM et al (2004) Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol 22:714–724. https://doi.org/10.1200/JCO.2004.06.078
Absolom K, Warrington L, Hudson E, Hewison J, Morris C, Holch P et al (2021) Phase III Randomized Controlled Trial of eRAPID: eHealth Intervention During Chemotherapy. J Clin Oncol 39:734–747. https://doi.org/10.1200/JCO.20.02015
Atherton PJ, Burger KN, Pederson LD, Kaggal S, Sloan JA (2016) Patient-reported outcomes questionnaire compliance in Cancer Cooperative Group Trials (Alliance N0992). Clin Trials 13:612–620. https://doi.org/10.1177/1740774516655101
Takala L, Kuusinen TE, Skytta T, Kellokumpu-Lehtinen PL, Barlund M (2021) Electronic patient-reported outcomes during breast cancer adjuvant radiotherapy. Clin Breast Cancer 21:e252–e270. https://doi.org/10.1016/j.clbc.2020.10.004
Basch E, Stover AM, Schrag D, Chung A, Jansen J, Henson S et al (2020) Clinical utility and user perceptions of a digital system for electronic patient-reported symptom monitoring during routine cancer care: findings from the PRO-TECT Trial. JCO Clin Cancer Inform 4:947–957. https://doi.org/10.1200/CCI.20.00081
Makhni EC, Higgins JD, Hamamoto JT, Cole BJ, Romeo AA, Verma NN (2017) Patient compliance with electronic patient reported outcomes following shoulder arthroscopy. Arthroscopy 33:1940–1946. https://doi.org/10.1016/j.arthro.2017.06.016
Patt D, Wilfong L, Hudson KE, Patel A, Books H, Pearson B et al (2021) Implementation of electronic patient-reported outcomes for symptom monitoring in a large multisite community oncology practice: Dancing the texas two-step through a pandemic. JCO Clin Cancer Inform 5:615–621. https://doi.org/10.1200/CCI.21.00063
Karsten MM, Speiser D, Hartmann C, Zeuschner N, Lippold K, Kiver V et al (2018) Web-Based patient-reported outcomes using the International Consortium for Health Outcome Measurement Dataset in a Major German University Hospital: Observational Study. JMIR Cancer 4:e11373. https://doi.org/10.2196/11373
Hartkopf AD, Graf J, Simoes E, Keilmann L, Sickenberger N, Gass P et al (2017) Electronic-based patient-reported outcomes: willingness, needs, and barriers in adjuvant and metastatic breast cancer patients. JMIR Cancer 3:e11. https://doi.org/10.2196/cancer.6996
Wiegel J, Seppen B, van der Leeden M, van der Esch M, de Vries R and Bos W (2021) Adherence to telemonitoring by electronic patient-reported outcome measures in patients with chronic diseases: a systematic review. Int J Environ Res Public Health 18(19):10161. https://doi.org/10.3390/ijerph181910161
Sobin LH, Gospodarowicz MK and Wittekind C. TNM classification of malignant tumours. John Wiley & Sons, 2011
Karsten MM, Roehle R, Albers S, Pross T, Hage AM, Weiler K et al (2022) Real-world reference scores for EORTC QLQ-C30 and EORTC QLQ-BR23 in early breast cancer patients. Eur J Cancer 163:128–139. https://doi.org/10.1016/j.ejca.2021.12.020
Kennedy F, Shearsmith L, Holmes M, Rogers Z, Carter R, Hofmann U et al (2022) Electronic patient-reported monitoring of symptoms during follow-up of ovarian cancer patients: a feasibility study. BMC Cancer 22:726. https://doi.org/10.1186/s12885-022-09817-5
Taarnhoj GA, Lindberg H, Dohn LH, Omland LH, Hjollund NH, Johansen C et al (2020) Electronic reporting of patient-reported outcomes in a fragile and comorbid population during cancer therapy - a feasibility study. Health Qual Life Outcomes 18:225. https://doi.org/10.1186/s12955-020-01480-3
Karsten MM, Kuhn F, Pross T, Blohmer JU, Hage AM, Fischer F et al (2021) PRO B: evaluating the effect of an alarm-based patient-reported outcome monitoring compared with usual care in metastatic breast cancer patients-study protocol for a randomised controlled trial. Trials 22:666. https://doi.org/10.1186/s13063-021-05642-6
Neve OM, van Benthem PPG, Stiggelbout AM, Hensen EF (2021) Response rate of patient reported outcomes: the delivery method matters. BMC Med Res Methodol 21:220. https://doi.org/10.1186/s12874-021-01419-2
Nota SP, Strooker JA, Ring D (2014) Differences in response rates between mail, e-mail, and telephone follow-up in hand surgery research. Hand (N Y) 9:504–510. https://doi.org/10.1007/s11552-014-9618-x
Lee M, Kang D, Kim S, Lim J, Yoon J, Kim Y et al (2022) Who is more likely to adopt and comply with the electronic patient-reported outcome measure (ePROM) mobile application? A real-world study with cancer patients undergoing active treatment. Support Care Cancer 30:659–668. https://doi.org/10.1007/s00520-021-06473-6
Graf J, Simoes E, Wißlicen K, Rava L, Walter CB, Hartkopf A et al (2016) Willingness of Patients with Breast Cancer in the Adjuvant and Metastatic Setting to Use Electronic Surveys (ePRO) Depends on Sociodemographic Factors, Health-related Quality of Life, Disease Status and Computer Skills. Geburtshilfe Frauenheilkunde 76:535–541. https://doi.org/10.1055/s-0042-105872
Grüne B, Menold H, Lenhart M, Muhlbauer J, Walach MT, Waldbillig F et al (2023) Patient compliance in assessing electronic patient-reported outcome measures after urologic surgery. Urol Int 107(3):280–287. https://doi.org/10.1159/000520755
Smith KL, Verma N, Blackford AL, Lehman J, Westbrook K, Lim D et al (2022) Association of treatment-emergent symptoms identified by patient-reported outcomes with adjuvant endocrine therapy discontinuation. NPJ Breast Cancer 8(1):53. https://doi.org/10.1038/s41523-022-00414-0
Gebert P, Schindel D, Frick J, Schenk L, Grittner U (2021) Characteristics and patient-reported outcomes associated with dropout in severely affected oncological patients: an exploratory study. BMC Med Res Methodol 21(1):77. https://doi.org/10.1186/s12874-021-01259-0
Christiansen P, Carstensen SL, Ejlertsen B, Kroman N, Offersen B, Bodilsen A et al (2018) Breast conserving surgery versus mastectomy: overall and relative survival-a population based study by the Danish Breast Cancer Cooperative Group (DBCG). Acta Oncol 57:19–25. https://doi.org/10.1080/0284186X.2017.1403042
Pusic AL, Matros E, Fine N, Buchel E, Gordillo GM, Hamill JB et al (2017) Patient-reported outcomes 1 year after immediate breast reconstruction: results of the Mastectomy Reconstruction Outcomes Consortium Study. J Clin Oncol 35:2499–2506. https://doi.org/10.1200/JCO.2016.69.9561
Riis CL, Stie M, Bechmann T, Jensen PT, Coulter A, Moller S et al (2021) ePRO-based individual follow-up care for women treated for early breast cancer: impact on service use and workflows. J Cancer Surviv 15:485–496. https://doi.org/10.1007/s11764-020-00942-3
Takvorian SU, Anderson RT, Gabriel PE, Poznyak D, Lee S, Simon S et al (2022) Real-world adherence to patient-reported outcome monitoring as a cancer care quality metric. JCO Oncol Pract 18:e1454–e1465. https://doi.org/10.1200/OP.21.00855
Kristman V, Manno M, Cote P (2004) Loss to follow-up in cohort studies: how much is too much? Eur J Epidemiol 19:751–760. https://doi.org/10.1023/b:ejep.0000036568.02655.f8
de Koning R, Egiz A, Kotecha J, Ciuculete AC, Ooi SZY, Bankole NDA et al (2021) Survey fatigue during the COVID-19 pandemic: an analysis of neurosurgery survey response rates. Front Surg 8:690680. https://doi.org/10.3389/fsurg.2021.690680
Acknowledgements
We thank Sarah Albers, Melissa Afshar-Bakshloo, Lea Pachal, Chiara Richter, Hivin Alsaied, Emel Ertürk, Julia Barho, Trang Trinh, Laura-Antonia Pohany, Ottilia Berninger, Julia Keinhorst, Melissa Yildirim-Duvinage, and Franziska Abend for documenting the clinical data in PRO Routine project.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Conceptualization/Design: PG., MMK. Data acquisition and curation: AMH., RR. Analysis and visualizations: PG. Interpretation of results: PG., MMK., AMH., RR., JUB. Writing-original draft: PG. Writing-review and edition: PG., MMK., AMH., RR., JUB. All authors approve the submitted and final version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethics approval
This study was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Ethics Committee of Charité – Universitätsmedizin Berlin (EA 4/127/16).
Consent to participate
All patients provided written informed consent for the collection of questionnaires and patient-reported outcomes.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gebert, P., Hage, A.M., Blohmer, JU. et al. Longitudinal assessment of real-world patient adherence: a 12-month electronic patient-reported outcomes follow-up of women with early breast cancer undergoing treatment. Support Care Cancer 32, 344 (2024). https://doi.org/10.1007/s00520-024-08547-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00520-024-08547-7