Abstract
Purpose
Recurrent urinary tract infection (rUTI) is a highly prevalent condition associated with significant poor quality of life outcomes. A patient-reported outcome measure (PROM) of rUTI-associated psychosocial impact is urgently required to supplement clinical evaluation and validate the challenges experienced by patients. This study therefore developed and validated the Recurrent UTI Impact Questionnaire (RUTIIQ).
Methods
A rigorous four-stage methodology was followed: (I) concept elicitation through a qualitative survey of the experiences of people with rUTI (N = 1983); (II) Delphi expert screening of the RUTIIQ with expert rUTI clinicians (N = 15); (III) one-to-one cognitive interviews with people experiencing rUTI (N = 28) to evaluate the comprehensiveness and comprehensibility of the RUTIIQ, and (IV) full pilot testing of the RUTIIQ with people experiencing rUTI (N = 240) to perform final item reduction and psychometric analysis.
Results
Exploratory factor analysis demonstrated a five-factor structure comprising: ‘patient satisfaction’, ‘work and activity interference’, ‘social wellbeing’, ‘personal wellbeing’, and ‘sexual wellbeing’, collectively accounting for 73.8% of the total variance in pilot scores. Results from expert clinicians and patients indicated strong item content validity (I-CVI > .75). The internal consistency and test–retest reliability of the RUTIIQ subscales were excellent (Cronbach’s α = .81–.96, ICC = .66–.91), and construct validity was strong (Spearman’s ρ > .69).
Conclusion
The RUTIIQ is a 30-item questionnaire with excellent psychometric properties, assessing the patient-reported psychosocial impact of living with rUTI symptoms and pain. This new instrument delivers the unique opportunity to enhance patient-centred care through standardised observation and monitoring of rUTI patient outcomes.
Trial registration
This study was pre-registered with ClinicalTrials.gov (identifier: NCT05086900).
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Plain English summary
Research has shown how recurrent urinary tract infections (rUTI) can severely impact quality of life, with negative consequences for mental health, socialising, the ability to engage with work and daily activities, and sexual wellbeing. Currently, there is no standardised approach for clinicians and researchers to evaluate this impact and understand how people are affected by living with rUTI. Therefore, in this study, a new validated questionnaire called a patient-reported outcome measure was developed. This questionnaire, called the Recurrent Urinary Tract Infection Impact Questionnaire, was developed with in-depth input from specialist clinicians in this field as well as a varied group of people living with rUTI. An initial test (or pilot) study of the questionnaire with a large group of people living with rUTI demonstrated its excellent statistical properties. This new tool provides the unique opportunity to enhance patient-centred care by supporting healthcare providers to understand the broad impact that this challenging condition may have, going beyond examination of symptoms alone.
Introduction
Recurrent urinary tract infection (rUTI), characterised by at least two UTIs in six months or at least three in a year [1], affects over 100 million people annually worldwide and is associated with high UTI-related symptom and personal burden [2,3,4]. Qualitative research has emphasised the breadth of psychosocial challenges faced by people living with rUTI, indicating severe and long-lasting negative consequences for quality of life (QoL) [5,6,7,8,9]. Anxiety and depression are particularly common in this patient population [10], and are exacerbated by the high levels of sexual distress experienced by 60–78% of people with rUTI [11,12,13,14]. The societal implications of UTIs are also significant, with rUTI estimated to cost the NHS an increasing cost of £45 million per year in community-based prescriptions alone [14,15,16].
Patients regularly report symptoms of UTIs which are not indicated by standard clinical outcome measures [17, 18]. Exploring such patient-reported symptoms and associated impacts could offer a unique insight into the rUTI patient perspective and the lived experience of rUTI. Given the distinctive complexities faced by this patient cohort, it is surprising that no validated measure of rUTI impact on QoL currently exists. Generic QoL instruments, including EuroQol assessments such as the 5-item EQ-5D [19], are commonly used in UTI research [20, 21]. However, such instruments have not been specifically validated for use with rUTI and are thus not reliably sufficient to capture the rUTI patient experience. Their brief, generalised approach may not meaningfully reflect the spectrum of psychosocial challenges faced by people living with rUTI, and they may be less sensitive to changes in specific aspects of the rUTI experience [22]. Additionally, generic measures such as the EQ-5D do not explore the health-related impact on sexual wellbeing: an important area of impact for many people living with rUTI [8, 11, 14]. Indeed, recent research emphasises the need for clinicians and researchers to incorporate a condition-specific measure into rUTI care and study designs as standard, in combination with a brief generic measure such as the EQ-5D [22, 23].
A comprehensive, condition-specific patient-reported outcome measure (PROM) of rUTI impact on QoL would benefit clinical and research settings, supporting shared-decision making and patient-doctor interactions, highlighting key psychosocial outcomes that require intervention (for example, psychotherapy), and allowing for patient monitoring [22, 24, 25]. This study therefore aimed to develop and validate the Recurrent UTI Impact Questionnaire (RUTIIQ).
Materials and methods
The RUTIIQ was developed and validated in accordance with PROM development guidelines (see Fig. 1) [26,27,28]. In-depth input from patients and expert clinicians was sought through all research stages [26,27,28], with particular emphasis on patient involvement to ensure the PROM is truly patient-centred [29].
Stage I: concept elicitation
Design, setting, and participants
An online cross-sectional survey of adult females experiencing rUTI (N = 1983, see Table 1 for demographic characteristics) was conducted to collect qualitative data about the impact of living with this condition. Visitors to a website hosted by Live UTI Free (https://liveutifree.com), a UTI patient advocacy and research organisation, were invited to complete the survey. Inclusion criteria comprised a minimum age of 18 years old and meeting the diagnostic criteria for rUTI (≥ 2 UTI in 6 months, or ≥ 3 UTIs in 12 months) based on self-report [1, 18]. Informed e-consent was obtained prior to survey completion and participants could withdraw at any point.
Most participants were from the USA (56.3%, n = 1,116), UK (19.3%, n = 383), Canada (5.30%, n = 105), and Australia (4.54%, n = 90). Participant ages were broadly distributed across the sample, with 56.7% (n = 1,126) aged between 18 and 39 years old and 43.2% (n = 857) aged 40 years old or above. Most participants reported that their UTI episodes last between 1 and 5 days long (57.8%, n = 1,146) and that they have 1 to 3 months between infections (45.6%, n = 904). Over a third of participants had experienced more than 15 UTIs (38.6%, n = 766).
Procedure
After providing consent, participants answered questions about their demographic characteristics and clinical history with rUTI, including frequency and duration of symptoms. Next, participants were asked to qualitatively describe their experience of rUTI via an open-text box.
Data handling
Framework analysis of the qualitative data and a thorough literature review were conducted to produce a conceptual framework of rUTI impact (see Online Resource 1 for data handling strategy and see Online Resource 2 for summary of literature consulted) [28, 30, 31]. After data familiarisation, the first author developed an initial thematic framework of psychosocial components based on factors identified a priori from existing literature and emergent issues raised by participants [31]. The entire research team reviewed this collaboratively in conjunction with the dataset and literature review findings, making agreed revisions. The first author then indexed and annotated the full dataset according to this framework, and patterns were charted and mapped to group the data into defined concepts (see Online Resource 3 for thematic framework) [31]. Secondary coding and triangulation were undertaken by the last author. Both coders hold advanced postgraduate training in research methods and extensive qualitative experience (see Stage III). Disagreements were resolved in discussion with the wider research team and in close consultation with the data. Data saturation was achieved. Each overarching framework component was selected for exploration as a preliminary subscale in the RUTIIQ, and initial items were drafted for each according to the relevant framework subcomponents.
Stage II: expert clinician screening
Design, setting, and participants
A Delphi methodology was employed to evaluate the content validity of the initial questionnaire from the perspective of clinicians with rUTI expertise (see Online Resource 4 for all items tested at this stage) [32]. Two rounds of anonymous surveys took place to build towards an expert consensus about the relevance and clarity of the questionnaire items [32].
Thirty-seven expert clinicians were invited to take part (n = 22 female, n = 15 male), of whom 15 were successfully recruited (n = 12 female, n = 3 male), meeting sample size recommendations (see Table 1 for demographic characteristics) [26, 32]. Purposive recruitment with snowball sampling was applied to obtain a heterogeneous sample with an equal proportion of clinicians working in primary and secondary care to reduce the risk of bias [33, 34]. Inclusion criteria comprised those currently working as either a general health practitioner or specialist doctor/nurse practitioner within urology or an allied discipline.
The expert clinicians were aged between 32 and 64 years old (M = 46.8, SD = 9.24) and their experience in treating rUTI ranged from 2 to 30 years (M = 13.2, SD = 7.95). Approximately half of the expert clinicians were general practitioners (53.3%, n = 8), and half were specialist doctors or nurse practitioners (46.7%, n = 7). Specialists practised within urology (71.4%, n = 5) and urogynaecology (28.6%, n = 2). The participants practised in the USA (53.3%, n = 8), UK (40.0%, n = 6), and Canada (6.67%, n = 1). Eighty percent retention was achieved in Round 2, supported by regular personalised email reminders.
Procedure
RUTIIQ items were presented using an online survey tool (REDCap; https://www.project-redcap.org). In Round 1, the clinicians were asked to rate each for relevance and clarity using a 7-point scale (0 = not at all relevant/clear, 6 = highly relevant/clear) and provide qualitative comments about comprehensiveness and comprehensibility [26, 32]. In Round 2, each RUTIIQ item was presented alongside the median relevance and clarity ratings and anonymised qualitative feedback from Round 1. The expert clinicians either retained or updated their original ratings and provided further qualitative feedback.
Data handling
Median ratings from Round 2 were calculated and analysed in conjunction with qualitative feedback. Content validity indices for items (I-CVI) were computed by dividing the number of experts who scored an item’s relevance/clarity as at least 4 out of 6 by the total number of experts [35]. A threshold of 0.75 was specified a priori as the minimum I-CVI required to indicate acceptable consensus of content validity, with a minimum median score of 4 [32, 34].
Stage III: patient cognitive interviews
Design, setting, and participants
To evaluate how the RUTIIQ may be mentally processed and where problems may arise, one-to-one semi-structured interviews were conducted with rUTI patients using Microsoft Teams [36]. Cognitive debriefing techniques were used to encourage participants to think aloud as they answered the RUTIIQ questions (see Online Resource 5 for all items tested at this stage) [36]. Interviews took place in two phases, with interim iterative refinements validated in the second phase [37].
All cognitive interviews were conducted by the first author to ensure homogeneity in interview style and to facilitate rapport and participant comfort [28, 36]. The interviewer had advanced postgraduate training in conducting and analysing qualitative interviews, and ongoing training and quality monitoring were provided by the last author who has extensive expertise as a Chartered Health Psychologist and academic qualitative researcher. To facilitate transcription, all interviews were audio-recorded. Full ethical approval was granted by the School of Psychology and Clinical Language Sciences Research Ethics Committee, University of Reading (project reference: 2021-043-KF). Anonymised recordings were securely stored on the University of Reading server, only accessible to the research team. Data were retained for five years from the study’s completion and destroyed sooner if requested. APA guidelines for ethical conduct were maintained at all times [38].
A clinically and demographically diverse sample of 28 adults experiencing rUTI was purposively recruited (see Table 1 for demographic characteristics). To reduce risk of selection bias and sampling error, a large sample representative of the different subgroups that make up the rUTI patient cohort was sought via a broad recruitment strategy with two possible sources: (1) via people signed up to receive newsletters and research notifications from a key stakeholder group: Live UTI Free (https://liveutifree.com), and (2) via other UTI-related online sources, such as support groups. Interested participants were encouraged to share the study information on social media. Recruitment was incentivised using a £25 online shopping voucher prize draw for one random winner, aiming to reduce dropout and attrition bias [39].
Inclusion criteria comprised a minimum age of 18 years old, native or advanced fluency in English, and meeting the diagnostic criteria for rUTI based on self-report [1, 18]. Participants who reported a current diagnosis of interstitial cystitis, were using urinary catheterisation, or were pregnant were excluded. Seventy-three potential participants completed a screening survey without exclusion, from which as diverse a sample as possible was selected via maximum variation sampling (see Online Resource 6) [40]. A minimum sample size of 25 participants was sought to achieve confidence that all possible problems with the questionnaire had been identified [26, 41]. With a final sample of 28 interviewed participants (n = 18 in the first interview phase, and n = 10 in the second interview phase), sampling adequacy was reached.
The final sample had an age range of 18 to 82 years old (M = 46.8, SD = 16.9), and comprised 92.9% females (n = 26) and 7.14% males (n = 2), with one participant describing themselves as non-binary and assigned female at birth. Participants resided in 10 countries, predominantly the USA (32.1%, n = 9), the UK (25.0%, n = 7), and Canada (14.3%, n = 4). The median number of UTI episodes in the past 6 and 12 months was 4 (IQR = 4) and 7 (IQR = 8), respectively. Years of UTI symptoms ranged from 1 to 65 (M = 17.3, SD = 14.5) and years of UTI impact to QoL ranged from 1 to 60 (M = 8.90, SD = 12.0).
Procedure
Participants provided e-consent after reviewing the study’s ethical considerations. The interviewer presented the RUTIIQ to participants using a ‘screen-share’ function and invited them to think aloud their thought processes whilst deciding their answer for each question, allowing evaluation of the measure’s overall comprehensiveness and comprehensibility [26, 28, 37]. Informed by Willis’ guidance on planning and conducting cognitive interviews for instrument development [36, 37], a topic guide (Online Resource 7) was designed and employed to semi-structure each interview, including scripted probes to encourage elaboration and clarification [37]. Questions about the scale and response options, the time taken to answer questions, and the questionnaire layout and formatting were also asked [36]. Anonymised field notes and written summaries were prepared throughout and following each interview to build richness and support transcript interpretation [37].
Data handling
Anonymised verbatim interview transcripts of the audio recordings were created using speech-to-text transcription software (Otter; https://otter.ai/), with errors manually corrected. Predefined codes from the Question Appraisal System (QAS-99) [42], designed to support the systematic assessment of questionnaire items and identification of potential problems, were used to support question feature coding. The QAS-99 training manual was applied to create a coding system for the dataset, systematically evaluating every participant response to each RUTIIQ item in relation to question features (for example, comprehension of technical terms). Initial coding was conducted by the first author, with triangulation undertaken by the last author. This assessment was supported by verbatim participant quotes and interviewer field notes [37].
Weekly wider research team meetings were held, allowing for in-depth analysis of transcripts, drawing together a variety of perspectives from expertise including experience in academic mixed-methods research, clinical practice, and patient advocacy. If there were any uncertainties found in Phase 1, the decision was taken to retain the item in Phase 2 and gain further feedback. A third version of the RUTIIQ was created after Phase 1 for assessment in Phase 2, with the same process undertaken at the end of Phase 2 to create a fourth version for pilot testing.
Stage IV: RUTIIQ pilot testing
Design, setting, and participants
To collect data for psychometric testing of the RUTIIQ and final item reduction, a two-part cross-sectional survey of adults experiencing rUTI was conducted online. Participants completed the same procedure twice to facilitate test–retest analysis [26,27,28]: (1) at baseline, and (2) 24 h later (Test–Retest Assessment). A maximum time period of 48 h to complete the Test–Retest Assessment was applied following the minimum satisfactory test–retest window advocated by Streiner, Norman & Cairney [43]. This prioritised within-episode stability and reduced the possibility of a separate rUTI episode altering reporting of rUTI symptom impact [44].
In addition to completing the RUTIIQ, participants completed existing validated measures relating to each RUTIIQ subscale to facilitate construct validity [27, 28]. It was hypothesised a priori that there would be moderate to strong correlations (Spearman’s ρ > 0.50) between the RUTIIQ subscale scores and existing instruments measuring constructs related to the RUTIIQ subscales (‘concurrent measures’) [27, 28].
A sample of 240 adults meeting the diagnostic criteria for rUTI completed the Baseline Assessment, of whom 106 (44.2%) completed the Test–Retest Assessment (see Table 1 for demographic characteristics, and Online Resource 8 for sampling and recruitment strategy). Participants were recruited using the same recruitment channels used in Stage III, also applying the same inclusion and exclusion criteria. At least 210 participants were required to complete the Baseline Assessment to perform final item reduction via exploratory factor analysis with at least 5 participants per questionnaire item (RUTIIQ = 42 items before final item reduction). Sampling adequacy was exceeded.
The final sample (N = 240) was aged between 18 and 84 years old (M = 45.0, SD = 17.3), and comprised 97.9% females (n = 235) and 2.08% males (n = 5), with two participants describing themselves as non-binary and assigned female at birth. Twenty-four countries were sampled, with most participants residing in the USA (38.8%, n = 93), the UK (32.1%, n = 77), Australia (7.50%, n = 18), and Canada (6.67%, n = 16).
Approximately half of the participants (56.3%, n = 135) reported taking antibiotics at the time of participation, either to treat a current UTI, prevent new UTIs, and/or for other indications. Approximately three-quarters (76.3%, n = 183) reported managing their rUTI with non-antibiotic treatment including natural remedies or supplements. More than three-quarters of participants (77.5%, n = 186) reported experiencing persistent lower urinary tract symptoms for at least the past three months, with the remainder reporting symptoms which occur on an episodic basis. The mean number of episodes of symptoms reported in the past six months was 6.81 (SD = 24.3), and the mean in the past year was 13.9 (SD = 48.4).
Procedure
In the Baseline Assessment, participants provided e-consent via REDCap after reviewing the study’s ethical considerations. Eligible participants who were not excluded during a screening questionnaire proceeded to complete the RUTIIQ and the following six concurrent measures: the Patient Health Questionnaire 9 (PHQ-9) to assess symptoms of depression [45], the Generalized Anxiety Disorder 7 (GAD-7) to assess levels of anxiety [46], the University of Los Angeles Loneliness Scale Version 3 to explore feelings of loneliness and social isolation [47], the Work Productivity and Activity Impairment Questionnaire for Specific Health Problems to evaluate the health-related impact on carrying out work and daily activities [48], the Female Sexual Distress Scale–Revised (FSDS-R) to measure sexual dysfunction [49], and the Patient Satisfaction Questionnaire 18 to assess patient-reported satisfaction with healthcare [50]. The Test–Retest Assessment included the same instruments.
Data handling
After preparing the data for analysis (see Online Resource 9 for data handling strategy [51,52,53,54,55,56,57,58,59,60]), summed scores were calculated for each RUTIIQ subscale and each concurrent measure. Exploratory factor analysis was conducted to perform final item reduction and determine the latent factor structure (structural validity) of the RUTIIQ [26, 28, 53]. Further psychometric analyses of the RUTIIQ, comprising test–retest reliability, internal consistency, and construct validity, were conducted and compared to gold-standard recommendations [27, 28]. Linear regression analyses were also performed to examine any measurement invariance in RUTIIQ scores (for example, related to sociodemographic differences). The Automated Readability Index, a readability measure known to be especially applicable to non-narrative text such as questionnaires [58], was computed to estimate the literacy level required for comprehension of the RUTIIQ.
Results
Stage I: concept elicitation
Framework analysis of the participants’ qualitative responses resulted in a conceptual framework comprising five key components: personal wellbeing, social wellbeing, work and activity interference, sexual wellbeing, and patient satisfaction (see Online Resource 3 for thematic framework and supporting verbatim quotations). These were selected for exploration as five subscales in the RUTIIQ, with initial items based on their subcomponents.
Stage II: expert clinician screening
All items achieved I-CVI for relevance and clarity greater than 0.75 and median ratings of at least 4 as specified a priori. Minimal item refinements were implemented based on qualitative recommendations to enhance clarity, by providing more detailed instructions and definitions (see Online Resource 4 for refinements and I-CVI).
Stage III: patient cognitive interviews
Qualitative feedback from patient participants in the cognitive interviews suggested that clarity and comprehensibility could be improved by giving examples and simplifying language (see Online Resource 5 for refinements and verbatim quotations). Refinements made after Phase 1 were tested during Phase 2, after which only minor changes were made with no new items added; data saturation was therefore reached [37].
Stage IV: RUTIIQ pilot testing
Exploratory factor analysis
Bartlett’s Test of Sphericity was statistically significant (p < 0.001), indicating the absence of multicollinearity [53]. The Kaiser–Meyer–Olkin Measure of Sampling Adequacy estimate was high at 0.89, confirming the suitability of the data for exploratory factor analysis [53]. All extracted communalities were greater than 0.40 except for item A5 (impact on diet), which also did not load above 0.40 on any initial factors and was therefore removed. All other items met these thresholds for communalities and factor loadings. Items demonstrating multiple cross-loadings (B1: impaired close relationships; B3: impaired social activities; B7: worrying about being a burden to others) were removed.
The final five-factor structure comprises the following factors: ‘patient satisfaction’, ‘work and activity interference’, ‘social wellbeing’, ‘personal wellbeing’, and ‘sexual wellbeing’ (see Table 2), together accounting for 73.8% of the total variance in scores. They represent a strong fit for the data, clearly distinguishing between the RUTIIQ subscales. The final version of the RUTIIQ consists of 30 items in total (see Table 3; the full questionnaire is available in Online Resource 10).
The final 30-item RUTIIQ consists of five subscales (see Table 3): personal wellbeing (4 items), social impact (5 items), work and activity interference (7 items), sexual wellbeing (4 items), and patient satisfaction (10 items). All five sections utilise an 11-point Likert scale ranging from 0 (‘strongly disagree’) to 10 (‘strongly agree’). For the first four subscales, greater scores indicate greater impact to QoL. For the patient satisfaction subscale, greater scores indicate greater patient satisfaction with UTI-related medical care.
Descriptive statistics and psychometric properties
Observed RUTIIQ subscale scores highlighted the breadth in patient experiences, with scores spanning the full possible range for all subscales except for the sexual wellbeing subscale, for which all participants reported at least some level of impact (see Table 4 for RUTIIQ descriptive statistics, see Online Resource 11 for concurrent measure descriptive statistics). The average PHQ-9 and GAD-7 scores indicated moderate depression (M = 11.5, SD = 7.22) [45], and mild to moderate anxiety (M = 9.23, SD = 6.21) [46], respectively. Participants typically indicated sexual distress considerably beyond the ‘normal’ FSDS-R range of 0–10 (M = 30.3, SD = 13.7) [49].
The Automated Readability Index for the RUTIIQ is 6.2, indicating suitability for people with a reading age of 11 years old or above [58]. Internal consistency (Cronbach’s α), test–retest reliability (ICC), and construct validity (Spearman’s ρ) were moderate to strong for all RUTIIQ subscales (see Table 4). All subscale psychometric statistics surpassed the relevant gold-standard recommendations except the sexual wellbeing subscale, which still achieved moderate performance [27, 28].
Linear regression analyses indicated the broad sociocultural applicability of the RUTIIQ, indicating no statistically significant group differences in scores in terms of ethnicity, country of residence, relationship status, or level of fluency in English (p > 0.05). Younger respondents typically reported greater rUTI impact than older respondents across all subscales except sexual wellbeing (p < 0.01, see Online Resource 12). Female participants felt that they experienced greater rUTI impact in personal wellbeing, work and activity interference, and sexual wellbeing than male participants (p < 0.05, see Online Resource 13). However, further testing with males is required to examine this difference.
Discussion
This study developed and validated the first patient-reported outcome measure (PROM) of the psychosocial impact of living with rUTI, the Recurrent UTI Impact Questionnaire (RUTIIQ). The 30-item RUTIIQ provides clinicians and researchers with a unique, critically informed, and patient-evaluated measure of rUTI impact using five key subscales: personal wellbeing, social wellbeing, work and activity interference, sexual wellbeing, and patient satisfaction. Pilot testing indicated a five-factor structure capable of distinguishing between these concepts, and excellent reliability and validity meeting or exceeding PROM development guidelines [26,27,28].
The unique strengths of the RUTIIQ development and validation included in-depth input from large, heterogeneous, international samples of patients (N = 1983 concept elicitation, N = 28 cognitive interviews, N = 240 pilot) and expert clinicians (N = 15), robustly following gold-standard recommendations and allowing for iterative refinement throughout [26,27,28]. The demographic and clinical diversity of the patient samples suggests the generalisability of the results across a broad spectrum of rUTI patient experiences. The observed psychometric properties and readability statistics of the RUTIIQ indicate its potential for highly effective application to both clinical and research settings.
Though the research was robustly conducted in accordance with gold-standard PROM development guidelines, some limitations are acknowledged. This research sampled participants from 24 countries, however it is acknowledged that most patient participants were Caucasian, native English-speaking females residing in high-income countries. Additional cross-cultural validation is therefore necessary. Whilst male participants were included, rUTI is more prevalent amongst females [12]; further evaluation of the psychometric properties of the RUTIIQ with males is required. Further test–retest assessment could be conducted with wider time spacing between original completion and retest, following Streiner, Norman & Cairney [43]. Whilst extensive patient involvement was conducted for the development of the RUTIIQ, further qualitative exploration of this measure from the perspective of expert clinicians would be beneficial to facilitate its use in practice. Furthermore, future research could aim to engage caregivers and family members to develop a caregiver-reported adaptation of the RUTIIQ for use in care contexts. The RUTIIQ could also be further validated against other chronic illness measures and populations. Research assessing the clinical responsiveness of the RUTIIQ is ongoing.
The RUTIIQ is the first PROM to specifically assess the patient experience of rUTI psychosocial impact and prioritise the importance of self-report in this unique health context. The UTI Symptom Assessment [61], a symptom-focussed questionnaire for acute UTI, asks respondents to rate how ‘bothersome’ symptoms are, and the Acute Cystitis Symptom Score [62], a symptom-focussed questionnaire for acute cystitis, includes three brief QoL-related questions. The RUTIIQ goes beyond this to capture a fuller picture of the psychosocial challenges faced by this patient cohort, sensitively exploring distinct areas of impact. Unlike generic QoL measures, the RUTIIQ has been developed and validated specifically for use in the rUTI patient population, allowing for evaluation of the unique interactions between psychological, social, and sexual wellbeing reported by patients.
The lack of capacity to measure the rUTI patient experience has been widely reported [23, 25], and the RUTIIQ represents a crucial step towards supplementing well-established clinical testing methods with the patient perspective. Reliable, validated measures of rUTI are essential to improve our understanding of the breadth of challenges associated with this prevalent condition, ultimately improving patient outcomes. Used in conjunction with UTI testing and assessment of symptoms [63], the application of the RUTIIQ in clinical practice allows for standardised observation, patient monitoring, and mapping of patient outcomes [24]. The RUTIIQ enables clinicians to identify how rUTI is impacting their patients, highlighting areas of concern that may require additional support (such as low mood, anxiety, social challenges). This measure has the potential to obtain a sensitive and rapid indication of changes in psychosocial experience over time, and could be used to demonstrate effectiveness of interventions [24].
Conclusion
The RUTIIQ is an important new outcome measure which specifically evaluates the patient-reported experience of rUTI impact, offering a critical, patient-centred tool for the quantification of psychosocial challenges experienced by this patient cohort. The RUTIIQ has demonstrated strong internal consistency, test–retest reliability, and stability, and has been carefully validated against concurrent measures, producing high construct validity. Such rigorous psychometric validation generates confidence in the use of the RUTIIQ in urology, primary care, and wider healthcare settings. By supporting standardised patient observation and monitoring, clinicians and healthcare professionals are now able to quantitatively calibrate those psychosocial challenges requiring intervention beyond UTI symptom experiences, assessing the effectiveness of their interventions. The RUTIIQ critically prioritises the examination of quality-of-life impact and its uptake will influence both healthcare policy and practice from a patient-centred perspective.
Data availability
Raw data from this research study and the final Recurrent UTI Impact Questionnaire is archived and accessible in the Open Science Framework data repository: https://osf.io/q2svk (https://doi.org/10.17605/OSF.IO/Q2SVK).
References
Bonkat, G., Bartoletti, R., Bruyére, F., Cai, T., Geerlings, S. E., Köves, B., Schubert, S., & Wagenlehner, F. (2020). EAU Guidelines on Urological Infections 2020. In European Association of Urology Guidelines. 2020 Edition. (Vol. presented at the EAU Annual Congress Amsterdam 2020). European Association of Urology Guidelines Office. http://uroweb.org/guideline/urological-infections/
Zeng, Z., Zhan, J., Zhang, K., Chen, H., & Cheng, S. (2022). Global, regional, and national burden of urinary tract infections from 1990 to 2019: An analysis of the global burden of disease study 2019. World Journal of Urology, 40(3), 755–763. https://doi.org/10.1007/s00345-021-03913-0
Wagenlehner, F., Wullt, B., Ballarini, S., Zingg, D., & Naber, K. G. (2018). Social and economic burden of recurrent urinary tract infections and quality of life: A patient web-based study (GESPRIT). Expert Review of Pharmacoeconomics & Outcomes Research, 18(1), 107–117. https://doi.org/10.1080/14737167.2017.1359543
Medina, M., & Castillo-Pino, E. (2019). An introduction to the epidemiology and burden of urinary tract infections. Therapeutic Advances in Urology, 11, 175628721983217. https://doi.org/10.1177/1756287219832172
Scott, V. C. S., Thum, L. W., Taylor, S., Markowitz, M., Maliski, S. L., Ackerman, L., Anger, J., & Kim, J.-H. (2021). Fear and frustration among women with recurrent urinary tract infections: Findings from patient focus groups. The Journal of Urology, 206, 1–7. https://doi.org/10.1097/JU.0000000000001843
Grigoryan, L., Mulgirigama, A., Powell, M., & Schmiemann, G. (2022). The emotional impact of urinary tract infections in women: A qualitative analysis. BMC Women’s Health, 22(1), 182. https://doi.org/10.1186/s12905-022-01757-3
Flower, A., Winters, D., Bishop, F. L., & Lewith, G. (2015). The challenges of treating women with recurrent urinary tract infections in primary care: A qualitative study of GPs’ experiences of conventional management and their attitudes towards possible herbal options. Primary Health Care Research & Development, 16(6), 597–606. https://doi.org/10.1017/s1463423615000201
Flower, A., Bishop, F. L., & Lewith, G. (2014). How women manage recurrent urinary tract infections: An analysis of postings on a popular web forum. BMC Family Practice, 15(1), 162. https://doi.org/10.1186/1471-2296-15-162
Izett-Kay, M., Barker, K. L., McNiven, A., & Toye, F. (2022). Experiences of urinary tract infection: A systematic review and meta-ethnography. Neurourology and Urodynamics, 41(3), 724–739. https://doi.org/10.1002/nau.24884
Renard, J., Ballarini, S., Mascarenhas, T., Zahran, M., Quimper, E., Choucair, J., & Iselin, C. E. (2015). Recurrent Lower urinary tract infections have a detrimental effect on patient quality of life: A prospective, observational study. Infectious Diseases and Therapy, 4(1), 125–135. https://doi.org/10.1007/s40121-014-0054-6
Boeri, L., Capogrosso, P., Ventimiglia, E., Scano, R., Graziottin, A., Dehò, F., Montanari, E., Montorsi, F., & Salonia, A. (2017). Six out of ten women with recurrent urinary tract infections complain of distressful sexual dysfunction—A case-control study. Scientific Reports, 7(1), 44380. https://doi.org/10.1038/srep44380
Foxman, B. (2014). Urinary tract infection syndromes: Occurrence, recurrence, bacteriology, risk factors, and disease burden. Infectious Disease Clinics of North America, 28(1), 1–13. https://doi.org/10.1016/j.idc.2013.09.003
Peters, K. M., Killinger, K. A., Carrico, D. J., Ibrahim, I. A., Diokno, A. C., & Graziottin, A. (2007). Sexual function and sexual distress in women with interstitial cystitis: A case-control study. Urology, 70(3), 543–547. https://doi.org/10.1016/j.urology.2007.04.037
Ciani, O., Grassi, D., & Tarricone, R. (2013). An economic perspective on urinary tract infection: The “costs of resignation.” Clinical Drug Investigation, 33(4), 255–261. https://doi.org/10.1007/s40261-013-0069-x
National Institute for Health and Care Research. (2016). Point-of-care testing for urinary tract infections (Horizon Scan Report 0045). https://www.community.healthcare.mic.nihr.ac.uk/reports-and-resources/horizon-scanning-reports/point-of-care-testing-for-urinary-tract-infections
NHS Business Authority. (2021). Antimicrobial stewardship: RightCare UTI Focus Pack.
Shallcross, L., Gaskell, K., Fox-Lewis, A., Bergstrom, M., & Noursadeghi, M. (2018). Mismatch between suspected pyelonephritis and microbiological diagnosis: A cohort study from a UK teaching hospital. Journal of Hospital Infection, 98(2), 219–222. https://doi.org/10.1016/j.jhin.2017.09.029
Dacheva, T., & Malone-Lee, J. (2012). The problems affecting the diagnosis of urinary tract infection. Aging and Health, 8(5), 537–545. https://doi.org/10.2217/ahe.12.53
Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., Bonsel, G., & Badia, X. (2011). Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of Life Research, 20(10), 1727–1736. https://doi.org/10.1007/s11136-011-9903-x
Gopinath, S., Anjui, P. C., John Wesley, I., & Prasobh, G. R. (2020). A study to evaluate the impact of patient counselling on the quality of life of female patients with recurrent urinary tract infection. International Journal of Basic & Clinical Pharmacology, 9(12), 1871–1876. https://doi.org/10.18203/2319-2003.ijbcp20205125
Alanazi, M. Q. (2020). Evaluation of health-related quality of life in women with community-acquired urinary tract infections using the EQ-5D-3L in Saudi Arabia. Patient Preference and Adherence, 14, 2419–2426. https://doi.org/10.2147/ppa.S277367
Al Sayah, F., Jin, X., & Johnson, J. A. (2021). Selection of patient-reported outcome measures (PROMs) for use in health systems. Journal of Patient-Reported Outcomes, 5(2), 99. https://doi.org/10.1186/s41687-021-00374-2
Naber, K. G., Tirán-Saucedo, J., & Wagenlehner, F. M. E. (2022). Psychosocial burden of recurrent uncomplicated urinary tract infections. GMS Infectious Diseases. https://doi.org/10.3205/id000078
Meadows, K. A. (2011). Patient-reported outcome measures: An overview. British Journal of Community Nursing, 16(3), 146–151. https://doi.org/10.12968/bjcn.2011.16.3.146
Sosland, R., & Stewart, J. N. (2021). Management of recurrent urinary tract infections in women: How providers can improve the patient experience. Urology, 151, 8–12. https://doi.org/10.1016/j.urology.2020.06.059
Mokkink, L. B., De Vet, H. C. W., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2018). COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1171–1179. https://doi.org/10.1007/s11136-017-1765-4
Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3
PROMIS Health Organization International. (2013). PROMIS instrument development and validation scientific standards version 2.0. Retrieved May 10, 2022, from https://staging.healthmeasures.net/images/PROMIS/PROMISStandards_Vers2.0_Final.pdf
Trujols, J., Portella, M. J., Iraurgi, I., Campins, M. J., Siñol, N., & Cobos, J. P. D. L. (2013). Patient-reported outcome measures: Are they patient-generated, patient-centred or patient-valued? Journal of Mental Health, 22(6), 555–562. https://doi.org/10.3109/09638237.2012.734653
Goldsmith, L. J. (2021). Using framework analysis in applied qualitative research. The Qualitative Report, 26(6), 2061–2076. https://doi.org/10.46743/2160-3715/2021.5011
Bryman, A., & Burgess, B. (1994). Analyzing qualitative data. Taylor & Francis Group.
McMillan, S. S., King, M., & Tully, M. P. (2016). How to use the nominal group and Delphi techniques. International Journal of Clinical Pharmacy. https://doi.org/10.1007/s11096-016-0257-x
Noy, C. (2008). Sampling knowledge: The Hermeneutics of snowball sampling in qualitative research. International Journal of Social Research Methodology, 11(4), 327–344. https://doi.org/10.1080/13645570701401305
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29(5), 489–497. https://doi.org/10.1002/nur.20147
Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Willis, G. (1999). Cognitive interviewing: A “how to” guide. Research Triangle Institute.
Willis, G. B. (2015). Analysis of the Cognitive Interview in Questionnaire Design. Oxford University Press.
American Psychological Association. (2017). Ethical principles of psychologists and code of conduct. http://www.apa.org/ethics/code/index.html
Booker, C. L., Harding, S., & Benzeval, M. (2011). A systematic review of the effect of retention methods in population-based cohort studies. BMC Public Health, 11(1), 249. https://doi.org/10.1186/1471-2458-11-249
Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage.
Perneger, T. V., Courvoisier, D. S., Hudelson, P. M., & Gayet-Ageron, A. (2015). Sample size for pre-tests of questionnaires. Quality of Life Research, 24(1), 147–151. https://doi.org/10.1007/s11136-014-0752-2
Willis, G., & Lessler, J. (1999). Question appraisal system QAS-99. Research Triangle Institute.
Streiner, D. L., Norman, G. R., & Cairney, J. (2014). Health measurement scales: A practical guide to their development and use (4th ed.). Oxford University Press.
Chang, S.-J., Lin, C.-D., Hsieh, C.-H., Liu, Y.-B., Chiang, I. N., & Yang, S.S.-D. (2015). Reliability and validity of a Chinese version of Urinary Tract Infection Symptom Assessment Questionnaire. International Brazilian Journal of Urology, 41(4), 729–738. https://doi.org/10.1590/s1677-5538.ibju.2014.0046
Spitzer, R. L., Williams, J. B. W., & Kroenke, K. (1999). Validation and utility of a self-report version of prime-md: The PHQ primary care study. JAMA, 282(18), 1737–1744. https://doi.org/10.1001/jama.282.18.1737
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092. https://doi.org/10.1001/archinte.166.10.1092
Russell, D. W. (1996). UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. Journal of Personality Assessment, 66(1), 20–40. https://doi.org/10.1207/s15327752jpa6601_2
Reilly, M. C., Zbrozek, A. S., & Dukes, E. M. (1993). The validity and reproducibility of a work productivity and activity impairment instrument. PharmacoEconomics, 4(5), 353–365. https://doi.org/10.2165/00019053-199304050-00006
Derogatis, L., Clayton, A., Lewis-D’Agostino, D., Wunderlich, G., & Fu, Y. (2008). Validation of the Female Sexual Distress Scale-Revised for assessing distress in women with hypoactive sexual desire disorder. The Journal of Sexual Medicine, 5(2), 357–364. https://doi.org/10.1111/j.1743-6109.2007.00672.x
Marshall, G. N., & Hays, R. D. (1994). The Patient Satisfaction Questionnaire Short-Form (PSQ-18). RAND Corporation.
Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1–25. https://doi.org/10.1146/annurev.clinpsy.032408.153639
Field, A. (2013). Discovering statistics using SPSS (4th ed.). SAGE.
Yong, A. G., & Pearce, S. (2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79–94. https://doi.org/10.20982/tqmp.09.2.p079
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. https://doi.org/10.1037/1082-989X.4.3.272
Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219–246. https://doi.org/10.1177/0095798418771807
Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Kincaid, J., & Delionback, L. (1973). Validation of the Automated Readability Index: A follow-up. Human Factors, 15(1), 17–20. https://doi.org/10.1177/001872087301500103
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555
Schober, P., Boer, C., & Schwarte, L. A. (2018). Correlation coefficients: Appropriate use and interpretation. Anesthesia & Analgesia, 126(5), 1763–1768. https://doi.org/10.1213/ane.0000000000002864
Clayson, D., Wild, D., Doll, H., Keating, K., & Gondek, K. (2005). Validation of a patient-administered questionnaire to measure the severity and bothersomeness of lower urinary tract symptoms in uncomplicated urinary tract infection (UTI): The UTI Symptom Assessment questionnaire. BJU International, 96(3), 350–359. https://doi.org/10.1111/j.1464-410x.2005.05630.x
Alidjanov, J. F., Abdufattaev, U. A., Makhsudov, S. A., Pilatz, A., Akilov, F. A., Naber, K. G., & Wagenlehner, F. M. (2014). New self-reporting questionnaire to assess urinary tract infections and differential diagnosis: Acute Cystitis Symptom Score. Urologia Internationalis, 92(2), 230–236. https://doi.org/10.1159/000356177
Newlands, A. F., Roberts, L., Maxwell, K., Kramer, M., Price, J. L., & Finlay, K. A. (2023). The Recurrent Urinary Tract Infection Symptom Scale: Development and validation of a patient‐reported outcome measure. BJUI Compass. Advance online publication. https://doi.org/10.1002/bco2.222
Acknowledgements
We would like to thank the expert clinicians and patients involved in this study for providing feedback on the Recurrent UTI Impact Questionnaire. We would also like to thank Live UTI Free for supporting this study and participant recruitment.
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation and data collection for Stage I was conducted by KM. Material preparation and data collection for Stages II, III and IV were conducted by AFN. Data analysis was conducted by AFN and KF. MK and JLP supported participant recruitment via Live UTI Free. The original draft of the manuscript was written by AFN and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
Melissa Kramer is CEO of Live UTI Free Ltd. (https://liveutifree.com); however, no financial incentives have been received.
Ethical approval and consent to participate
Ethical approval was granted by the School of Psychology and Clinical Language Sciences Ethics Committee, University of Reading (project reference: 2021-043-KF). All individual participants were provided with study information sheets and debrief forms, and informed electronic consent was obtained from all.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .
About this article
Cite this article
Newlands, A.F., Roberts, L., Maxwell, K. et al. Development and psychometric validation of a patient-reported outcome measure of recurrent urinary tract infection impact: the Recurrent UTI Impact Questionnaire. Qual Life Res 32, 1745–1758 (2023). https://doi.org/10.1007/s11136-023-03348-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-023-03348-7