Abstract
Purpose
To critically appraise, compare and summarize the quality of all existing PROMs that have been validated in hyperhidrosis to at least some extend by applying the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology. Thereby, we aim to give a recommendation for the use of PROMs in future clinical trials in hyperhidrosis.
Methods
We considered studies evaluating, describing or comparing measurement properties of PROMs as eligible. A systematic literature search in three big databases (MEDLINE, EMBASE and Web of Science) was performed. We assessed the methodological quality of each included study using the COSMIN Risk of Bias checklist. Furthermore, we applied predefined quality criteria for good measurement properties and finally, graded the quality of the evidence.
Results
Twenty-four articles reporting on 13 patient-reported outcome measures were included. Three instruments can be further recommended for use. They showed evidence for sufficient content validity and moderate- to high-quality evidence for sufficient internal consistency. The methodological assessment showed existing evidence gaps for eight other PROMs, which therefore require further validation studies to make an adequate decision on their recommendation. The Hyperhidrosis Disease Severity Measure-Axillary (HDSM-Ax) and the short-form health survey with 36 items (SF-36) were the only questionnaires not recommended for use in patients with hyperhidrosis due to moderate- to high-quality evidence for insufficient measurement properties.
Conclusion
Three PROMs, the Hyperhidrosis Quality of Life Index (HidroQoL), the Hyperhidrosis Questionnaire (HQ) and the Sweating Cognitions Inventory (SCI), can be recommended for use in future clinical trials in hyperhidrosis. Results obtained with these three instruments can be seen as trustworthy. Nevertheless, further validation of all three PROMs is desirable.
Systematic review registration
PROSPERO CRD42020170247
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Background
Hyperhidrosis is characterized by excessive sweating beyond physiological needs. This disorder can be generalized, involving the whole body, or focal, involving specific areas of the body such as the axillae (axillary hyperhidrosis), the hands and feet (palmar and plantar hyperhidrosis) or the face (cranio-facial hyperhidrosis) [8, 49, 50]. With a recently found prevalence of 4.8% in the USA, about more than half of the affected individuals suffer from axillary hyperhidrosis [8, 42]. The severity of hyperhidrosis can range from light sweating to real dripping. Therefore, those affected often report negative impacts on their quality of life (QoL) including for example limited daily activities, less social relationships, impairments in their study or work life, and a general reduced emotional well-being [8, 14, 19].
Measurement instruments that try to capture what is reported by affected individuals are called “patient-reported outcome measures (PROMs)”. PROMs are self-completed questionnaires reflecting the patient’s perspective and measuring, e.g. severity or QoL. By PROMs, the involvement of patients in both clinical research as well as routine health care can be fostered [28, 51].
Several PROMs that cover diverse constructs have been developed and reported in the literature for patients with hyperhidrosis, for instance, the Hyperhidrosis Quality of Life Index (HidroQoL) [20], the Hyperhidrosis Disease Severity Scale (HDSS) [47] or the Axillary Sweating Daily Diary (ASDD) [34]. In clinical research and practice, not only hyperhidrosis-specific PROMs are used but also skin-specific or more generic PROMs such as the Dermatology Life Quality Index (DLQI) [9] or the short-form health survey (SF-36) [18, 38].
Especially in clinical research, it is important to select measurement instruments with sufficient measurement properties in the population of interest. PROMs should be reliable, valid, responsive and feasible. The selection of instruments should be based on complete information regarding these measurement properties and the quality of the underlying research.
In preparation of the development of the HidroQoL, Kamudoni rated the psychometric properties of several instruments used in measuring QoL in hyperhidrosis. For this rating, he used literature-based standard quality criteria [18]. Wade et al. [50] also conducted a review of the most commonly used QoL measurement instruments in hyperhidrosis, but explicitly refrained from using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), as this would have been beyond the scope of their review given the high level of detailed information required and the level of expertise needed in the application of the COSMIN checklist.
We intend to fill this gap by performing a systematic comparison of all existing PROMs in hyperhidrosis (not just of those measuring QoL) and an assessment of the quality of these PROMs using the established COSMIN methodology.
Objectives
Our main objective was to critically appraise, compare and summarize the quality of all existing PROMs that have been validated in hyperhidrosis to at least some extent by applying COSMIN methodology.
More specifically, our objectives were
-
1.
to systematically assess the measurement properties of PROMs in hyperhidrosis and
-
2.
to identify PROMs in hyperhidrosis
-
a.
that meet the predefined criteria to be recommended in future hyperhidrosis trials;
-
b.
that have the potential to be recommended in the future depending on the results of further validation studies;
-
c.
that do not meet the predefined criteria to be recommended and therefore should not be used anymore.
-
a.
Materials and methods
Protocol and registration
The methods of this systematic review were developed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement [40]. The corresponding study protocol was registered in the International Prospective Register of Systematic Reviews (PROSPERO): CRD42020170247 and published in Systematic Reviews [10].
Literature search
A systematic, librarian assisted literature search was performed in the bibliographic databases MEDLINE (via Ovid, 1946–02 June 2020, database code “medall”), EMBASE (via Ovid, 1974–02 June 2020, database code “oemezd”), Science Citation Index Expanded (1965–02 June 2020, database code "SCI-EXPANDED") and Social Sciences Citation Index (1990–02 June 2020, database code "SSCI") (the latter two simultaneously via Web of Science) on 02 June 2020 with a last update on 11 June 2021. The search strategy comprised the following search elements [32]:
-
A.
Target population: Hyperhidrosis. In order to reach maximal sensitivity a broad compilation of controlled vocabulary and free text terms was used. The search strategy for this element was not peer reviewed.
-
B.
Construct of interest: All patient-reported outcome measures regardless of the underlying construct. For optimal sensitivity the search strategy of this search element was based on a combination of the PubMed filter "Quality of life (QoL)" of Vissers and de Vries [48], the PubMed filter "Patient reported outcome measures (PROMs)" of Jansma and de Vries [17], and additional search terms from the "PROM group construct & instrument type filter" of Mackintosh et al. [27] Patient-reported outcome measures is a broad term and it includes measures of QoL or health status [12, 28].
-
C.
Measurement properties: The validated and sensitive search filter (recommended by the COSMIN group [36]) for finding studies on measurement properties developed by Terwee et al. [44] was used. We employed the translation of the original PubMed filter to Ovid MEDLINE by Alberta University [4].
-
D.
Feasibility of PROMs: The search strategy for this element was based on the search terms for the concept ‘feasibility’ of Heinl et al. [15] (included in their search statement #1, additional file 2).
-
E.
Individual PROMs: A list of known relevant PROMs including those identified in the preliminary work of Kamudoni [18] and in the systematic review of Wade et al. [50]
-
F.
Exclusion filter: This was the exclusion filter from Terwee et al. [44] for a number of irrelevant publication types and for animal-only studies.
The search elements were combined as follows in order to identify all articles on the measurement properties or the feasibility of PROMs in hyperhidrosis. From these records, the exclusion filter removed irrelevant publication types as well as animal-only studies: ((A AND B AND (C OR D)) OR (C AND E)) NOT F, or in words: ((population AND construct AND (measurement properties OR feasibility)) OR (individual PROMs AND measurement properties)) NOT (exclusion filter).
Search strategies for MEDLINE, EMBASE and Web of Science were developed. The initially developed MEDLINE search strategy was translated to the other databases choosing appropriate syntax and index terms. The full, reproducible search strategies are included in Appendix 1 (supplementary files). A PRISMA-S checklist is in Appendix 2 (supplementary files) [37].
In addition, databases specific for PROMs were searched for records relevant to the target population: PROQOLID (https://eprovide.mapi-trust.org/about/about-proqolid), the COSMIN database of systematic reviews of outcome measurement instruments (http://www.cosmin.nl/database-of-systematic-reviews.html), the Test Archive of Leibniz Institute for Psychology Information (https://www.testarchiv.eu/) and the PubPsych search engine (https://pubpsych.zpid.de/pubpsych/). In addition to the electronic search, hand-searching was conducted by perusing reference lists of the studies included and by searching key articles on this topic. No study registries were searched due to the study designs eligible for this review. We did not contact persons or institutions in order to seek additional studies.
Subsequently, the bibliographic databases and the databases specifically on PROMs were searched again with the names of hyperhidrosis-specific PROMs found during the initial search.
There were no restrictions regarding publication date. Only papers in English, German, French or Italian were included. After the deduplication in EndNote X9 following the method of Bramer et al. [2], titles and abstracts were screened in EndNote. No further software was used for the full-text review. Data were extracted using excel sheets.
Eligible studies
The eligibility criteria are in agreement with the COSMIN guideline for systematic reviews of patient-reported outcome measures [36]. The population of interest were patients with hyperhidrosis. At least 50% of the study sample need to consist of hyperhidrosis patients to fulfil the eligibility criteria. The evaluation of measurement properties, the development of a PROM or the evaluation of the interpretability of the PROMs of interest should be the principal aim of selected studies. Studies that only use the PROM to measure the outcome or in which the PROM is used for the validation of another instrument were excluded. Only full-text articles were included because abstracts or posters provide quite often very limited information on the design of a study. Studies that concern the development (“development paper”) and/or the evaluation of the measurement properties (“validation paper”) of PROMs were included as well (Table 1).
Study selection
Titles and abstracts found in the literature search were independently judged by two reviewers. For the remaining titles and abstracts, full-text articles were searched and judged for eligibility also by two reviewers independently. If any disagreement occurred, consensus was reached by consulting a third reviewer. If at least one reviewer considered a study as relevant based on the abstract, or in case of doubt, the full-text article was screened.
Data extraction
Assessment of measurement properties and adequacy of the PROMs
Measurement properties were evaluated in the following order:
-
a.
Evaluation of the content validity.
-
b.
Evaluation of internal structure including structural validity, internal consistency and cross-cultural validity/measurement invariance.
-
c.
Evaluation of remaining measurement properties including reliability, measurement error, criterion validity, hypotheses testing for construct validity and responsiveness.
All measurement properties were evaluated following three sub steps, except for the measurement property “criterion validity” since no gold standard for PROMs in hyperhidrosis exists. For construct validity and responsiveness, we formulated hypotheses to evaluate the results against.
First, the methodological quality of the included studies was evaluated by two independent reviewers using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist which was developed exclusively for systematic reviews of PROMs [30]. Both reviewers had a psychological and therefore also psychometric background and were familiar with the COSMIN methodology. The COSMIN Risk of Bias checklist consists of 10 Boxes, each for one measurement property (Table 2). Only those boxes for the measurement properties that are assessed in an article were filled in.
All measurement properties of the COSMIN Risk of Bias checklist are clearly defined [33]. Content validity is considered as the most important measurement property because the items of a PROM have to be relevant, comprehensive and comprehensible regarding the population and construct of interest [45]. If there is high-quality evidence for insufficient content validity, the PROM was not further assessed and directly categorized as C, i.e. the PROM should not be recommended for use. Each study was rated on a 4-point rating scale (that is, “inadequate”, “doubtful”, “adequate”, “very good”). The overall quality of a study was determined by the lowest rating of any standard in the box, i.e. “the worst score counts” principle [30]. Each study on a measurement property was assessed separately and all measurement properties of each study were rated as either very good, adequate, doubtful or inadequate [31].
Second, we extracted relevant data on characteristics of the included PROMs and the included study populations and summarized them in evidence tables [31]. Interpretability and feasibility which are also important for a recommendation were described after the evaluation of the measurement properties. Interpretability means the degree to which qualitative meaning can be assigned to a PROM’s quantitative score. Feasibility contains aspects of the ease of application (e.g. costs, length, ease of administration) [31].
Furthermore, we applied quality criteria. We used updated criteria for good measurement properties recommended by the COSMIN group [36]. The result of each single study was rated as either sufficient (+), insufficient (−) or indeterminate (?) [31].
Third, we aimed to summarize the evidence per measurement property per PROM, rate the overall result against criteria for good measurement properties and grade the quality of the evidence by the GRADE approach. Here, the focus was no longer on the single studies, but on the PROM [31].
The third substep included several further substeps: (1) we looked at the consistency of our results, searched for explanations if inconsistency occurred or downgraded for inconsistency if no explanation was found; (2) we pooled or summarized the results in Summary of Findings (SoF) Tables, each measurement property per PROM in one table; (3) we rated each pooled or summarized result again against the quality criteria to obtain an overall rating for the pooled or summarized result as either sufficient (+), insufficient (−), inconsistent ( ±) or indeterminate (?); and (4) we graded the quality of the evidence to define whether the pooled or summarized result was trustworthy [31]. The recognition of the quality of evidence can help to prevent misguided recommendations [13]. Using the GRADE approach, we determined whether confidence in estimates of true measurement properties is given. We used a GRADE approach with four GRADE factors (risk of bias, inconsistency, imprecision and indirectness) and four levels of quality evidence (high, moderate, low or very low) (Table 3). If the results did not seem trustworthy, the quality of evidence was downgraded. Each PROM was graded separately [36]. If the overall rating for a measurement property was inconsistent (±) or indeterminate (?), the quality of evidence was not graded [36].
Generating recommendations for the use of PROMs in patients with hyperhidrosis
Each assessed instrument was assigned to a recommendation category according to its methodological quality and adequacy. We used three categories of recommendation that were proposed by the COSMIN group [36]:
-
A.
PROMs with evidence for sufficient content validity (any level) and at least low-quality evidence for sufficient internal consistency.
-
B.
PROMs categorized not in A or C.
-
C.
PROMs with high-quality evidence for an insufficient measurement property
PROMs of category A can be recommended for use and results obtained with these PROMs can be seen as trustworthy. For PROMs of category B, further validation is needed; however, they still have the opportunity to be recommended for use. PROMs of category C should not be recommended for use. If only PROMs of category B are found, the PROM with the best evidence for content validity can be preliminarily recommended for use, until further evidence is given [31].
Our aim was to identify the best (currently available) PROM(s) in hyperhidrosis.
Results
Searching the bibliographic databases yielded 6691 records of which 3922 remained after deduplication and were moved into the screening. We found 188 studies to be included in the full-text screening, 19 of which were considered for qualitative and quantitative synthesis (Fig. 1). Three further relevant articles were found in the reference lists of the included studies, resulting in 24 relevant studies for data extraction. One study by Kamudoni contained data on the content validity of the HidroQoL, but did not formally meet the inclusion criteria [19]. Nevertheless, supplementary information on content validity was extracted to assess the methodological quality of the PROM development. The PhD thesis of Paul Kamudoni was also included as it provided complementary information to the paper by Kamudoni et al. published in 2015 [18, 20]. The development study of Amir et al. [1] was added since it provided preliminary work for the development of the Hyperhidrosis Quality of Life Questionnaire (HQLQ) by de Campos et al. [6]. In total, we identified 24 studies reporting on 13 different PROMs.
Five included studies reported on the DLQI [3, 26, 41, 43, 46]; three on the HQLQ [1, 6, 35], the HidroQoL [9, 18, 20] and the HDSS [39, 46, 47], respectively; two on the SF-36 [38, 46], the Hyperhidrosis Disease Severity Measure-Axillary (HDSM-Ax) [16, 22], as well as the Hyperhidrosis Scale (HS) [21, 35]; and one each on the ASDD and its child version (ASDD-C) [34], the Hyperhidrosis Impact Questionnaire (HHIQ) [25], the Illness Intrusiveness Rating Scale (IIRS) [5], the Hyperhidrosis Questionnaire (HQ) [24], the Sweating Cognitions Inventory (SCI) [52] and the self-evaluation scale (SES) [23]. The questionnaires of Amir et al. [1] and de Campos et al. [6] were also found as two independent questionnaires. Since the de Campos questionnaire is a further development based on the main content of the study of Amir et al. [1], studies on these two questionnaires were summarized in this paper under the de Campos questionnaire. Additionally, we found several designations for the questionnaires of de Campos et al. [6] and Kuo et al. [24]. In the following, we adopted the terms used by Wade et al. [50], namely the HQLQ and HQ.
Data extraction
Regarding the data extraction using the COSMIN Risk of Bias checklist, the two reviewers had an agreement of 80.35%. Consensus was mostly found between the two reviewers. Some major disagreements were discussed with a third reviewer having expertise with the COSMIN methodology.
Evaluation of content validity
An ‘inadequate’ PROM development rating was found for three PROMs: the HQ, the HQLQ as well as the SCI. Regarding the HQLQ, the omission of a cognitive interview study or pilot test to assess the comprehensibility and comprehensiveness in a sample representing the target population was the reason for the ‘inadequate’ rating. The evaluation of the HQ’s and the SCI’s PROM development was inadequate since the PROM development studies were based on a literature search only or performed in a group of clinicians and researchers rather than in a sample representing the target population for which the PROM was developed, as required. All content validity studies, when conducted, were of doubtful quality as information on the number of researchers involved in the data analysis was mostly lacking (Table 4).
The quality of evidence of the HidroQoL was moderate since at least one content validity study of doubtful quality was available [18, 20]. Copies of the HQ and SES were not available. Only the general design and the structure of the response options were known, but no complete version of the questionnaires and their wording was available. Therefore, some aspects were judged as “?” in the reviewer’s rating. In case of an inconsistent or indeterminate overall rating, there was no grading of the quality of the evidence (Table 5).
We could not find high-quality evidence that the content validity of any PROM was insufficient; thus, the remaining measurement properties of every PROM were further assessed.
Evaluation of the remaining measurement properties (structural validity, internal consistency, cross-cultural validity/measurement invariance, reliability, measurement error, criterion validity, hypotheses testing for construct validity and responsiveness)
In total, the methodological quality of 111 measurement properties was rated. 44 measurement properties (39.6%) had very good, 25 (22.5%) had adequate and 21 (18.9%), respectively, doubtful and inadequate methodological quality (Table 6).
Characteristics of the included PROMs and study populations
A complete overview of all included PROMs is presented in Appendix 3 (supplementary files). Characteristics of the included study populations are shown in Appendix 4 (supplementary files).
Sample sizes ranged from 8 to 665 patients. Only four [1, 34, 43, 46] of the 21 studies included children < 16 years. On average, slightly more women participated in the studies, accounting for 64% of the study populations. The studies were classified into development, validation and intervention studies and were conducted in more than 15 countries. The lowest number of items in a questionnaire was one, the highest 41 with an optional 10-item follow-up module. Only two questionnaires partially use a dichotomous response format, whilst the predominant Likert scale format is applied in various forms (3- to 11-point Likert scale) in all PROMs.
Most of the PROMs are disease-specific measurement instruments for hyperhidrosis. The ASDD(-C) and the HDSM-Ax are also site-specific for axillary hyperhidrosis. The same applies to the HS and the SES for palmar hyperhidrosis. These four PROMs, as well as the HDSS for primary hyperhidrosis in general, intend to measure the sweating severity. The HidroQoL, HQ and HQLQ, on the other hand, are disease-specific PROMs measuring health-related QoL. Similarly, the HHIQ measures the impact of hyperhidrosis in the different domains in life. However, the SCI takes a different approach and captures the types of dysfunctional negative beliefs in hyperhidrosis held by patients.
The remaining PROMs, the DLQI, the IIRS and the SF-36, are not hyperhidrosis-specific. The SF-36 is a measurement instrument of generic health-related QoL. The DLQI is applied to patients with skin conditions and measures the impact of the condition on the patient's QoL. A child version is also available. The IIRS is validated for patients with moderate to severe chronic disabling and/or life-threatening diseases. The construct of intrusiveness represents the disruptive effects on various aspects of life due to the disease. As general questionnaires, these PROMs are applicable in a large population, which is also shown by the high number of translated versions. The DLQI is available in more than 110 languages (https://www.cardiff.ac.uk/medicine/resources/quality-of-life-questionnaires/dermatology-life-quality-index). There are various validated translations for the SF-36 (https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html), such as German, French or Japanese and also the IIRS has been translated into various languages, e.g. French or Chinese [7].
Information on interpretability and feasibility
Information on the distribution of scores in the study population was only given for the HidroQoL and the SCI. The results in the thesis of Kamudoni [18] showed a positive skew for the items towards higher response categories, whereas Gabes et al. [9] indicated negative skewness and evidence that the data were not normally distributed. Both reports showed ceiling effects for most of the items. According to Gabes et al. [9], 26–91% of the patients chose the highest response category. Floor effects were found by Kamudoni [18] for 13 items of the HidroQoL. Wheaton et al. [52] compared the distribution of scores in patients with hyperhidrosis and in a control group, showing a normal distribution for patients and positively skewed scores for controls. Small floor and ceiling effects were observed for the HDSM-Ax [16]. Other ceiling effects were only given by Nelson et al. [34] indicating some ceiling effects for Item 4 of the ASDD. The distribution of missing items was analysed for the HidroQoL, showing an increase in missing data towards the end of the questionnaire. However, no further structure in the missing data was apparent. Minimal important difference (MID) values of 3 to 4 were proposed for the HidroQoL by Kamudoni [18] and Gabes et al. [9]; differences in values are likely due to a more homogenous study population in the latter study. Hobart et al. [16] estimated meaningful change scores of the HDSM-Ax and stated that a change in the HDSM-Ax total score of one point represents a clinically meaningful change in axillary hyperhidrosis severity. Nelson et al. [34] did not calculate a MID value but referred to patients who achieved a reduction in weekly average scores on ASDD Item 2 of ≥ 4 points as responders to treatment. No information on response shift could be extracted of the included studies.
All PROMs are self-administered. There were no problems reported regarding the patient's comprehensibility or administration. Campanati et al. [3] explicitly mentioned that the DLQI does not require any specific intellectual abilities. For most questionnaires, it was stated that they have a short completion time, ranging from only a few minutes for the DLQI to approximately 8–10 min for the HQ. The HDSS can also be used by non-specialists. The HDSS and the SES are only single-item instruments. For the DLQI, HDSM-Ax, HidroQoL, HQLQ, IIRS and SCI, a simple summary score can be obtained by adding up all item scores. For the ASDD(-C), consisting of 2 to 4 questions, scores for the individual items can be calculated. For the HQ and SF-36, scores for their individual domains can be obtained. Only for the HS, a normalized score can be used by dividing the total score by the number of completed items. No information on the scoring system was given for the HHIQ. The DLQI is copyrighted, but can be used without further permission for routine clinical purposes (https://www.cardiff.ac.uk/medicine/resources/quality-of-life-questionnaires/dermatology-life-quality-index). Two other questionnaires are copyrighted, the ASDD(-C) and the HidroQoL, but no information about their terms of use was found. The SF-36 is freely available on the RAND homepage and, except for a credit line, requires no further permission for use (https://www.rand.org/health-care/surveys_tools/mos/36-item-short-form.html). A copy of the HHIQ was kindly provided by the responsible company for an evaluation within this paper. For the remaining PROMs, no information could be retrieved regarding their accessibility.
Summary of findings (SoF) tables and recommendation
The summarized results per measurement property per PROM are presented in Table 7. The overall ratings for reliability of the HDSS and for hypotheses testing for construct validity of the ASDD-C and the SCI were inconsistent since not all studies reported ICCs ≥ 0.7 for the HDSS and only around half of the a priori hypotheses could be confirmed for the ASDD-C and the SCI. Structural validity and internal consistency of the SCI were downgraded due to indirectness since one relevant study was partly performed in another population of interest (student population). The HQLQ and the SF-36 showed inconsistent results regarding hypotheses testing for construct validity. We decided to base the overall rating on the majority of the results and therefore downgraded the quality of evidence for one level due to inconsistency. For the items 3 and 4 of the ASDD, we found an inconsistent overall rating since only one-third of the a priori hypotheses could be confirmed with the data extracted. There was one study in which test–retest reliability was assessed twice for the HidroQoL, with and without an intervention between the two measurements. Results were presented for both subgroups separately. The insufficient reliability rating found for the intervention-subgroup might be explained by treatment effects and should not be overestimated. Furthermore, for the HidroQoL and the HDSM-Ax, very few hypotheses for construct validity and responsiveness could not be confirmed. However, the corresponding correlations were only 0.03–0.09 above the fixed threshold and therefore not classified as “inconsistent”.
The results of the SoF Tables were used to recommend the most appropriate PROM. The final recommendations according to the COSMIN guidelines [31] for all four PROMs are presented in Table 8.
Discussion
This systematic review provides a first synthesis of the methodological assessment of the measurement properties of 13 PROMs used in patients with hyperhidrosis following an established methodology. As Wade et al. [50] have already stated in their review in 2017, a high level of information about the development and the validation of PROMs is necessary to be able to appropriately judge them. In this study, three PROMs, the HidroQoL, the HQ and the SCI, showed evidence for content validity and moderate- to high-quality of evidence for internal consistency and therefore can be further recommended for use according to the COSMIN criteria. Results obtained with these PROMs can be seen as trustworthy. Those PROMs are assessing different constructs. The HidroQoL and the HQ are both measuring health-related QoL, whereas the SCI is measuring sweating cognitions, i.e. types of dysfunctional negative beliefs in hyperhidrosis.
Especially construct validity of the SCI should be further assessed since we found an inconsistent overall rating for this measurement property. An evaluation of the responsiveness and reliability of the SCI is also needed, as there are still gaps in evidence. In addition, further validation studies should be conducted within the target population (patients with hyperhidrosis) to strengthen the quality of evidence and avoid downgrading due to indirectness. Regarding the two QoL-PROMs, the HidroQoL currently seems to be more convincing than the HQ. This is based on a higher quality of evidence of the HidroQoL regarding content validity and internal consistency as well as a larger study population where these results are based on. Moreover, the HidroQoL lacked only evaluations of three measurement properties, measurement error, criterion validity and cross-cultural validity. Many other measurement properties can already be considered as sufficient on a high quality of evidence level. The HQ met the requirements for a recommendation according to the COSMIN criteria; however, evidence gaps remain, for instance with regard to structural validity with an indeterminate overall rating. Especially in clinical trials, PROMs should be reliable, valid, responsive and feasible and therefore, a comprehensive assessment of the measurement properties is crucial.
Many other PROMs such as the ASDD(-C), DLQI, HDSS, HHIQ, HQLQ, HS, IIRS and the SES could still possibly be recommended for use, but further validations studies are needed. The HDSM-Ax and the SF-36 cannot be recommended for use in patients with hyperhidrosis since we found moderate- and high-quality evidence for insufficient measurement properties (structural validity for the HDSM-Ax and construct validity and responsiveness for the SF-36). The HDSM-Ax did not fit the Rasch model what was shown in two independent studies and what led to an insufficient structural validity rating. The poor performance of the SF-36 could also be a consequence of the fact that generic as well as skin-specific PROMs do not comprehensively reflect the specific needs of patients with hyperhidrosis. This assumption is also reflected for instance in the insufficient content validity rating of the DLQI. Importantly, future validation studies should look at the interpretability and feasibility of PROMs since only little information was available for the currently included PROMs.
Strengths and limitations of this systematic review
In this systematic review, we identified several strengths: an a priori registered protocol, the use of a comprehensive and sensitive search filter, the search in three large databases (MEDLINE, EMBASE and Web of Science), several smaller databases and reference lists of the included studies, the application of predefined eligibility criteria and the use of the COSMIN Risk of Bias checklist to assess the methodological quality of the included studies. Two independent reviewers (MG und GK) carried out every step of the review process to ensure consistency. One eligible paper where two of the authors (MG and CA) were conflicted was evaluated by two unconflicted reviewers (GK and CT). Discrepancies were discussed and resolved within the whole research team. A potential limitation of this systematic review is the fact that not all reference lists of relevant full-texts were searched for further eligible studies (backward search). We have not performed a forward search either.
Conclusion
This systematic review suggests that currently three PROMs, the HidroQoL, the HQ and the SCI, can be recommended for use in patients with hyperhidrosis. To strengthen and extend the evidence of those measurement instruments, future validation studies should focus on those PROMs.
Data Availability
All supplementary files and additional data that support the findings of this study are available from the University of Regensburg Publication Server (https://doi.org/10.5283/epub.46453, https://epub.uni-regensburg.de/46453/).
Code availability
All data analyses were conducted using the COSMIN manuals (available at https://www.cosmin.nl/tools/guideline-conducting-systematic-review-outcome-measures/).
References
Amir, M., Arish, A., Weinstein, Y., Pfeffer, M., & Levy, Y. (2000). Impairment in quality of life among patients seeking surgery for hyperhidrosis (excessive sweating): Preliminary results. Israel Journal of Psychiatry and Related Sciences, 37, 25–31.
Bramer, W. M., Giustini, D., De Jonge, G. B., Holland, L., & Bekhuis, T. (2016). De-duplication of database search results for systematic reviews in EndNote. Journal of the Medical Library Association, 104, 240–243. https://doi.org/10.3163/1536-5050.104.3.014
Campanati, A., Penna, L., Guzzo, T., Menotta, L., Silvestri, B., Lagalla, G., Gesuita, R., & Offidani, A. (2003). Quality-of-life assessment in patients with hyperhidrosis before and after treatment with botulinum toxin: Results of an open-label study. Clinical Therapeutics, 25, 298–308. https://doi.org/10.1016/s0149-2918(03)90041-5
Canada AU. (2015). Search filter for finding studies on measurement properties for OVID (Medline) (p. 2).
Cinà, C. S., & Clase, C. M. (1999). The Illness Intrusiveness Rating Scale: A measure of severity in individuals with hyperhidrosis. Quality of Life Research, 8, 693–698. https://doi.org/10.1023/a:1008968401068
De Campos, J. R., Da Fonseca, H. V., & Wolosker, N. (2016). Quality of life changes following surgery for hyperhidrosis. Thorax, 26, 435–443. https://doi.org/10.1016/j.thorsurg.2016.06.008
Devins, G. M. (2010). Using the illness intrusiveness ratings scale to understand health-related quality of life in chronic disease. Journal of Psychosomatic Research, 68, 591–602. https://doi.org/10.1016/j.jpsychores.2009.05.006
Doolittle, J., Walker, P., Mills, T., & Thurston, J. (2016). Hyperhidrosis: An update on prevalence and severity in the United States. Archives of Dermatological Research, 308, 743–749. https://doi.org/10.1007/s00403-016-1697-9
Gabes, M., Jourdan, C., Schramm, K., Masur, C., Abels, C., Kamudoni, P., Salek, S., & Apfelbacher, C. (2020). Hyperhidrosis Quality of Life Index (HidroQoL©): Further validation and clinical application in patients with axillary hyperhidrosis using data from a phase III randomized controlled trial. British Journal of Dermatology. https://doi.org/10.1111/bjd.19300
Gabes, M., Knüttel, H., & Apfelbacher, C. J. (2021). Measurement properties of patient-reported outcome measures (PROMs) in patients with hyperhidrosis: Protocol for a systematic review. Systematic Reviews, 10, 163. https://doi.org/10.1186/s13643-021-01701-w
Grade GRADE Handbook - Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. (2013).
Greenhalgh, J., Long, A. F., & Flynn, R. (2005). The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory? Social Science and Medicine, 60, 833–843. https://doi.org/10.1016/j.socscimed.2004.06.022
Guyatt, G. H., Oxman, A., Vist, G. E., et al. (2008). GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 336, 924–926. https://doi.org/10.1136/bmj.39489.470347.AD
Hamm, H., Naumann, M. K., Kowalski, J. W., Kütt, S., Kozma, C., & Teale, C. (2006). Primary focal hyperhidrosis: Disease characteristics and functional impairment. Dermatology, 212, 343–353. https://doi.org/10.1159/000092285
Heinl, D., Prinsen, C. A., Drucker, A. M., et al. (2016). Measurement properties of quality of life measurement instruments for infants, children and adolescents with eczema: Protocol for a systematic review. Systematic Reviews, 5, 25. https://doi.org/10.1186/s13643-016-0202-z
Hobart, J., Burke, L., Kirsch, B., Burke, L., Hobart, J., Angulo, D., & Walker, P. S. (2021). Hyperhidrosis disease severity measure-axillary (HDSM-Ax): Evaluation of measurement performance. Journal of Drugs in Dermatology, 20, 410–418. https://doi.org/10.36849/jdd.2021.5569
Jansma, E.P., & Vries, R.D. (2017). Patient reported outcome measures (PROMs) search blocks.
Kamudoni, P. (2014). Development, validation and clinical application of a patient-reported outcome measure in hyperhidrosis: The Hyperhidrosis Quality of Life Index (HidroQoL ©). Cardiff University.
Kamudoni, P., Mueller, B., Halford, J., Schouveller, A., Stacey, B., & Salek, M. S. (2017). The impact of hyperhidrosis on patients’ daily life and quality of life: A qualitative investigation. Health and Quality of Life Outcomes, 15, 121. https://doi.org/10.1186/s12955-017-0693-x
Kamudoni, P., Mueller, B., & Salek, M. S. (2015). The development and validation of a disease-specific quality of life measure in hyperhidrosis: The Hyperhidrosis Quality of Life Index (HidroQOL(c)). Quality of Life Research, 24, 1017–1027. https://doi.org/10.1007/s11136-014-0825-2
Keller, S. M., Bello, R., Vibert, B., Swergold, G., & Burk, R. (2009). Diagnosis of palmar hyperhidrosis via questionnaire without physical examination. Clinical Autonomic Research, 19, 175–181. https://doi.org/10.1007/s10286-009-0006-5
Kirsch, B. M., Burke, L., Hobart, J., Angulo, D., & Walker, P. S. (2018). The Hyperhidrosis disease severity measure-axillary: Conceptualization and development of item content. Journal of Drugs in Dermatology, 17, 707–714.
Krogstad, A. L., & Piechnik, S. K. (2005). Are patients better than the laboratory in assessing sweating? Validation study. Dermatologic Surgery, 31, 1434–1439. https://doi.org/10.2310/6350.2005.31210
Kuo, C. H., Yen, M., & Lin, P. C. (2004). Developing an instrument to measure quality of life of patients with hyperhidrosis. The Journal of Nursing Research, 12, 21–30.
Li, D. C., Hulbert, A., Waldbaum, B., Ober, C., Hooker, C. M., Huang, P., Molena, D., Yang, S. C., Ito, T., Perry-Parrish, C., & Brock, M. V. (2018). Endoscopic thoracic sympathectomy for primary focal hyperhidrosis: Impact on psycho-social symptomatology and psychotropic medication use. European Journal of Cardio-Thoracic Surgery, 54, 904–911. https://doi.org/10.1093/ejcts/ezy211
Lynch, O. E., Aherne, T., Gibbons, J., Boland, M. R., Ryan, É. J., Boyle, E., Egan, B., & Tierney, S. (2020). Five-year follow-up of patients treated with intra-dermal botulinum toxin for axillary hyperhidrosis. Irish Journal of Medical Science, 189, 1023–1026. https://doi.org/10.1007/s11845-019-02131-3
Mackintosh, A., Comabella, C., Hadi, M., Gibbons, E., Fitzpatrick, R., & Roberts, N. (2010). PROM group construct & instrument type filters.
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: A structured review. Journal of Evaluation in Clinical Practice, 12, 559–568. https://doi.org/10.1111/j.1365-2753.2006.00650.x
Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G.; Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA Statement. Open Med, 3, e123-130.
Mokkink, L. B., De Vet, H. C., Prinsen, C. A., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2017). COSMIN Risk of Bias checklist for systematic reviews of patient-reported outcome measures. Quality of Life Research. https://doi.org/10.1007/s11136-017-1765-4
Mokkink, L.B., Prinsen, C.A., Patrick, D.L., et al. (2018). COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs) - user manual.
Mokkink, L.B., Prinsen, C.A., Patrick, D.L., et al. (2018). COSMIN methodology for systematic reviews of Patient-Reported Outcome Measures (PROMs) - user manual. https://www.cosmin.nl/tools/guideline-conducting-systematic-review-outcome-measures/.
Mokkink, L. B., Terwee, C. B., Patrick, D. L., et al. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63, 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006
Nelson, L. M., DiBenedetti, D., Pariser, D. M., Glaser, D. A., Hebert, A. A., Hofland, H., Drew, J., Ingolia, D., Gillard, K. K., & Fehnel, S. (2019). Development and validation of the Axillary Sweating Daily Diary: A patient-reported outcome measure to assess axillary sweating severity. Journal of Patient-Reported Outcomes, 3, 59. https://doi.org/10.1186/s41687-019-0148-8
Panhofer, P., Zacherl, J., Jakesz, R., Bischof, G., & Neumayer, C. (2006). Improved quality of life after sympathetic block for upper limb hyperhidrosis. British Journal of Surgery, 93, 582–586. https://doi.org/10.1002/bjs.5304
Prinsen, C. A., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., De Vet, H. C., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research : An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation. https://doi.org/10.1007/s11136-018-1798-3
Rethlefsen, M. L., Kirtley, S., Waffenschmidt, S., et al. (2021). PRISMA-S: An extension to the PRISMA statement for reporting literature searches in systematic reviews. Systematic Reviews, 10, 39. https://doi.org/10.1186/s13643-020-01542-z
Schreiner, W., Mykoliuk, I., Dudek, W., & Sirbu, H. (2019). Impact of selective quality of life analysis in patients with local hyperhidrosis after sympathicus clipping. Zentralblatt fur Chirurgie, 144, 139–145. https://doi.org/10.1055/a-0808-5003
Şener, S., & Karakoç, Y. (2019). Effects of direct current administration on hyperhidrosis disease severity scale in patients with axillary hyperhidrosis. BioMed Research International, 2019, 3232015. https://doi.org/10.1155/2019/3232015
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. BMJ, 350, g7647. https://doi.org/10.1136/bmj.g7647
Skroza, N., Bernardini, N., La Torre, G., & La Viola, G. (2011). Correlation between Dermatology Life Quality Index and Minor test and differences in their levels over time in patients with axillary hyperhidrosis treated with botulinum toxin type A. Acta Dermatovenerologica Croatica, 19, 16–20.
Strutton, D. R., Kowalski, J. W., Glaser, D. A., & Stang, P. E. (2004). US prevalence of hyperhidrosis and impact on individuals with axillary hyperhidrosis: Results from a national survey. Journal of the American Academy of Dermatology, 51, 241–248. https://doi.org/10.1016/j.jaad.2003.12.040
Swartling, C., Naver, H., & Lindberg, M. (2001). Botulinum A toxin improves life quality in severe primary focal hyperhidrosis. European Journal of Neurology, 8, 247–252. https://doi.org/10.1046/j.1468-1331.2001.00207.x
Terwee, C. B., Jansma, E. P., Riphagen, I. I., & de Vet, H. C. (2009). Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Quality of Life Research, 18, 1115–1123. https://doi.org/10.1007/s11136-009-9528-5
Terwee, C.B., Prinsen, C.A., Chiarotto, A., et al. (2017), COSMIN methodology for assessing the content validity of Patient-Reported Outcome Measures (PROMs). User manual.
Tetteh, H. A., Groth, S. S., Kast, T., Whitson, B. A., Radosevich, D. M., Klopp, A. C., D’Cunha, J., Maddaus, M. A., & Andrade, R. S. (2009). Primary palmoplantar hyperhidrosis and thoracoscopic sympathectomy: A new objective assessment method. The Annals of Thoracic Surgery, 87, 267–274. https://doi.org/10.1016/j.athoracsur.2008.10.028
Varella, A. Y., Fukuda, J. M., Teivelis, M. P., et al. (2016). Translation and validation of hyperhidrosis disease severity scale. Revista Da Associacao Medica Brasileira (1992), 62, 843–847. https://doi.org/10.1590/1806-9282.62.09.843
Vissers, T., & Vries, R.D. (2018). Quality of life (QoL) search blocks.
Vorkamp, T., Foo, F. J., Khan, S., Schmitto, J. D., & Wilson, P. (2010). Hyperhidrosis: Evolving concepts and a comprehensive review. Surgeon, 8, 287–292. https://doi.org/10.1016/j.surge.2010.06.002
Wade, R., Jones-Diette, J., Wright, K., Layton, A. M., & Woolacott, N. (2019). Hyperhidrosis quality of life measures: Review and patient perspective. The Journal of Dermatological Treatment, 30, 303–308. https://doi.org/10.1080/09546634.2018.1506080
Weldring, T., & Smith, S. M. (2013). Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Services Insights, 6, 61–68. https://doi.org/10.4137/hsi.s11093
Wheaton, M. G., Braddock, A. E., & Abramowitz, J. S. (2011). The sweating cognitions inventory: A measure of cognitions in hyperhidrosis. Journal of Psychopathology and Behavioral Assessment, 33, 393–402. https://doi.org/10.1007/s10862-010-9211-8
Funding
Open Access funding enabled and organized by Projekt DEAL. The study was funded by a grant from Dr. August Wolff GmbH & Co. KG Arzneimittel.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Christian Apfelbacher has received institutional funding from Dr. August Wolff GmbH & Co. KG Arzneimittel for research on the measurement properties of the HidroQoL and consultancy fees from Dr. August Wolff GmbH & Co. KG Arzneimittel, Sanofi Genzyme and LEOPharma. MG is lead author and CA is senior author of a validation paper of the HidroQoL which is included in this systematic review.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Gabes, M., Knüttel, H., Kann, G. et al. Measurement properties of patient-reported outcome measures (PROMs) in hyperhidrosis: a systematic review. Qual Life Res 31, 671–686 (2022). https://doi.org/10.1007/s11136-021-02958-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-021-02958-3