Abstract
Purpose
To assess awareness of, opinion about and adherence to evidence-based guidelines on chronic rhinosinusitis among Dutch Otolaryngologists.
Methods
We assessed implementation of two guidelines, one Dutch and one European, that are both intended for diagnosis and treatment of patients with chronic rhinosinusitis. We invited 485 Otolaryngologists to fill out a questionnaire and report on their opinion on and adherence to the guidelines. The adherence was further tested by 4 clinical case scenarios, derived from guideline recommendations.
Results
166 (34%) completed the questionnaire. 99% of the respondents was aware of one or both guidelines. Most respondents (90%) consider the guidelines as directing or supportive for their clinical practice based on the clinical case scenarios, between 62 and 99% of the respondents act according to guidelines. Concerning diagnosis, CT-imaging is performed more and allergy testing less than recommended. Where multiple treatment options are recommended, the responses are more heterogeneous as a result of this. Nonetheless, high recommended treatment was chosen more often. Otolaryngologists were reluctant in surgical treatment as a first option, which is according to the guidelines.
Conclusions
Overall, both the EPOS and CBO guideline are well known among Dutch Otolaryngologists and 90% indicates that the guideline is important in their daily practice. Adherence to the guidelines is sufficient to high. If multiple treatment or diagnostic options are recommended this leads to a more heterogeneous response pattern. Recommendations with a high grade of recommendation were followed up most often.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Otolaryngologists are both encouraged and expected to incorporate available evidence-based clinical guidelines in daily practice [1]. Their use has become standard of care in most hospitals. For many conditions in Otolaryngology, (inter)national guidelines have been developed [2, 3]. However, the publication of a clinical practice guideline does not immediately result in implementation of the use of the guideline in daily practice [4]. In 1996, a Pathman et al. developed a model for different steps in the implementation of guidelines. Clinicians must be aware of the guideline, agree, adopt the guidelines in clinical practice for their patients, and then actually adhere to the guideline at appropriate times. With each step, there is a risk of losing clinicians in the process of implementing a guideline [5]. After implementation, the guideline can be integraded in a shared decision making approach, with integration of patient specific circumstances or values [6]. Numerous barriers and facilitators of guideline implementation have been identified, that consist of patient, physician, environmental, and guideline-related factors [7,8,9,10,11].
The self-reported adherence to evidence-based guidelines among Dutch Otolaryngologists has been previously assessed, in 2010, and is considered rather high [2]. That is, 62% indicated that their daily practice was supported by guidelines, and 32% stated that guidelines guided their clinical practice.
In this article, we will focus only on guidelines concerning chronic rhinosinusitis (CRS), which is a common disease in the practice of Otolaryngologists, with a reported prevalence ranging from 2 to 11% [12, 13]. For this condition, multiple guidelines have been developed [14,15,16,17].
In The Netherlands, the Dutch Society of Otolaryngology and Head & Neck Surgery initiates and maintains evidence-based guidelines for Otolaryngologists [18]. They recommend the use of the Dutch guideline CBO [15]. However, the authors suspect from their own experience that the European guideline, EPOS, is also widely used [16]. The guidelines are available for free on the internet since 2010 and 2012.
In our study, we evaluated the self-reported awareness of the CBO [15] and EPOS [16] guidelines among Dutch Otolaryngologists, their opinion on these guidelines, and the implementation of these guidelines based on clinical scenarios.
Methods
Compliance with ethical standards
This study does not involve patients. The Otolaryngologists were approached without obligation and filled out the questionnaire anonymously.
National survey
Between May 2017 and December 2017, we performed a survey among Dutch Otolaryngologists. We send a questionnaire to 485 Otolaryngologists by e-mail and mail, and the request was repeated twice. The questionnaires took respondents 10–15 min.
General questions
The first part of the questionnaire related to respondent characteristics, i.e., gender, PhD grade, training in evidence-based practice, time registered as Otolaryngologist, area(s) of interest and how often they read publications related to CRS. We further asked them about the awareness and opinion of both guidelines, the self-reported adherence to the guidelines and reasons not to apply the guidelines [7,8,9,10,11] (see Electronic supplementary material; complete questionnaire).
Clinical case scenarios
The second part of the questionnaire existed of four clinical case scenarios concerning diagnosis and treatment of patients with CRS. We posed questions on clinical decisions that they would make in these cases and compared their answers to the content and recommendations of the two guidelines, with the intention to provide further insight into the adoption of and adherence to the guideline. The clinical case scenarios were designed to be representative for patients encountered in daily practice.
The recommendations, with corresponding grade of recommendation (GoR), for CBO and EPOS were extracted from the guidelines and compared [19]. EPOS only provides recommendations on treatment options, CBO provides recommendations on both diagnosis and treatment. Therefore, we included questions about both treatment and diagnosis in our clinical case scenarios. For the EPOS guideline, advice regarding diagnosis was retrieved from the full-text of the guideline [16].
The clinical case scenarios are based on patients with (cases 1 and 4) and without nasal polyps (NP) (cases 2 and 3), with (cases 3 and 4) or without (cases 1 and 2) prior treatment. There are four questions concerning diagnosis (1.1, 1.2, 1.3, and 2.1) and four concerning therapy (1.4, 2.2, 3.4, and 4.4).
If provided, the GoR (high, medium, moderate, and low) was extracted from the guideline [19]. The corresponding type of research evidence can be found in Appendix 1 (Electronic supplementary material). We incorporated questions that were based on different GoR, since we expect that responses might be divert. For recommendations with a high GoR, we expect that most respondents will adhere to the guideline, and therefore, clinical practice will show probably little variation. For a lower GoR, we expect less adherence and more variation in adherence to the guideline and in clinical practice. We expect a similar outcome for questions based on contradicting GoRs.
See Table 1 for clinical case scenarios and accompanying questions. See complete questionnaire in Electronic supplementary material for all answer options. Data were analyzed using SPSS (version 21) [20].
Results
General questions: respondent characteristics
Of the 485 contacted Otolaryngologists, 166 (34%) replied. Five respondents indicated that their discipline was only head and neck surgery. In total, 161 (33.2%) completed the questionnaire, their baseline characteristics did not differ and can be found in Table 2.
Respondents could indicate their area of interest (multiple options possible). The results are described in Table 3.
General questions: evidence-based practice behavior
138 respondents (86%) have had training in evidence-based practice. 61 respondents (39%) indicate that they read publications on rhinosinusitis once a month or more, the remaining respondents read publications on rhinosinusitis less than once a month.
General questions: awareness of, opinion on, and self-reported adherence to the guidelines
Of the 161 respondents, 1 respondent (1%) was not aware of any guideline. 154 (96%) were aware of the CBO guideline and 119 (74%) of the EPOS guideline. 111 respondents (69%) were aware of both guidelines. Two respondents (1%) were aware of guidelines beside CBO and EPOS, namely, the guideline by Rosenfeld [14].
Of the 154 Otolaryngologists aware of the CBO guideline, the guideline is used daily by 60 respondents (39%), 2–3 times a week by 36 respondents (23%), and once a week or less by 41 respondents (27%). Of the 119 respondents aware of the EPOS guideline, 35 (29%) uses it every day, 34 (29%) 2–3 times a week, and 45 (39%) uses it once a week or less.
The CBO guideline is directing practice for 37 (24%) respondents, supportive for 100 (65%) and impeding for three (2%). Of the remaining respondents; three (2%) do not know, two (1%) think of the guideline as “an opinion”, and 5 (3%) state that it should be revised. The EPOS guideline is directing practice for 34 respondents (29%), supportive for 72 (61%) and impeding for 5 respondents (4%). Three respondents (3%) state that the guideline should be revised. The opinion of the respondents on the content of the guideline can be found in Table 4. For CBO guideline, 115 (75%) respondents think that it is most or partly based on clearly traceable sources, for EPOS this is similar, 91 respondents (76%).
To provide more insight in the opinion of the respondents on the two guidelines, we asked them to indicate barriers to application of the guideline (despite being aware of it) [7,8,9,10,11] and their answers can be found in Fig. 1. There are no differences between the guidelines. All selected barriers play a role, but the largest barrier experienced by our respondents is the amount of information provided in the guidelines.
Clinical case scenarios
The clinical case scenarios with accompanying questions can be found in Table 1. The answers to the questions were compared to both guidelines. For question 1.1, EPOS and CBO use the exact same definition (see Electronic supplementary material Appendix 2), and they do not provide a grade of recommendation to this definition. As expected, most respondents (143; 89%) use the correct definition of anamnestic symptoms and there was not much variation in answer options.
For question 1.2, the responses can be found in Table 5. For symptoms that both guidelines advise to check (asthma, allergy, smoking), most respondents comply. The symptoms not mentioned by one or two guidelines (passive smoking and viral infections), are far less frequently asked. Note that reflux is not recommended to ask by both guidelines; nevertheless, one-third of respondents asks this anyway.
Question 1.3 (see Table 1) is on diagnostics tests for a patient with complaints of CRS, with polyps seen by nasal endoscopy. The guidelines give multiple recommendations, with varying GoR, and we also see variation in answers between respondents. 73 respondents (45%) would perform no additional tests, corresponding to both guidelines. 46 (29%) would perform a CT scan, even though it is not advised by both guidelines (EPOS; no GoR, CBO; moderate/low). It is advised only pre-operative or when in doubt about diagnosis in patients with persistent complaints. Allergy testing is advised by both guidelines for patients with anamnestic symptoms of allergy (EPOS: no GoR, CBO: moderate), and 66 (41%) of respondents would perform the test for this patient. No respondent would perform an X-ray or a maxillary sinus culture, and this corresponds with the advice of both guidelines (EPOS: no GoR, CBO moderate). 11 respondents (7%) would perform a nasal culture. This is not mentioned by EPOS and not advised by CBO (GoR medium). In total, 114 (71%) of respondents act according to the guideline(s).
Question 1.4 (see Table 1) discusses treatment options for a patient with CRS and nasal polyps. Answers and guideline recommendations can be found in Table 6. Both guidelines advise intranasal steroids with high recommendation, which is followed by 93%. In total, 141 (88%) act of respondents act according to the guideline(s). Striking is that nasal saline irrigation is applied by 79% of respondents, while it is only mentioned by 1 guideline with a low GoR.
Clinical case 2 concerns a patient with CRS without mucosal disease at nasal endoscopy (see Table 1). For question 2.1, the respondents indicate the diagnostic test(s) that they would perform. The guidelines recommend multiple diagnostic strategies and we see this reflected in the varied response. 68 respondents (42%) would not perform additional testing. 56 (35%) would perform a CT scan. 57 (35%) would perform allergy testing. According to the guidelines, all these choices are justified. The recommendations are identical for question 1.3. One (1%) respondent would perform an X-ray, one (1%) a maxillary sinus culture, one (1%) an X-OPT, and two (1%) a nasal culture. This does not correspond with both EPOS or CBO (see question 1.3 for recommendations). In total, only 3% would perform diagnostic tests that were not advised by the guidelines.
For question 2.2, the answers are displayed in Table 6. In total, 107 (66%) of respondents act according to the guideline(s). Most respondents chose the answer option with a high GoR (intranasal steroids and saline irrigation).
Clinical case 3 concerns a patient with CRS without nasal polyps, confirmed by both nasal endoscopy and CT, that has been treated with intranasal steroids. For guidelines recommendations, see Table 6 (2.2). Note that this patient can be considered as having an exacerbation. There are multiple treatment options according to the guidelines, this is reflected in a varied response. Most respondents chose 3 or more treatment modalities. 60 (37%) would start nasal saline irrigation, 98 (61%) would start short-term antibiotics and 22 (14%) long-term. Concerning long-term antibiotics, the guidelines provide a contradicting recommendation. 99 (62%) would continue intranasal steroids, and 49 (30%) would start systemic steroids. All these treatment options are considered valid according to the guidelines. 24 (15%) would start decongestants (in combination with another treatment option) and 29 respondents (18%) would choose FESS, both treatment options are not according to guideline recommendations. In total, 113 (62%) of respondents act according to the guideline(s).
Clinical case 4 concerns a patient with CRS and nasal polyps that has been operated but still has complaints, with sign of disease at nasal endoscopy. For guidelines recommendations, see Table 6 (1.4). Note that this patient can be considered as having an exacerbation. Multiple treatment options are possible according to the guidelines, and this is reflected by a varied response. Most respondents choose a combination of 3 or more treatment options. 124 (77%) would treat this patient with saline irrigation and 137 (85%) with intranasal steroids). 63 (39%) would start short-term antibiotics, 28 (17%) long-term. 96 (60%) would start systemic steroids. All these treatment options correspond to the guideline(s) (except for long-term antibiotics according to CBO). High recommended treatment was chosen more often, while treatment option with moderate, low, or contradicting recommendations is chosen less often. 2 (1%) opt for revision surgery. Both guidelines state that revision surgery is reserved for patients failing maximal conservative therapy (EPOS: no GoR, CBO: Moderate GoR). In total, 159 (99%) of respondents act according to the guideline(s).
Discussion
Synopsis of key findings
Guidelines on rhinosinusitis are very well known by Dutch Otolaryngologists. The guideline recommended by the Dutch Society of Otolaryngology and Head & Neck Surgery, the CBO guideline [15] is best known, but also the EPOS guideline [16] is very well known, as we expected in advance. Most respondents (99%) are aware of one or two guideline and the majority indicates that they have confidence in the guideline. The self-reported adherence to the guideline is high, 60% of respondents uses the guideline every day or 2–3 times a week, and 90% indicates that the guideline is leading or supportive in their daily practice. Concerning the clinical case scenarios, 62–99% respondents responded according to the guidelines, which we consider to be sufficient to good adherence. For diagnosis of CRS with polyps, CT-imaging is performed more and allergy testing less than recommended. It is also noticeable that if multiple or contradicting treatment options are recommended, the overall response is more heterogeneous as a result of this. Nonetheless, high recommended treatment was chosen more often. In general, surgical treatment is not chosen as first option, which is according to both guidelines.
Limitations of the study
Some limitations can be addressed. First, our response rate was 34%, which means that a selection of Otolaryngologists has responded. This could be a selection that known the topic and guideline(s) very well and is positive about the use, or vice versa. We believe that our sample is representative of all Dutch Otolaryngologists, since their baseline characteristics do not differ (Table 2). When we look at the specific interest of our respondents (Table 3), this shows a varied group, which is also a resemblance of Dutch Otolaryngologists.
Second, we tried to assess adherence to the guideline according to questions based on clinical case scenarios. Overall, 62–99% respondents responded according to the guidelines, which we consider to be sufficient to good adherence. This might not reflect their actual clinical behavior, since there is the possibility of socially desirable answers, and since it was possible for respondents to check the guideline for the right answers while filling out the questionnaire. The actual adherence could be lower than we found in this study. In clinical practice, less participants might act according to the guidelines.
Third, this study focusses on the question if the recommendations of the guidelines are implemented. The actual purpose of the guideline, i.e., whether it has led to better treatment outcomes, has not been studied by us [3]. This is a different research question and could be interesting for further research on this topic.
Comparison to other studies
In the study of Aarts et al. [2], 61% of Dutch Otolaryngologists reported to have accurate knowledge of the CBO guideline, our results show adherence has improved since then. Other studies on the implementation of CBO or EPOS have not been performed. A study on the implementation of the guideline by Rosenfeld [14] based on retrospective chart review of 10 Otolaryngologists showed that adherence to recommendations on rhinosinusitis ranged from 4 to 88% and concluded that adherence was overall rather low [21]. Our results show better adherence, but it needs to be considered that self-reported adherence and clinical practice might not correspond [3].
Implications for future guideline development
Based on the results of our survey, we formed recommendations for the future development or revisions of the guidelines. As we expected from the previous literature, we also found multiple and various barriers to the use of the guidelines [7,8,9,10,11]. Of our respondents, 60% indicated reasons not to apply the guidelines (see Fig. 1). For both the CBO and EPOS guidelines, the most important barrier was that they contain too much and too detailed information. Therefore, authors of guidelines have to watch for concise information, clear recommendations, and a manageable guideline.
Because of the regularly expected need for actualization, guidelines have an “expiry date”, after that date, the guideline is no longer valid [22]. This could apply to both guidelines, since they date from 2010 to 2012. Recommendations could be outdated or overtaken by new publications. We, therefore, advise authors to update the guideline regularly, with a maximum of 5 years [22].
In advance, we expected that on topics, where the guideline was very clear and directive, there would be little variation in answers. For topics, where the guidelines give multiple options or are contradictive, we expected more variation in response. With a few exceptions, our results mostly confirmed this. Therefore, we recommend authors to formulate their recommendations in a way that the content and intention are clear to the reader. Authors should also take into account the fact that recommendations with lower GoR might be followed up less than recommendations with high GoR.
We found contradictive recommendations between guidelines, e.g., long-term antibiotics for the treatment of CRS. It is not desirable that there are differences between guidelines, since this is confusing for its reader. Our results show this, because there in case of contradicting recommendations, we found more variation in practice and less adherence. Authors of guidelines should compare their recommendations with those of other guidelines (if available) to check for contradictions.
References
RVS (Raad voor Volksgezondheid en Samenleving) (2017) Zonder context geen bewijs. Over de illusie van evidence-based practice in de zorg. Advies 17-05:1–92
Aarts MC, van der Heijden GJ, Siegers C, Grolman W, Rovers MM (2012) Awareness of, opinions about, and adherence to evidence-based guidelines in otorhinolaryngology. Arch Otolaryngol Head Neck Surg 138:148–152
Ryan MA (2017) Adherence to clinical practice guidelines. Otolaryngol Head Neck Surg 157:548–550
Glasziou P, Haynes B (2005) The paths from research to improved health outcomes (editorial). ACP J Club 142:8–10
Pathman DE, Konrad TR, Freed GL et al (1996) The awareness-to-adherence model of the steps to clinical guideline compliance: the case of pediatric vaccine recommendations. Med Care 34:873–889
Towle A, Greenhalgh T, Gambrill J, Godolphin W (1999) Framework for teaching and learning informed shared decision making. BMJ 319:766–771
Lugtenberg M, Zegers-Van Schaick JM, Westert GP, Burgers JS (2009) Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Biomed Central 4:1–9
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PC et al (1999) Why don’t physicians follow clinical practice guidelines? A framework for improvement. Am Med Assoc 282:1458–1468
Oxman AD, Glasziou P, Williams JW (2008) What should clinicians do when faced with conflicting recommendations? Find guidelines that are systematic and transparent, and make informed judgements. BMJ 337:a2530
Grol R, Dalhuijsen J, Thomas S, In ‘t Veld C, Rutten G, Mokkink H (1998) Attributes of clinical guidelines that influence use of guidelines in general practice: observational study. BMJ 317:858–861
Grol R (2001) Successes and failures in the implementation of evidence-based guidelines for clinical practice. Med Care 39:46–54
Hastan D, Fokkens W, Bachert C, Newson RB, Bislimovska J, Bockelbrink A et al (2011) Chronic rhinosinusitis in Europe—an underestimated disease. A GA(2)LEN study. Allergy 66:1216–1223
Shashy RG, Moore EJ, Weaver A (2004) Prevalence of the chronic sinusitis diagnosis in Olmsted County, Minnesota. Arch Otolaryngol Head Neck Surg 130:320–323
Rosenfeld RM et al (2015) Clinical practice guideline (update): adult sinusitis. Otolaryngol Head Neck Surg 152:S1–S39
Fokkens W, Bel E, van Haastert R et al (2018) CBO Richtlijn Chronische Rhinosinusitis en Neuspoliepen 2010. https://www.nvalt.nl/kwaliteit/richtlijnen/copd-astma-allergie//COPD%20-%20astma%20-%20allergie/Richtlijn-rhinosinusitis-Augustus%202010.pdf. Accessed 13 Aug 2018
Lund W, Fokkens V, Mullol J et al (2012) European position paper on rhinosinusitis and nasal polyps (EPOS). Rhinology 50:suppl.23
Desrosiers M, Evans G, Keith P et al (2011) Canadian clinical practice guidelines for acute and chronic rhinosinusitis. Allergy Asthma Clin Immunol 7:2
https://www.kno.nl/kno-vereniging/. Accessed 19 July 2018
Atkins D, Best D, Briss P et al (2004) Grading quality of evidence and strength of recommendations. GRADE Working Group. BMJ 328:1490
IBM Corp (2012) IBM SPSS Statistics for Windows, Version 21.0. IBM Corp., Armonk
Darrat I, Yaremchuk K, Payne S, Nelson M (2014) A study of adherence to the AAO-HNS “Clinical Practice Guideline: Adult Sinusitis”. Ear Nose Throat J 93:338–352
Gurgel RK (2015) Updating clinical practice guidelines: how do we stay current? Otolaryngol Head Neck Surg 153:488–490
Acknowledgements
Prof. Dr. G.J. Hordijk. Prof. Dr. R.J. Stokroos. Dutch Society of Otolaryngology & Head and Neck Surgery. Drs. J.J. Kaper. Drs. I. Ligtenberg-van de Drift. J. Huisman.
Funding
No funding was received for this work.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
OpenAccess This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Kaper, N.M., Aarts, M.C.J., van Benthem, P.P.G. et al. Otolaryngologists adhere to evidence-based guidelines for chronic rhinosinusitis. Eur Arch Otorhinolaryngol 276, 1101–1108 (2019). https://doi.org/10.1007/s00405-019-05289-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00405-019-05289-9