Abstract
Background and aims
Difficult endotracheal intubation is one of the most challenging operations in anesthesia. How to better predict difficult airway and make corresponding preparations to reduce the occurrence of accidents is a difficult task faced by anesthesiologists every day. This study decide to evaluate the value of the Upper Lip Bite Test (ULBT) and the Modified Mallampati Test (MMT) in predicting difficult intubation under direct laryngoscopy and find out the most intuitive and simple method to predict difficult intubation under direct laryngoscopy in apparently normal patients.
Patients and methods
This descriptive-analytical study was performed on 450 patients for elective surgery under general anesthesia requiring endotracheal intubation. The ULBT and MMT grading were evaluated preoperatively and Cormack and Lehane’s (CL) classification was recorded on the day of surgery during intubation under direct laryngoscopy. The accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), likelihood ratio (LR), Youden index and area under ROC curve of ULBT and MMT respectively and in combination were calculated and compared. And the consistency between the total scores of ULBT and MMT combined in different ways and CL grading was counted.
Results
Of the 450 patients, 69 (15.3%) were classified as difficult cases of direct laryngoscopy. The accuracy, sensitivity, specificity, PPV and NPV of ULBT were 81.33, 11.59, 93.96, 25.81, 85.44%; and those the corresponding values for MMT were 66.22, 62.32, 69.29, 26.88 and 91.03%. A combination of ULBT and MMT did not improve the sensitivity in the sample tested. The combined total scores of ULBT and MMT in both ways were less consistent with CL grading in predicting difficult intubation under direct laryngoscopy.
Conclusion
Based on findings of current study, we conclude that ULBT and MMT for difficult intubation have only poor to moderate discriminative power when used alone.
The combination of the two tests in fractional form is also not a good predictor of difficult intubation under direct laryngoscopy.
Trial registration
Chinese Clinical Trial Registry, ChiCTR2100052987, Registered 07 November 2021, http://www.chictr.org.cn
Similar content being viewed by others
Introduction
In recent years, with the updating of anesthesia equipment, the level of anesthesia technology has been improved. The clinical application of general anesthesia and endotracheal intubation is becoming more and more widespread, but the incidence of difficult intubation as high as 1–18% is still a difficult situation for clinical anesthesiologists [1]. Failure of oxygenation or an unexpectedly difficult airway can result in brain hypoxia, brain damage and even death [2].
By being able to anticipate the presence of a difficult airway, we will be able to plan for appropriate equipment, experienced personnel, and alternative airway management strategies, such as endotracheal intubation with spontaneous breathing and awareness [3].
Therefore, it is important to have a simple and direct prediction of difficult airways in seemingly normal patients, but there is no standard test to assess and predict. Many researchers have attempted to predict difficult intubation by using simple bedside physical examinations, such as the upper lip bite test (ULBT) and the modified mallampati test (MMT) [4]. It has been reported that ULBT appears to be a useful bedside test for predicting difficult airways with moderate sensitivity and high specificity, with higher accuracy than MMT [5,6,7]. Any test needs to be proven over and over again. The purpose of this study was to evaluate the value of these two tests in predicting difficult intubation under direct laryngoscopy and find out the most intuitive and simple method to predict difficult intubation under direct laryngoscopy in patients without risk factors for difficult airways.
Materials and methods
Study design
This was a prospective observational, single-centre study which was conducted in Qilu Hospital of Shandong University between 2021 and 2022. The study was approved by the Medical Ethics Committee of Qilu Hospital of Shandong University (Approval Document No. 2020 (095)) and registered in The Chinese Clinical Trial Registry (Registration Number: ChiCTR2100052987) on 07/11/2021. All participating patients were informed of the purpose and process of the study and signed an informed consent for anesthesia.
Participants
Four hundred and fifty adults aged between 18 to 75 years old with American Society of Anesthesiologists (ASA) physical status I-II, who were scheduled to undergo endotracheal intubation general anesthesia for orthopedics, thoracic, neurosurgery, and general surgery were enrolled in this prospective observational study. Patients who were unwilling to participate, patients with body mass index (BMI) > 35 kg/m2, muscle weakness, limited mouth opening, and a large tongue, patients without teeth or with dentures, patients with limited neck mobility and mandible, emergency surgery patients, and subjects who could not cooperate were excluded from the study.
Definitions
Difficult intubation: Endotracheal intubation by an experienced anesthesiologist requires more than three attempts, regardless of the presence or absence of airway pathology.
MMT: Patient was asked to sit up with his mouth open as much as possible and to stick out his tongue without making a sound. Oropharyngeal structures are visualized and classified with the help of a flashlight [8,9,10].
Class I: soft palate, fauces, uvua and pillars
Class II: soft palate, fauces and uvula
Class III: Soft palate and base of uvula
Class IV: Hard palate only
I & II are considered as predictors of easy intubation.
III & IV are considered as predictors of difficult intubation.
ULBT: ULBT evaluates the range and freedom of mandibular movement and the architecture of the teeth [11]. In this examination, patients were asked to bite their upper lip with lower incisors and were graded accordingly by the upper lip mucosa as the boundary [9].
Class I: Lower incisor can bite the upper lip above the vermillion line
Class II: Lower incisor can bite the upper lip below the vermillion line
Class III: Lower incisors can not bite upper lip
Class I &II are predictive of easy intubation whereas Class III suggests difficult intubation [12].
CL classification: After adequate muscle relaxation, the patient is placed in the sniffing position, but no external laryngeal pressure is applied [9]. On direct laryngoscopy glottis view was classified according to CL classification.
Class I: full view of glottis is seen
Class II: Glottis partly exposed, only posterior commissure is seen
Class III: Only epiglottis is seen
Class IV: Epiglottis is not seen
Class I and II are considered as easy intubation and III and IV as difficult Intubation [8].
Anesthesia management
The day before surgery, an anesthesiologist visited the enrolled patients and recorded all data relevant to the subjects, including type of surgery, age, gender, weight, height, BMI, ASA, medical history and the grade of ULBT and MMT on prepared forms. Subsequently, the second anesthesiologist with more than 3 years experience in anesthesia performed a direct laryngoscopy on the day of surgery after sufficient muscle relaxation induced by anesthesia and determined each subject’s CL grading [13].
Endpoints
The combination of ULBT and MMT scores for predicting CL grading under direct laryngoscopy was the main endpoint of the study. Investigating the effectiveness of ULBT and MMT in the prediction of difficult airways was the secondary endpoint of the study.
Statistical analysis
SPSS 25 was used to analyze the data. Quantitative results, such as age, weight and height, BMI are presented in the form of mean and standard deviation. Frequency and percentage of qualitative variables such as gender and ASA status were calculated. Data for each continuous variable were analyzed for normal distribution using the Kolmogorov-Smirnov test combined with histograms and P-P plots. Analysis of continuous variable with a normal distribution was performed using the two-tail Student’s t-test and the Chi-square test was used for categorical variables. Paired Chi-square test (McNemar-Bowker Test) was used to test the correlation between the two variables in the paired design of multi-classification ordered variables. Accuracy, sensitivity, specificity, PPV and NPV were calculated for MMT and ULBT, while maintaining CL grading as the gold standard. The p-value and Kappa value of paired Chi-square test (McNemar-Bowker Test) for the total score of MMT and 2-fold ULBT and CL grading and for the total score of ULBT and 2-fold MMT and CL grading was counted for predicting consistency of difficult intubation. P < 0.05 is considered significant [14].
The sample size was calculated while assuming the incidence of difficult laryngoscopy to be 4% [15]. Based on the preliminary experiment, the sensitivity of the MMT and ULBT were 0.9231 and 0.2308, respectively. We determined that 450 patients would be required to demonstrate a difference between two predicting tools with a type 1 error (α) of 5% and power (1-β) of 90% (two-sided) using the PASS program.
Results
A total of 611 patients with elective tracheal intubation and general anesthesia were enrolled in the study. One hundred thirty-three patients were excluded from preoperative visits due to lack of teeth or dentures, limited cervical mobility, poor coordination, and BMI greater than 35, and 28 patients were excluded due to cancelled operation for various reasons. Ultimately, data of 450 patients were analyzed (Fig. 1).
Two tests (ULBT and MMT) were performed on each patient. Of the 450 participants, 168 (37.3%) were classified as MMT Class I, 122 (27.1%) MMT Class II, 59 (13.1%) MMT Class III and 101 (22.4%) MMT Class IV. 250 (55.6%) participants were classified as ULBT Class I, 169 (37.6%) ULBT Class II and 31 (6.9%) ULBT Class III (Table 1).
Of the 450 patients, 69 (15.3%) were classified as difficult cases of intubation: 59 (85.5%) CL III and 10 (14.5%) CL IV. Easy laryngoscopy was found in 381 (84.7%) patients; 155 (40.7%) CL I and 226 (59.3%) CL II. There were significant differences in mean age between difficult and easy laryngoscopy groups (p < 0.05), while weight, height, BMI, gender and ASA grade were not significant (p > 0.05) (Table 2).
The accuracy, sensitivities, specificities, PPV, NPV, likelihood ratios, and area under ROC curve of the various tests for the prediction of difficult intubation are listed in Table 3 and Fig. 2.
The p-value of paired Chi-square test (McNemar-Bowker Test) for the total score of MMT and 2-fold ULBT and CL grading was 0.128 (> 0.05) and Kappa value was 0.160 (< 0.4), indicating that there was no statistical difference between the prediction results of the two methods, but the consistency of the two methods was poor. Therefore, the total score of MMT and 2-fold ULBT couldn’t be used to directly predict CL grade under direct laryngoscopy. Similarly, the p-value of paired Chi-square test for the total score of ULBT and 2-fold MMT and CL grading was <0.001 (<0.05) and the Kappa value was 0.114 (<0.4), suggesting that the prediction results of the two ways were statistically different, but the consistency of the two ways was still not strong. The total score of ULBT and 2-fold MMT also did not directly predict CL grade under direct laryngoscopy (Table 4).
In our study, the accuracy of ULBT (81.33%) was higher than that of MMT (66.22%), and the specificity of ULBT (93.96%) was higher than that of MMT (69.29%). In particular, in our trial, the sensitivity of the ULBT group (11.59%) was significantly lower than that of the MMT group (62.32%). The sensitivity, specificity, and accuracy of the combination of MMT and ULBT in the assessment of difficult intubation were between the two alone.
Among the 69 patients with difficult laryngoscopic view, the percentage of patients with MMT class > II was 62.3%(43 of 69), whereas only 8 patients (11.6%) had ULBT grade III.
Discussion
Endotracheal intubation is an important means to maintain airway patency. A lack of necessary preparation for difficult airway can have disastrous consequences. It is always the goal of anesthesiologists to accurately judge the difficulty of intubation before operation.
Because ULBT requires no position restriction, no special equipment, no extra light and no voice restriction, which is very applicable, and the subjects can complete the test within a few seconds, it has become a popular bedside test for predicting difficult airways.
In previous tests, the comprehensive assessment of ULBT was a better predictor of difficult airways than MMT [5]. But current research results indicate that the clinical effect of ULBT is not superior to MMT, because sensitivity should be paid more attention to in judging and predicting the value of difficult intubation factors, so as not to miss patients with actual difficult airway and cause serious consequences.
In this study, the predicted results of the two tests, MMT and ULBT, were not as described in the study by Kahn et al. [5, 13, 16]. However, the most significant difference was that the sensitivity of the ULBT test in our trial was much lower. This ratio was only 11.6%, compared with 76.5% in the original experiment5, which was similar to some other studies [17,18,19]. This means that the ULBT test will fail to identify some patients with difficult airways (a large number of patients present with false negatives).
We concluded that one of the factors contributing to the low sensitivity of ULBT is the low incidence of ULBT class III in subjects. According to a summary of several literatures, this feature can be explained by skeletal variation and soft tissue redundancy in Far East Asians [17].
ULBT evaluates the range and degree of freedom of mandibular motion as well as the structure of teeth. In addition, ULBT is classified by the upper lip mucosa as the boundary. Therefore, any differences in these tissues will affect the results of ULBT. In the field of orthodontic and maxillofacial surgery, several studies comparing soft tissues of different ethnic groups have been published [20,21,22,23,24]. The anthropological literature described that craniofacial and dental alignment varies from race to race and confirmed that there are significant racial differences in mandibular and maxillary morphological measurements [25,26,27]. Thus ULBT may be a useful predictor in some populations, but its utility for Asians may be limited [17].
According to literature reports, the upper lip of Chinese people is longer and sharper than that of caucasians [23]. A morphometric analysis on European-American and Asian subjects was performed by Chang and colleagues [24]. Far East Asian (Chinese, Korean, Japanese, and Taiwanese) men have significantly shorter skulls and smaller anterior skull base angles. Due to the relative retraction of the naso-maxillary complex and the relative anteriorness of the mandible, Chinese people tend to have a shorter middle face, a protruding mandible and an anteriorly moved temporomandibular joint (TMJ) [17, 24]. Thus, the scarcity of grade III ULBT in Asians can be explained as a result of excessive soft lip tissues and an anterior TMJ.
The value of MMT in predicting difficult intubation has been controversial. In an extensive systematic evaluation of 34,513 patients in 42 studies, Lee et al. found MMT ranged in accuracy from poor to good [28]. In this study, we found the specificity of MMT to be 69.3% which was almost near to the study conducted by Khan et al. (66.8%) [5] and Eberhart et al. (61%) [18]. The sensitivity of MMT in this study is 62.3%, which is Lower than of Jamuna et al. (80%) [10]. Although the modified test largely solves the mouth opening and tongue base size problems associated with oropharynx, patient cooperation is critical and the test should be demonstrated well by observers. The anesthesiologist’s experience with intubation may also lead to changes in results.
In our trial, neither test could reproduce the high area under ROC curve and NPV of Khan et al. [5], but the two indicators of MMT were both higher than those of ULBT, indicating that MMT has higher diagnostic accuracy than ULBT.
The total scores of the two tests combined in different ways were less consistent with CL classification in predicting difficult intubation, which may be because the sensitivity of the two tests was not high, so the total scores were not a good predictor.
Both tests had high PPV, meaning that both predicted easy intubation very well, while NPV that predicted the incidence of difficult intubation were low. This means that other tests are needed to better predict difficult airways.
The main advantage of our study is that both tests were evaluated by the same investigator, and CL grading was also evaluated by experienced anesthesiologists, thus reducing the error of interobserver variation to a large extent.This study innovatively proposed to predict difficult airways using the total scores of the two tests, although the results showed that this simple and intuitive method was not feasible. The limitation of our study is that we were not able to test patients who were uncooperative or had problems with their teeth or cervical spine, so the results are not applicable to everyone. Larger sample size and more diverse population are needed to validate the value of ULBT and MMT in predicting difficult intubation under direct laryngoscopy.
Conclusion
Although MMT and ULBT are easy to perform, they do not have high sensitivity, and misprediction results can lead to difficult intubation situations that are more dangerous. Both tests had high NPV and were better predictors of easy intubation rather than difficult intubation.The combination of ULBT and MMT in fractional form is also not a good predictor of intubation difficulties under direct laryngoscopy. Therefore, we should be more active in the search for more ideal tests and be prepared for the unexpected during anesthesia.
Availability of data and materials
All data generated or analysed during this study are included in this published article [and its supplementary information files].
Abbreviations
- ULBT:
-
Upper Lip Bite Test
- MMT:
-
Modified Mallampati Test
- CL:
-
Cormack and Lehane’s
- PPV:
-
Positive predictive value
- NPV:
-
Negative predictive value
- LR:
-
Likelihood ratio
- ASA:
-
American Society of Anesthesiologists
- BMI:
-
Body mass index
- CI:
-
Confidence interval
- TMJ:
-
Temporomandibular joint
References
Wajekar AS, Chellam S, Toal PV. Prediction of ease of laryngoscopy and intubation-role of upper lip bite test, modified mallampati classification, and thyromental distance in various combination. J Family Med Prim Care. 2015;4(1):101–5.
Thomas M, Saldanha NM. Comparison of upper lip bite test with modified mallampati score in predicting difficult intubation. Int J Sci Healthc Res. 2022;7(1):2455–7587.
Xu Z, Ma W, Hester DL, et al. Anticipated and unanticipated difficult airway management. Curr Opin Anaesthesiol. 2018;31(1):96–103.
Richa F, Chalhoub V, Gebrayel WB, et al. Upper lip bite test versus modified Mallampati classification in predicting difficult laryngoscopy and/or intubation among morbidly obese patients. J Clin Anesth. 2020;63:109761.
Khan ZH, Kashfi A, Ebrahimkhani E. A comparison of the upper lip bite test (a simple new technique) with modified Mallampati classification in predicting difficulty in endotracheal intubation: a prospective blinded study. Anesth Analg. 2003;96(2):595–9.
Faramarzi E, Soleimanpour H, Khan ZH, et al. Upper lip bite test for prediction of difficult airway: a systematic review. Pak J Med Sci. 2018;34(4):1019–23.
Koirala S, Shakya BM, Marhatta MN, et al. Comparison of upper lip bite test with modified mallampati test and thyromental distance for prediction of difficult intubation. Nepal J Med Sci. 2020;5(1):2–9.
Chavan RV, Sinharay M. Predicting difficult intubation: a comparison between upper lip bite test (ULBT) and modified mallampati test (MMT). Indian J Clin Anaesth. 2019;6(4):601–6.
Ali MA, Qamar-ul-Hoda M, Samad K. Comparison of upper lip bite test with Mallampati test in the prediction of difficult intubation at a tertiary care hospital of Pakistan. J Pak Med Assoc. 2012;62(10):1012–5.
Jamuna T, Rao MI, Naveen. Comparative study between MMT classification and ULBT for predicting difficulty during endotracheal intubation. J Evol Med Dent Sci. 2018;7(12):1428–33.
Bhanushali A, Date A. Evaluation of upper lip bite test and thyromental height test for prediction of difficult laryngoscopy: a prospective observational study. Airway. 2021;4:185–90.
Selvi O, Kahraman T, Senturk O, et al. Evaluation of the reliability of preoperative descriptive airway assessment tests in prediction of the Cormack-Lehane score: a prospective randomized clinical study. J Clin Anesth. 2017;36:21–6.
Mahmoodpoor A, Soleimanpour H, Golzari SEJ, et al. Determination of the diagnostic value of the modified mallampati score, upper lip bite test and facial angle in predicting difficult intubation: a prospective descriptive study. J Clin Anesth. 2017;37:99–102.
Ali ST, Samad K, Raza SA, et al. Ratio of height to thyromental distance: a comparison with mallampati and upper lip bite test for predicting difficult intubation in Pakistani population. J Pak Med Assoc. 2021;71(6):1570–4.
Arné J, Descoins P, Fusciardi J, et al. Preoperative assessment for difficult intubation in general and ENT surgery: predictive value of a clinical multivariate risk index. Br J Anaesth. 1998;80(2):140–6.
Khan ZH, Mohammadi M, Rasouli MR, et al. The diagnostic value of the upper lip bite test combined with Sternomental distance, thyromental distance, and interincisor distance for prediction of easy laryngoscopy and intubation: a prospective study. Anesth Analg. 2009;109(3):822–4.
Kim JC, Ki Y, Kim J, et al. Ethnic considerations in the upper lip bite test: the reliability and validity of the upper lip bite test in predicting difficult laryngoscopy in Koreans. BMC Anesthesiol. 2019;19:9.
Eberhart LHJ, Arndt C, Cierpka T, et al. The reliability and validity of the upper lip bite test compared with the mallampati classification to predict difficult laryngoscopy: an external prospective evaluation. Anesth Analg. 2005;101(1):284–9.
Myneni N, O'Leary AM, Sandison M, et al. Evaluation of the upper lip bite test in predicting difficult laryngoscopy. J Clin Anesth. 2010;22(3):174–8.
Hwang HS, Kim WS, McNamara JA. Ethnic differences in the soft tissue profile of Korean and European-American adults with normal occlusions and well-balanced faces. Angle Orthod. 2002;72(1):72–80.
Ioi H, Nakata S, Nakasima A, et al. Comparison of cephalometric norms between Japanese and Caucasian adults in antero-posterior and vertical dimension. Eur J Orthod. 2007;29(5):493–9.
Miyajima K, McNamara JA, Kimura T, et al. Craniofacial structure of Japanese and European-American adults with normal occlusions and well-balanced faces. Am J Orthod Dentofac Orthop. 1996;110(4):431–8.
Cooke MS, Wei SHY. A comparative-study of southern Chinese and British caucasian cephalometric standards. Angle Orthod. 1989;59(2):131–8.
Chang HP, Liu PH, Tseng YC, et al. Morphometric analysis of the cranial base in Asians. Odontology. 2014;102(1):81–8.
Hanihara T, Ishida H, Dodo Y. Characterization of biological diversity through analysis of discrete cranial traits. Am J Phys Anthropol. 2003;121(3):241–51.
Badawi-Fayad J, Cabanis EA. Three-dimensional procrustes analysis of modern human craniofacial form. Anat Rec Adv Integr Anat Evol Biol. 2007;290(3):268–76.
Perez SI, Bernal V, Gonzalez PN. Differences between sliding semi-landmark methods in geometric morphometrics, with an application to human craniofacial and dental variation. J Anat. 2006;208(6):769–84.
Lee A, Fan LTY, Gin T, et al. A systematic review (meta-analysis) of the accuracy of the Mallampati tests to predict the difficult airway. Anesth Analg. 2006;102(6):1867–78.
Acknowledgements
Not applicable.
Statement
All methods were performed in accordance with the relevant guidelines and regulations in the Ethics approval and consent to participate Declarations section.
Funding
The present research was supported by grants from the Shandong Provincial Natural Science Foundation [grant number ZR2021MH099, ZR2015HM038], Shenzhen Fundamental Research Program [grant number JCYJ20190807093801661], National Natural Science Foundation of China [grant number 81570044], and project supported by Hainan Province Clinical Medical Center.
Author information
Authors and Affiliations
Contributions
LYW conducted the study and wrote the first draft of the manuscript. LYW, KDZ, ZHZ and DXZ performed data analysis. HLW designed the study and revised the manuscript. FQ gave a lot of references in the process of revising the manuscript. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
The study was approved by the Medical Ethics Committee of Qilu Hospital of Shandong University (Approval Document No. 2020 (095)). All participating patients were informed of the purpose and process of the study and signed an informed consent for anesthesia.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Wang, Ly., Zhang, Kd., Zhang, Zh. et al. Evaluation of the reliability of the upper lip bite test and the modified mallampati test in predicting difficult intubation under direct laryngoscopy in apparently normal patients: a prospective observational clinical study. BMC Anesthesiol 22, 314 (2022). https://doi.org/10.1186/s12871-022-01855-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12871-022-01855-7