Abstract
Background
Differences in the classification results among triage nurses in the emergency room can be improved by training or applying an algorithm. This study aimed to confirm whether the agreement among triage nurses could be improved through learner-led problem-based learning.
Methods
This study had a single-group time series design to investigate the effect of problem-based learning led by triage nurses on the agreement of Korean Triage and Acuity Scale classification results for patients who visited the emergency department. We extracted 300 patients each in May and August 2018 before learning began and 300 patients each in May and August 2019 after learning.
Results
After problem-based learning was applied, the self-efficacy of triage nurses for emergency patient classification increased statistically significantly compared to before learning (7.88 ± 0.96, p < .001), and the weighted kappa coefficient was also found to be almost perfectly agreement (0.835, p < .001).
Conclusions
In this study, problem-based learning improved the inter-rater agreement of Korean Triage and Acuity Scale classification results and self-efficacy of triage nurses. Therefore, problem-based learning can contribute to patient safety in the emergency department by enhancing the expertise of triage nurses and increasing the accuracy of triage classification.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Background
According to statistics released by the National Emergency Medical Center in Korea in 2019, more than 10 million patients visited the emergency department (ED) during 2018, which was more than 20% higher than that in 2008 as a result, ED overcrowding is increasing [1]. As the number of patients who visited the ED increases, ED overcrowding has been pointed out as one of the most important problems [2]. One of the most important ways to relieve ED overcrowding is by reducing the length of stay of emergency patients [3, 4]. The ED stay time can be reduced by appropriately classifying the severity of emergency through accurate initial assessment of patients who visit the ED [5, 6].
Classifying the severity appropriately through initial assessment of patients visiting the ED is a process of determining where to receive treatment [7]. Accurate patient classification is essential for identifying patients who do not require prior intervention and optimizing emergency medical resources for immediate treatment [8]. Therefore, triage nurses in charge of initial assessment in the ED should quickly and appropriately categorize the severity of patients visiting the ED. This is one of the most important tasks of ED triage nurses [9].
For initial assessment and classification tool of emergency patients in Korea, various classification tools were used in each hospital until recently [10]. In 2012, the Korean Triage and Acuity Scale (KTAS) Committee affiliated with the Korean Society of Emergency Medicine developed KTAS as a Korean type emergency patient classification tool based on Canadian Triage and Acuity Scale (CTAS), Canada’s five-stage classification tool, by modifying and supplementing it to suit the domestic situation [11]. Since 2016, the law on emergency medical care has been changed. All EDs have been using the KTAS to classify patients visiting the ED [12]. This severity classification is performed by nurses in the United States [12]. In most EDs in Korea, nurses perform patient classification through initial evaluation. However, there is a difference in the degree of agreement among triage nurses according to ED experience or clinical experience of nurses who perform the evaluation. Objective evaluation may be difficult in psychological and mental health areas, although respiratory diseases could be objectively evaluated [9]. In addition, the severity classification may be different because different factors determine the degree of urgency [13]. Even if there are clear criteria for classification, there might be differences in the severity classification results among evaluators. In one study determining the agreement between nurses and emergency doctors [14], the Kappa coefficient was 0.659. In addition, there was a significant difference in classification between male and female nurses (p = .003) [14]. Another study has assessed the degree of agreement among nurses [15] and found that the kappa coefficient is 0.79. The kappa coefficient was 0.721 in one study that determined the degree of agreement between nurses and medical students [16]. In one study that determined the agreement between triage nurses and an expert group consisting of KTAS instructors, the weighted kappa coefficient was 0.77 [17]. These results are interpreted by Landis & Koch, which shows a ‘substantial agreement’, but there are some differences among evaluators [18]. As such, differences in severity classification results among triage nurses may occur, and the differences in classification results may cause patient dissatisfaction and threaten patient safety. The agreement of these classification results can be improved by training or applying an algorithm [13].
Problem-based learning (PBL) is a small group of learning method that enables students to present problems and learn knowledge, skills, and attitudes to solve problems [19]. This is a learning method that can develop not only knowledge acquisition, but also reasoning ability and critical thinking ability [19]. In previous studies, after PBL was conducted, learning attitude [20, 21], critical thinking skill [22, 23], problem solving [21, 24], and knowledge [25, 26] of nursing students and medical students were improved. As such, it is believed that PBL, led by nurses, will help resolve the discrepancy in the severity classification results of ED patients and help improve the patient classification algorithm. However, previous studies that suggested a method to improve the agreement of the severity classification results through PBL were insufficient. It is necessary to confirm whether PBL led by triage nurses using actual patient cases helps to improve the agreement of classification results among triage nurses. Therefore, the purpose of this study is to investigate the effect of PBL led by a triage nurse on the consistency of KTAS classification results of patients who visited the ED.
Methods
Study design
This study had a single-group time series design to investigate the effect of PBL led by triage nurses on the agreement of KTAS classification results for patients who visited the ED.
Study subjects
Patients
Bujang and Baharum have presented a minimum sample number of 396 with a significant level of 0.05, power of 90%, with a goal of 0.7 to 0.8 kappa coefficient for tools of grade 5 [27]. In another study that presented a monogram for calculating sample size with Kappa statistics, the required number of samples was at least 283 at significant level of 0.05, power of 80%, and kappa coefficient of 0.9 [28]. Therefore, this study included approximately 1,200 patients (600 patients before PBL and 600 patients after PBL, considering daily visits to the ED. Patients aged 15 years or older who had visited an ED during May and August 2018 for preliminary surveys and May and August 2019 for postmortem surveys respectively were included. Those who had insufficient initial evaluation nursing record in the electronic medical record were excluded.
Triage nurses
Subjects were nurses with KTAS certification in the ED who were in charge of initial patient classification during the study. A total of 51 nurses are working in the ED of the hospital in which this study was conducted, and one triage room is operated normally. Of a total of 51 nurses, about 15 nurses who have received the qualifications granted by the KTAS committee take turns classifying patients in the ED. We retrospectively investigated the results of triage nurses classifying patients who visited the ED. In May and August 2018, the preliminary survey period, 11 and 12 triage nurses were included, respectively, and in May and August 2019, the post-test period, 12 and 13 triage nurses were included, respectively.
Study procedure
Problem based learning (PBL)
PBL was led by triage nurses in charge of patient classification in the ED. Triage nurses in charge of patient classification in the emergency room were asked to record ambiguous cases during the initial patient classification task in a shared notebook placed in the triage room. In this learning meeting, triage nurses and emergency physicians gathered to present their opinions on the KTAS classification results of cases recorded in this shared note, and through discussions, a classification policy was set so that patients with similar symptoms can later visit the ED (Fig. 1). The date and time of PBL was announced two weeks in advance, and triage nurses were encouraged to participate voluntarily. When additional learning is needed for a specific case, one or two triage nurses reviewed the literature and made a presentation within 10 min at the next meeting, and the classification policy for the case was decided through further discussion. Social media, groupware e-mails, and shared notes in the triage room were used to share the decisions made in PBL with other ED nurses. This learning meeting lasted about 60 min each time, and about 10-15 people participated, and it was held twice a month (Fig. 2).
Data collection procedure
For pre-investigation, we extracted 300 patients using Microsoft’s Excel random function from EDs in May and August of 2018 before the PBL meeting began. We retrospectively reviewed emergency nursing information surveys stored in the electronic medical record (EMR). For post-investigation, we reviewed patient’s emergency nursing information surveys stored in the EMR for patients visiting the ED six months after the problem-based study meeting in May 2019 and August 2019 in the same way as the pre-investigation. Emergency nursing information surveys for patients who visited the ED during pre- and post- investigation periods were retrospectively reevaluated without knowing KTAS classification results evaluated by triage nurses by two Gold Standard nurses; one nurse was a KTAS instructor and a nurse with over 15 years of ED work experience, and the other nurse had over 15 years of emergency room work experience and over 10 years of triage work experience. We compared KTAS classification results classified by these Gold Standard nurses with those evaluated by triage nurses. We measured and compared the weighted Kappa coefficient, the coefficient of agreement.
Study endpoints
Inter-rater agreement of KTAS
Gold Standard evaluators re-evaluated the KTAS classification results classified by triage nurses, and the weighted KAPPA coefficient was measured to confirm the degree of agreement between these two groups. Cohen suggested the Kappa result be interpreted as follows: values ≤ 0 as indicating no agreement and 0.01–0.20 as none to slight, 0.21–0.40 as fair, 0.41– 0.60 as moderate, 0.61–0.80 as substantial, and 0.81–1.00 as almost perfect agreement.
KTAS self-efficacy
The self-efficacy of the severity classification was investigated with the self-efficacy tool developed by Bandura [29]. This tool is a numeric evaluation scale, with 0 points for the leftmost and 100 points for the rightmost for self-efficacy for triage, and the subject selects one point on a continuous line. And scored. The higher the score, the higher the level of self-efficacy.
Length of ED stay
In the electronic medical record, length of ED stay (ED LoS) was defined as the time of discharge in the ED such as discharge or hospitalization in minutes from the time of receipt in the ED.
Statistical analysis
Collected data were analyzed using SPSS for Windows 23.0 (IBM, Armonk, NY, USA). General characteristics of triage nurses and patients were subjected to descriptive statistics using nominal variables, frequency, and percentage. Continuous variables are presented as mean and standard deviation. One-way ANOVA was used to test the homogeneity of general characteristics of patients and triage nurses before and after PBL meeting. One-way ANOVA was used to compare ED stay time and self-efficacy of nurses before and after PBL. Weighted Kappa coefficient was measured to analyze the consistency of KTAS classification results between triage nurses and Gold standard evaluators.
Ethical considerations
This study was conducted after receiving approval from the B Hospital Medical Research Ethics Review Committee, where researchers of this study were affiliated (IRB approval number: 20,190,426/30-2019-36/053).
Results
General characteristics of study patients and triage nurses according to investigation time
Homogeneity test was performed for general characteristics of study patients and triage nurses at the time of the investigation. As a result, the homogeneity of general characteristics according to the time of investigation was secured for both patients and triage nurses groups (Tables 1 and 2).
ED LoS according to investigation time
Table 1 shows the ED LoS according to the time of investigation. Mean lengths of ED stay at the time of the investigation were 261.53 ± 215.74 min and 264.91 ± 201.63 min prior to the PBL in May 2018 and August 2018, respectively. Mean lengths of ED stay in May 2019 and September 2019 were 237.82 ± 164.13 min and 239.31 ± 181.21 min, respectively. After the PBL meeting, the mean ED LoS decreased, although such decrease was not statistically significant (p = .172) (Table 3).
Self-efficacy according to the time of investigation
Mean self-efficacy scores of KTAS classification at the time of the investigation of triage nurses were 6.50 ± 1.16 and 6.57 ± 0.94 in May 2018 and August 2018, respectively, before the PBL meeting was conducted. After the PBL meeting, mean self-efficacy scores in May 2019 and August 2019 were significantly increased to 7.73 ± 0.89 and 7.88 ± 0.96, respectively (p < .001) (Table 4). As a result of the post-HOC test, there was no statistically significant difference in self-efficacy between May 2018 and August 2018 before the PBL meeting. And there was no statistically significant difference in self-efficacy between May 2019 and August 2019 after the PBL meeting either. However, there were significant differences in self-efficacy between before and after PBL meeting (Table 4).
Inter-rater agreement of KTAS classification results by investigation time
The inter-rater agreement of triage nurses in the ED showed weighted Kappa coefficients of 0.69 and 0.67 in May 2018 and August 2018, respectively, before the PBL meeting. However, after conducting the PBL meeting, showed weighted Kappa coefficients in May 2019 and August 2019 were 0.82 and 0.83, respectively, indicating ‘almost perfect’ agreement according to the interpretation proposed by Landis and Koch (1977). The inter-rater agreement of KTAS classification results between triage nurses and gold standard nurses was significantly (p < .001) improved after conducting PBL meeting (Fig. 3).
Discussion
As Emergency Medical Service Act was amended, all EDs in Korea have been using KTAS to classify emergency patients since January 2016 [10]. This task is handled by nurses in most EDs. Many previous studies have reported that KTAS classification results might be different among evaluators. However, it is difficult to find studies suggesting a way to improve the inter-rater agreement among triage nurses. Therefore, this study attempted to improve the agreement among triage nurses’ self-efficacy for severity classification and inter-rater agreement among triage nurses through PBL meeting. Whether the improved agreement might affect the length of ED was also examined. Based on the results of this study, we would like to discuss ways to improve the professionalism of ED triage nurses.
Self-efficacy for patient classification task
In this study, self-efficacy for emergency patient severity classification was improved after PBL led by ED triage nurses. This result cannot be directly compared to previous results because there is no previous research applying PBL. However, results of the study [30] were similar to results of the present study. They compared self-efficacy by developing and applying a web-based KTAS learning program with a control group [30]. Self-efficacy has been found to be improved after education compared to that before and after education in a study comparing HIRAID (History, Identify, Red flags, Assessment, Interventions, Diagnostics, reassessment and communication) framework developed to provide ED nurses with a structured and systematic approach to emergency patient assessment as a simulation training program [31]. The present study confirmed that the self-efficacy was improved through PBL led by triage nurses. However, previous studies have evaluated self-efficacy by applying web-based self-learning program or simulation program. We speculate that self-education, repetitive learning, and meetings to discuss learner-led clinical cases might have raised the self-efficacy of triage nurses’ KTAS classification.
CTAS and KTAS, unlike ESI which predicts and classifies emergency medical resources to be used, are tools that can classify patients based on their complaints [10]. In the first stage, patients are classified by age. In the second stage, patients are classified according to symptoms that patients complain. In the third stage, detailed symptoms included in the major classification are selected. In step 4, the KTAS level is determined by checking the pain or symptom of detailed symptoms selected in step 3. Finally, the place of treatment of the patient is determined according to the possibility of infectious disease that can transmit the disease [10]. Worldwide, emergency patients are classified by nurses in most EDs [9, 32]. Thus, KTAS classification results should be carefully classified because they can be directly linked to the calculation of emergency medical care fees. They are also important for the safety of patients. However, several previous studies have reported differences in classification among evaluators. The Kappa coefficient was 0.659 in a study of Rahmani et al. to determine the agreement of ESI classification between nurses and emergency physicians. In the study of Choi et al., classification was conducted by two research nurses for a total of 233 patients [15]. These patients were also reassessed by 10 triage nurses. They found that the weighted Kappa coefficient was 0.79. The weighted Kappa coefficient was 0.721 in a study of Kim et al., confirming the inter-rater agreement between nurses and medical students [16]. In addition, a weighted Kappa factor of 0.77 was reported in a study confirming the agreement between an expert group consisting of KTAS instructors and triage nurses for severity classification of ED pediatric patients [17]. The interpretation presented by Landis and Koch can be interpreted as a ‘substantial agreement’ [16]. However, there were some differences between the evaluators. In this study, the weighted Kappa coefficients were identified 0.687 and 0.67 respectively, before PBL meeting between triage nurses and Gold Standard nurses. After the PBL meeting was conducted, these weighted Kappa coefficients were improved significantly to 0.823 and 0.835, respectively, showing almost perfect agreement according to Landis and Koch’s interpretation [18]. Results of the present study could not be directly compared to results of previous studies because there is no such previous research. However, results of this study were similar to results of Rankin, Then, & Atack showing that online learning could help triage nurses improve their severity classification accuracy for emergency patients [33].
Effect of PBL on the agreement of triage results
Barrows has proposed PBL method that can be conducted in small groups of student-led learning for medical students [19]. It is a learning method that learners can present their problems and learn knowledge and skills to solve problems through discussions in small groups so that they can develop reasoning skills and critical thinking skills to cope with given similar situations [19]. Previous studies have reported that learning attitude [20, 21], critical thinking skill [22, 23], problem solving ability [21, 24], and knowledge [25, 26] of nursing students and medical students are improved after the implementation of PBL. In the present study, learner-led PBL meeting was held with triage nurses working on the KTAS classification task to discuss cases that needed further discussion. In doing so, a consensus was reached and shared among ED nurses. These shared results might have helped their decision making for similar situations later and inter-rater agreement among triage nurses is likely to improve.
However, there was a slight decrease in the ED LoS before and after PBL, although the decrease was not statistically significant. This was different from previous studies [5, 6] showing that the ED LoS was reduced due to accurate patient classification. In the study of Jobé, Ghuysen, & D’Orio, accurate patient classification helped reduce the ED LoS for patients who came to the ED for chest pain [6]. Direct comparisons, not pre-post comparisons, were difficult. However, Erimsah, Yaka, Yilmaz, Kama, & Pekdemir and Kim et al. have reported that adequate patient classification can help reduce the ED LoS [34, 35]. Pierce & Gormley have also reported that primary and secondary assessments can improve the classification of emergency patients, resulting in a shorter ED LoS as a result of applying a more accurate and appropriate patient classification system [36]. In the present study, the ED LoS was reduced approximately 30 min after the PBL meeting, although such reduction was not statistically significant. Various factors may exist to explain the reduction in the ED LoS. It would be hard to say that the improvement in the consistency of KTAS classification only affected the reduction in the ED LoS. Further studies will be needed to determine whether the agreement of emergency severity classification affects the ED LoS.
Limitations
This study has some limitations. First, the inter-rater agreement of KTAS classification might have improved as nurses’ experiences in patient classification work increased after PBL meeting compared to those before PBL meeting. Second, the participation rate was very high, although PBL meeting for nurses was voluntary. However, there were also a small number of nurses who showed low participation frequency. For nurses who did not participate in the problem based-learning meeting, results of the meeting were shared using SNS ‘Band’ application, ‘Groupware email’, and ‘Shared Note’. Third, in this study, the inter-rater agreement between triage nurses and Gold Standard nurses was evaluated. However, we did not determine agreements among the three evaluators. Such information might provide more accurate classification results. Fourth, although most of the nurses who participated in the PBL before and after meeting were the same, the before and after were not completely the same because there were two nurses who resigned and three nurses who were newly starting the triage task. Lastly, this study was a single-center study conducted at a general hospital in Seoul. Thus, it is difficult to generalize results of this study to other settings.
Conclusions
In this study, PBL meeting for triage nurses improved the inter-rater agreement of KTAS classification results and the self-efficacy of triage nurses for emergency patient severity classification. Therefore, PBL meeting led by triage nurses can contribute to patient safety in hospitals by enhancing the expertise of triage nurses and increasing the accuracy of triage classification. Further studies should be conducted to determine whether the agreement of KTAS classification results among triage nurses affects the ED LoS. Educational programs need to be developed to enhance the capacity and professionalism of triage nurses.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.
Abbreviations
- ED:
-
emergency department
- KTAS:
-
Korean Triage and Acuity Scale
- CTAS:
-
Canadian Triage and Acuity Scale
- PBL:
-
problem-based learning
- EMR:
-
electronic medical record
- ED LoS:
-
length of emergency department stay
References
Moon SW. 2018 Emergency Medical Statistics Yearbook[Internet]. Seoul: National Emergency Medical Center; 2019. [cited 2020 Feb 23]. Available from :https://www.egen.or.kr/nemc/statistics_annual_report.do?brdclscd=01.
Mohiuddin S, Busby J, Savović J, Richards A, Northstone K, Hollingworth W, et al. Patient flow within UK EDs: a systematic review of the use of computer simulation modelling methods. BMJ Open. 2017;7(5):e015007. https://doi.org/10.1136/bmjopen-2016-015007.
Azeredo TRM, Guedes HM, de Almeida RAR, Chianca TCM, Martins JCA. Efficacy of the Manchester Triage System: a systematic review. Int Emerg Nurs. 2015;23(2):47–52. https://doi.org/10.1016/j.ienj.2014.06.001.
Thirlwall K, Cooper PJ, Karalus J, Voysey M, Willetts L, Creswell C. Treatment of child anxiety disorders via guided parent-delivered cognitive–behavioural therapy: Randomised controlled trial. Br J Psychiatry. 2013;203(6):436–44. https://doi.org/10.1192/bjp.bp.113.126698.
Ha BH, Park JY. Triage and length of stay in a cancer center emergency department. Asian Oncol Nurs. 2017;17(4):246–51. https://doi.org/10.5388/aon.2017.17.4.246.
Jobé J, Ghuysen A, D’Orio V. Advanced nurse triage for emergency department. Rev Med Liege. 2018;73(5-6):229–36. PMID: 29926560.
Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Deutsches Ärzteblatt. 2010;107(50):892. https://doi.org/10.3238/arztebl.2010.0892.
Kuriyama A, Urushidani S, Nakayama T. Five-level emergency triage systems: variation in assessment of validity. Emerg Med J. 2017;34(11):703–10. https://doi.org/10.1136/emermed-2016-206295.
Lee EK, Kim JS. Factors influencing triage nurses’ the Korean Triage and Acuity Scale performance ability. J Korean Acad Soc Nurs Educ. 2018;24(1):94–102. https://doi.org/10.22650/JKCNR.2018.24.1.94.
Park J, Lim T. Korean triage and acuity scale (KTAS). J Korean Soc Emerg Med. 2017;(6):547–51.
Lee I, Kim O, Kim C, Oh J, Lim T, Lee J, et al. Validity analysis of Korean Triage and Acuity Scale. J Korean Soc Emerg Med. 2018;29(1):13–20.
Migdal VL, Harper K, Haqqani N, Janiak B. Time Cost of Standardized Nursing Screens in the ED. West J Emerg Med. 2019;20(6):851. https://doi.org/10.5811/westjem.2019.9.44084.
FitzGerald G, Jelinek GA, Scott D, Gerdtz MF. Republished paper: emergency departement triage revisited. J Postgrad Med. 2010;86(1018):502–8. https://doi.org/10.1136/pgmj.2009.077081rep.
Rahmani F, Sepehri Majd P, Ebrahimi Bakhtavar H, Rahmani F. Evaluating the accuracy of emergency nurses in correct triage using emergency severity index triage in Sina hospital of Tabriz: a cross-sectional analysis. JEPT. 2018;4(1):9–13. https://doi.org/10.15171/JEPT.2017.19.
Choi HK, Choi MJ, Kim JW, Lee JY, Shin SH, Lee HJ. Reliability of the Emergency Severity Index version 4 performed by trained triage nurse. J Korean Crit Care Nurs. 2012;5(2):61–71.
Kim JY, Hong DY, Kim SY, Kim JW, Park SO, Lee KR, et al. Reliability of Korean Triage and Acuity Scale-based triage system as a severity index in emergency patients. J Korean Soc Emerg Med. 2017;28(6):552–6.
Moon SH, Shim JL. Triage accuracy of pediatric patients using the Korean Triage and Acuity Scale in emergency departments. J Korea Acad Industr Coop Soc. 2018;19. https://doi.org/10.5762/KAIS.2018.19.11.626.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;159–74. https://doi.org/10.2307/2529310.
Barrows HS. A taxonomy of problem-based learning methods. Med Educ. 1986;20(6):481–6. https://doi.org/10.1111/j.1365-2923.1986.tb01386.x.
Mulyanto H, Gunarhadi G, Indriayu M. The effect of problem based learning model on student mathematics learning outcomes viewed from critical thinking skills. J Edu Res Rev. 2018;3(2):37–45. https://doi.org/10.24331/ijere.408454.
Senel E, Ulucan H, Adilogullari I. The Relationship between Attitudes towards problem-based Learning and motivated strategies for learning: A study in school of physical education and sport. Anthropologist. 2015;20(3):446–56. https://doi.org/10.1080/09720073.2015.11891748.
Asyari M, Al Muhdhar MHI, Susilo H. Improving critical thinking skills through the integration of problem based learning and group investigation. Int J Lesson Learn Stud. 2016;5(1):36–44. https://doi.org/10.1108/IJLLS-10-2014-0042.
Yu D, Zhang Y, Xu Y, Wu J, Wang C. Improvement in critical thinking dispositions of undergraduate nursing students through problem-based learning: A crossover-experimental study. J Nurs Educ. 2013;52(10):574–81. https://doi.org/10.3928/01484834-20130924-02.
Son Y-J, Song Y-A. Effects of simulation and problem-based learning courses on student critical thinking, problem solving abilities and learning. J Korean Acad Soc Nurs Educ. 2012;18(1):43–52. https://doi.org/10.5977/jkasne.2012.18.1.043.
Last K, Appleton J, Stevenson H. Basic science knowledge of dental students on conventional and problem-based learning (PBL) courses at Liverpool. Eur J Dent Educ. 2001;5(4):148–54. https://doi.org/10.1034/j.1600-0579.2001.50402.x.
Mayner L, Gillham D, Sansoni J. Anatomy and physiology for nursing students: Is problem-based learning effective? Prof Inferm. 2013;66(3):182–86. https://doi.org/10.7429/pi.2013.663182.
Bujang MA, Baharum N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Arch Orofac Sci. 2017;12(1):1–11.
Hong H, Choi Y, Hahn S, Park SK, Park B-J. Nomogram for sample size calculation on a straightforward basis for the kappa statistic. Ann Epidemiol. 2014;24(9):673–80. https://doi.org/10.1016/j.annepidem.2014.06.097.
Bandura A. Guide for creating self-efficacy scales. In: Pajares F, Urdan T, editors. Self-efficacy beliefs of adolescents. Greenwich (CT): Information Age Publishing; 2006. pp. 307–37.
Kim H-J, Kang H-Y. Effects of a Web-Based Korean Triage and Acuity Scale learning program on triage self-efficacy and triage performance ability for nurses in emergency department. J Korean Acad Nurs. 2019;49(2):171–80. https://doi.org/10.4040/jkan.2019.49.2.171.
Munroe B, Buckley T, Curtis K, Murphy M, Strachan L, Hardy J, et al. The impact of HIRAID on emergency nurses’ self-efficacy, anxiety and perceived control: A simulated study. Int Emerg Nurs. 2016;25:53–8. https://doi.org/10.1016/j.ienj.2015.08.004.
Göransson KE, Ehrenberg A, Ehnfors M. Triage in emergency departments: National survey. J Clin Nurs. 2005;14(9):1067–74. https://doi.org/10.1111/j.1365-2702.2005.01191.x.
Rankin JA, Then KL, Atack L. Can emergency nurses’ triage skills be improved by online learning? Results of an experiment. J Emerg Nurs. 2013;39(1):20–6. https://doi.org/10.1016/j.jen.2011.07.004.
Erimşah ME, Yaka E, Yilmaz S, Kama A, Pekdemir M. Inter-rater reliability and validity of the Ministry of Health of Turkey’s mandatory emergency triage instrument. Emerg Med Australas. 2015;27(3):210–5. https://doi.org/10.1111/1742-6723.12385.
Kim JH, Kim JW, Kim SY, Hong DY, Park SO, Baek KJ, et al. Validation of the Korean Triage and Acuity Scale compare to triage by emergency severity index for emergency adult patient: Preliminary study in a tertiary hospital emergency medical center. J Korean Soc Emerg Med. 2016;27(5):436–41.
Pierce BA, Gormley D. Are split flow and provider in triage models in the emergency department effective in reducing discharge length of stay? J Emerg Nurs. 2016;42(6):487–91. https://doi.org/10.1016/j.jen.2016.01.005
Acknowledgements
The authors would like to acknowledge the triage nurses in the emergency department of Seoul National University Boramae Medical Center.
Funding
No funding was received for this study. All data collection and analysis fees were paid by the authors.
Author information
Authors and Affiliations
Contributions
KJ and EJ conceived and designed the study, KJ and KJS analysed the data, and KJ wrote the manuscript. EJ and KJS recruited the study participants and collected the data. KJ and EJ were involved in the interpretation of the data and contributed to the manuscript preparation. EJ and KJS were involved in title selection, data analysis, and drafting of the manuscript and approved the final manuscript. All authors have read and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This study was approved by the SMG-SNU Boramae Medical Center Institutional Review Board (IRB approval number: 20190426/30-2019-36/053). Written informed consent was obtained from all the triage nurses. All methods were performed in accordance with the relevant guidelines and regulations.
Consent for publication
We obtained written consent from all participants for the use of personally identifiable images in one scene of the PBL meeting of triage nurses and emergency physician in “Fig. 2”.
Competing interests
All the authers declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Jang, K., Jo, E. & Song, K.J. Effect of problem-based learning on severity classification agreement by triage nurses. BMC Nurs 20, 256 (2021). https://doi.org/10.1186/s12912-021-00781-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12912-021-00781-2