Abstract
Purpose
Despite the importance of patient flow to emergency department (ED) management, there is a need to strengthen and expand training in flow strategies for practicing ED staff. To date, there has been limited academic inquiry into the skills and training that ED staff require to improve patient flow. As part of a quality improvement initiative, our team aimed to identify the topics and training methods that should be included in flow training for ED staff.
Methods
We conducted an integrative review and modified Delphi. For the integrative review, we sought to identify appropriate skills, training strategies, and training modalities to include in a curriculum for ED staff. The findings from the review were compiled and distributed to Canadian experts in ED efficiency through a modified Delphi, including physicians, nurses, and nurse practitioners.
Results
Our literature search retrieved 8359 articles, of which 46 were included in the review. We identified 19 skills, 9 training strategies, and 12 training modalities used to improve ED efficiency in the literature. For the modified Delphi, we received responses from 39 participants in round one and 28 in round two, with response rates of 57% and 41%, respectively. The topics chosen by the most respondents were: “flow decisions,” “teamwork,” “backlog and surge management,” “leadership,” and “situational awareness.”
Conclusion
Our findings suggest that flow training should teach ED staff how to make decisions that improve flow, work more effectively as a team, manage patient backlog and surge, improve leadership skills, and develop situational awareness. These findings add to a gap in the academic literature regarding the training ED staff require to improve patient flow.
Résumé
Objectifs
Malgré l'importance du flux des patients vers la gestion des services d'urgence (SU), il est nécessaire de renforcer et d'étendre la formation sur les stratégies de flux pour le personnel en exercice des SU. Jusqu'à présent, peu d'études universitaires ont été menées sur les compétences et la formation dont le personnel des urgences a besoin pour améliorer le flux des patients. Dans le cadre d'une initiative d'amélioration de la qualité, notre équipe a cherché à identifier les sujets et les méthodes de formation qui devraient être inclus dans la formation sur les flux pour le personnel des urgences.
Méthodes
Nous avons procédé à une étude intégrative et à une analyse Delphi modifiée. Dans le cadre de l'étude intégrative, nous avons cherché à déterminer les compétences, les stratégies de formation et les modalités de formation appropriées à inclure dans un programme de formation destiné au personnel des services d'urgence. Les conclusions de l'étude ont été compilées et distribuées à des experts canadiens en matière d'efficacité des urgences par le biais d'un Delphi modifié, comprenant des médecins, des infirmières et des infirmières praticiennes.
Résultats
Notre recherche littéraire a permis de récupérer 8 359 articles, dont 46 ont été inclus dans l'examen. Nous avons identifié 19 compétences, 9 stratégies de formation et 12 modalités de formation utilisées pour améliorer l'efficacité de l'urgence dans la littérature. Pour le Delphi modifié, nous avons reçu des réponses de 39 participants au premier tour et de 28 au deuxième tour, avec des taux de réponse de 57 % et 41 %, respectivement. Les sujets choisis par le plus grand nombre de répondants sont : " décisions de flux ", " travail d'équipe ", " gestion de l'arriéré et de l'afflux ", " leadership " et " conscience situationnelle ".
Conclusions
Nos résultats suggèrent que la formation sur le flux devrait enseigner au personnel des urgences comment prendre des décisions qui améliorent le flux, travailler plus efficacement en équipe, gérer l'arriéré et l'afflux de patients, améliorer les compétences en leadership et développer la conscience de la situation. Ces résultats viennent combler une lacune dans la littérature académique concernant la formation dont le personnel des urgences a besoin pour améliorer le flux des patients.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
What is known about the topic? Despite the importance of patient flow to emergency department (ED) management, there is a need to improve training in flow strategies for practicing emergency department staff |
What did this study ask? What topics and training methods should be used in a curriculum for emergency department staff to improve patient flow? |
What did this study find? The topics chosen by the most respondents were: “flow decisions,” “teamwork,” “backlog and surge management,” “leadership,” and “situational awareness.” |
Why does this study matter to clinicians? Teaching ED staff how to improve flow is critical to decreasing wait times for patients seeking emergency care |
Introduction
Canadian emergency departments (EDs) suffer from overcrowding, long wait times, and low levels of patient satisfaction [1]. Excessive wait times can lead to increased morbidity and mortality, untreated pain and discomfort, and increased violence or aggression against staff [2]. They can also prevent access to urgent and required care [3]. While many issues contribute to this crisis, poor patient flow through the ED is a contributing factor [4].
Despite the importance of patient flow to ED management, there is a need to strengthen and expand training in flow strategies for practicing ED staff. The Standards of Accreditation for Residency Programs in Emergency Medicine from the Royal College of Physicians and Surgeons of Canada states that residents transitioning to practice should regularly be responsible for the “clinical management of the emergency department and of overall patient flow” [5]. However, this directive does not outline how these skills should be taught. Patient flow is also not included as a priority topic for residents completing training in emergency medicine through the College of Family Physicians of Canada [6]. Physicians already in practice may not have received this training during a clinical residency or might require a refresher course to strengthen their existing knowledge [7]. Additionally, charge nurses, who are often responsible for managing patient flow, typically receive no specialized training in this area, instead learning these skills through observation and experience [8].
In addition to the gap in flow training for ED staff, limited academic literature outlines the specific concepts and strategies that should be employed in ED flow training. Existing literature has begun to address this gap by identifying and describing strategies for teaching ED flow, primarily to medical residents [9,10,11,12,13,14]. However, there is a need to identify a comprehensive list of topics and training methods for flow training for ED staff, including emergency physicians, nurse practitioners, nurses, and medical learners.
As part of a quality improvement initiative aimed at improving patient flow and decreasing ED wait times [15], our team sought to identify the topics that should be included in a flow training course for ED staff. We aimed to address the following two questions: (1) What skills do ED staff require to improve patient flow? (2) What training strategies and modalities are effective in helping ED staff develop these skills?Footnote 1 We conducted an integrative review and modified Delphi to answer these questions. Our findings address steps one and two of Kern’s six-step approach to curriculum development [16].
Methods
We conducted an integrative review [17] to identify appropriate skills, training strategies, and training modalities to include in a curriculum for ED staff. The findings from the review were compiled and distributed to Canadian experts in ED practice through a modified Delphi.
Integrative review
Our team conducted an integrative review to identify potential topics to include in a curriculum to improve patient flow, based on Whittemore and Knalf’s [17] methodology for integrative reviews and qualitative content analysis [18]. Integrative systematic reviews combine literature from various methodological sources, including experimental and non-experimental research [17]. We selected this type of review since we aimed to examine the full breadth of skills, training strategies, and training modalities employed to train ED staff to improve flow from various academic sources.
Our research question was developed based on the population, concept, and context framework [19]. We asked which skills and training strategies contribute to improved efficiency among ED staff. A medical librarian searched the online databases Ovid MEDLINE, Embase, CINAHL, and PsycINFO on January 27, 2021 (with an updated search on January 28 2022). Search terms were developed by content experts (CP, PN, CY, SA) and a medical librarian and included variations of “emergency department,” “training,” and “wait time(s).” Articles were stored and managed in Covidence.
We included peer-reviewed journals, Ph.D. dissertations, and commentaries retrieved by the database search published in English that discuss the skills or training that emergency department staff require to improve patient flow. We excluded conference abstracts, articles published in languages other than English, and studies that did not focus on the emergency department or skills and training related to patient flow.
Two research team members screened each title and abstract, excluding those unrelated to our research objectives. Conflicts were resolved through a discussion between the two reviewers; a third team member provided feedback when necessary. We repeated the same process for the full-text review. We conducted a backward and forward reference search of all included articles to determine if any additional studies should be considered.
At this stage, we developed an extraction tool to aid in organizing and analyzing data from the included articles. The tool gathered the publication information, research question, research design, methods, type of intervention, target group, sample size, findings, and conclusions for each article. Consistent with the methods indicated for integrative reviews, we extracted qualitative data from both quantitative and qualitative studies [17]. The team calibrated the tool by extracting data from five articles and meeting to compare data and make amendments to the tool. Two research team members then extracted relevant data from each remaining article, meeting to resolve any discrepancies.
A research team member with expertise in qualitative research (CY) coded and analyzed the extracted data [17, 18]. Using the qualitative analysis software QDA Miner, she coded the extracted data until all data segments were assigned to a category. The initial coding list was refined based on feedback from members of the research team: we combined similar codes or renamed them to reflect the data organized within that code or the terms typically employed in clinical practice. The research team reviewed and approved the final code list, which we used as the foundation for a modified Delphi.
Modified Delphi
A modified Delphi is a method for gaining a consensus from a panel of experts through a series of structured questionnaires [20]. After completing the integrative review, our team conducted a modified Delphi to obtain expert feedback on which skills, training strategies, and training modalities should be included in our training curriculum. We obtained ethical approval to conduct the Delphi from the Newfoundland and Labrador Health Research Ethics Board (HREB Reference #2019.264).
To conduct the modified Delphi, we designed a survey using Qualtrics. Data were divided into training topics, strategies, and modalities. Participants were asked to identify which items from each section should be included in a flow training curriculum and any topics, strategies, or modalities that were absent from our list. Space was also provided for participants to provide additional written comments. We pre-tested the survey with members of the research team and amended it based on their feedback.
We conducted purposeful sampling [21] to recruit a sample representing gender, years of practice, occupation, and the province of residence. We invited nurses, nurse practitioners, and emergency physicians to participate, including authors of studies in the integrative review and others known to have expertise in ED research or practice in Canada. Some participants were also recruited through snowball sampling. We recruited participants via email using a standard script that provided details about the research project and a link to the survey.
For the second round of the Delphi, we designed a survey in Qualtrics to ensure that the findings from the first round were comprehensive. We invited all individuals who were contacted to complete the first round. We presented the data using the same categories as round one. This round differed because we provided participants with a complete list of items for each category and asked whether each list was comprehensive and, if not, which additional items should be added to each category.
The findings from the first round of the Delphi were analyzed by counting which topics, training strategies, and training modalities were selected most frequently and comparing the data based on occupation, years of practice, and gender. For the second round, we examined whether any comments added by participants constituted novel concepts. At this stage, we determined that consensus had been achieved and a third round of review was unnecessary.
Results
Integrative review
The initial search yielded 8359 results, of which 2144 were duplicates. Of the 6215 articles that underwent title and abstract screening, reviewers deemed 6051 irrelevant (see Fig. 1). After conducting a full-text screening of the remaining 164 articles, 46 were included in the review (see supplement for details about each article). We did not add any new articles through the backward and forward search of included studies. Most studies were conducted in the United States (37%) and Canada (33%), with the remaining originating from Australia (15%) and Europe (15%). Study design included mixed-methods (26%), quantitative (24%), commentary (22%), qualitative (20%), observational (4%), simulation (2%), and review (2%). Physicians were included as a target group in 59% of the articles, followed by nurses (37%), residents (30%), and other ED staff (13%), including nurse practitioners, physician assistants, and medical students. We identified 19 skills, 9 training strategies, and 12 training modalities (see Fig. 2) used to teach ED flow.
Modified Delphi
We received responses from 39 participants in round one and 28 in round two, with 57% and 41% response rates, respectively. The majority of respondents in round one were emergency physicians (56%), followed by nurse practitioners (21%) and then nurses (15%). Similar ratios were present in the second round (physicians: 68%; nurses: 14%; nurse practitioners: 11%). Both rounds had a greater proportion of responses from men than women (see Table 1).
In round one, each of the topics identified in the integrative review were selected by at least 44% of participants (see Table 2). The topics chosen by the most respondents were as follows: “flow decisions,” “teamwork,” “backlog and surge management,” “leadership,” and “situational awareness.” Participants added two new topics we had not identified through the integrative review: “appropriate limitation of workup” and “admission avoidance.” Similarly, all training strategies were selected by at least 50% of the sample, with the most popular being: “providing clear instruction and feedback,” “thinking aloud about decision making,” “observing learners and offering direction,” “involving learners in decision-making,” and “problem-solving.”
In general, the results for training modalities were more uneven. The five most popular modalities—“on-the-job training,” “simulation,” “workshop,” “mentorship,” and “focus group discussion”—were selected by at least 58% of the sample. However, fewer than 25% of respondents chose the bottom five modalities. These included (in descending order) “web-based learning environment,” “webinar,” “conference,” “placing informative posters in the emergency department,” and “e-newsletters.”
In round one, we identified two notable differences among respondents based on occupation. Of the primary care providers surveyed, 81% of emergency physicians selected “speed and efficiency” as relevant to a flow training curriculum, compared to only 38% of nurse practitioners. In addition, while 75% of nurse practitioners and 100% of nurses identified “patient-centred care” as a relevant topic, only 52% of emergency physicians selected this item as applicable to ED flow training.
In round two, 86% of participants indicated that our list of curriculum topics, training strategies, and training modalities was comprehensive. Only four participants (14%) provided suggestions for additional topics. Based on our analysis and input from clinical team members, we determined that only one of these comments constituted a novel concept (“impact of community and hospital resources on ED flow”), while the remaining three could be categorized under existing topics. Four participants (14%) also identified additional training strategies, while two (7%) suggested further training modalities. Our team analyzed these responses and found that they could be captured under existing categories or were unrelated to ED flow training.
Discussion
Interpretation of findings
In general, the modified Delphi confirmed the findings from the integrative review. The experts we surveyed appeared to prioritize those skills related to interpersonal conduct among the emergency department staff (e.g. teamwork and leadership) and the management of routine flow and surge management. Both rounds of the modified Delphi had more responses from men than women; however, given that emergency physicians constituted over 55% of the sample in both rounds, this gender composition approximately reflects that found in the study population [22]. We noted that emergency physicians were likelier to identify “speed and efficiency” as an essential topic than nurse practitioners. We also found that nurses and nurse practitioners were more likely to identify “patient-centred care” as a relevant topic than physicians—an underexplored topic in emergency care [23]. These findings may reflect the different responsibilities, training, and ideological perspectives of healthcare professionals practising in the ED. They may also reflect the payment models of each profession. While nurses and nurse practitioners are often paid at a set salary rate regardless of their output, physicians are incentivized to be more productive through fee-for-service funding models.
Comparison to previous studies
Our findings build on existing literature that describes strategies for teaching ED flow, particularly for medical residents [8,9,10,11,12,13,14]. This literature emphasizes the importance of teaching management and leadership skills necessary for improving patient flow and efficiency through constructive feedback, leading by example, and providing opportunities for residents to discuss and practice patient flow management. Our paper integrates findings from the existing literature to identify a comprehensive list of flow training topics, strategies, and modalities.
Strengths and limitations
These findings add to a gap in the academic literature regarding the skills ED staff require to improve patient flow and the training strategies and modalities appropriate for delivering flow education. However, the paper also has several limitations. While the data extracted through the integrative review allowed us to identify training topics, strategies, and modalities, it did not provide insight into which topics should be prioritized in a flow curriculum or the advantages or disadvantages of various training approaches. Additionally, since we conducted an integrative review and included a variety of sources, we did not perform a quality assessment of the included articles. Finally, since our objective was to identify a list of relevant training topics, we did not identify specific content that should be taught to develop each skill.
Clinical implications
Our findings suggest that flow training should be prioritized and standardized in training programs for emergency physicians, nurses, nurse practitioners, and practicing healthcare professionals. Gaining insight into the skills that ED staff require to improve flow and efficiency and the appropriate training strategies and modalities to teach these competencies is critical to enhancing ED flow.
Research implications
Our findings address steps one and two of Kern’s six-step approach to curriculum development in medical education by identifying the problem and conducting a targeted needs assessment through the integrative review and modified Delphi [16]. Future research is required to complete the subsequent steps in Kern’s model and develop an ED flow training curriculum.
Conclusion
This paper addresses a significant gap in the academic literature regarding appropriate flow training for ED staff and a practical gap in clinical education for ED physicians, nurses, and nurse practitioners. Our findings suggest that flow training should teach ED staff how to make decisions that improve flow, work more effectively as a team, manage patient backlog and surge, improve leadership skills, and develop situational awareness.
Notes
We define training modalities as the method by which certain training strategies are delivered.
References
Affleck A, Parks P, Drummond A, Rowe BH, Ovens HJ. Emergency department overcrowding and access block. Can J Emerg Med. 2013;15(6):359–70. https://doi.org/10.1017/s1481803500002451.
Chang AM, Lin A, Fu R, McConnell KJ, Sun B. Associations of emergency department length of stay with publicly reported quality-of-care measures. Acad Emerg Med. 2017;24(2):246–50. https://doi.org/10.1111/acem.13102.
Derlet RW, Richards JR. Overcrowding in the nation’s emergency departments: complex causes and disturbing effects. Ann Emerg Med. 2000;35(1):63–8. https://doi.org/10.1016/s0196-0644(00)70105-3.
Canadian Association of Emergency Physicians. Emergency training efficiency. https://canadiem.org/caep-fei-emergency-training-efficiency/.
Royal College of Physicians and Surgeons of Canada. Standards of accreditation for residency programs in emergency medicine. https://www.royalcollege.ca/rcsite/documents/ibd/emergency-medicine-sa-e.pdf.
The College of Family Physicians of Canada. Preparing for the examination of added competence in emergency medicine. https://www.cfpc.ca/en/education-professional-development/examinations-and-certification/examination-of-added-competence-in-emergency-medic/preparing-for-the-examination-of-added-competence#examcontent.
Carmelli C, Watson E, Villarroel NA, Dixon W, Clarke SO. A national survey of workflow efficiency education among emergency medicine residency training programs. Ann Emerg Med. 2020;76(4s):S140–1. https://doi.org/10.1002/aet2.10598.
Holmgren C, Jussen S, Hagiwara MA, Radestad M. Charge nurses’ perceived experience in managing daily work and major incidents in emergency departments: a qualitative study. Aust Emerg Care. 2022. https://doi.org/10.1016/j.auec.2022.02.003.
Bandiera G, Lee S, Tiberius R. Creating effective learning in today’s emergency departments: how accomplished teachers get it done. Ann Emerg Med. 2005;45(3):253–61.
Chan TM, Van Dewark K, Sherbino J, Schwartz A, Norman G, Lineberry M. Failure to flow: an exploration of learning and teaching in busy, multi-patient environments using an interpretive description method. Perspect Med Educ. 2017;6(6):380–7. https://doi.org/10.1007/s40037-017-0384-7.
Chan TM, Van Dewark K, Sherbino J, Lineberry M. Coaching for chaos: a qualitative study of instructional methods for multipatient management in the emergency department. AEM Educ Train. 2019;3(2):145–55. https://doi.org/10.1002/aet2.10312.
Chan TM, Sherbino J, Welsher A, Chorley A, Pardhan A. Just the Facts: how to teach emergency department flow management. CJEM. 2020;22(4):459–62. https://doi.org/10.1017/cem.2020.32.
Chorley A, Welsher A, Pardhan A, Chan TM. Faculty-lead opinions on workplace-based methods for graduated managerial teaching (FLOW MGMT): a national cross-sectional survey of Canadian emergency medicine lead educators. AEM Educ Train. 2021;5(1):19–27. https://doi.org/10.1002/aet2.10429.
Egan HM, Swanson MB, Ilko SA, Pomeranz KA, Mohr NM, Ahmed A. High-efficiency practices of residents in an academic emergency department: a mixed-methods study. AEM Educ Train. 2021;5(3): e10517. https://doi.org/10.1002/aet2.10517.
Patey C, Norman P, Araee M, Asghari S, Heeley T, Boyd S, Hurley O, Aubrey-Bassler K. SurgeCon: priming a community emergency department for patient flow management. Western J Emerg Med. 2019;20(4):654–65. https://doi.org/10.5811/westjem.2019.5.42027.
Kern DE. Overview: a six-step approach to curriculum development. In: Thomas PA, Kern DE, Hughes MT, Chen BY, editors. Curriculum development for medical education: a six-step approach. Baltimore: Johns Hopkins University Press; 2016. p. 5–10.
Whittemore R, Knalf K. The integrative review: updated methodology. J Adv Nurs. 2005;52(5):546–53. https://doi.org/10.1111/j.1365-2648.2005.03621.x.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. https://doi.org/10.1177/1049732305276687.
The Joanna Briggs Institute Reviewers’ Manual 2015 Methodology for JBI Scoping Reviews https://nursing.lsuhsc.edu/JBI/docs/ReviewersManuals/Scoping-.pdf.
Powell C. The Delphi technique: myths and realities. J Adv Nurs. 2003;41(4):376–82. https://doi.org/10.1046/j.1365-2648.2003.02537.x.
Palinkas LA, Horwitz SM, Green CA, et al. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health. 2015;42(5):533–44. https://doi.org/10.1007/s10488-013-0528-y.
Number and percent distribution of physicians by specialty and sex, Canada 2018 https://www.cma.ca/sites/default/files/2019-03/2018-06-spec-sex.pdf.
Walsh A, Bodaghkhani E, Etchegary H, Alcock L, Patey C, Senior D, Asghari S. Patient-centered care in the emergency department: a systematic review and meta-ethnographic synthesis. Int J Emerg Med. 2022;15:36. https://doi.org/10.1186/s12245-022-00438-0.
Funding
The authors are currently receiving financial support from the Canadian Institutes of Health Research (Grant No. SR4-165123), the Government of Newfoundland and Labrador (Grant No. 5404-2312-101), Eastern Health, Memorial University of Newfoundland, and the Trinity Conception Placentia Health Foundation for the continued development of the SurgeCon platform to improve emergency department wait times and patient satisfaction.
Author information
Authors and Affiliations
Contributions
C.Y., C.P., P.N., & S.A. conceptualized the design of the research. C.Y., S.A., C.P., P.N., & O.H. performed the data extraction and analysis for the integrative review. C.P., P.N., T.C., and S.A. provided expert feedback on the findings from the integrative review and modified Delphi. C.Y. designed the modified Delphi, recruited participants, and prepared the manuscript. M.S. designed and conducted the database search for the integrative review. All authors reviewed and commented on the manuscript and contributed substantially to its revision.
Corresponding author
Ethics declarations
Conflict of interest
Christopher Patey and Paul Norman are the cofounders of SurgeCon Innovations. Our team received funding for a project entitled “SurgeCon: An Emergency Department Surge Management Platform,” from the Canadian Institutes of Health Research, Newfoundland and Labrador Provincial Government, Eastern Health, and the Trinity Conception Placentia Health Foundation. Paul Norman has a royalty sharing agreement with MOBIA Technology Innovations and the Newfoundland and Labrador Eastern Regional Health Authority.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Young, C., Patey, C., Norman, P. et al. Identifying relevant topics and training methods for emergency department flow training. Can J Emerg Med 24, 837–843 (2022). https://doi.org/10.1007/s43678-022-00390-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43678-022-00390-1