Abstract
Background
Many countries, including the United Kingdom, have established Emergency Department (ED) pharmacy services where some ED pharmacists now work as practitioners. They provide both traditional pharmaceutical care and novel practitioner care i.e. clinical examination, yet their impact on quality of care is unknown.
Aim
To develop a framework of structures, processes and potential outcome indicators to support evaluation of the quality of ED pharmacy services in future studies.
Method
Framework components (structures, processes and potential outcome indicators) were identified in three ways: from a narrative review of relevant international literature, and separate panel meetings with ED pharmacists and then other ED healthcare professionals. Structures and processes were collated into categories developed iteratively throughout data collection, with outcome indicators collated into six domains of quality as proposed by the Institute of Medicine. These raw data were then processed e.g. outcome indicators screened for clarity i.e. those which explicitly stated what would be measured were included in the framework.
Results
A total of 190 structures, 533 processes, and 503 outcome indicators were identified. Through data processing a total of 153 outcome indicators were included in the final framework divided into the domains safe (32), effective (50), patient centred (18), timely (24), efficient (20) and equitable (9).
Conclusion
The first framework specific to the quality evaluation ED pharmacy services, service evaluators should validate potential outcome indicators prior to their use. The minimum expected of a high-quality service should also be defined to enable interpretation of relevant measurements.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Impact statements
-
The ‘Manchester Framework’ of outcome indicators can be used to support the quality evaluation of ED pharmacy services in the UK and internationally, with outcome measurements used to guide service developments.
-
Additional outcome indicators are required to evaluate whether ED pharmacy services provide care that is patient centred, equitable and efficient, and thereby ensure all aspects of quality can be measured and quality concluded.
Introduction
Pharmacists provide services to emergency departments (EDs) in many countries such as the United States [1], Saudi Arabia [2], Colombia [3] and the United Kingdom (UK) [4]. In the UK, in part due to a shortage of ED doctors and nurses, pharmacists have completed additional clinical training so to take on a greater role in patient care [5]. Termed ‘ED pharmacist practitioners’, they provide traditional pharmacy care e.g. medicines reconciliation [6], but also ‘practitioner’ care e.g. perform physical examinations and manage patients [5]. There has been some evaluation of ED pharmacy services, particularly in the United States [7, 8], but this is mostly limited to the more traditional activities of pharmacists in those settings. Overall, while at least 20 pharmacists now work as practitioners and provide care to patients in UK EDs [5], there has been no evaluation of the quality of those services. Evaluation of the quality of care provided by health services is important to identify areas requiring improvement, as well as ensure the appropriate use of resources [9, 10]. According to the Institute of Medicine [11], quality care is: safe, effective, patient-centred, timely, efficient and equitable.
Evaluation of the quality of care centres on the measurement of outcome indicators [12, 13]. Either qualitative or quantitative, indicator measurements are used to conclude the outcome of a service. It is also important to measure multiple outcome indicators together to ensure any observed change in measurement can be interpreted in the context of other measurements [14]. For example, if a desirable change is observed for one outcome indicator, with an undesirable change for another, these measurements can be considered together and the overall change deemed desirable or undesirable [15, 16]. The context of outcome measurements should also be considered to aid interpretation, specifically, the environment through which care is provided (structures) and actual care delivery (processes) [9].
In practice, quality evaluation first involves development of potential outcome indicators [17]. As outlined by Mainz and colleagues [14, 17], these should be clearly described, an ‘acceptable’ measurement defined (i.e. that expected of a high-quality service), and their reliability and validity tested. Reliability and validity testing are usually undertaken for a defined population, meaning the outcome indicator may only be reliable and valid for that population [16, 18].
Frameworks have been used to collate different indicators of structure, process and outcome and ensure a systems-based approach to quality evaluation [14, 19]. For example, in January 2019, the International Federation of Emergency Medicine (IFEM) published “An updated Framework on Quality and Safety in Emergency Medicine” [20]. The framework lists indicators of structure, process and outcome grouped into the six IoM domains of quality. While this and other frameworks exist to evaluate ED quality more generally, there is no framework specific to ED pharmacy services.
Aim
To develop a framework of structures, processes and potential outcome indicators to support evaluation of the quality of ED pharmacy services in future studies.
Ethics approval
No ethical approval was required as ED pharmacists and other healthcare professionals were asked non-sensitive questions that were within their professional competence unrelated to their employer. Panel members were aware of how their data would be used to create an evaluation framework.
Method
Three data collection stages were chosen to identify potential outcome indicators, structures and processes, informed by methods used successfully by IFEM to develop their framework: a literature review (Stage 1), an expert panel with ED pharmacists (Stage 2) and finally an expert panel with other ED healthcare professionals (Stage 3). Campbell’s definitions of structure, process and outcome were used to guide all stages of data collection [11], with data collated into 12 separate tables (see electronic supplementary material A). Six of those tables were for outcome indicators, one for each IoM quality domain, with the indicators grouped into ‘topics of evaluation’ (i.e. outcomes). A sample of outcome indicators is presented later in Table 2.
Literature review (Stage 1)
Five databases commonly used in Health Services Research were systematically searched for studies which had previously evaluated ED pharmacy services, with the objective of identifying and extracting potential outcome indicators, and structures and processes using the complete strategy (see electronic supplementary material B). Specific databases were: Cumulative Index of Nursing and Allied Health Literature’ (CINAHL); Web of Science Core Collection; MEDLINE; International Pharmaceutical Abstracts; and Embase. Based on the search objective and the Patient, Intervention, Comparison, Outcome (PICO) framework, three primary search terms were identified: emergency department; structure, process and outcome; and pharmacist. Preliminary searches with these terms were undertaken and the keywords of initial search results recorded and used as secondary search terms. Other secondary search terms were: synonyms of primary terms (e.g. structure, process, and outcome each included as individual terms); abbreviations; and international terminology. The completeness of the search strategy was tested by adding additional secondary search terms until the number of results stabilised.
After removal of duplicates, a total of 432 unique search results were identified from the databases. The reference lists of a systematic review [21] and narrative review [22] were examined to identify any further relevant literature. Titles and abstracts were then reviewed by the author for potential inclusion and 130 results thought potentially relevant were taken forward to full-text eligibility screening, including one study [4] identified from the reference lists of the reviews.
For full-text screening, the eligibility of studies was evaluated using the inclusion/exclusion criteria developed according to the study aim. Studies were reviewed and re-reviewed to ensure decisions made to include/exclude them were accurate. Of the 130 studies reviewed, 34 met the inclusion criteria and were taken forward to data extraction [4, 6, 23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54].
Eligibility was not checked by a second researcher. The quality of the studies as a whole was not checked as poor-quality studies could still have included high quality outcome indicators which would add to the framework.
Inclusion criteria
Studies included were those that:
-
Measured the direct impact of pharmacists’ on the quality of care (i.e. direct from pharmacist to patient); or the indirect impact of pharmacists’ on the quality of care (i.e. outcomes via another healthcare professional); or the direct impact of a pharmacist on the activities of other healthcare professionals (i.e. a surrogate outcome).
-
Measured ED pharmacist processes (i.e. no outcome indicators) and were UK studies.
-
Measured outcomes which manifested and/or were measured within or outside the ED.
-
Involved pharmacists who work in the ED, or units closely affiliated/named differently e.g. ED short stay unit.
-
Involved the care of a general adult population (no less than 16 years of age), or if paediatric data were included then adult data were available for extraction separately.
.
As most studies of ED pharmacist impact are international, UK studies which only concerned ED pharmacist processes (i.e. no outcome indicators) were included to ensure the framework included UK relevant processes. While increasing the framework’s relevance to UK practice, this approach did not detract anything from its use in other countries.
Exclusion criteria
Studies excluded were those that:
-
Suggested, rather than measured, the impact of ED pharmacists i.e. suggestions based on opinion or the extrapolation of previous research.
-
Investigated a specialist ED e.g. for elderly or paediatric patients only.
-
Had a ‘research pharmacist’ (i.e. a pharmacist who did not routinely provide patient care in the ED) carry out patient care processes in the ED e.g. for an intervention study.
.
For each study, structures, processes and outcome indicators were extracted and collated into the 12 data tables. Extraction was done independently by author DG but under the supervision of the other authors i.e. decisions made by DG were justified and discussed during meetings of all authors. As per the review inclusion criteria, outcome indicators of ED pharmacist’s indirect impact on patient care (i.e. via another healthcare professional) were included. Albeit indirect, these outcome indicators still suggested a relationship between pharmacist activity and outcomes. They were, however, collated separately for if it was later decided they should be excluded from the framework. An overall summary of literature processing is given in Fig. 1.
ED pharmacist panel (Stage 2)
A panel of seven ED pharmacists was convened in October 2017 to identify further potential topics of evaluation (outcomes), outcome indicators, and processes. Many recurring structures had already been identified from the literature so were not sought in what would already be a busy meeting. Data sources which could be used to measure outcome indicators were also sought. Audio recorded and lasting two hours, the meeting was held at the University of Manchester (UoM) and hosted by the primary author with the support of authors DS and SM. The five pharmacists who participated face-to-face were all students of the UoM ‘Advanced Specialist Training in Emergency Medicine’ (ASTEM) programme which upskills ED pharmacists to provide practitioner care. Of those five pharmacists, four worked in EDs in the North West of England while one worked in Scotland. Two further ED pharmacists joined via Skype® (both audio and video), neither of whom were ASTEM students or graduates but did provide practitioner care. All participants had at least two years of experience working as a pharmacist and a postgraduate diploma in clinical pharmacy.
Using a data collection form, participants were first asked to record potential topics for evaluation (outcomes) of ED pharmacist services (both ‘traditional’ and ‘practitioner’ activities, as per a previously developed work typology) [55]. In turn, participants then contributed their ideas to the panel, which were collated on a flipchart visible to participants. Although asked to prioritise ideas not already on the flipchart, they could comment on existing suggestions. Next, and in small groups, participants were asked to consider the potential outcomes for two of the six IoM domains and suggest related processes. Processes were not fed back to the whole group or discussed, due to time constraints. After the meeting, each participant was forwarded all outcomes and related processes and asked to record potential indicators for each of the outcomes. Data sources that could be used to support evaluation of outcome indicators were also sought.
Multidisciplinary panel (Stage 3)
A panel of five ED healthcare professionals was convened in March 2018 to identify further potential outcome indicators. Participants were two staff nurses; a nurse practitioner; a physiotherapist; and an occupational therapist. Physicians were invited but none were recruited. They were chosen due to their varied roles which could support identification of different indicators, and were recruited through professional networks or Twitter® and worked in UK EDs. Lasting two hours and facilitated by author DG, the meeting platform GoToMeeting® was used whereby data collection was presented interactively on screen.
First, outcomes identified from the literature and ED pharmacist panel were listed on screen for one of the IoM quality domains. Taking each outcome in turn, participants were asked to record potential outcome indicators with an example given for the first outcome listed to aid understanding of the task. Having recorded all their ideas (unlimited time permitted), participants were in turn asked to share their indicators with the group with these recorded on screen by DG. The process was then repeated for each outcome for the first IoM domain, and then for a further three domains. Due to time constraints, participants were forwarded outcomes of the final two IoM domains for consideration after the meeting. They were asked to return their suggestions to the meeting facilitator when convenient. Data sources which could be used to support evaluation of outcome indicators were also sought.
Processing data and creation of the Manchester framework
Raw data were placed in tables of direct and indirect outcome indicators and any duplicates e.g. exactly the same outcome indicator identified from multiple data sources, combined. Then, all outcome indicators were screened with those which were vague i.e. more closely resembled a theme and did not explicitly state what would be measured, removed. To increase usability of the resultant framework, the more specific outcome indicators were collated into broader outcome indicators. For example, indicators for the safety domain ‘number of prescribing errors’ and ‘number of errors that involve high-risk medicine’ were collated under the broader outcome indicator ‘number of medication errors’, with those more specific indicators given as examples. Some outcome indicators were also re-worded to ensure clarity but also international relevance. For example, references made to ‘Trust’ (a term used to describe a collection of hospitals or health services in the UK) were reworded to ‘hospital’. For structures and processes, some examples of different categories were included in the final framework as examples which the user may wish to consider for evaluation studies. To that end, instructions for how to use the framework are also included, with reference made to a study which has previously evaluated the quality impact of an ED pharmacy service.
Results
From the three stages of data collection and prior to data processing, a total of 399 direct outcome indicators, 103 indirect outcome indicators, 533 processes and 190 structures were identified (unique items), divided into 12 different categories (Table 1).
The framework
The ‘Manchester framework for the evaluation of ED pharmacy services’ (see electronic supplementary material C) comprises three sections. In Section A, of the 502 unique potential outcome indicators identified (399 direct, 103 indirect), 322 had clarity (i.e. explicitly stated what would be measured) and were collated to give the final total of 153. The 153 potential outcome indicators are presented for the six quality domains: safety (32 potential outcome indicators), effectiveness (50), patient centred (18), timely (24), efficient (20), and equitable (9). Table 2 presents example potential outcome indicators for each of the domains, grouped into specific areas of evaluation.
Section B of the framework lists 11 example structures and 16 example processes. Some of these are presented below in Table 3.
In Section C, an example study [4] which measured outcome indicators and considered structures and processes is given to demonstrate how components of the framework could be used. Some examples of data sources are also given, such as: medical notes, medication administration records, pain and function score charts, and ‘near-miss’ error logs.
Discussion
Statement of key findings
Although there are already frameworks which can be used to evaluate the quality of ED care more generally, this study is the first specific to ED pharmacy services. The inclusion of international literature, and use of the IoM quality domains [11] to guide identification of structures, processes and potential outcome indicators, means the framework has global relevance. At least some items e.g. particular outcome indicators, should be relevant to the pharmacy services of any given country. With respect to the UK where some ED pharmacists now work as practitioners, the framework can be used to evaluate both traditional and new ‘practitioner’ care.
Supporting a system-based approach to evaluation, the framework can be used to evaluate different indicators together by pharmacists with researchers. Potential outcome indicators are grouped into the different domains of quality should more focused evaluation be desired e.g. to purposely measure only the safety of care. Further, through narrative and use of an example study, the framework explains how to evaluate quality including how processes can be used to identify outcome indicators sensitive to said processes. As has been stressed by other researchers [9, 13], the importance of processes and structures in contextualising outcome measurements is also described with examples of those components given.
Fewer potential outcome indicators were identified for the ‘equitable’, ‘efficient’ and ‘patient-centred’ domains, than for the other three. For equitable and efficient, no indicators were identified from the literature. The IoM recognise that the equitable and efficient domains, and to a lesser extent patient-centred, are often neglected by evaluators [56]. Indeed, some organisations have opted not to include the equitable and efficient domains in their definition of quality e.g. the Organisation for Economic Co-operation and Development [57]. With regards to ED pharmacy services, these three domains might be more challenging to consider or investigate than the others, or a lower priority for evaluation. Given that the IoM domains are themselves supposed to be ‘equitable’ i.e. six aims for healthcare improvement [56], further identification of indicators for those neglected domains is warranted. However, it could be that for ED pharmacy services, there are fewer potential outcome indicators to be identified for those quality domains typically neglected.
Considering the methods used to develop the framework, many of the potential outcome indicators suggested by the expert panels more closely resembled themes i.e. no detail as to what might be measured. While expert contribution was valuable, particularly to gain more current data e.g. outcome indicators for novel practitioner care, panel meetings took longer than anticipated, perhaps due to the complex nature of quality. Further, many outcome indicators suggested lacked clarity and instead more closely resembled themes. With respect to indicators of ‘indirect outcomes’ i.e. outcomes via another healthcare professional, these were included as no reason to exclude them from the framework was identified throughout development. Much of pharmacists’ work is to influence other healthcare professionals e.g. prescribing error interventions, with a change in outcome still possible albeit indirectly.
Strengths and weaknesses
A strength of this study is the use of different data collection methods to identify varied framework components, enabling a large range of future evaluation studies. Another strength, literature databases were searched systematically, meaning most – if not all – relevant studies from five databases were included. There are also several limitations to this study. First, experts were all UK healthcare professionals which may mean the framework is less relevant to other countries. Further, five of the seven pharmacists who participated were ASTEM students who practiced in the North West of England, potentially meaning the framework is more tailored to practices in that region. The inclusion of literature from different countries countered these limitations, increasing the international relevance of the framework. Another limitation, due to meetings taking longer than planned, final tasks were often completed independently by participants after the meeting. This may have limited the amount and quality of data collected as there was no opportunity for group discussion of those final tasks.
A third limitation, all four authors are pharmacists and pharmacy practice researchers whom could be biased in favour of pharmacists. For example, particular studies could have been favoured and included in the final framework with others discarded. To ensure a consistent approach, explicit inclusion and exclusion criteria were developed to screen studies. The potential for bias should also be an important consideration for those who use the framework and evaluate ED pharmacy services. Evaluation teams should be multidisciplinary to ensure different perspectives are considered [17].
Interpretation
The Manchester framework provides a starting point to evaluate ED pharmacy services. Although comprised of potential outcome indicators which require validation prior to their use, their eventual measurement could indicate the quality of ED pharmacy services. If outcome measurements are undesirable, services could be modified e.g. through development of specific, targeted interventions. Re-measurement can then be used to conclude whether changes have had a positive or negative impact on outcomes. Having been developed from international literature, if used by service providers in different countries, the framework provides global alignment for evaluation.
Further research
Further research should seek to develop additional outcome indicators which could be used to measure the extent to which ED pharmacy services are equitable, efficient and patient-centred domains. These domains are currently under-represented in the framework – something which is by no means limited to evaluation of ED pharmacy services, but rather, is an issue of quality evaluation more broadly. Given that expert panels often contributed themes rather than explicit outcome measures, a recommendation for others seeking to identify explicit outcome indicators would be to use longer or several sequential meetings could prove more effective.
Future research should use potential indicators to evaluate the quality of ED pharmacy services. For example, to evaluate safety, evaluators should first choose one or more relevant outcome indicators and validate them. Then, an ‘acceptable’ measurement for each chosen indicator should be defined i.e. the minimum acceptable standard of service. Progressing to actual measurement, given the complexities of systems-based outcome measurement, evaluation teams should be multidisciplinary and ideally involve researchers with relevant expertise. Finally, dissemination of measurements and resultant service modifications will increase our understanding of what constitutes a high-quality ED pharmacy service.
Conclusion
Building on the experiences and methods of more general ED quality evaluation frameworks, the Manchester framework is the first exclusively concerned with the evaluation of ED pharmacy services. Prior to their use, outcome indicators should be treated as potential outcome indicators which first require further development i.e. validation, with standards to interpret measurements also defined. When evaluating ED pharmacy services, all quality domains should be assessed and not just those that are straightforward to measure, at the expense of those that are neglected. After all, quality health services are not only safe, effective and timely, but also patient centred, efficient and equitable.
References
Patanwala AE, Sanders AB, Thomas MC, et al. A prospective, multicenter study of pharmacist activities resulting in medication error interception in the emergency department. Ann Emerg Med. 2012;59(5):369–73.
Almulhim AS, Aldayyen A, Yenina K, et al. Optimization of antibiotic selection in the emergency department for urine culture follow ups, a retrospective pre-post intervention study: clinical pharmacist efforts. J Pharm Policy Pract. 2019;12:8.
Becerra-Camargo J, Martínez-Martínez F, García-Jiménez E. The effect on potential adverse drug events of a pharmacist-acquired medication history in an emergency department: a multicentre, double-blind, randomised, controlled, parallel-group study. BMC Health Serv Res. 2015;15(1):337.
Mills PR, McGuffie AC. Formal medicine reconciliation within the emergency department reduces the medication error rates for emergency admissions. Emerg Med J. 2010;27(12):911.
Greenwood D, Tully MP, Martin S, et al. The description and definition of Emergency Department Pharmacist Practitioners in the United Kingdom (the ENDPAPER study). Int J Clin Pharm. 2019;42(2):434–44.
Hatton K, Grice K, Morgan L, et al. Evaluation of the pharmacist service to the emergency department at a large teaching hospital. Pharmacoepidemiol Drug Saf. 2016;25:12–3.
Masic D, Hidalgo DC, Kuhrau S, et al. Pharmacist Presence Decreases Time to Prothrombin Complex Concentrate in Emergency Department Patients with Life-Threatening Bleeding and Urgent Procedures. J Emerg Med. 2019;57(5):620–8.
Patanwala AE, Sanders AB, Thomas MC, et al. A prospective, multicenter study of pharmacist activities resulting in medication error interception in the emergency department. Ann Emerg Med. 2012;59(5):369–73.
Campbell SM, Roland MO, Buetow SA. Defining quality of care. Soc Sci Med. 2000;51(11):1611–25.
Lee H, Delene LM, Bunda MA, et al. Methods of Measuring Health-Care Service Quality. J Bus Res. 2000;48(3):233–46.
Institute of Medicine Committee on Quality of Health Care. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington (DC): National Academies Press (US) Copyright 2001 by the National Academy of Sciences. All rights reserved.; 2001
Worning AM, Mainz J, Klazinga N, et al. Policy on quality development for the medical profession. Ugeskr Laeg. 1992;154(49):3523–33.
Donabedian A. The quality of care: How can it be assessed? JAMA. 1988;260(12):1743–8.
Mainz J. Defining and classifying clinical indicators for quality improvement. Int J Qual. 2003;15(6):523–30.
Cameron PA, Schull MJ, Cooke MW. A framework for measuring quality in the emergency department. J Emerg Med. 2011;18(3):735–40.
Gunter MJ. The role of the ECHO model in outcomes research and clinical practice improvement. Am J Manag Care. 1999;5(Suppl 4):217-24.
Mainz J. Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003;15(Suppl 1):i5–11.
Anema HA, Kievit J, Fischer C, et al. Influences of hospital information systems, indicator data collection and computation on reported Dutch hospital performance indicator scores. BMC Health Serv Res. 2013;13(1):212.
Lecky F, Benger J, Mason S, et al. The International Federation for Emergency Medicine framework for quality and safety in the emergency department. Emerg Med J. 2014;31:926–9.
International Federation of Emergency Medicine. An Updated Framework on Quality and Safety in Emergency Medicine. 2nd ed. [Internet]. 2019 [cited 2020 Dec 10]. Available from: https://www.ifem.cc/wp-content/uploads/2019/05/An-Updated-Framework-on-Quality-and-Safety-in-Emergency-Medicine-January-2019.pdf.
Cohen V, Jellinek SP, Hatch A. et al. Effect of clinical pharmacists on care in the emergency department: A systematic review. Am J Health Syst Pharm. 2009;66(15):1353–61.
Jacknin G, Nakamura T, Smally AJ, et al. Using pharmacists to optimize patient outcomes and costs in the ED. Am J Emerg Med. 2013;32(6):673–7.
Abdelaziz H, Al Anany R, Elmalik A, et al. Impact of clinical pharmacy services in a short stay unit of a hospital emergency department in Qatar. Int J Clin Pharm. 2016;38(4):776–9.
Attwood RJ, Garofoli AC, Baudoin MR, et al. Impact of emergency department clinical pharmacist response to an automated electronic notification system on timing and appropriateness of antimicrobials in severe sepsis or septic shock in the emergency department. Ann Emerg Med. 2012;60(4 SUPPL. 1):S118.
Cesarz JL, Steffenhagen AL, Svenson J, et al. Emergency department discharge prescription interventions by emergency medicine pharmacists. Ann Emerg Med. 2013;61(2):209 – 14.e1.
Cohen V, Jellinek-Cohen SP, Likourezos A, et al. Feasibility of a Pharmacy-Based Influenza Immunization Program in an Academic Emergency Department. Ann Pharmacotherapy. 2013;47(11):1440–7.
Chan TC, Castillo EM, Humber DM, et al. Frequency of Pharmacy Interventions and Emergency Overrides Following Implementation of Electronic Pharmacy Review In the Emergency Department. Ann Emerg Med. 2010;56(3):112-S.
deClifford JM, Caplygin FM, Lam SS, et al. Impact of an emergency department pharmacist on prescribing errors in an Australian hospital. J Pharm Pract and Res. 2007;37(4):284–6.
Ernst AA, Weiss SJ, Sullivan A, et al. On-site pharmacists in the ED improve medical errors. Am J Emerg Med. 2012;30(5):717–25.
Fee C, Chen GH. Impact of Pharmacy Review of Emergency Department Medication Orders on Time From Antibiotic Order to Administration for Patients Admitted With Pneumonia. Ann Emerg Med. 2010;56(3):143-S.
Gaskin J, Conyard E. Clinical pharmacist interventions in the emergency department and their impact on preventable adverse drug events and associated cost avoidance. Eur J Hosp Pharm. 2017;24:A81.
Gosser RA, Arndt RF, Schaafsma K, et al. Pharmacist Impact on Ischemic Stroke Care in the Emergency Department. J Emerg Med. 2016;50(1):187–93.
Hanna N, Price CA, Cook B, et al. Pharmacist impact on the appropriate selection and administration time of antibiotics in patients with community acquired pneumonia presenting to the emergency department. ASHP Midyear Clinical Meeting. 2005;40:P–509E.
Hayes BD, Donovan JL, Smith BS, et al. Pharmacist-conducted medication reconciliation in an emergency department. Am J Health Syst Pharm. 2007;64(16):1720–3.
Jiron M, Martinez M, Sandoval T, et al. Effect of clinical pharmacist interventions on patient satisfaction in the emergency department: A randomized controlled trial. Pharmacoepidemiol Drug Saf. 2017;26:598.
Kellner FN, Freer C. Impact of a clinical pharmacist on antibiotic selection for treating urinary tract infections in the emergency department. ASHP Midyear Clinical Meeting. 2012;2011:P–292. :(D .
Lada P, Delgado G Jr. Documentation of pharmacists’ interventions in an emergency department and associated cost avoidance. Am J Health Syst Pharm. 2007;64(1):63–8.
Lingenfelter E, Drapkin Z, Fritz K et al. ED pharmacist monitoring of provider antibiotic selection aids appropriate treatment for outpatient UTI. Am J Emerg Med. 2016;34(8):1600-3.
Miller K, McGraw MA, Tomsey A, et al. Pharmacist addition to the post-ED visit review of discharge antimicrobial regimens. Am J Emerg Med. 2014;32(10):1270–4.
Mogensen CB, Olsen I, Thisted AR. Pharmacist advice is accepted more for medical than for surgical patients in an emergency department. Dan Med J. 2013;60(8):6.
Mohorn P, Cox H, Grof T. Time to initial antimicrobial therapy in emergency department patients with sepsis improves when a clinical pharmacist participates on the care team. Crit Care Med. 2012;1:129.
Montgomery K, Hall AB, Keriazes G. Pharmacist’s Impact on Acute Pain Management During Trauma Resuscitation. J Trauma Nurs. 2015;22(2):87–90.
Okere AN, Renier CM, Tomsche JJ. Evaluation of the influence of a pharmacist-led patient-centered medication therapy management and reconciliation service in collaboration with emergency department physicians. J Manag Care Spec Pharm. 2015;21(4):298–306.
Parris M, Tredway L, Henry VR. Success with pharmacist interventions and quinolone prescribing patterns. ASHP Midyear Clinical Meeting. 2003;38(DEC):P.
Perry T, Gama J, Jost P, et al. Improving door-to-needle time with direct pharmacy ordering process. Stroke. 2016;47.
Rafie S, Chan T, Castillo E, et al. Evaluation of a pharmacist oversight program for medication use in the emergency department of an academic medical center. Pharmacotherapy. 2011;31(10):399e.
Randolph TC. Expansion of pharmacists’ responsibilities in an emergency department. Am J Health Syst Pharm. 2009;66(16):1484–7.
Robey-Gavin E, Abuakar L. Impact of Clinical Pharmacists on Initiation of Postintubation Analgesia in the Emergency Department. J Emerg Med. 2016;50(2):308–14.
Weeks GR, Ciabotti L, Gorman E, et al. Can a redesign of emergency pharmacist roles improve medication management? A prospective study in three Australian hospitals. Res Social Adm Pharm. 2014;10(4):679–92.
Zhang X, Rowan N, Pflugeisen BM, et al. Urine culture guided antibiotic interventions: A pharmacist driven antimicrobial stewardship effort in the ED. Am J Emerg Med. 2017;35(4):594–8.
Rothschild JM, Churchill W, Erickson A, et al. Medication errors recovered by emergency department pharmacists. Ann Emerg Med. 2010;55(6):513–21.
Davis LC, Covey RB, Weston JS, et al. Pharmacist-driven antimicrobial optimization in the emergency department. Am J Health Syst Pharm. 2016;73(5 Suppl 1):49–56.
Collignon U, Oborne CA, Kostrzewski A. Pharmacy services to UK emergency departments: a descriptive study. Pharm World Sci. 2010;32(1):90–6.
Mattson AE, Scherber KJ, Clark SL, et al. Impact of pharmacist bedside tissue plasminogen activator (TPA) admixture for ischemic stroke in the emergency department. Acad Emerg Med. 2017;24:193-S4.
Greenwood D, Tully MP, Martin S, et al. Development of a Clinical Pharmacy Care Typology to support description and comparison of Emergency Department Pharmacist Practitioner roles. Int J Pharm Prac. 2019;27(S1):6–31.
Schroeder S, Berkowitz B, Berwick D. Performance measurement: Accelerating improvement. Washington, DC: Institute of Medicine of the National Academies; 2006.
The King’s Fund. Getting the measure of quality: opportunities and challenges. [Internet]. 2010 [cited 2022 Apr 19]. Available from: https://www.kingsfund.org.uk/sites/default/files/Getting-the-measure-ofquality-Veena-Raleigh-Catherine-Foot-The-Kings-Fund-January-2010.pdf
Acknowledgements
The authors would like to thank all those pharmacists and other healthcare professionals who supported this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
We are grateful to Pharmacy Research UK, the UK Clinical Pharmacy Association, Health Education North West and the Centre for Pharmacy Postgraduate Education who funded this research.
Conflicts of interest
Authors D Greenwood, MP Tully, S Martin and D Steinke declare that they have no conflicts of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Greenwood, D., Tully, M., Martin, S. et al. Development of the Manchester framework for the evaluation of emergency department pharmacy services. Int J Clin Pharm 44, 930–938 (2022). https://doi.org/10.1007/s11096-022-01403-w
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11096-022-01403-w