Abstract
Background
The coronavirus (COVID-19) outbreak basically changed teaching methods across the world, and learning was almost replaced by virtual learning during the pandemic. Also, the spacing effect is one of the most well-established phenomena in the science of learning. Using temporal intervals for re-exposing learners to information over time (spaced learning) leads to more effective retention of knowledge compared to having information presented at a single time (massed learning). Hence, we designed a virtual spaced learning method to reap the benefits of virtual learning and spaced learning concomitantly.
Methods/approach
An interventional semi- experimental survey among 66 Pharm D students was designed and implemented. Students were divided into two groups (spaced vs mass learning) in the national integrated virtual education platform (NAVID) as the matrix for teaching as well as evaluation. Classes were conducted in the following sequence: 1- answering the pre-test, 2- watching and listening to the educational content (separately for each group), 3- answering the post-test (n = 1). The pre/post-test consisted of 10 four-choice questions based on the Kirkpatrick Model extracted from the educational content.
Results/outcomes
Findings revealed that the average score was not significantly different between the post-tests of the spaced learning and mass learning (7.26 ± 2.26 vs 6.5 ± 2.5) methods utilizing the independent t- test (p ≥ 0.05).
Conclusions
Since no statistically significant improvement was observed in the virtual spaced learning group compared to the control group, it seems that clarifying the significant influence of the spaced learning strategy in pharmacy education requires longer period of study, or study on less complex or skill-based topics for further evaluation.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction/background
The new coronavirus (COVID-19) in 2019 has basically changed the way teaching is practiced across the world [1]. Social distancing and limitations on gathering in order to minimize the spread of COVID-19 based on WHO recommendations, have seriously affected Pharm D student training [2]. Since the start of the pandemic, Pharm D education has been fundamentally renovated and almost all academic programs including lecturers and different assessments have turned to virtual learning, using the developed electronic education platforms [3].
Along with the merits of e-learning, such as providing greater educational opportunities for students worldwide and improved cost effectiveness [4], some challenges have also been reported in virtual education. For example, the limited numbers of expert instructional designers or instructional technologists to support e-learning processes [5], time zone variations (when conducting real-time distance learning) [6], financial expenses of implementing and maintaining the infrastructure necessary for e-learning [7], lack of face-to-face interaction [8, 9] and time commitment required for teachers to commit to the experience [10] can be mentioned as some of these obstacles. Also, some studies have revealed the non-significant effectiveness of e-learning technologies in comparison with traditional education, in which instruction takes place between an instructor and students who are all physically present in the same space [4, 11].
Among several factors affecting learning yield [12, 13], the spacing effect is one of the most well-established phenomena. Using temporal intervals for re-exposing learners to information over time (spaced learning) leads to more effective retention of knowledge in comparison to presenting it at a single time (massed learning) [14, 15]. It has been proven that presenting the educational contents in a learning process which involves repetition for a second or third time after one or more diverse intervals from the first encounter (spaced learning), has a better outcome as opposed to a state in which the second set of information follows the first immediately in a bolus or mass presentation [16]. As well as the variety of educational methods [17], spacing techniques mainly differ in terms of temporality. Some researchers distribute learning sections over a few days, while others use minutes, hours, weeks or months [18]. Spaced learning has been shown to enhance learning efficiency and retention [19], facilitate skill acquisition and short term and long-term retention in motor skill training [20, 21].
The aim of this study was to increase the effectiveness of virtual education during the COVID-19 pandemic for students. Hence, we designed a virtual spaced learning method to reap the benefits of virtual learning and spaced learning concomitantly. The topic was “Good manufacturing practice (GMP) requirements for pharmaceutical microbiology” in Pharm D students.
Methods
This study was conducted as an interventional semi-experimental survey among Pharm D students. Pharmacy students in Guilan university of medical sciences in their 9th semester of education who had registered for a pharmaceutical microbiology course were included in this study. Sixty-six students aged 21–24 years old were sorted on a list based on their GPA (grade point average). Next, in order to have similar GPAs in peer groups, odd numbers were categorized as the control group (mass learning) while even numbers formed the study group (spaced learning). This study was performed on the topic of Good Manufacturing Practice (GMP) requirements for pharmaceutical microbiology (microbiological quality control of dosage forms) in a two-hour session. The national integrated virtual education platform (NAVID) was utilized as the matrix for teaching and also exams.
In a face to face briefing session, the teaching method was explained for the students and they were assured that the pre/post-test points would not influence their final point, and consent was obtained. The inclusion criteria for the students were: being a Pharm D student, being in the 9th semester of education (coordinated with normal Pharm D curriculum), registering in a pharmaceutical microbiology course for the first time. The exclusion criteria were: being absent in the briefing session, delay in attending in online session (due to the impossibility of repeating the pre-test), probable network disconnections, lack of interest in attending the study.
As mentioned, one group was subjected to routine virtual education with narrated power point slides (mass learning) as the control group, while the other group was subjected to the same narrated slides with the difference that two videos were inserted between slides as breaktime (spaced learning study group). Power-point slides were narrated in detail by the instructor for mass virtual education and for spaced learning group, and two diverse 10 min’ videos were placed between slides. The first video was about an overview of a pharmaceutical company and the second one was a meditation video. The two groups of students were registered in NAVID (spaced and mass learning groups) and the classes were conducted on line for both groups as follows: when the students concurrently entered their profile, first the pre-test exam was activated and they had to answer 10 four-choice questions from the scheduled educational content. At the end of the pre-test, the educational content (narrated slides) was activated for the students to watch and listen. After finishing the slides, the post-test exam, which consisted of the same questions as the pre-test was activated, and students had to answer them again. The steps included the following: 1- answering the pre-test, 2- watching and listening to the educational content, 3- answering the post test. The pre/post-test included 10 four-choice questions based on the Kirkpatrick Model [22]. The aforementioned educational process was virtually performed simultaneously for both groups (Fig. 1).
Statistical analysis
The difference between the average scores of the pre-tests and post-tests of the students in the control and test groups (regardless of the learning method) was determined by the paired t-test (p ≤ 0.05) and the difference in educational method efficacy was distinguished by the independent t-test (p ≤ 0.05), comparing the groups’ post-test average scores. Data analysis was performed using IBM SPSS Statistics 23 software.
Results
Amongst 33 existing students in each group, 20 students in the control group (mass learning) and 23 students in the test group (spaced learning) participated in this study. At the end of the teaching process (pre-test, online class, post-test) the average points of the tests were evaluated and compared between the control and test groups. One point was given to each question, so there were 10 points for 10 questions. The minimum and maximum scores of students in the post-test of the mass learning group were 3 and 10, respectively, with an average of 7.26 ± 2.26, and the minimum and maximum scores of students in the post-test of the spaced learning group were 1 and 10, respectively, with an average of 6.5 ± 2.5 as shown in Table 1 and Fig. 2. Results revealed that the average score was not significantly different between the pre-test of the spaced learning (3 ± 1.31) and mass learning (3.32 ± 1.56) methods, and no difference was observed between the two groups’ in the post-test (7.26 ± 2.26 vs 6.5 ± 2.5) utilizing the independent t- test (p ≥ 0.05) (Table 2). Variances were considered equal in both groups.
Based on paired t-test results, the average score was significantly different between the pre-test and post-test (p ≤ 0.0001) in both control and test groups, which meant that after the education process utilizing both (mass and spaced) methods, students’ average scores increased in the post-test compared to the pre-test (Table 3).
Discussion
This study was designed and implemented with the aim of comparing the learning effect of two educational methods (mass and spaced education), virtually, on Pharm D students in their 9th semester in a pharmaceutical microbiology course. Results showed that the average points of post-tests were significantly higher than pre-tests in both groups. However, no statistically significant difference was observed regarding the average points of post-tests between the control and test groups.
During the COVID-19 pandemic, online platforms unified the communication and collaboration platforms to allow teachers to create educational courses for training and skill development. Well-known platforms such as Microsoft Teams, Google Classroom, Canvas and Blackboard utilized options like workplace chat, video meeting and file storage that keep classes organized and user friendly [23]. Also, sharing a variety of content, such as Word, PDF and Excel files, audios, videos, and assessment of student learning by using quizzes were possible [24]. However, virtual education was performed through various platforms, and to our knowledge, few studies have utilized them to combine a new teaching technique with e-learning. For example, Doucet et al., have mentioned the flipped classroom as a suitable method for virtual education, whereby learning resources such as articles, pre-recorded videos and YouTube links were provided before the class and the online classroom time was then used to deepen understanding through discussion with faculty and peers [25].
Several studies have been designed to evaluate the mechanism and optimization of spacing and its effect on learning outcomes [26, 27]. Among them, healthcare professionals have widely utilized this technique in theoretical and skill acquiring education [18], including resuscitation courses [28], adaptation of optokinetic response [29], microsurgical procedures [30], emergency medicine [31] and pharmacy [32].
Moreover, in pharmaceutical education, the spaced learning strategy has been incorporated in various areas, including learning the names of drugs [33], performing physical assessments [34], pharmacotherapy [35] and an online spaced-education game for students to study drugs in a skill- lab course [32].
Although many investigations have supported the affirmative effects of spaced learning in pharmacy [36,37,38], there are some studies which have revealed no significant effect for this learning strategy [39]. Yates et al., presented a case-based, spaced learning strategy for teaching physical assessment skills to first-year pharmacy students as a successful approach [34] and Terenyi et al., confirmed that repeated quizzes with spacing can improve long-term retention of learning in pharmacy students [33]; while Sedlacek et al., observed no improvement in the summative assessment performance of Pharm D students in remote asynchronous lectures including time-spaced quizzes for pharmacotherapeutic courses [35]. In addition, Sando et al., revealed that utilizing an online spaced education game did not significantly affect the scores of pharmacy students in the top 200 drug examination, although, high levels of student engagement and positive student perceptions were observed [32]. These results were in accordance with our findings, which showed no statistically significant difference between students’ scores using the virtual spaced learning method compared with the mass learning method.
This lack of improvement may have been related to the difficulty of the subject taught, which was mainly knowledge-based, or possibly due to the shortness of the course used to assess this teaching method. It seems that clarifying the significant influence of the spaced learning strategy (education and assessment) in pharmacy education, requires further evaluation with careful consideration of the differences between knowledge-based and skill-based courses over a longer time period, and preferentially, in the form of a multi-center or distributed study across several pharmacy colleges coordinately.
Conclusion
In this study, we aimed to increase the advantages of virtual learning by incorporating the spaced learning method. The virtual spaced learning method offered no statistically significant difference in terms of Pharm D students’ scores compared with the mass learning method in a pharmaceutical microbiology course. A longer period of study is suggested for further evaluation. Also, less complex or skill-based topics may lead to more significant learning among pharmacy students, and this matter also warrants further investigation.
Availability of data and materials
All datasets generated for this study are included in this published article [and its supplementary information files].
References
Lazaro T, Srinivasan VM, Rahman M, Asthagiri A, Barkhoudarian G, Chambless LB, Kan P, Rao G, Nahed BV, Patel AJ. Virtual education in neurosurgery during the COVID-19 pandemic. Neurosurg Focus. 2020;49(6):E17.
Hasan SS, Kow CS, Zaidi STR. Social distancing and the use of PPE by community pharmacy personnel: Does evidence support these measures? Res Social Adm Pharm. 2021;17(2):456–9.
Amir LR, Tanti I, Maharani DA, Wimardhani YS, Julia V, Sulijaya B, Puspitawati R. Student perspective of classroom and distance learning during COVID-19 pandemic in the undergraduate dental study program Universitas Indonesia. BMC Med Educ. 2020;20(1):392.
Frehywot S, Vovides Y, Talib Z, Mikhail N, Ross H, Wohltjen H, Bedada S, Korhumel K, Koumare AK, Scott J. E-learning in medical education in resource constrained low-and middle-income countries. Hum Resour Health. 2013;11(1):1–15.
Erah PO, Dairo EA. Pharmacy students perception of the application of learning management system in patient-oriented pharmacy education: University of Benin experience. Int J Health Res. 2008;1(2):63–72.
Vyas R, Albright S, Walker D, Zachariah A, Lee M. Clinical training at remote sites using mobile technology: an India–USA partnership. Distance Educ. 2010;31(2):211–26.
Vincent DS, Berg BW, Hudson DA, Chitpatima ST. International medical education between Hawaii and Thailand over Internet2. J Telemed Telecare. 2003;9(2_suppl):71–2.
Muñoz DC, Ortiz A, González C, López DM, Blobel B. Effective e-learning for health professional and medical students: the experience with SIAS-Intelligent Tutoring System. Stud Health Technol Inform. 2010;156:89–102.
Akkoyunlu B, Soylu MY. A study of student’s perceptions in a blended learning environment based on different learning styles. 2008.
Silva CS, Souza MB, Silva Filho RS. Medeiros LMd, Criado PR: E-learning program for medical students in dermatology. Clinics. 2011;66:619–22.
Vichitvejpaisal P, Sitthikongsak S, Preechakoon B, Kraiprasit K, Parakkamodom S, Manon C, Petcharatana S. Does computer-assisted instruction really help to improve the learning process? Med Educ. 2001;35(10):983–9.
Dadgaran I, Parvizy S, Peyrovi H. Nursing students’ views of sociocultural factors in clinical learning: a qualitative content analysis. Jpn J Nurs Sci. 2013;10(1):1–9.
Masooleh IS, Ramezanzadeh E, Yaseri M, Khatibani SSM, Fayazi HS, Balou HA, Louyeh HE, Zaersabet F, Khoshrang H, Dadgaran I. The effectiveness of training on daily progress note writing by medical interns. J Adv Med Educ Prof. 2021;9(3):168.
Carpenter SK, Cepeda NJ, Rohrer D, Kang SHK, Pashler H. Using spacing to enhance diverse forms of learning: review of recent research and implications for instruction. Educ Psychol Rev. 2012;24(3):369–78.
Cepeda NJ, Coburn N, Rohrer D, Wixted JT, Mozer MC, Pashler H. Optimizing distributed practice: theoretical analysis and practical implications. Exp Psychol. 2009;56(4):236–46.
Glenberg AM, Lehmann TS. Spacing repetitions over 1 week. Mem Cognit. 1980;8(6):528–38.
Jahandideh Y, Balasi LR, Saberi BV, Dadgaran I. Designing and assessing fixed dental prostheses 2 multimedia-based education in dentistry students. Med J Islam Repub Iran. 2016;30:455.
Versteeg M, Hendriks RA, Thomas A, Ommering BWC, Steendijk P. Conceptualising spaced learning in health professions education: A scoping review. Med Educ. 2020;54(3):205–16.
Pashler H, Rohrer D, Cepeda NJ, Carpenter SK. Enhancing learning and retarding forgetting: Choices and consequences. Psychon Bull Rev. 2007;14(2):187–93.
Cecilio-Fernandes D, Cnossen F, Jaarsma DA, Tio RA. Avoiding surgical skill decay: a systematic review on the spacing of training sessions. J Surg Educ. 2018;75(2):471–80.
Spruit EN, Band GP, Hamming JF. Increasing efficiency of surgical training: effects of spacing practice on skill acquisition and retention in laparoscopy training. Surg Endosc. 2015;29(8):2235–43.
Smidt A, Balandin S, Sigafoos J, Reed VA. The Kirkpatrick model: A useful tool for evaluating training outcomes. J Intellect Dev Disabil. 2009;34(3):266–74.
Mouchantaf M. The COVID-19 pandemic: Challenges faced and lessons learned regarding distance learning in Lebanese higher education institutions. Theory and Practice in Language Studies. 2020;10(10):1259–66.
Pokhrel S, Chhetri R. A literature review on impact of COVID-19 pandemic on teaching and learning. High Educ Future. 2021;8(1):133–41.
Doucet A, Netolicky D, Timmers K, Tuscano FJ. Thinking about pedagogy in an unfolding pandemic: An independent report on approaches to distance learning during COVID19 school closures. Education International; 2020.
Smolen P, Zhang Y, Byrne JH. The right time to learn: mechanisms and optimization of spaced learning. Nat Rev Neurosci. 2016;17(2):77–88.
Kramár EA, Babayan AH, Gavin CF, Cox CD, Jafari M, Gall CM, Rumbaugh G, Lynch G. Synaptic evidence for the efficacy of spaced learning. Proc Natl Acad Sci. 2012;109(13):5121–6.
Yeung J, Djarv T, Hsieh MJ, Sawyer T, Lockey A, Finn J, Greif R, Lightfoot D, Singletary E, Morley P, et al. Spaced learning versus massed learning in resuscitation — A systematic review. Resuscitation. 2020;156:61–71.
Pham NC, Kim YG, Kim SJ, Kim CH. Efficacy of spaced learning in adaptation of optokinetic response. Brain and behavior. 2021;11(1):e01944.
Teo WZ, Dong X, Yusoff SKBM, De Das S, Chong AK. Randomized controlled trial comparing the effectiveness of mass and spaced learning in microsurgical procedures using computer aided assessment. Sci Rep. 2021;11(1):1–6.
Breckwoldt J, Ludwig JR, Plener J, Schröder T, Gruber H, Peters H. Differences in procedural knowledge after a “spaced” and a “massed” version of an intensive course in emergency medicine, investigating a very short spacing interval. BMC Med Educ. 2016;16(1):1–9.
Sando KR, Feng X. Use of an online spaced-education game to study top 200 drugs in a skills laboratory course. Am J Pharm Educ. 2018;82(7):6324.
Terenyi J, Anksorus H, Persky AM. Optimizing the spacing of retrieval practice to improve pharmacy students’ learning of drug names. Am J Pharm Educ. 2019;83(6):7029.
Yates M, Gal P, Conlon H, Ragan R. Mid-fidelity manikins improve first-year pharmacy students’ confidence and accuracy with performing physical assessment. Curr Pharm Teach Learn. 2021;13(12):1578–83.
Sedlacek J, Boylan PM, Perry A. Relationships Between Remote Asynchronous Lectures and Summative Assessment Performance in four Pharmacotherapeutics Courses. J Pharm Technol. 2022;38(4):225–31. https://doi.org/10.1177/87551225221092683.
Phillips JL, Heneka N, Bhattarai P, Fraser C, Shaw T. Effectiveness of the spaced education pedagogy for clinicians’ continuing professional development: a systematic review. Med Educ. 2019;53(9):886–902.
Donker SCM, Vorstenbosch MATM, Gerhardus MJT, Thijssen DHJ. Retrieval practice and spaced learning: preventing loss of knowledge in Dutch medical sciences students in an ecologically valid setting. BMC Med Educ. 2022;22(1):65.
Blazek MC, Dantz B, Wright MC, Fiedorowicz JG. Spaced learning using emails to integrate psychiatry into general medical curriculum: Keep psychiatry in mind. Med Teach. 2016;38(10):1049–55.
Timmer MC, Steendijk P, Arend SM, Versteeg M. Making a lecture stick: the effect of spaced instruction on knowledge retention in medical education. Med Sci Educ. 2020;30(3):1211–9.
Acknowledgements
The funding source of this research was provided by the National agency for strategic research in medical education under grant number 4000457.
Funding
The funding source of this research is National agency for strategic research in medical education under the grant number of 4000457.
Author information
Authors and Affiliations
Contributions
ZH designed the study, performed virtual classes and prepared the manuscript draft. MSh performed the statistical analysis. ME finalized the manuscript draft. All authors contributed to the article and approved the submitted version.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All procedures performed in this study were in accordance the Declaration of Helsinki and approved by the Research Ethics Committees of National Agency for Strategic Research in Medical Education (IR.NASRME.REC.1400.317). Informed consent was obtained from all participants.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Sharifdini, M., Evazalipour, M. & Hesari, Z. Virtual spaced-learning method, during COVID-19 for Pharm D students. BMC Med Educ 23, 605 (2023). https://doi.org/10.1186/s12909-023-04595-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-023-04595-5