Abstract
Experts have called for virtual reality (VR) training and learning applications that can facilitate the changes needed in training programmes for years to come. To help expedite the adoption process, this study used a mixed-methods approach to identify the key factors that promote intentions to use VR technology in medical training. The qualitative research was based on interviews with five doctors and medical students, which focused on identifying the most significant determinants. Next, a survey was conducted to collect data from 154 medical interns and students in Spanish universities and hospitals, whose responses were processed using partial least squares-structural equation analysis. The limited sample size means this study is exploratory. The results indicate that perceived entertainment significantly strengthens behavioural intention to use VR technology in medical courses. The findings also underline the potential uses of VR learning tools in healthcare contexts and the need to incorporate this technology into medical training.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
The coronavirus disease-19 pandemic has clearly driven the recent trend towards digitalising healthcare, but the concept of digital healthcare already existed before this crisis (Masneri et al. 2023; Pedram et al. 2023; White and Shaban-Nejad 2022). The healthcare sector by its very nature has always been connected to technological advances, so it has generated retrospective feedback on all aspects of the digitalisation process. Technology has had an impact on medicine in many different areas, ranging from purely technical features (i.e. interventions and treatments) (Cavanagh et al. 2022) to largely relational aspects (e.g. provision of information to patients) (Oliver Wyman 2021).
Medicine has thus become increasingly linked to big data (Aebi et al. 2021), artificial intelligence (AI) (Morales-Lara and Adedinsewo 2022), telediagnosis (Galván et al. 2021; Minervini et al. 2022) and computer systems, among other innovations. Another digital innovation applied in medicine is virtual reality (VR). For example, RelieVRx – formerly known as EaseVRx – was authorised by the United States’s Food and Drug Administration for sale as part of treatments for moderate to severe lower back pain (Giravi et al. 2022; Rubin 2021). These major advances not only provide advantages in the present but also promise great benefits in the long term. Healthcare innovation is doubtlessly here to stay.
VR deserves special attention within the vast number of ways that digitalisation and technology can contribute to education due to the novelty and possible uses of VR applications (Calvert and Hume 2023; Chang et al. 2023; Howard and Davis 2023; Lau 2023; Stefan et al 2023). Healthcare is a field in which VR is most expected to play a vital role due to its wide range of applications (Aiello et al. 2023; Pieterse et al. 2023). VR can provide assistance in diverse medical areas including remote procedures (Matsangidou et al. 2022) and treatments of problems such as phobias (Freitas et al. 2021), obesity (Anastasiadou et al. 2022) or Alzheimer’s disease (Kruse et al. 2022).
VR usage in medical training is particularly interesting. VR, healthcare and education in combination offer many possibilities for the creation of immersive simulations or more simple, three-dimensional (3D) visualisations of parts of the body (Im et al. 2023). VR applications can allow a larger number of medical professionals and students to have access to the same training course, reduce their training schedule (Pottle 2019; Oxford Medical Simulation 2019) and increase their motivation and interest in the topics being studied (Sattar et al. 2020). Because of these benefits, the demand for VR tools is growing in hospitals and universities.
VR applications in medicine are revolutionising the way medical professionals diagnose, treat and educate patients (Fertleman et al. 2018). For instance, VR can be used to conduct mirror visual feedback (MVF) treatments, which provide visual feedback to alleviate phantom limb pain or improve motor function in a more engaging, realistic manner (Bullock et al. 2020). VR also increases the flexibility of exposure therapy (ET), which involves simulated exposures to a feared situation or object (Ezendam et al. 2009). This technology is also often an effective tool in learning processes (Lee and Wong 2008), so the current research took on the important task of determining what key factors affect the acceptance of VR in medical training and how these variables work in this context.
The success of this type of technology depends on the medical community’s perception of VR applications as valid, functional, accessible and valuable. In other words, their use in medical training needs to be accepted by the relevant doctors. Concurrently, medical students must be interested in using these devices and training simulators or the benefits associated with applying VR in educational settings will remain unrealised. Overall, students must prioritise their resources (e.g. time and money). If VR is perceived as a time- and money-saving tool, these individuals will be more likely to use the related devices (Fussell and Truong 2022).
The literature includes few studies that have focused on this topic, and the limited research on VR and medicine has assumed that healthcare professionals will generally adopt these new techniques without hesitation given the clear benefits of this technology (Lange et al. 2020). To address these gaps, the present investigation sought to identify the most crucial factors driving doctors and medical students’ intention to use VR in their learning and training. This study thus concentrated on addressing the deficiencies in prior research pointed out by various authors (Lin and Peh 2019; Sagnier et al. 2020) in order to clarify which determinants drive medical students to use VR in their learning.
Aliwi et al.’s (2023) review of the literature on VR in medical practice identified additional methodological gaps related to techniques, sample size and outdated equipment. The cited authors, therefore, called for more empirically rigorous assessments of VR technology in healthcare training. To respond to this appeal, the present study applied a multidimensional approach that included the elements of context, content, process and individual differences, with reference to Davis’s (1989) technology acceptance model (TAM) and Venkatesh et al.’s (2003) unified theory of acceptance and use of technology (UTAUT). The present literature review included examining these models, both of which have been widely applied in related research.
A mixed-methods approach was selected for this research given the novelty of healthcare VR technology and the absence of qualitative studies specifically focused on this topic. The first phase concentrated on gathering qualitative data from healthcare experts to identify which variables needed to be assessed. In the second phase, a quantitative study was conducted using structural equation modelling (SEM) to find which factors have a significant effect on the continued use of VR as a teaching method in healthcare.
The results provide stimulating ideas that can help increase VR usage and strengthen healthcare providers’ commitment to VR applications. The selected methods effectively identified the factors influencing the chances that VR will be well received – given the existing demand in healthcare – including the drivers of and obstacles to the continued use of VR. In addition, the findings provide information that companies offering this technology can apply to design and market learning tools of value to users, as well as highlighting the variables that may indicate a greater or lesser proclivity for using VR. Instructors and curriculum coordinators can also use this expanded knowledge to design programmes that prepare students to use VR in their medical training and encourage them to adopt VR for personal use. In this way, these individuals will gain greater familiarity with and enjoyment of this technology during their learning experiences.
2 VR usage in healthcare training
The term VR first appeared in 1987 when Jaron Lanier, together with Tom Zimmerman, developed the data glove. More recently, Lopreiato et al. (2016) defined VR as follows:
VR is a wide range of applications based on computers commonly associated with immersive, highly visual 3D characteristics that allow the participant to look around and navigate inside a world that is apparently real and physically present. VR is generally defined based on the type of technology used, such as visual display units placed on the head, stereoscopic vision capacity, input devices and the number of sensory systems stimulated. (p 40)
Experts, however, continue to debate how best to conceptualise VR. This technology has developed quite naturally, causing its definition to expand and evolve in parallel ways and inspiring scholars to integrate new perspectives into its conceptualisation.
VR has been used in healthcare to help patients recover their mobility (Yeo et al. 2019), to treat phobias (e.g. Psious VR or Amelia) (Freitas et al. 2021) and migraines (e.g. GlaxoSmithKline or GSK) (Vekhter et al. 2020) and to facilitate medical training (Zhao and Li 2022). VR applications in medical education allow a larger number of medical professionals and students to gain access to the same training session and to participate as often as they want (Oxford Medical Simulation 2019). These benefits have increased the demand for VR tools in hospitals and universities.
Academic research on VR in healthcare has reflected the medical community’s growing interest, expanding significantly in recent years and focusing largely on applications of this technology in health services for individuals with disabilities (De Ribaupierre et al. 2014; Levin et al. 2014; Maples-Keller et al. 2017; Sveistrup 2004). VR applications simulating different surgeries also encompass a wide range of procedures and treatments. Other applications include MVF and ET, as well as simulators of dental and bone surgery, intubation, body, eye surgery and endoscopic techniques (Ruthenbeck and Reynolds 2015). The medical literature has long acknowledged that VR can be used to enhance capabilities and train different medical groups based on their individual and collective needs (Samadbeik et al. 2018).
In the field of education, other studies have addressed the question of how VR enhances medical training (King et al. 2018; Lie et al. 2022; Mantovani et al. 2003; Pottle 2019) and have concentrated on analysing the impact VR has on learning. According to Pottle (2019), the main benefits are improvements in students’ learning curve and access to courses. King et al. (2018) and Mantovani et al. (2003) highlight the benefit of a greater absorption capacity. Students who are taught via VR retain more information and apply what they have learned more fully as compared to the results obtained with other methods (Krokos et al. 2018). VR also improves medical students’ ability to learn by awakening a greater interest in – and motivation to study – the relevant topics (Sattar et al. 2020).
However, prior studies have ignored other aspects of VR usage in healthcare professionals’ training. Only a few recent investigations thus far have focused on the main factors affecting the acceptance of VR technology in medical learning (Ustun 2020; Cabero-Almenara et al. 2023; Sprenger and Schwaninger 2021; Ustun et al. 2022). No researcher, however, has applied the UTAUT and TAM to confirm how well VR applications meet needs in healthcare learning from the students’ perspective.
2.1 Students’ attitudes towards medical learning with VR
Before incorporating VR into educational programmes, educators must understand the factors that motivate students to use it. VR is a relatively new technology that has not yet been widely adopted, so only a small percentage of students will have had any VR experience before using it as a learning tool. Most students thus need to familiarise themselves with these technologies. This preparation can impact their acceptance of VR technology, especially in terms of behavioural intention to use, which in turn could affect students’ level of engagement and learning (Sagnier et al. 2019; Shen et al. 2019a, b).
Many educators assume that VR will benefit students while training and that they will accept this technology without hesitation. However, VR applications can also have a negative impact on students’ learning process (Makransky et al. 2017). For instance, these individuals can become frustrated if they are unfamiliar with – or inexperienced in using – this technology, which can adversely affect their learning performance when utilising VR (Maraj et al. 2015). According to Fussel and Truong (2021), students may also only embrace VR in a dynamic learning environment if they understand how this technology works and how it will benefit their education.
The literature, therefore, indicates that user acceptance and motivation for use are crucial factors to consider when explaining the effectiveness of VR technologies in medical education (Aggelidis and Chatzoglou 2009; Barteit et al. 2021; Beke Hen 2019; Holden and Karsh 2010). Previous studies have found evidence that medical students tend to show high levels of participation, which has a positive effect on how well these individuals learn. Désiron et al. (2022) assert, nonetheless, that the adoption of these new technologies in medical training remains an open question.
2.2 Adoption of new technologies
Studies of technology acceptance have referred to the available general models either directly or by adapting them to multiple technological contexts with new factors and relationships between these. Various authors (Kim and Crowston 2011; Oliveira and Martins 2011) have reported that the most widely used models applied to explain technology acceptance by users are Davis’s (1989) TAM and Venkatesh et al.’s (2003) UTAUT.
The TAM was developed by Davis (1989) to create a methodology that could measure users’ acceptance of new technological systems before they are implemented. This model is thus fully adapted for assessments of the adoption of technologies, especially computer systems. Despite the widespread use of TAM, it has been criticised by multiple authors (Bensabat and Barki 2007). More specifically, critics have focused on problems such as limited explanatory and predictive power, triviality and low practical value (Chuttur 2009), as well as the omission of key factors such as cost and certain structural imperatives (Lunceford 2009).
In response to these criticisms, Venkatesh and Davis (2000) presented an expanded TAM (i.e. the TAM2) that includes social influence (i.e. subjective norms, voluntariness and image) and cognitive instrumental processes (i.e. job relevance, output quality, result demonstrability and perceived ease of use). Venkatesh and Bala (2008) also developed a third version of the TAM (i.e. the TAM3) that adds the explanatory constructs of computer self-efficacy, perceived external control, computer anxiety, computer playfulness, perceived enjoyment and objective usability.
The UTAUT and UTAUT2 are, however, the models most often referred to in more recent research (Tamilmani et al. 2021). The UTAUT is a TAM formulated by Venkatesh et al. (2003) that seeks to explain users’ intention to use technologies and their behaviours while using them. The UTAUT covers four key factors: performance expectancy, effort expectancy, social influence and facilitating conditions. Brown and Venkatesh (2005) subsequently introduced the UTAUT2 model, which incorporates three new factors related to end-user contexts: hedonic motivation, price value and habit.
Similar to scholars in other fields, healthcare technology researchers have most often applied the UTAUT and UTAUT2. More specifically, UTAUT2 has been used in studies unrelated to VR, that is, research on the adoption of electronic storage systems to keep information about patients’ health (Alazzam et al. 2016, 2015; Tavares and Oliveira 2014), wearables that control patient information (Jin and Ahn 2019), cell phones (Ameri et al. 2020) and applications that control child vaccination (Algahtani et al. 2021).
The present literature review (see Table 1), however, revealed that few studies have concentrated on behavioural intention to adopt VR in medical learning. Only some recent investigations have associated this intention with the perceived usefulness and ease of use of VR technologies, and previous research has mainly relied on the TAM (Cabero-Almenara et al. 2023; Sprenger and Schwaninger 2021). Désiron et al. (2022) and Ustun et al. (2020, 2022) are the only authors who have used the UTAUT to analyse factors affecting VR adoption in medical learning. However, they stopped short of examining the relationships between these variables.
Research on technology acceptance in all sectors has applied the TAM and UTAUT as originally conceived (Murillo et al. 2021) or used a combination or an adaptation of these models (Kayali and Allaraj 2020) to fit technological contexts with new factors or links between these. These two aspects similarly need to be considered when discussing the acceptance of VR in medical training contexts. Nonetheless, no previous studies have used the UTAUT2 to assess how well VR applications meet needs in healthcare learning from the students’ perspective, and no investigations have combined the UTAUT2 with the TAM in any of its versions.
3 Hypothesis development
Disentangling the factors affecting VR adoption and use in medical education is crucial because this technology provides new practical training tools that medical specialists can introduce into their learning processes (Georgieva-Tsaneva and Servezova 2020). The literature review covered in the previous section revealed that a wide range of models have already been developed to explain the acceptance of different learning technologies (e.g. mobile applications, AI or augmented reality) and users’ continuance intention (Alzahrani 2020; Criollo et al. 2021; Lu and Yang 2014). In addition, the review confirmed the scarcity of previous research on healthcare learners’ acceptance of VR that was based on the UTAUT and TAM.
The UTAUT 2 and TAM1, 2 and 3 have aggregated – and exploited the synergies between – many constructs that are positively related to technology adoption and that can also play a critical role in learning processes. The present study thus took the UTAUT2 and TAM3 as a starting point for its hypotheses regarding the identified variables, as discussed in the following subsections.
3.1 Performance expectancy
Performance expectancy – coded as PER in the analyses – refers to learners’ belief that using VR training technology is helpful (Azizi et al. 2020). Venkatesh et al. (2012) define performance expectance as ‘the degree to which an individual believes that using a system will help him or her to gain profit... [through improved] performance’ (p 159). Many previous studies have confirmed that performance expectancy has a positive impact on behavioural intentions (Chao 2019; Chen and Hwang 2019; Huang 2020; Mtebe and Raisamo 2014). The current research thus included the following hypothesis:
H1
Performance expectancy has a significant effect on medical learners’ intention to use VR technology.
3.2 Effort expectancy
Venkatesh et al. (2012) conceptualise effort expectancy – coded as EE in the present proposed model – as ‘the degree of simplicity and ease of use of a system’ (p 159). According to Azizi et al. (2020), this construct overlaps with ease of use. Prior research has also found a positive relationship between effort expectancy and behavioural intention (Chao 2019; Dajani and Hegleh 2019; Raza et al. 2021). Therefore, the current study added a second hypothesis:
H2
Effort expectancy has a significant effect on medical learners’ intention to use VR technology.
3.3 Social influence
Venkatesh et al. (2012) define social influence – coded as SI in the current research – as ‘the degree to which an individual perceives that others (e.g. peers and faculty members) believe he or she should use a modern system or a new approach in learning’ (p 159). Previous studies have shown that social influence has a significant influence on behavioural intention (Al-Gahtani 2016; El-Masri and Tarhini 2017; Moorthy et al. 2019). The third hypothesis developed for the present research reflected the above findings:
H3
Social influence has a significant effect on medical learners’ intention to use VR technology.
3.4 Facilitating conditions
The term facilitating conditions – coded as FC in subsequent analyses – ‘refers to consumers’ perceptions of the resources and support available to perform a behavior’ (Venkatesh et al. 2012, p 159). Prior investigations have confirmed a positive relationship exists between facilitating conditions and behavioural intention (Masadeh et al. 2016; Moorthy et al. 2019; Nikou and Economides 2017; Shen et al. 2019a, b). Thus, the fourth hypothesis created for the current study was worded as follows:
H4
Facilitating conditions have a significant effect on medical learners’ intention to use VR technology.
3.5 Hedonic motivation
Venkatesh et al. (2012) conceptualise hedonic motivation – coded as HM in the present proposed model – as ‘the user’s fun or pleasure... [obtained from] using... technology’ (p 161). Previous studies have found a positive connection between hedonic motivation and behavioural intention (Al-Azawei and Alowayr 2020; Moorthy et al. 2019). The current research thus included the following hypothesis:
H5
Hedonic motivation has a significant effect on medical learners’ intention to use VR technology.
3.6 Price value
Venkatesh et al. (2012) define price value – coded as PV in the present analyses – as ‘consumers’ cognitive trade off between the perceived benefits of the applications and the monetary cost of using them’ (p 161). Prior research has verified that a positive link is present between price value and behavioural intention (Al-Azawei and Alowayr 2020; Lewis et al. 2013). The sixth hypothesis developed for the current study reflected the above findings:
H6
Price value has a significant effect on medical learners’ intention to use VR technology.
3.7 Habit
Habit has been defined as the extent to which people tend to perform learned behaviours automatically (Limayem et al. 2007). Habit has been operationalised in two distinct ways (Venkatesh et al. 2012, p 161): as prior behaviour (Kim et al. 2005) and as the extent to which individuals believe their behaviour is automatic (Kim et al. 2005; Limayem et al. 2007). Previous studies have confirmed a positive relationship exists between habit and behavioural intention (Baptista and Oliveira 2015; Morosan and Defranco 2016; Yahia et al. 2018). The final hypothesis formulated for the current research was thus as follows:
H7
Habit has a significant effect on medical learners’ intention to use VR technology.
4 Methodology
A mixed-methods approach and sequential research design were chosen to adjust the TAM and UTAUT2 factors so that they more adequately reflect VR adoption in medical contexts, as well as to achieve the proposed objectives (Onwuegbuzie et al. 2009) (see Fig. 1). The variables were first selected based on a qualitative study. In the second phase, a survey was conducted, and the data were analysed using quantitative techniques. All the steps of both phases are shown in Fig. 1.
The qualitative research facilitated a more accurate formulation of the hypotheses and identification of the variables included in the conceptual model. Mixed-methods research is seen as an important third type of methodology because, by combining quantitative and qualitative approaches, it provides expanded opportunities to explore relatively unknown or understudied topics (Moscoloni 2005; Rocco et al. 2003; Tashakkori and Teddlie 2003).
4.1 Qualitative study
The current qualitative research was conducted by following the steps suggested by Becker et al. (2002), namely, in-depth interviews of individual experts and codification and classification of the ideas provided. Grounded theory guidelines were followed when the medical experts’ interviews were scheduled. The interviewees thus comprised three medical interns and two medical students with more than three years of researching VR education and medical training (Glaser and Strauss 2017).
In step one, in-depth interviews were first scheduled and then conducted in these experts’ place of work. The interviews began with an introduction to the variables mentioned in the literature on the TAM and UTAUT that can affect individuals’ acceptance and use of a technology, after which the interviewees were invited to comment on these factors or propose new ones. In step two, the experts’ opinions were recorded, compiled and analysed.
Step three of the qualitative phase consisted of identifying which variables should be included in the quantitative phase. The interviewees’ answers were codified and classified to ensure more empirically robust results. The only factors subjected to subsequent analyses were those fully supported by the majority of the experts (i.e. those reaching the point of theoretical saturation). More specifically, factors were only selected if at least four out of the five experts interviewed agreed that the variables were significant.
The findings included that the interviewees lacked any knowledge about how VR can be applied in medical training, and only one individual was familiar with this technology outside of educational settings. The experts thus all agreed that the variable habit did not appear to make much sense in the research context, so this factor was excluded from the quantitative analysis. In contrast, the variable performance expectancy was considered important because the interviewees wanted to know how effective this type of tool would be in their training. More specifically, they were quite interested in how VR could shorten their learning curve. This reaction suggested that performance expectancy could be measured as a variable related to learning time.
Effort expectancy is also a key factor in most explanatory models in the existing literature. All the interviewees agreed that the limitations of VR technology in terms of its comfort, accessibility and usability needs to be clear as these variables could either constitute obstacles or facilitate VR usage. With regard to effort, the results also reveal an interest in the interactivity this technology could contribute to training courses. The experts were specifically interested in VR tools’ potential for gamification since the interviewees had experienced this aspect in videogames. This idea was included in the research model as a new factor focused on the entertainment value of this technology in educational processes, which was labelled ‘perceived entertainment’ and coded as PEN.
Facilitating conditions was also included in the model since all the interviewees agreed that the main course structure should fully support VR technology. The experts underlined that, in this setting, the most important component is the university or hospital providing the employees’ training. Social influence was also considered by four out of five interviewees to be a determinant in this context. These experts asserted that, in the medical profession, their own behaviour is affected to a greater or lesser extent by colleagues’ methods, tools and conduct. The interviewees also mentioned that a hierarchy exists in their job so that the comportment of upper-level staff members seen as role models can noticeably affect their subordinates’ attitudes. This second feature reinforced the need to include a construct to measure social influence.
The interviewers additionally elicited information regarding a possible component of hedonism by exploring how important pleasure and fun is to the experts in their medical practice. All the interviewees agreed that learning activities, in general, need to heighten their level of enjoyment, so this is a significant factor when choosing to use or reject VR technology.
Another variable that produced notable results was price. The research model included price value because the experts emphasised the importance of the final price of this technology. For example, they were quite interested in how much VR tools might affect the overall cost of their training courses. As noted previously, the interviewees’ comments highlighted that none of them had used VR in their education and that few of their colleagues were familiar with VR and even fewer knew about its use in learning processes.
In summary, the factor of habit was removed from the conceptual model because of both the qualitative findings and the final theoretical framework adopted, even though this variable appears in the UTAUT2. A new factor – perceived entertainment – was added to the proposed model in subsequent analyses. As mentioned previously, this variable was coded as PEN in the present analyses.
These decisions were based on the interview results as the experts considered habit unimportant, while perceived entertainment was thought to be a significant motivator of VR usage in medical training. The existing literature on perceived entertainment defines this factor as ‘the extent to which the activity of using the technology is perceived to be enjoyable in its own right, apart from any performance consequences that may be anticipated’ (Davis et al. 1992, p 1113). Since the TAM3 was developed (Venkatesh and Davis 2000), multiple researchers have reported evidence of a positive relationship between perceived entertainment and behavioural intention to use in learning processes (Alyoussef 2021; Chao 2019).
Therefore, all the hypotheses were maintained except for H7, which was replaced by H7b. The latter was formulated as follows:
H7b
Perceived entertainment has a significant effect on medical learners’ intention to use VR technology.
Figure 2 shows the final research model and the relationships incorporated.
4.2 Quantitative study
The final version of the questionnaire created for this research included items assessing each of the factors taken from various TAMs that had been expanded or modified to reflect the results of qualitative studies. Three items were taken from Sung et al.’s (2015) work as indicators of performance expectancy (i.e. PER), as well as three items assessing effort expectancy (i.e. EE). Three items were drawn from Rese et al.’s (2017) scale for perceived entertainment (i.e. PEN). Facilitating conditions (i.e. FC) was measured with three items adopted from Attuquayefio and Addo (2014). Four indicators of social influence (i.e. SI) were taken from Tu et al.’s (2014) research. Hedonic motivation (i.e. HM) was assessed using three items drawn from Molinillo et al.’s (2017) work, and two indicators of price value (i.e. PV) were adopted from Sung et al.’s (2015) scale. Finally, the present questionnaire also included one measure of behavioural intention (i.e. BI) taken from Venkatesh et al.’s (2012) study.
The survey thus contained a total of 22 items pertaining to constructs taken primarily from the UTAUT2 and TAM3. The responses to the items were measured on a Likert-type scale that ranged from 7 (‘Very likely’) to 1 (‘Quite unlikely’). This scale has been used by most studies of users’ opinions and attitudes (Joshi et al. 2015). The questionnaire further elicited information about the respondents’ identity and sociodemographic characteristics.
Before the fieldwork began, the questionnaire was sent to seven education experts, who checked if the wording was clear and the items covered the variables to be measured. These specialists’ feedback was used to refine three terms and two items in the questionnaire.
The research population comprised medical students and licensed physicians at Spanish universities and hospitals, which was considered an infinite population for sampling purposes. A representative sample of 154 individuals was gathered that fit these parameters. The fieldwork was conducted during August and September 2021 using personal interviews or self-administered surveys. The data were collected entirely in hospitals and university medical centres in Andalusia, Valencia, Castile-La Mancha, Extremadura, Murcia, Madrid, Catalonia and the Basque Country. This study obtained ethical approval from the ethics committee of the researchers’ university in order to ensure compliance with established ethical guidelines.
The questionnaires were distributed using convenience sampling at the selected locations. The interviewer first asked the respondents why they were in the hospital or university to screen out inappropriate individuals. If they were there for medical training, they could answer the questionnaire. Because participation was voluntary, all the individuals included in the sample provided informed consent prior to participation by voluntarily signing the informed consent form.
The survey answers were automatically placed in online folders. The respondents’ demographic characteristics, medical field and VR experience in their medical training were included in the dataset (see Table 2).
The final step in the quantitative phase was a statistical analysis of the data using partial least squares (PLS) and SEM because the main objective was to identify causal relationships between the variables and behavioural intention (Ringle et al. 2015). The proposed model was evaluated in a two-step procedure that followed Chin’s (1998) guidelines. First, the outer (i.e. measurement) model was validated by assessing the reliability, convergent validity and discriminant validity of the constructs (Barroso et al. 2010). This model comprised the variables selected by the experts interviewed in the qualitative phase.
Next, the inner (i.e. structural) model was analysed to examine the hypothesised relationships between the constructs and assess the overall predictive capability of the proposed model. This step used the methodology outlined by Hair et al. (2014). The results section below provides more detailed information about the process of validating both the measurement and structural models.
5 Results
As shown in Fig. 2 above, the qualitative component of the present study produced a list of factors selected by the experts interviewed: performance expectancy, effort expectancy, social influence, facilitating conditions, hedonic motivation, price value and perceived entertainment. These variables were included in the measurement and structural models validated using PLS-SEM to ensure the research objectives were achieved.
5.1 Measurement model estimation
Various evaluation measures were used to assess the goodness of fit of the model. These methods included Cronbach’s alpha, composite reliability and Hair et al.’s (2014) convergent validity test.
5.2 Common method bias (CMB)
The issue of CMB was dealt with by applying two statistical control methods. First, Harman’s single-factor test was conducted using principal component analysis to confirm the presence or absence of CMB. The results indicate that less than 50% of the total variance is explained by any one factor, thereby verifying that no CMB is present (Fuller et al. 2016; Podsakoff et al. 2012).
Next, the full-collinearity test recommended by Kock (2015) was performed, which revealed low variance inflation factor values ranging from 1.000 to 2.185 for all latent constructs. These values fall below the threshold of 5, so collinearity is not an issue (Hair et al. 2011). The present results thus indicate that CMB did not distort the findings.
5.3 Reliability and validity assessment
To assess the measurement model, the first step was to determine the reliability of each item (see Table 3). Measures or indicators can be accepted as valid for a construct if the loading of the indicators on that variable is greater or equal to 0.707 (Barclay et al. 1995; Hair et al. 2011), which implies that the construct and the shared variance of its indicators are larger than the error variance (Carmines and Zeller 1979). In the present study, all the indicators have loadings above 0.707, except for the items PEN2, SI1 and SI2 – each with a value below 0.6. All three were removed from their respective scales, so perceived entertainment and social influence were subsequently each assessed using two items.
Composite reliability was checked to ensure the internal consistency of all the constructs incorporated into the model, thereby providing an empirically rigorous evaluation of how well the relevant indicators measure the same latent variable. The analysis produced values well above the minimum of 0.70, thereby confirming strong internal consistency (see Table 2 above). Composite reliability values are considered satisfactory when they fall between 0.60 and 0.70 in exploratory research, although other types of studies further along in the research process must meet a more stringent standard of between 0.70 and 0.90 (Nunnally and Bernstein 1994). Values below 0.60 indicate a lack of reliability (Hair et al. 2011; Richter et al. 2016). The results for the present model verify that all the constructs satisfy this criterion and thus can be considered reliable (see Table 3 above).
The last step was to evaluate the convergent and discriminant validity of the measurement model. Convergent validity requires a confirmation that each set of indicators represents or measures a single underlying construct, which can be determined by checking if the construct is unidimensional (Henseler et al. 2009). An average variance extracted (AVE) value of over 0.50 shows that more than 50% of the variance of a construct is explained by its indicators (Hair et al. 2011, 2014). The constructs included in the current model all have AVE values greater than 0.5 except for social influence (0.432), so this variable had to be excluded (see Table 3 above).
Discriminant validity, in turn, ascertains to what extent a specific construct is different from other variables in the relevant model, which helps expose possible problems with overlapping. That is, each construct should share more variance with its own indicators than with the other variables in the model (Barclay et al. 1995). In the present research, this step in the analysis comprised three procedures. The first involved applying Fornell and Larcker’s (1981) criterion, which requires that latent constructs share more variance with their assigned indicators than with the other latent variables in the present model. In statistical terms, the AVE of each latent construct should be greater than the variance it shares with other factors in the model (Barclay et al. 1995; Hair et al. 2011; Henseler et al. 2009; Richter et al. 2016). Thus, another way to confirm discriminant validity is to check if the intercorrelation values of the constructs are lower than the square roots of AVE (see Table 3 above).
The second procedure used to determine discriminant validity is less stringent or strict, namely, checking for cross loadings. The indicators should more strongly load on or correlate with their own construct than with the other latent variables (Hair et al. 2011; Henseler et al. 2009). This technique was applied earlier during the analysis of the discriminant validity of each item (see Table 2 above).
The last procedure was to estimate the heterotrait-monotrait (HTMT) ratio (Henseler et al. 2015). The cited authors found that, when they ran simulation studies, inadequate discriminant validity could best be detected with this ratio. Discriminant validity is present if the correlations between the indicators that measure the same construct (i.e. monotrait-heteromethod) are stronger than the correlations between the indicators that assess different variables (i.e. heterotrait-heteromethod). The HTMT ratio should thus be less than 1, although Gold et al. (2001) recommend a more conservative value of 0.90. Resampling or bootstrapping can also be used to confirm if the HTMT ratio diverges significantly from 1 by measuring the confidence interval. The criterion established for this confidence interval is again that they must be less than 1 in order to demonstrate discriminant validity.
The present analysis confirmed that the variables have validity except for hedonic motivation and performance expectancy. According to Henseler et al. (2015), better results can be obtained by eliminating the items that have weaker correlations with their constructs – in this case, hedonic motivation and performance expectancy. However, the discriminant validity results for performance expectancy improved significantly after PER3 was eliminated, so only this item was removed – along with all the hedonic motivation items – from subsequent analyses. The final version of the measurement model has satisfactory discriminant validity for all the constructs as shown in Table 4.
5.4 Structural model assessment and hypothesis testing
After the measurement model was refined, the next step was to validate the structural model using PLS analysis in order to confirm the structural relationships between the variables included in the hypotheses. The model was evaluated based on its R2 values. The Stone-Geisser test was run (see Table 4) to confirm predictive power (i.e. acceptable Q2 scores), and the path coefficients were calculated (Cepeda-Carrión and Roldán Salgueiro 2004). The stability of the values was evaluated based on the t-statistic, using bootstrapping with 5000 resamples (see Table 5).
The final step was to check the standardised regression weights in order to confirm if the proposed hypotheses are statistically significant (Hair et al. 2011). To validate the previous findings, a nonparametric method of confidence intervals was applied. According to Henseler et al. (2009, p 306), ‘if a confidence interval for a path coefficient’s estimated β [beta weight] does not include zero, the hypothesis that β is equal to zero must be rejected.’ The present study followed this procedure, thereby confirming the previous results (see Table 6). The path coefficient linking perceived entertainment and behavioural intention (β = 0.413; t = 2.512; p = 0.016) is positive and statistically significant. Therefore, this relationship is supported.
The last step in validating the structural model was to examine its robustness by focusing on nonlinear effects, endogeneity and unobserved heterogeneity. Interaction terms were incorporated to represent the quadratic effects on BI of the links between PER, EE, FC, PV and PEN in order to identify potential nonlinearities. A 5000 sample bootstrapping procedure confirmed that no significant nonlinear effects are present.
To check for endogeneity, the Gaussian copula approach was applied as suggested by Park and Gupta (2012), which indicated that the copula values for each construct are statistically non-significant (p > 0.05), thereby confirming the absence of any endogeneity effect. Finally, unobserved heterogeneity was assessed by following the finite mixture-PLS procedure and Sarstedt et al. (2020) guidelines. The results are inconclusive for the segment solution, which demonstrates that unobserved heterogeneity has no significant impact on the research outcomes, as evidenced by fit indices such as Akiake information criterion (AIC) 3 and consistent AIC. These findings also support different segment solutions, with a normalised error value of over 0.50. The results shown in Fig. 3 confirm that the proposed structural model is valid and robust and that perceived entertainment (i.e. H7b) predicts medical learners’ intention to use VR technology.
Statistical tests and confidence intervals can also be used to draw useful conclusions about research population parameters. The percentile bootstrap confidence interval, in particular, is recommended when measuring the adequacy of confidence intervals. The path coefficient estimates for the hypothesised relationships included in the model range from –0.050 to 0.413. The path coefficients are all statistically non-significant (i.e. a 5% significance level) except for that of PEN. More specifically, increasing PEN by one standard deviation increases intention to use VR by 0.413 standard deviations if all other variables are kept constant. Thus, the results for the model reveal a significant impact of perceived entertainment on intention to use VR, which shows that greater intention to use VR in medical training occurs when perceived entertainment is present.
The above findings are corroborated by Agudo-Peregrina et al. (2014), who also found that a strong relationship exists between perceived entertainment and intention to use VR for training. In addition, perceived entertainment has a positive impact on willingness to use VR in training programmes (Alyouseff 2021). Previous research on intention to use VR has further confirmed a significant positive link between students’ perceived entertainment and their behavioural intentions (Chao 2019).
The data analysis results thus indicate that the remaining constructs in the model have no significant relationship with intention to use VR in medical training. This finding is inconsistent with the earlier qualitative results, which could be explained by the respondents’ characteristics or the small sample size.
6 Discussion and conclusions
The qualitative interview data indicated that all the variables examined in the existing literature – except for habit – help explain acceptance of VR technology, as well as adding more details about some determinant factors. However, the quantitative study validated only one variable: perceived entertainment. This result means that the proposed model is much simpler than most approaches previously recommended by scholars. Notably, more complex models are not necessarily more streamlined or elucidatory, and more sophisticated explanatory models have been criticised by Bagozzi (2007) and Li (2020) for being overly complicated.
The present findings support Hu et al.’s (1999) rejection of the TAM as an explanatory model of acceptance of VR technologies in medical education because the single driver validated by the current study does not coincide with the multiple determinants included in the TAM. The proposed model is instead in line with the extant literature on technology acceptance in education (Agudo-Peregrina et al. 2014; Wong et al. 2023) given that the present results best fit the TAM3. This study also adds to previous research on factors that specifically influence intention to use technology (Agudo-Peregrina et al. 2014; Alyoussef 2021; Chao 2019), which has found that perceived entertainment is a key determinant of behavioural intention, in this case, to use VR in medical training.
6.1 Theoretical contributions and managerial implications
The present research went a step further and developed a model that integrates the TAM3 and UTAUT2 factors that experts on VR and medical education agree are determinants of VR adoption. The proposed approach contributes to the literature on VR in medical education by more effectively capturing the complexity of implementation and usage issues. In addition, this model is the first to confirm that perceived entertainment is a determinant of medical interns and students’ acceptance of VR applications.
From a methodological perspective, the mixed-methods approach also created a more empirically robust, context-specific framework for understanding and predicting users’ behaviour in this research setting. Regarding practical implications, the importance of perceived entertainment to individuals’ acceptance of this technology constitutes valuable information for education companies and organisations as this factor most clearly influences doctors and medical students’ intention to use VR applications. Universities and hospitals can more successfully incorporate this technology into their medical training programmes by generating pleasant experiences via innovative VR learning tools.
The qualitative study also highlighted other significant factors, especially performance expectancy, that suggest the best way to market VR products is to identify niche markets within healthcare and education, which seek to meet students’ needs with innovative applications. Benefits can be reaped from working with universities and organisations that make innovation an important component of their action plans as these entities will be more open to including VR in their learning processes – if these organisations have not done so already. In addition, social influence has a significant role, indicating that business strategies should focus on large groups rather than individuals to foster and strengthen medical professionals’ tendency to adopt VR products.
VR training solutions already exist, especially in the field of invasive surgery (Sadeghi et al. 2020). Even though VR training solutions are highly regarded in the medical field, the current qualitative study confirmed that performance expectancy is still a crucial factor determining the use of VR in medical training. In addition, the literature (Chiang et al. 2012) raises concerns about inaccuracies in images that limit the precision of real-time representations (i.e. quality imaging) produced by VR hardware devices (Chiang et al. 2012). The cited authors’ findings confirm that, while VR has made significant progress in medical training contexts, caution has to be exercised when adopting this technology in medical education. VR has potential inaccuracies, such as issues with image quality, that should be considered carefully when making adoption decisions.
6.2 Limitations and future research
As in all research, the present study had limitations. The sample was quite small (Sigala 2021), so the quantitative results must be treated with caution, namely, as a first attempt to disentangle the factors that predict intention to use VR in medical training. Future research would benefit from collecting a larger sample to facilitate data analysis that can take into account diverse medical fields and age groups.
The present qualitative results suggest that data on this topic need to be processed according to participants’ specific profiles. In general, demographic variables such as gender or age are key variables when marketing products, but, in this research context, more specific variables stand out, such as medical field and prior experience with VR technology. More in-depth investigations are needed to define more effective marketing strategies. Medical specialties are particularly important to VR applications in healthcare training because quite specific proposals have to be developed and training programmes are expensive to create in terms of time and money. Market segmentation by medical field could help companies choose the most suitable target markets that would be the most interested in adopting this technology.
Finally, the fieldwork was solely grounded in a questionnaire that sought to measure the respondents’ perceptions. Valuable insights could be gained by conducting additional studies that replicate the present research using alternative qualitative (e.g. omnibus survey) and quantitative (e.g. experimentation) techniques. Investigations also need to delve further into the differences between virtual and physical training, as well as between simulated and real-world operations.
Data availability
The data that generated by this study are available from Pilar Alarcón-Urbistondo and can be requested from the corresponding author.
References
Aebi NJ, De Ridder D, Ochoa C, Petrovic D, Fadda M, Elayan S, Sykora M, Puhan M, Naslund JA, Mooney SJ, Gruebner O (2021) Can big data be used to monitor the mental health consequences of COVID-19? Int J Public Health 66:633451. https://doi.org/10.3389/ijph.2021.633451
Aggelidis VP, Chatzoglou PD (2009) Using a modified technology acceptance model in hospitals. Int J Med Informatics 78(2):115–126. https://doi.org/10.1016/j.ijmedinf.2008.06.006
Agudo-Peregrina ÁF, Hernández-García Á, Pascual-Miguel FJ (2014) Behavioral intention, use behavior and the acceptance of electronic learning systems: differences between higher education and lifelong learning. Comput Hum Behav 34:301–314. https://doi.org/10.1016/j.chb.2013.10.035
Aiello S, Cochrane T, Sevigny C (2023) The affordances of clinical simulation immersive technology within healthcare education: a scoping review. Virtual Real 27(4):3485–3493
Al-Azawei A, Alowayr A (2020) Predicting the intention to use and hedonic motivation for mobile learning: a comparative study in two Middle Eastern countries. Technol Soc 62:101325. https://doi.org/10.1016/j.techsoc.2020.101325
Alazzam MB, Sibghatullah AS, Doheir M, Enaizan OM, Mamra AHK (2015) EHRS acceptance in Jordan hospitals by UTAUT2 model: preliminary result. J Theor Appl Inf Technol 78(3):473–482
Alazzam MB, Basari ASH, Sibghatullah AS, Ibrahim YM, Ramli MR, Naim MH (2016) Trust in stored data in EHRs acceptance of medical staff: using UTAUT2. Int J Appl Eng Res 11(4):2737–2748
Al-Gahtani SS (2016) Empirical investigation of e-learning acceptance and assimilation: a structural equation model. Appl Comput Inform 12(1):27–50. https://doi.org/10.1016/j.aci.2014.09.001
Algahtani M, Altameem A, Baig AR (2021) An extended UTAUT2 model to explain the adoption of virtual reality technology in health centers: an empirical study based in Riyadh. Int J Comput Sci Netw Secur 21(3):219–228. https://doi.org/10.22937/IJCSNS.2021.21.3.30
Aliwi I, Schot V, Carrabba M, Duong P, Shievano S, Caputo M et al (2023) The role of immersive virtual reality and augmented reality in medical communication: a scoping review. J Pat Exper 10:23743735231171560
Alyoussef IY (2021) Factors influencing students’ acceptance of m-learning in higher education: an application and extension of the UTAUT model. Electron 10(24):3171. https://doi.org/10.3390/electronics10243171
Alzahrani NM (2020) Augmented reality: a systematic review of its benefits and challenges in e-learning contexts. Appl Sci 10(16):5660. https://doi.org/10.3390/app10165660
Ameri A, Khajouei R, Ameri A, Jahani Y (2020) Acceptance of a mobile-based educational application (LabSafety) by pharmacy students: an application of the UTAUT2 model. Educ Inf Technol 25(1):419–435. https://doi.org/10.1007/s10639-019-09965-5
Anastasiadou D, Slater M, Spanlang B, Porras DC, Comas M, Ciudin A, Puig GP, Vazquez-De Sebastian J, Ramos-Quiroga J, Lusilla-Palacios P (2022) Clinical efficacy of a virtual reality tool for the treatment of obesity: study protocol of a randomised controlled trial. BMJ Open 12(6):e060822. https://doi.org/10.1136/bmjopen-2022-060822
Attuquayefio S, Addo H (2014) Using the UTAUT model to analyze students’ ICT adoption. Int J Educ Dev Using ICT 10(3):75–86
Azizi SM, Roozbahani N, Khatony A (2020) Factors affecting the acceptance of blended learning in medical education: application of UTAUT2 model. BMC Med Educ 20(1):1–9. https://doi.org/10.21203/rs.3.rs-27351/v1
Bagozzi RP (2007) The legacy of the technology acceptance model and a proposal for a paradigm shift. J Assoc Inf Syst 8(4):244–254. https://doi.org/10.17705/1jais.00122
Baptista G, Oliveira T (2015) Understanding mobile banking: the unified theory of acceptance and use of technology combined with cultural moderators. Comput Hum Behav 50(September):418–430. https://doi.org/10.1016/j.chb.2015.04.024
Barclay D, Higgins C, Thompson R (1995) The partial least squares (PLS) approach to causal modeling: personal computer adoption and use as an illustration. Technol Stud 2(2):285–309
Barteit S, Lanfermann L, Bärnighausen T, Neuhann F, Beiersmann C (2021) Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review. JMIR Serious Games 9(3):e29080. https://doi.org/10.2196/29080
Becker H, Berger P, Luckmann T, Burawoy M, Gans H, Gerson K, Glaser B, Strauss A, Horowitz R, Horowitz R, Inciardi J, Horowitz R, Pottieger A, Lewis O, Liebow E, Mead GH, Mills CW (2002) Observation and interviewing: options and choices in qualitative research. In: May T (ed) Qualitative research in action. Sage Publications, New York, pp 200–224. https://doi.org/10.4135/9781849209656
Beke Hen, L (2019) Augmented reality and virtual reality: the power of AR and VR for business exploring surgeon’s acceptance of virtual reality headset for training. pp 291–304 https://doi.org/10.1007/978-3-030-06246-0_21
Bensabat I, Barki H (2007) Quo vadis, TAM? J Assoc Inf Syst 8(4):211–218. https://doi.org/10.17705/1jais.00126
Brown SA, Venkatesh V (2005) Model of adoption of technology in households: a baseline model test and extension incorporating household life cycle. MIS Q 29(3):399–426. https://doi.org/10.2307/25148690
Bullock K, Won AS, Bailenson J, Friedman R (2020) Virtual reality-delivered mirror visual feedback and exposure therapy for FND: a midpoint report of a randomized controlled feasibility study. J Neuropsy Clin Neurosc 32(1):90–94
Cabero-Almenara J, Llorente-Cejudo C, Palacios-Rodríguez A, Gallego-Pérez Ó (2023) Degree of Acceptance of Virtual Reality by Health Sciences Students. Int J Environ Res Pub Hea 20(8):5571
Calvert J, Hume M (2023) Improving student learning outcomes using narrative virtual reality as pre-training. Virtual Real 27:2633–2648
Carmines EG, Zeller RA (1979) Reliability and validity assessment. Sage, Beverly Hills, CA
Cavanagh R, Gerson SM, Gleason A, Mackey R, Ciulla R (2022) Competencies needed for behavioral health professionals to integrate digital health technologies into clinical care: a rapid review. J Technol Behav Sci 17:1–14. https://doi.org/10.1007/s41347-022-00242-w
Cepeda-Carrión G, Roldán Salgueiro JL (2004) Aplicando en la práctica la técnica PLS en la administración de empresas
Chang CY, Kuo HC, Du Z (2023) The role of digital literacy in augmented, virtual, and mixed reality in popular science education: a review study and an educational framework development. Virtual Real 27:2461–2479
Chao CM (2019) Factors determining the behavioral intention to use mobile learning: an application and extension of the UTAUT model. Frontiers Psych 10:1652. https://doi.org/10.3389/fpsyg.2019.01652
Chen PY, Hwang GJ (2019) An empirical examination of the effect of self-regulation and the unified theory of acceptance and use of technology (UTAUT) factors on the online learning behavioural intention of college students. Asia Pac J Educ 39(1):79–95. https://doi.org/10.1080/02188791.2019.1575184
Chiang P, Zheng J, Mak KH, Thalmann NM, Cai Y (2012) Progressive surface reconstruction for heart mapping procedure. Comp-Aid Des 44(4):289–299
Chuttur MY (2009) Overview of the technology acceptance model: origins, developments and future directions. Work Pap Inf Syst 9(37):9–37
Criollo CS, Guerrero-Arias A, Jaramillo-Alcázar Á, Luján-Mora S (2021) Mobile learning technologies for education: benefits and pending issues. Appl Sci 11(9):4111. https://doi.org/10.3390/app11094111
Dajani D, Hegleh ASA (2019) Behavior intention of animation usage among university students. Heliyon 5(10):e02536. https://doi.org/10.1016/j.heliyon.2019.e02536
Davis FD (1989) Perceived usefulness, perceived ease of use and user acceptance of information technology. MIS Q 13(3):319–340. https://doi.org/10.2307/249008
Davis FD, Bagozzi RP, Warshaw PR (1992) Extrinsic and intrinsic motivation to use computers in the workplace. J Appl Social Psych 22(14):1111–1132. https://doi.org/10.1111/j.1559-1816.1992.tb00945.x
De Ribaupierre S, Kapralos B, Haji F, Stroulia E, Dubrowski A, Eagleson R (2014) Healthcare training enhancement through virtual reality and serious games. Intell Syst Reference Libr 68:9–27. https://doi.org/10.1007/978-3-642-54816-1_2
Désiron JC, Petko D, Lapaire V, Ullrich C, Clack L (2022) Using virtual reality to train infection prevention: what predicts performance and behavioral intention? Virtual Real 27(2):1013–1023
El-Masri M, Tarhini A (2017) Factors affecting the adoption of e-learning systems in Qatar and USA: extending the unified theory of acceptance and use of technology 2 (UTAUT2). Educ Technol Res Dev 65(3):743–763. https://doi.org/10.1007/s11423-016-9508-8
Ezendam D, Bongers RM, Jannink MJ (2009) Systematic review of the effectiveness of mirror therapy in upper extremity function. Disabil Rehabil 31:2135–2149
Fertleman C, Aubugeau-Williams P, Sher C, Lim AN, Lumley S, Delacroix S, Pan X (2018) A discussion of virtual reality as a new tool for training healthcare professionals. Front in Pub Heal 6:44
Fornell C, Larcker DF (1981) Evaluating structural equation models with unobservable variables and measurement error. J Market Res 18(3):382–388. https://doi.org/10.2307/3151312
Freitas JRS, Velosa VHS, Abreu LTN, Jardim RL, Santos JAV, Peres B, Campos PF (2021) Virtual reality exposure treatment in phobias: a systematic review. Psych Q 92(4):1685–1710. https://doi.org/10.1007/s11126-021-09935-6
Fuller CM, Simmering MJ, Atinc G et al (2016) Common methods variance detection in business research. J Bus Res 69(8):3192–3198. https://doi.org/10.1016/j.jbusres.2015.12.008
Fussell SG, Truong D (2022) Using virtual reality for dynamic learning: an extended technology acceptance model. Virtual Real 26(1):249–267. https://doi.org/10.1007/s10055-021-00554-x
Oxford Medical Simulation (2019) Future of simulation, virtual reality medical training. Oxford University Partners with Oxford Medical Simulation to Transform Medical Education. https://oxfordmedicalsimulation.com/future-of-simulation/oxford-university-partners-with-oxford-medical-simulation-to-transform-medical-education/. Accessed 15 October 2022
Galván P, Fusillo J, González F, Vukujevic O, Recalde L, Rivas R, Ortellado J, Portillo J, Mazzoleni J, Hilario E (2021) Rapid screening for COVID-19 by applying artificial intelligence to chest computed tomography images: a feasibility study. J Med Access 5:23992026211013644. https://doi.org/10.1177/23992026211013
Georgieva-Tsaneva G, Serbezova I (2020) Virtual reality and serious games using in distance learning in medicine in Bulgaria. Int J Emerg Technol Learn 15(19):223–230. https://doi.org/10.3991/ijet.v15i19.15753
Giravi HY, Biskupiak Z, Tyler LS, Bulaj G (2022) Adjunct digital interventions improve opioid-based pain management: impact of virtual reality and mobile applications on patient-centered pharmacy care. Front in Dig Heal 4:884047
Glaser BG, Strauss AL (2017) Discovery of grounded theory: strategies for qualitative research. Routledge, New York
Gold A, Malhotra A, Segars A (2001) Knowledge management: an organizational capabilities perspective. J Manag Inf Syst 18(1):185–214. https://doi.org/10.1080/07421222.2001.11045669
Hair JF, Ringle CM, Sarstedt M (2011) PLS-SEM: indeed a silver bullet. J Market Theory Pract 19(2):139–152. https://doi.org/10.2753/MTP1069-6679190202
Hair JF, Sarstedt M, Hopkins L, Kuppelwieser VG (2014) Partial least squares structural equation modeling (PLS-SEM): an emerging tool in business research. European Bus Rev 26(2):106–121. https://doi.org/10.1108/EBR-10-2013-0128
Henseler J, Ringle CM, Sinkovics RR (2009) The use of partial least squares path modeling in international marketing. In: Sinkovics RR, Ghauri PN (eds) New challenges to international marketing: advances in international marketing, vol 20. Emerald Group Publishing Limited. Bingley, UK, pp 277–319
Henseler J, Ringle CM, Sarstedt M (2015) A new criterion for assessing discriminant validity in variance-based structural equation modeling. J Acad Market Sci 43(1):115–135. https://doi.org/10.1007/s11747-014-0403-8
Holden RJ, Karsh BT (2010) The technology acceptance model: its past and its future in health care. J Biomed Inform 43(1):159–172. https://doi.org/10.1016/j.jbi.2009.07.002
Howard MC, Davis MM (2023) A meta-analysis of augmented reality programs for education and training. Virtual Real 27(4):2871–2894
Hu P, Chau P, Sheng O, Tam K (1999) Examining the technology acceptance model using physician acceptance of telemedicine technology. J Manag Inf Syst 16(2): 91–113. https://www.jstor.org/stable/40398433
Huang FH (2020) Adapting UTAUT2 to assess user acceptance of an e-scooter virtual reality service. Virtual Real 24(4):635–643. https://doi.org/10.1007/s10055-019-00424-7
Im JE, Gu JY, Lim EJ, Lee JG (2023) Virtual reality technology using a 360° video: development and evaluation of an educational tool for intraoral radiography using the bisecting angle technique. Virtual Real. https://doi.org/10.1007/s10055-023-00803-1
Jin S, Ahn H (2019) A study on wearable healthcare device adoption: an integrated approach of UTAUT2 and MIR. J Inf Syst 28(3):159–202
Joshi A, Kale S, Chandel S, Pal DK (2015) Likert scale: explored and explained. Br J Appl Sci Technol 7(4):396–403. https://doi.org/10.9734/BJAST/2015/14975
Kayali M, Alaaraj S (2020) Adoption of cloud based E-learning in developing countries: a combination a of DOI, TAM and UTAUT. Int J Contemp Manag Inf Technol 1(1):1–7
Kim Y, Crowston K (2011) Technology adoption and use theory review for studying scientists’ continued use of cyber-infrastructure. Proceed Am Soci Inform Sci Technol 48(1):1–10
Kim S, Malhotra NK, Narasimhan S (2005) Research note—two competing perspectives on automatic use: a theoretical and empirical comparison. Inf Syst Res 16(4):418–432
King D, Tee S, Falconer L, Angell C, Holley D, Mills A (2018) Virtual health education: scaling practice to transform student learning. Nurse Educ Today 71:7–9. https://doi.org/10.1016/j.nedt.2018.08.002
Kock N (2015) Common method bias in PLS-SEM: A full collinearity assessment approach. Int J e-Collab (ijec) 11(4):1–10
Krokos E, Plaisant C, Varshney A (2018) Virtual memory palaces: immersion aids recall. Virtual Real 23(1):1–15. https://doi.org/10.1007/s10055-018-0346-3
Kruse CS, Sen K, Armenta V, Hubbard N, Brooks R (2022) Leveraging m-health and virtual reality to improve cognition for Alzheimer’s patients: a systematic review. Healthc 10(10):1845. https://doi.org/10.3390/healthcare10101845
Lange AK, Koch J, Beck A, Neugebauer T, Watzema F, Wrona KJ, Dockweiler C (2020) Learning with virtual reality in nursing education: qualitative interview study among nursing students using the unified theory of acceptance and use of technology model. JMIR Nurs 3(1):e20249. https://doi.org/10.2196/20249
Lau KW (2023) Learning game innovations in immersive game environments: a factor analytic study of students’ learning inventory in virtual reality. Virtual Real 27:2331–2339
Lee EAL, Wong KW (2008) A review of using virtual reality for learning. In: El Rhalibi A (ed) Transactions on edutainment I. Springer, New York, pp 231–241
Levin MF, Weiss PL, Keshner EA (2014) Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Phys Ther 95:415–425. https://doi.org/10.2522/ptj.20130579
Lewis CC, Fretwell C, Ryan J, Parham JB (2013) Faculty use of established and emerging technologies in higher education: a unified theory of acceptance and use of technology perspective. Int J High Educ 2(2):22–34. https://doi.org/10.5430/ijhe.v2n2p22
Li J (2020) Blockchain technology adoption: examining the fundamental drivers. In: Proceedings of the second international conference on management science and industrial engineering. ACM Publication, New York, pp 253–260. https://doi.org/10.13140/RG.2.2.30288.25602/1
Lie SS, Helle N, Sletteland NV, Vikman MD, Bonsaksen T (2022) Implementation of virtual reality in health professional higher education: protocol for a scoping review. JMIR Res Protoc 11(7):e37222. https://doi.org/10.2196/37222
Limayem M, Hirt SG, Cheung CM (2007) How habit limits the predictive power of intention: the case of information systems continuance. MIS Quart 31(4):705–737
Lin PH, Yeh SC (2019) How motion-control influences a VR-supported technology for mental rotation learning: from the perspectives of playfulness, gender difference and technology acceptance model. Int J Hum-Comp Inter 35(18):1736–1746
Lopreiato JO, Downing JA, Gammon D, Lioce W, Sittner L, Slot V, Spain AE, Terminology & Concepts Working Group (Eds) (2016) Healthcare simulation dictionary. Agency for Healthcare Research and Quality Publication, Rockville, MD. https://www.ahrq.gov/sites/default/files/wysiwyg/patient-safety/resources/simulation/sim-dictionary-2nd.pdf Accessed 15 October 2022
Lu HP, Yang YW (2014) Toward an understanding of the behavioral intention to use a social networking site: an extension of task-technology fit to social-technology fit. Comput Hum Behav 34:323–332. https://doi.org/10.1016/j.chb.2013.10.020
Lunceford B (2009) Reconsidering technology adoption and resistance: observations of a semi-luddite. Explor Media Ecol 8:29–47
Makransky G, Terkildsen TS, Mayer RE (2017) Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn Instr. https://doi.org/10.1016/j.learninstruc.2017.12.00
Mantovani F, Castelnuovo G, Gaggioli A, Riva G (2003) Virtual reality training for health-care professionals. Cyber Psych Behav 6(4):389–395. https://doi.org/10.1089/109493103322278772
Maples-Keller JL, Bunnell BE, Kim S, Rothbaum BO (2017) The use of virtual reality technology in the treatment of anxiety and other psychiatric disorders. Harv Rev Psychiatry 25(3):103–113
Maraj CS, Lackey SJ, Badillo-Urquiola KA, Ogreten SL, and Maxwell DB (2015) Empirically derived recommendations for training novices using virtual worlds. In: Proceedings of interservice/industry training, simulation and education conference (IT/TSEC), 2015, Orlando, FL, 25(3):103–111. https://doi.org/10.1097/HRP.0000000000000138
Masadeh R, Tarhini A, Mohammed AB, Maqableh M (2016) Modeling factors affecting student’s usage behaviour of e-learning systems in Lebanon. Int J Bus Manag 11(2):299–312. https://doi.org/10.5539/ijbm.v11n2p299
Masneri S et al (2023) cleAR: an interoperable architecture for multi-user AR-based school curricula. Virtual Real 27:1813–1825
Matsangidou M, Otkhmezuri B, Ang CS, Avraamides M, Riva G, Gaggioli A, Iosif D, Karekla M (2022) ‘Now I can see me’: designing a multi-user virtual reality remote psychotherapy for body weight and shape concerns. Hum-Comput Interact 37(4):314–340. https://doi.org/10.1080/07370024.2020.1788945
Minervini G, Russo D, Herford AS, Gorassini F, Meto A, D’Amico C, Cervino G, Cicciu M, Fiorillo L (2022) Teledentistry in the management of patients with dental and temporomandibular disorders. BioMed Res Int. https://doi.org/10.1155/2022/7091153
Molinillo S, Gomez-Ortiz B, Pérez-Aranda J, Navarro-García A (2017) Building customer loyalty: the effect of experiential state, the value of shopping, and trust and perceived value of service on online clothes shopping. Cloth Text Res J 35(3):156–171. https://doi.org/10.1177/0887302X17694270
Moorthy K, Chun T’ing L, Ming KS, Ping CC, Ping LY, Joe LQ, Jie WY (2019) Behavioral intention to adopt digital library by the undergraduates. Int Inf Libr Rev 51(2):128–144. https://doi.org/10.1080/10572317.2018.1463049
Moorthy K, Yee TT, T’ing LC, Kumaran VV (2019) Habit and hedonic motivation are the strongest influences in mobile learning behaviours among higher education students in Malaysia Australasian. J Educ Technol. https://doi.org/10.14742/ajet.4432
Morales-Lara C, Adedinsewo DA (2022) Can artificial intelligence improve cardiovascular disease screening in pregnancy?: the digital future and cardio-obstetrics. Int J Cardiol 354:48–49. https://doi.org/10.1016/j.ijcard.2022.03.002
Morosan C, DeFranco A (2016) It’s about time: revisiting UTAUT2 to examine consumers’ intentions to use NFC mobile payments in hotels. Int J Hosp Manag 53:17–29. https://doi.org/10.1016/j.ijhm.2015.11.003
Moscoloni N (2005) Complementación metodológica para el análisis de datos cuantitativos y cualitativos en evaluación educativa [Methodological complementarity for quantitative and qualitative data analysis in educational evaluation]. Rev Electrónica Metodología Aplicada 10(2):1–10. https://doi.org/10.17811/rema.10.2.2005.1-10
Mtebe J, Raisamo R (2014) Investigating students’ behavioural intention to adopt and use mobile learning in higher education in East Africa. Int J Educ Dev Using ICT, 10(3)
Murillo GG, Novoa-Hernández P, Rodriguez RS (2021) Technology acceptance model and moodle: a systematic mapping study. Inf Dev 37(4):617–632
Nikou SA, Economides AA (2017) Mobile-based assessment: investigating the factors that influence behavioral intention to use. Comput Educ 109:56–73. https://doi.org/10.1016/j.compedu.2017.02.005
Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York, NY
Oliveira T, Martins M (2011) Literature review of information technology adoption models at firm level. Electr J Inform Syst Eval 14(1):110–121
Onwuegbuzie AJ, Johnson RB, Collins KM (2009) Call for mixed analysis: a philosophical framework for combining qualitative and quantitative approaches. Int J Multiple Res Approaches 3(2):114–139. https://doi.org/10.5172/mra.3.2.114
Park S, Gupta S (2012) Handling endogenous regressors by joint estimation using copulas. Mark Sci 31(4):567–586
Pedram S, Kennedy G, Sanzone S (2023) Toward the validation of VR-HMDs for medical education: a systematic literature review. Virtual Real 27:2255–2280
Pieterse AD et al (2023) User experiences of medical students with 360-degree virtual reality applications to prepare them for the clerkships. Virtual Real 27:1381–1389
Podsakoff PM, Mackenzie SB, Podsakoff NP (2012) Sources of method bias in social science research and recommendations on how to control it. Ann Rev Psych 63:539–569. https://doi.org/10.1146/annurev-psych-120710-100452
Pottle J (2019) Virtual reality and the transformation of medical education. Future Healthc J 6(3):181–185. https://doi.org/10.7861/fhj.2019-0036
Raza SA, Qazi W, Khan KA, Salam J (2021) Social isolation and acceptance of the learning management system (LMS) in the time of COVID-19 pandemic: an expansion of the UTAUT model. J Educ Comput Res 59(2):183–208. https://doi.org/10.1177/0735633120960421
Rese A, Baier D, Geyer-Schulz A, Schreiber S (2017) How augmented reality apps are accepted by consumers: a comparative analysis using scales and opinions. Technol Forecast Social Change 124:306–319. https://doi.org/10.1016/j.techfore.2016.10.010
Richter NF, Sinkovics RR, Ringle CM, Schlägel C (2016) A critical look at the use of SEM in international business research. Int Market Rev 33(3):376–404. https://doi.org/10.1108/IMR-04-2014-0148
Ringle C, Da Silva D, Bido D (2015) Structural equation modeling with the SmartPLS. Braz J Market 13(2):56–73
Rocco TS, Bliss LA, Gallagher S, Pérez-Prado A (2003) Taking the next step: mixed methods taking the next step: mixed methods research in organizational systems research in organizational systems. Inf Technol Learn Perform J 21(1):19–29
Rubin R (2021) Dispositivo de realidad virtual autorizado para aliviar el dolor de espalda. JAMA 326:2354. https://doi.org/10.1001/jama.2021.22223
Ruthenbeck GS, Reynolds KJ (2015) Virtual reality for medical training: the state-of-the-art. J Simul 9:16–26
Sadeghi AH, Bakhuis W, Van Schaagen F, Oei FB, Bekkers JA, Maat AP, Taverne YJ (2020) Immersive 3D virtual reality imaging in planning minimally invasive and complex adult cardiac surgery. Europ Hea Jour-Dig Hea 1(1):62–70
Sagnier C, Loup-Escande E, Lourdeaux D, Thouvenin I, Valléry G (2020) User acceptance of virtual reality: an extended technology acceptance model. Int J Human-Comput Interaction 36(11):993–1007. https://doi.org/10.1080/10447318.2019.1708612
Samadbeik M, Yaaghobi D, Bastani P, Abhari S, Rezaee R, Garavand A (2018) The applications of virtual reality technology in medical groups teaching. J Adv Med Educ Prof 6(3):123
Sattar M, Palaniappan S, Lokman A, Shah N, Khalid U, Hasan R (2020) Motivating medical students using virtual reality based education. Int J Emerg Technol Learn 15(2):160–174. https://doi.org/10.3991/ijet.v15i02.11394
Shen CW, Ho JT, Ly PTM, Kuo TC (2019a) Behavioural intentions of using virtual reality in learning: perspectives of acceptance of information technology and learning style. Virtual Real 23(3):313–324. https://doi.org/10.1007/s10055-018-0348-1
Shen CW, Ho JT, Ly PTM, Kuo TC (2019b) Behavioural intentions of using virtual reality in learning: perspectives of acceptance of information technology and learning style. Virtual Real 23:313–324
Sigala M (2021) In search of originality and contribution in tourism research: an editor’s reflections and suggestions. J Hosp Tourism Manag 48:604–608. https://doi.org/10.1016/j.jhtm.2021.08.010
Sprenger DA, Schwaninger A (2021) Technology acceptance of four digital learning technologies (classroom response system, classroom chat, e-lectures, and mobile virtual reality) after three months’ usage. Int J Edu Tech Hig Edu 18(1):8
Stefan H, Mortimer M, Horan B (2023) Evaluating the effectiveness of virtual reality for safety-relevant training: a systematic review. Virtual Real 27(4):2839–2869
Sung HN, Jeong DY, Jeong YS, Shin JI (2015) The relationship among self-efficacy, social influence, performance expectancy, effort expectancy, and behavioral intention in mobile learning service. Int J u- e-Serv Sci Technol 8(9):197–206. https://doi.org/10.14257/ijunesst.2015.8.9.21
Sveistrup H (2004) Motor rehabilitation using virtual reality. J Neuroeng Rehabil 1(1):1–8. https://doi.org/10.1186/1743-0003-1-10
Tamilmani K, Rana NP, Wamba SF, Dwivedi R (2021) The extended unified theory of acceptance and use of technology (UTAUT2): a systematic literature review and theory evaluation. Int J Inf Manag 57:102269. https://doi.org/10.1016/j.ijinfomgt.2020.102269
Tashakkori A, Teddlie C (2003) Issues and dilemmas in teaching research methods courses in social and behavioural sciences: US perspective. Int J Social Res Methodol 6(1):61–77. https://doi.org/10.1080/13645570305055
Tavares J, Oliveira T (2014) Electronic health record portal adoption by health care consumers-proposal of a new adoption model. Int Conf Web Syst Technol 2:387–393. https://doi.org/10.2196/jmir.5069
Tu Z, Yuan Y, Archer N (2014) Understanding user behaviour in coping with security threats of mobile device loss and theft. Int J Mob Commun 12(6):603–623. https://doi.org/10.1016/0167-8116(94)00019-K
Ustun AB, Karaoglan-Yilmaz FG, Yilmaz R (2022) Educational UTAUT-based virtual reality acceptance scale: a validity and reliability study. Virtu Real 27(2):1063–1076
Ustun AB, Yilmaz R, Yilmaz FGK (2020) Virtual reality in medical education. In: Mobile devices and smart gadgets in medical sciences, pp. 56–73. IGI Global
Vekhter D, Robbins MS, Minen M, Buse DC (2020) Efficacy and feasibility of behavioral treatments for migraine, headache and pain in the acute care setting. Curr Pain Headache Rep 24(10):1–9. https://doi.org/10.1007/s11916-020-00899-z
Venkatesh V, Bala H (2008) Technology Acceptance Model 3 and a research agenda on interventions. Decis Sci 39(2):273–315. https://doi.org/10.1111/j.1540-5915.2008.00192.x
Venkatesh V, Davis F (2000) A theoretical extension of the technology acceptance model: four longitudinal field studies. Manage Sci 46(2):186–204
Venkatesh V, Morris MG, Davis GB, Davis FD (2003) User acceptance of information technology: toward a unified view. MIS Q 27(3):425–478. https://doi.org/10.2307/30036540
Venkatesh V, Thong JY, Xu X (2012) Consumer acceptance and use of information technology: extending the unified theory of acceptance and use of technology. MIS Q 36(1):157–178. https://doi.org/10.2307/41410412
White BM, Shaban-Nejad A (2022) Utilization of digital health dashboards in improving COVID-19 vaccination uptake, accounting for health inequities. Stud Health Technol Inform 295:499–502. https://doi.org/10.2307/30036540
Wong EYC, Hui RTY, Kong H (2023) Perceived usefulness of, engagement with, and effectiveness of virtual reality environments in learning industrial operations: the moderating role of openness to experience. Virtual Real 27(3):2149–2165
Oliver Wyman (2021) The digital frontier of health promotion and prevention. Oliver Wyman, Singapore. https://www.oliverwyman.com/our-expertise/insights/2021/feb/the-digital-frontier-of-health-promotion-and-prevention.html. Accessed 15 October 2022
Yahia IB, Al-Neama N, Kerbache L (2018) Investigating the drivers for social commerce in social media platforms: importance of trust, social support and the platform perceived usage. J Retail Consumer Serv 41:11–19. https://doi.org/10.1016/j.jretconser.2017.10.021
Yeo E, Chau B, Chi B, Ruckle DE, Ta P (2019) Virtual reality neurorehabilitation for mobility in spinal cord injury: a structured review. Innov Clin NeuroSci 16(1–2):13–20
Zhao X, Li X (2022) Comparison of standard training to virtual reality training in nuclear radiation emergency medical rescue education. Disaster Med Public Health Prep. https://doi.org/10.1017/dmp.2022.65
Acknowledgements
The authors wish to thank MetaMedicsVR for their contribution to this research. The project was conducted in collaboration with the private sector, which facilitated an exploration of the potential demand for medical training based on virtual reality applications.
Funding
Funding for open access publishing: Universidad de Málaga/CBUA.
Author information
Authors and Affiliations
Contributions
All the authors contributed to conceptualising and designing this research. Material preparation and data collection were performed by PAU. The literature review was conducted by AMCM and JPA and the data analysis by JPA. All the authors commented on previous versions of the manuscript and then read and approved the final version.
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Alarcon-Urbistondo, P., Perez-Aranda, J. & Casado-Molina, A. Key determinants of intention to use virtual reality in medical training. Virtual Reality 28, 90 (2024). https://doi.org/10.1007/s10055-024-00990-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10055-024-00990-5