Abstract
Despite being validated in different populations to assess fear of COVID-19, the Fear of COVID-19 Scale (FCV-19S) has scatter validations in healthcare professionals, often with several limitations, especially in Spanish-speaking professionals. Our research aims to extend previous studies by: (i) using a large sample of Spanish nurses and physicians; (ii) incorporating longitudinal data; and (iii) using a covariance-based SEM methodology to test different factor structures. 686 Spanish healthcare professionals (M = 42.7 years; 80.5% women; 76.7% nurses) participated in 2021 (Time 1), of whom, 216 were reassessed one year later (Time 2). The results (S-Bχ2 = 69.134, df = 13, p < 0.001, CFI = 0.974, and SRMR ≤ 0.031) supported a two-factor structure with a factor of somatic reactions and another of emotional expressions of fear of COVID-19. The FCV-19S evidenced strong factorial measurement invariance regarding gender, professional category, age and professional experience and also showed significantly higher levels of fear of COVID-19 in women, nurses, and professionals under 40 years old. The internal consistency was high for the somatic factor (ω = 0.86; α = 0.85), the emotional factor (ω = 0.82; α = 0.82) and the overall scale (α = 0.89). The scale showed good convergent, divergent, and incremental validity with respect to psychological symptomatology, perceived health, burnout, and worry about contagion. Finally, the FCV-19S showed criterion validity regarding generalized anxiety disorder, burnout, and the risk of leaving the profession. The FCV-19S evidenced excellent psychometric properties in Spanish healthcare professionals and was predictive of different health outcomes one year after administration. Study implications and limitations are also discussed.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The COVID-19 pandemic has been a major burden on countries’ healthcare systems, not only logistically, but has also affected the mental health of healthcare personnel, comprising different disorders such as stress, anxiety and insomnia (Pappa et al., 2020). These disorders have also led to other types of consequences such as post-traumatic stress and sleep disorders which have lowered the quality of life among healthcare personnel (Pappa et al., 2020). In Spain, which has experienced a substantial number of affected individuals and deaths at the pandemic's onset, the consequent strain on the country's economic framework and the health of its inhabitant has been decidedly more intense than in many other nations across Europe (Pinilla et al., 2021). This challenging scenario has severely threatened the stability of its until that moment well-established national health care system, imposing substantial workloads on healthcare workers, thereby jeopardizing their mental health (Priede et al., 2021). Various factors may have contributed to these negative consequences. Among them, the lack of personal protective equipment and working on the frontline with infectious patients stand out. Some studies have also shown that the fear of contagion, whether the individual’s own or that of a family member, is one of the factors with a clear influence on the deterioration of the health of healthcare professionals during the pandemic (García-Hedrera et al., 2021).
Given the magnitude of the COVID-19 pandemic and the psycho-emotional implications it entailed, Ahorsu et al. (2020a, b) developed a brief and valid seven-item instrument to assess an individual’s fear of COVID-19, namely, the COVID-19 Fear Scale (FCV-19S), with a unidimensional structure. The FCV-19S was developed using two types of psychometric testing: classical test theory (CTT) analysis and Rasch analysis (Ahorsu et al., 2020a, b). Since its initial development, the FCV-19S has been translated and tested in over 20 languages with excellent psychometric properties, including the Spanish version (Piqueras et al., 2021). Its factorial structure has been debated as to whether it has one or two factors, with most psychometric studies confirming a one-factor structure (Mailliez et al., 2022; Soraci et al., 2022; Waddimba et al., 2023). Most of those who have identified a two-factor structure agree that these factors are emotional response and somatic response (Masuyama et al., 2022; Reznik et al., 2021), although other authors propose a difference between emotional factor and fear-related thinking (Yang et al., 2022). Internal consistency values exceed 0.80, and total scores on the FCV-19S have shown significant positive associations with anxiety, depression, and stress (Mailliez et al., 2022; Soraci et al., 2022; Waddimba et al., 2023), and negative associations with happiness, mental well-being, emotional regulation and life satisfaction (Green et al., 2021; Stănculescu, 2022).
Validations have been carried out among different populations, especially in the general public. However, validations have also been observed among university students (Min et al., 2022; Perz et al., 2022; Yang et al., 2022), including medical students (Dadfar et al., 2021) or among children and adolescents (Masuyama et al., 2022). To date, the FCV-19S has been little studied among healthcare professionals (Ahorsu et al., 2022; Hawley et al., 2022; Llorente-Alonso et al., 2021), despite the relevance that this particular fear has among this population (Crowe et al., 2021; Della Monica et al., 2022). Additionally, there is only one validation study that, predominantly using a general population sample, has explored this instrument in a longitudinal manner (Waddimba et al., 2023).
Regarding previous validations among Spanish samples, all of them describe a unifactorial model, in different samples including elderly people over 60 years of age (Cárdenas Soriano et al., 2022), adults (Piqueras et al., 2021), and university students (Martínez-Lorca et al., 2020). Among the Spanish-speaking healthcare population, there have been two published studies. One was conducted with Colombian physicians (Mercado-Lara et al., 2022), in which two items were eliminated, which was criticized by some of the FCV-19S developers for not respecting the structure and content validity of the original instrument (Lin et al., 2023). The second one, in Spain, was a validation study comprising 194 health professionals. Here, a unifactorial model was reported with high internal consistency (0.90), and the scale’s total score was positively associated with anxiety, depression and psychological detachment and negatively associated with collaborative work, relaxation, search for challenges, and control (Llorente-Alonso et al., 2021).
Taking into account the significant incidence of fear of COVID-19 among healthcare professionals due to their continuous contact with it (Crowe et al., 2021), and given the scarcity of validation studies of this instrument among healthcare professionals, the present study aimed to validate the FCV-19S among Spanish healthcare professionals. The study also aimed to overcome some of the limitations of the previous validation study of Spanish healthcare professionals carried out by Llorente-Alonso et al. (2021). More specifically, the study by Llorente-Alonso et al. (2021) used a relatively small sample (under 200 participants) composed almost exclusively of nursing professionals and women. Methodologically, the partial least squares methodology was used, which, in addition to not considering the measurement error of the variables by not using latent variables, is more prone to obtain biased estimators, and presents difficulties in identifying mis-specified models and is not very suitable for confirmatory purposes (Rönkkö et al., 2016). That is why several authors prefer covariance-based SEM methodology as a superior and more suitable alternative for this type of research (Goodhue et al., 2012; Rönkkö et al., 2016).
Therefore, the present study aimed to extend the findings of the previous study (Llorente-Alonso et al., 2021) by: (i) using a large sample of health professionals (nurses and physicians) from various parts of the country; (ii) incorporating longitudinal data; and (iii) using a covariance-based SEM methodology in which the adjustment of different factorial structures of the scale was tested. Consequently, guided by the aforementioned studies that predominantly reveal a single-factor structure, the present research hypothesizes that the FCV-19S will demonstrate a unidimensional configuration in Spanish healthcare professionals, providing strong evidence of reliability and appropriate validity concerning psychological distress variables.
Method
Participants
A total of 686 healthcare professionals (mean age = 42.7 years; 80.5% women; 76.7% nurses) were recruited during the year 2021 (Time 1 [T1]) from different hospital units in three regions of Spain (Comunidad de Madrid, Cataluña, and Comunidad Valenciana). Among these initial participants, 216 were reassessed one year later (Time 2 [T2]). Socio-demographic and occupational characteristics of the total sample as well as of physicians and nurses are separately detailed in Table 1.
Procedure
The present study is part of a larger prospective study (covering the 2020–2022 period) aimed to assess the effect of the COVID-19 pandemic on the mental health of Spanish healthcare workers and associated psychosocial variables. Owing to the pressing necessity to evaluate the immediate mental health consequences at the outset of the COVID-19 pandemic, a non-probability convenience sampling was used. Data to validate the FCV-19S were collected in 2021 (n = 686) and 2022 (n = 216) using an online survey administered to professionals in the Spanish healthcare system who were working during the onset of the COVID-19 crisis. This method of survey application was adopted in response to the COVID-19 pandemic's isolation and social distancing protocols. The first page of the survey described the study aim and requested informed consent. The recruitment process utilized a multi-faceted approach. Initially, healthcare professionals were directly contacted through institutional email lists. To enhance the scope of recruitment, the survey link was disseminated via a personal contact network, utilizing social media platforms including Facebook, Twitter, and LinkedIn. Furthermore, team leaders across various medical specialties in selected hospitals were engaged to ensure a broad and diverse representation of participants. For longitudinal follow-up, participants were re-assessed one year later using the same online platform. Email reminders, utilizing initial survey contact information, were sent to ensure sustained engagement over the study's duration. The study was approved by the ethics committee of Hospital Universitario Fundación Alcorcón (Reference 20/88, date 04/05/2020).
Measures
Socio-demographic and professional variables [assessed at T1]
Demographic variables (gender and age) and professional characteristics (medical unit worked in, years of experience working in the profession, having direct contact with COVID-19 patients, and number of months having direct contact with COVID-19 patients) were evaluated using a self-developed questionnaire.
Fear of COVID-19 [assessed at T1]
Fear of COVID-19 was assessed using the FCV-19S [(Ahorsu et al., 2020a, b); Spanish version (Martínez-Lorca et al., 2020)]. This 7-item instrument has a 5-point Likert response format ranging from 1 (strongly disagree) to 5 (strongly agree). Although it was originally designed to provide a total score (Ahorsu et al., 2020a, b), various studies find evidence of the existence of an emotional factor (Items 1, 2, 4 and 5) and a somatic factor (Items 3, 6 and 7) (Huarcaya-Victoria et al., 2022; Masuyama et al., 2022; Reznik et al., 2021). Higher scores indicate a higher level of fear of COVID-19. The internal consistency is reported in the Results section and was assessed both with a conventional estimator based on the covariance between items using Cronbach’s alpha (α) and with an estimator based on the item factor loadings using McDonald’s omega (ω).
Depressive, anxiety and stress symptoms [assessed at T1 and T2]
The Depression, Anxiety and Stress Scale [DASS-21 (Lovibond & Lovibond, 1995); Spanish version (Daza et al., 2002)] was used to assess the level of anxiety, depression and stress symptoms. The scale contains 21 items (seven per dimension) rated on 4-point Likert response format from 0 (did not apply to me at all) to 3 (applied to me very much, or most of the time) with higher scores indicate a higher degree of affective symptomatology. In the present study, internal consistency was very good at both T1 (α = 0.90, 0.86 and 0.89 for depression, anxiety, and stress symptoms, respectively) and T2 (α = 0.90, 0.86 and 0.87 for depression, anxiety, and stress symptoms, respectively).
Burnout [assessed at T1 and T2]
The Maslach Burnout Inventory-Human Services Survey [MBI-HSS (Maslach et al., 1997); Spanish version (Gil-Monte, 2005)] was used to assess the level of burnout. This 22-item scale has a 7-point Likert response format ranging from 0 (never) to 6 (everyday). The instrument assesses three burnout dimensions: emotional exhaustion (i.e., feelings of depletion and overloading of an individual’s emotional and physical resources; 9 items), cynicism (i.e., a callous, negative, or excessively detached response to various aspects of the job and the individuals associated with it; 5 items), and low personal accomplishment (i.e., a sense of incompetence and a lack of achievement and productivity at work; 8 items). Adequate internal consistency was observed at T1 (α = 0.91, 0.77 and 0.85 for emotional exhaustion, cynicism, and personal accomplishment, respectively) and T2 (α = 0.91, 0.78 and 0.85 for emotional exhaustion, cynicism, and personal accomplishment, respectively).
Generalized anxiety disorder [assessed at T1]
The presence of the DSM-IV symptoms of generalized anxiety disorder was assessed using the 7-item self-rated Generalized Anxiety Disorder Scale [GAD-7 (Spitzer et al., 2006); Spanish version (García-Campayo et al., 2010)]. This 7-item scale has a 4-point Likert response format ranging from 0 (not at all) to 3 (nearly every day). Higher scores indicate more severe symptoms. In this study, an excellent internal consistency was obtained at T1 (α = 0.94).
General health perception [assessed at T1]
The perception of the participant’s general state of health was evaluated using a single item (i.e., “Do you consider your current state of health as…”) with a Likert-type response format ranging from 1 (bad or very bad) to 4 (good or very good). Higher scores indicate better perceived health.
Worry about the possibility of contagion of COVID-19 from oneself or from a family member [assessed at T1 and T2]
An item was included for each type of concern (i.e., “What is your level of worry about the possibility of self-contagion by COVID-19?” and “What is your level of worry about the possibility of contagion of other family members by COVID-19?”) with a 3-point Likert response format ranging from 1 (not at all worried) to 3 (very worried).
Thoughts of leaving the profession [assessed at T1]
To assess whether participants had ever contemplated leaving the profession as a consequence of the pandemic, a dichotomous (yes/no) item was used (i.e., “After everything that has happened with the COVID-19 pandemic, have you thought about leaving your profession?”).
Psychological assistance [assessed at T1]
In order to assess whether the participant had requested psychological help due to the pandemic and its impacts, a dichotomous (yes/no) item was used (i.e., “Have you requested psychological assistance at any time during these months due to the effects that the pandemic has produced on you?”).
Statistical analysis
Data corresponding to this research is accessible via the Open Science Framework (https://osf.io/9tus4/?view_only=d7f5cfeab716411ab126577dd7687df8). IBM SPSS Statistics version 26.0 (IBM Corp., Armonk, NY, USA) was used for the following analyses: (i) descriptive statistics, (ii) differences between groups, (iii) convergent/divergent validity, (iv) incremental validity, and (v) criterion validity. The factor structure, the measurement invariance, and the reliability of the scale were analyzed applying structural equation modeling (SEM) methodology with Mplus version 8.5 (Los Angeles, CA, USA).
First, the sociodemographic characteristics of the study participants at T1 (n = 686) and T2 (n = 216) were examined. There were no missing values, as the online form used meant the online survey could only be submitted if all questions were answered.
The factor structure of the FCV-19S was explored by confirmatory factor analysis (CFA) testing the main configurations supported by previous research: the one-factor structure, the two-factor structure, and the bi-factor structure (each item loads simultaneously on both one of the two uncorrelated factors and on a general factor). Considering the absence of univariate normality (significant p-values in the Kolmogorov–Smirnov test for all FCV-19S items), which is a prerequisite for multivariate normality, the models were tested following a model comparison strategy using the MLM robust estimation method (maximum likelihood parameter estimates with standard errors and the mean-adjusted χ2 statistic), also referred to as Satorra-Bentler χ2 (S-Bχ2). Since χ2 penalizes larger sample sizes (generally over 200 participants), increasing the probability of erroneously rejecting models that fit the data properly (Garson, 2012), this statistic was accompanied with a series of alternative adjustment indices such as the comparative fit index (CFI) and the Standardized Root Mean Square Residual (SRMR). Despite its wide use, the Root Mean Square Error of Approximation (RMSEA) was not used because it is overly sensitive in models with few degrees of freedom (Kenny et al., 2014), such as the current one. To compare non-nested models, the Akaike Information Criterion (AIC) was used as a parsimony index. Therefore, the global adjustment of each assessed model was determined based on the following cut-off points: S-Bχ2 p-value ≥ 0.05, CFI ≥ 0.95, SRMR ≤ 0.08, and AIC of less magnitude suggesting increased parsimony (Hu & Bentler, 1999). Moreover, and simultaneously, the model’s local adjustment was explored through the standardized factor loadings (λ) and the item’s individual reliability (R2), with λ ≥ 0.70 and ≥ 0.50, as well as R2 ≥ 0.50 and ≥ 0.25, denoting good and acceptable local fit, respectively (Hair et al., 2014).
The covariance-based SEM analysis involved a series of structured steps. Initially, we defined our models, grounded in theoretical insights and previous research. This was followed by model identification, a crucial step to confirm our models' appropriateness for the data of the study. The MLM method was then employed to effectively utilize our data's covariance structure. Subsequently, we assessed model fit using the aforementioned adjustment indices. The last step was to consider possible improvements to the model, in line with the statistical guidelines and the theoretical framework.
Once the most robust factor structure for the FCV-19S was established, measurement invariance analyses were performed to assess the psychometric equivalence (same structure and meaning) of the construct across groups (Putnick & Bornstein, 2016). The variables selected to make group comparisons via multi-group CFA were gender (males vs. females), professional category (physicians vs. nurses), age (40 years or younger vs. older than 40 years) and professional experience (10 years of experience or less vs. more than 10 years).
Three nested models with progressive restrictions were compared between the two groups of each of the four aforementioned grouping variables in order to test configural (pattern of items that load on their corresponding factor constrained to be equal between groups), metric (factor loadings constrained to be equal, in addition to the previous step’s restrictions), and scalar (item intercepts constrained to be equal, in addition to the two previous steps’ restrictions) invariance. Configural invariance is achieved if CFI and SRMR indices show an adequate fit of the model in this first step (Putnick & Bornstein, 2016). Metric invariance is reached if the model of the second step (i.e., metric) shows a decrease in CFI ≤ 0.01 and an increase in SRMR ≤ 0.03 with respect to the fit of the first model (i.e., configural) (Chen, 2007). Scalar invariance is achieved if the model of the third step (i.e., scalar) shows a decrease in CFI ≤ 0.01 and an increase in SRMR ≤ 0.015 with respect to the fit of the second model (i.e., metric) (Chen, 2007). If two groups reach measurement invariance, it is assumed that comparisons can be made between these groups (Putnick & Bornstein, 2016).
As aforementioned, the internal consistency of the scale (or the subscales) was assessed both by the α coefficient and by CFA-based procedures such as the ω coefficient. The second method has the advantage of not being affected by the number of items or their lack of homogeneity and is preferable when SEM methodology is used (Garson, 2012). Scores over 0.70 for ω and α suggest adequate composite reliability of the scale or factor (Chen, 2007; Kline, 2011).
Subsequently, group comparisons in FCV-19S scores by gender, professional category, age, and professional experience were explored using t-tests. To quantify the magnitude of these possible differences Cohen’s d was computed. Values of 0.20, 0.50, and 0.80 indicate small, medium, and large effect sizes, respectively (Cohen, 1988).
Bivariate correlations between FCV-19S scores, assessed solely at T1, and a series of theoretically-related variables (symptoms of anxiety, stress and depression, general health perception, and worry about the contagion of COVID-19 by themselves and their families), measured at T1 and T2, were performed in order to explore convergent and discriminant validity. Without specifying specific cut-off points, Campbell and Fiske note that those correlations that are significantly different from zero and sufficiently large are indicative of convergent validity (Campbell & Fiske, 1959). Regarding discriminant validity, correlations greater than 0.90 pose a problem when it comes to differentiating between different variables or between dimensions of the same construct (Rönkkö & Cho, 2020), so the cut-off point of 0.90 proposed by Kline was used in the present study (Kline, 2011).
To assess incremental validity, multiple linear regression analyses were performed exploring the independent associations of FCV-19S scores with psychological symptoms (anxiety, depression and stress) and burnout dimensions, measured at T1 and T2, after controlling for specific occupational and sociodemographic factors that could determine such outcomes (Haynes & Lench, 2003). The enter method was employed in the analyses.
Finally, criterion validity was assessed by exploring mean differences in FCV-19S scores depending on the healthcare worker’s status at T1 on the variables of burnout, generalized anxiety disorder, thoughts of leaving the profession, and receipt of psychological assistance. The status of general anxiety disorder was determined by using the cut-off point (≥ 10 points in GAD-7) (García-Campayo et al., 2010); whereas high burnout status was established following the cut-off points (≥ 26, ≥ 9 and ≥ 35 points for the MBI dimensions of emotional exhaustion, cynicism, and personal accomplishment, respectively) recommended by Merino-Plaza et al. (2018) for Spanish health professionals. Cohen’s d effect size was also computed to quantify the magnitude of these possible differences.
As mentioned in this section, although not all variables could be assessed at both time points (i.e., T1 and T2), the present study incorporates longitudinal data in the following analyses: a) in the examination of the demographic characteristics of the sample at T1 and T2 via descriptive statistical analysis; b) in the exploration of the association of FCV-19S scores at T1 with worry about contagion and psychological symptoms of anxiety, depression, and stress at T2 through bivariate correlations; and c) in the analysis of the independent longitudinal impact of T1 FCV-19S scores on burnout and the mentioned psychological symptoms at T2, via multiple linear regression (adjusted for occupational and sociodemographic factors).
Results
Factor structure
The one-dimensional structure proposed by the original authors of the scale (Ahorsu et al. (2020a, b) was first tested, which obtained an unsatisfactory fit (S-Bχ2 = 146.953, df = 14, p < 0.001, CFI = 0.938, SRMR ≤ 0.042, and AIC = 12,699.626). In contrast, the structure of two correlated factors supported by several authors (Masuyama et al., 2022; Reznik et al., 2021; Stănculescu, 2022) obtained an adequate fit and also appeared to be more parsimonious (S-Bχ2 = 69.134, df = 13, p < 0.001, CFI = 0.974, SRMR ≤ 0.031, and AIC = 12,602.197). On the contrary, it was not possible to obtain evidence to support the bi-factor structure since the model could not be estimated due to the improper solutions obtained (the matrix was not positively defined). These results support a factor structure of two correlated factors (emotional and somatic) that also obtain a fairly good local fit (see Fig. 1).
Measurement invariance
The invariance analyses showed that the two-factor structure was invariant in terms of gender, professional health category, age, and professional experience (see Supplementary Table 1). The different groups that were compared showed an equivalent configuration, factor loadings, and item intercepts.
Reliability
Regarding reliability, the scale showed high internal consistency (ω of 0.82 and 0.86 for the emotional and somatic factor, respectively; α of 0.82, 085 and 0.89 for the emotional factor, the somatic factor and the overall score, respectively).
Mean comparisons by group
Once the psychometric equivalence of the FCV-19S between groups was verified, differences were found in the mean levels of fear of COVID-19 in three of the four grouping variables explored (see Supplementary Table 2). Therefore, nurses (compared to physicians) and those professionals 40 years of age or younger (compared to the older participants) showed significantly higher levels of fear of COVID-19 both in the two factors (emotional and somatic) and in the overall fear level. The effect size of these differences was small. Females also showed significantly higher levels of fear of COVID-19. In this case, these differences were of greater magnitude both for the emotional factor and for the overall score, with a small-medium effect size. No significant differences were found between groups regarding professional experience.
Convergent and discriminant validity
In general, the emotional factor, the somatic factor, and the overall FCV-19S score had significant associations with all the variables selected for this analysis, both at T1 and T2 (see Table 2). These findings suggest the existence of convergent validity. The FCV-19S scores showed moderate relationships with both the mental health variables and with the questions that specifically assessed worry about COVID-19 contagion (individuals themselves or family members), as well as small associations with general health perception. For those variables assessed on two occasions, all the correlations of the FCV-19S were higher at T1 than in T2 (after one year). More specifically, and with regard to mental health symptoms, the emotional and somatic factors of FCV-19S showed very similar associations with depressive and stressful symptoms; whereas in the case of anxious symptoms, the somatic aspects were the ones that were more strongly related. The medium–high correlations established with the questions concerning the level of concern regarding contagion from COVID-19 (slightly closer to the emotional than the somatic subscale), showed evidence of discriminant validity of the FCV-19S. In addition, the correlation of 0.74 found between the emotional and somatic dimensions also suggests that both factors, although strongly associated, are conceptually distinguishable.
Incremental validity
Multiple linear regression analyses were performed to explore the incremental validity of the FCV-19S, over and above the possible incidence of occupational and sociodemographic factors, with respect to psychological symptoms and burnout dimensions. These analyses were carried out for the variables evaluated in both at T1 (see Table 3) and T2 (see Supplementary Table 3). Regarding the psychological symptoms evaluated at T1, the emotional and somatic factors of the FCV-19S jointly explained an additional percentage of variance (with respect to the sociodemographic and occupational variables) of 25.7%, 13.4%, and 18.8% of the symptoms of anxiety, stress and depression, respectively. These percentages were reduced, respectively, to 12.7%, 3.2% and 4.4% at T2. Concerning to the burnout dimensions evaluated at T1, the emotional and somatic factors of the FCV-19S jointly explained an additional percentage of variance of 15%, 7.1%, and 1.9% of emotional exhaustion, cynicism, and personal accomplishment, respectively. The aforementioned percentages were reduced, respectively, to 4.9%, 6.1%, and 1.9% at T2.
Criterion validity
Significant differences in the FCV-19S scores (both generally and with respect to their emotional and somatic aspects) were found between participants with high burnout status and those with low or moderate burnout (see Table 4). More specifically, a moderate effect size was found for the emotional exhaustion and cynicism dimensions, while a small effect size was obtained for the personal accomplishment dimension. In the latter case, as expected and contrary to the other two dimensions, the levels of fear of COVID-19 were significantly lower among healthcare professionals with high personal accomplishment. Likewise, significant differences in the levels of FCV-19S were found between professionals with probable generalized anxiety disorder and those without (see Table 4). Here, a large effect size was found.
Additionally, significantly higher levels of fear of COVID-19 were found both among professionals who considered leaving the profession (versus those who had not) and among those who received psychological assistance (versus those who did not). A moderate effect size was found for the first of these variables and a relatively low effect size was found for the second.
Discussion
Health professionals have been severely affected by the COVID-19 pandemic, developing different psycho-emotional consequences (Pappa et al., 2020). It is therefore of particular relevance to determine whether the FCV-19S (Ahorsu et al., 2020a, b) is a sufficiently valid instrument to assess the fear that Spanish nurses and physicians have of the disease.
The present findings showed that the Spanish version of the FCV-19S (Martínez-Lorca et al., 2020) exhibited adequate psychometric properties and is a useful instrument for assessing the fear of COVID-19 among Spanish healthcare workers. First, in spite of the evidence of a single-factor structure in the original scale (Ahorsu et al., 2020a, b) and validations conducted in various countries, and contrary to our hypothesis, the findings with medical and nursing professionals in the present study indicated that the two-factor structure exhibited a markedly superior fit than the unidimensional one. In fact, several studies have found evidence that the FCV-19S assesses two dimensions of fear of COVID-19: one related to feelings of fear, discomfort, anxiety, and nervousness, and the other related to the presence of somatic symptoms such as heart palpitations, clammy hands, and insomnia (Barrios et al., 2021; Caycho-Rodríguez et al., 2022; Hawley et al., 2022; Iversen et al., 2022; Magano et al., 2021; Yang et al., 2022). Although some of these studies evidenced the simultaneous existence of both these two factors of fear of COVID-19 and a general factor, the results of the present study did not support the bi-factor structure because the model could not be estimated. However, anomalous results and improper solutions are quite common when applying bi-factor models (Eid et al., 2017). Despite the lack of consensus on the structure of the FCV-19S, the authors of the original scale maintained more recently that the instrument is designed to assess two types of fear responses to COVID-19, one emotional and one somatic (Lin et al., 2023). These findings align with the multidimensional conception of fear advocated by some authors, where fear involves both a set of physical changes (linked to the autonomic nervous system) and subjective sensations experienced in response to changes in one's own environment and body (Mobbs et al., 2019). Therefore, it is possible that many of the validation studies (Mailliez et al., 2022; Nazari et al., 2021; Piqueras et al., 2021; Soraci et al., 2022; Ullah et al., 2021; Waddimba et al., 2023; Winter et al., 2023) have found a unifactorial structure because, after obtaining adequate fit indices, they did not explore the possibility of other models that could fit better (such as the two-factor model). Moreover, the aforementioned studies that found support for the two-factor solution did explore the single-factor structure in all cases. The findings of the present study suggest that the fear of COVID-19 is a multidimensional construct.
The results of the invariance analyses showed that the construct of fear of COVID-19 assessed by the FCV-19S is invariant in terms of age, professional experience, gender, and professional category of healthcare professionals. Previous studies with the Spanish-speaking general population have found that the FCV-19S is invariant in relation to age, gender, country, and worker versus student status (Caycho-Rodríguez et al., 2022; Piqueras et al., 2021). However, the evidence concerning Spanish-speaking healthcare professionals is more limited. Therefore, Huarcaya-Victoria et al. (2022), who included 23% of Peruvian healthcare workers among their study participants, found that the bi-factorial structure of the FCV-19S was invariant with respect to the professional sector (healthcare workers versus worker in other sectors or unemployed individuals). In the specific case of Spain, there is only one study to date that has shown that the unifactorial structure (no other was tested) of the FCV-19S is invariant among those healthcare workers who experienced a change in their functions due to COVID-19 versus those who did not (Llorente-Alonso et al., 2021). However, that study had a small sample size (under 200 participants) comprised almost exclusively of nurses and nursing assistants. Using a relatively large Spanish sample, the present study expands on previous findings and supports that the construct of fear of COVID-19, comprising somatic and emotional dimensions, is invariant not only regarding to gender, age, and professional experience, but also with respect to the professional category of the healthcare workers (i.e., physicians versus nurses). Therefore, the construct assessed by the FCV-19S has the same meaning for these subgroups of healthcare workers, which allows comparison of their levels of fear of COVID-19.
The internal consistency of the FCV-19S was good and similar both to that found by the original developers of the scale (Ahorsu et al., 2020a, b) and to that obtained by the authors of the Spanish version used in the present study (Martínez-Lorca et al., 2020). Focusing specifically on the studies with Spanish-speaking health professionals, the reliability was almost identical to that obtained in Spanish nursing professionals (Llorente-Alonso et al., 2021) but somewhat lower than that of Peruvian professionals (Huarcaya-Victoria et al., 2022).
Concerning the analysis of differences between subgroups of healthcare workers, the results are in line with a systematic review and meta-analysis study which concluded that both females and nursing professionals had significantly higher levels of fear during the COVID-19 pandemic (Pappa et al., 2020). The findings of the present study suggest differences in FCV-19S of small-medium magnitude and concur with those found among both Spanish (Piqueras et al., 2021) and other nationalities (Tsipropoulou et al., 2021). This increased fear of the disease among females could be due to the fact that, as a consequence of a combination of biological, environmental, and socialization-related factors, females generally present higher levels of anxiety and fear throughout the life cycle (McLean & Anderson, 2009). Consistent with other authors (Cabarkapa et al., 2020), the present study found higher levels of fear among nurses than in physicians, although the magnitude of these differences was small. Some researchers (Pappa et al., 2020) propose that this could be due to the increased risk of exposure to COVID-19 patients as a consequence of staying longer and being in closer contact with patients (e.g., biological sample collections for virus detection) (Pappa et al., 2020). Regarding age, the results of those studies that explored differences in the levels of fear of COVID-19 in relation to this variable are not very consistent. In the general population, some studies have found higher levels of fear among middle-aged adults (40–49 years) (Piqueras et al., 2021), while others found that fear was higher but only among individuals aged 75 years or older (Tsipropoulou et al., 2021). The results obtained with the FCV-19S in the present study are consistent with research showing that emotional symptoms associated with COVID-19 are more adverse among younger medical professionals (Hameed et al., 2023b).
Among the few studies with healthcare professionals, only one explored this variable and found that age predicted the level of fear of COVID-19 among Italian healthcare workers (Troisi et al., 2021). Although it had a small effect size, the results of the present study indicated that the levels of fear were higher among healthcare professionals who were 40 years of age or younger than among those who were older than 40 years. It is possible that these modest differences can be explained by the professional category because the percentage of nurses was higher (87.3%) among younger professionals compared to those over 40 years of age (70.5%). This issue should be further explored in future studies.
Regarding convergent and discriminant validity, the present results showed that the FCV-19S had significant associations with anxiety, depression and stress symptomatology at both T1 and T2 (one year after). Previous evidence obtained in the study of the original scale (Ahorsu et al., 2020a, b), in the general Spanish-speaking population (Barrios et al., 2021), and among Spanish healthcare professionals (Llorente-Alonso et al., 2021) indicated that the fear of COVID-19 is consistently related to the presence of mood disorders. Studies specifically using the DASS-21 instrument to assess symptoms of anxiety, depression and stress (Satici et al., 2021; Bitan et al., 2020) have also found significant associations between FCV-19S and these three types of mood symptoms. However, unlike the present study, their authors found that the symptom that was least strongly related was depression (rather than stress). Although this should be confirmed in future studies, this could be related to possible differences between the general population and healthcare professionals. Furthermore, the results concur with those of the only study that explored how the emotional and somatic dimensions of FCV-19S related to these three mood symptoms (Bitan et al., 2020), showing that, while both dimensions maintain similar associations with depression and stress symptomatology, the FCV-19S somatic dimension is more closely related than the dimension of anxiety symptoms. Although of lesser magnitude, this pattern of relationships with anxiety, depression, and stress symptomatology of the healthcare workers was maintained over a one-year period. These findings are in line with those obtained in the only longitudinal study carried out with the current scale, which also reported associations of greater magnitude with anxiety than with depression (Waddimba et al., 2023).
Consistent with previous research using the FCV-19S both globally (Ahorsu et al., 2020a, b) and differentiating both dimensions (Iversen et al., 2022), the results of the present study also showed that increased emotional and somatic COVID-19 fear responses are relatively weakly associated with poorer perceived general health. The present study also explored whether fear of COVID-19 could essentially be reduced to individuals experiencing worry about their own and loved ones’ contagion. As found in other studies (Iversen et al., 2022), the FCV-19S and its dimensions showed relationships of moderate magnitude with this type of worry, being closer in the case of worry about individuals infecting themselves. The associations between FCV-19S and worry about self-infection were somewhat lower than those obtained by Iversen et al. (2022), which could perhaps be due to the fact that healthcare workers experience the possibility of infection as more ordinary and natural than the general population does. Therefore, the results of the convergent and divergent validity analysis suggest that although the construct of fear of COVID-19 is related to perceptions of an individual’s own health and its vulnerability, it seems to be something conceptually distinct and more complex that involves both emotional and somatic aspects of the individual in relation to the COVID-19 and the implications of contracting the virus.
The Spanish version of the FCV-19S (Martínez-Lorca et al., 2020) also exhibited adequate incremental validity among the present sample of Spanish healthcare professionals, explaining significant percentages of additional variance after controlling for occupational and sociodemographic variables in the fear of COVID-19’s relationship with anxiety, stress, depression, and burnout. Although some previous studies have suggested that the FCV-19S has predictive capacity on both anxious-depressive (Llorente-Alonso et al., 2021; Satici et al., 2021) and stressful symptomatology (Piqueras et al., 2021; Satici et al., 2021), only Llorente-Alonso et al. (2021) and Piqueras et al. (2021) have found incremental validity of this construct with respect to psychological symptomatology, above and beyond aspects such as psychological empowerment and maladaptive coping, respectively (Llorente-Alonso et al., 2021; Piqueras et al., 2021). The results of the present study go in the same direction and show that, beyond demographic and occupational factors, the dimensions of the FCV-19S manage to explain a non-negligible proportion of additional variance in symptoms of stress, depression and, especially, anxiety.
In the case of burnout, more empirical evidence has been accumulated among health professionals about the incremental validity of the FCV-19S, with respect to the contribution made by sociodemographic and professional variables, in relation to this professional syndrome (Pang et al., 2022; Stefanatou et al., 2022). The present results are consistent with the findings of these studies. Additionally, they find that emotional exhaustion is the burnout component that shows the strongest and most permanent independent association with fear of COVID-19 (especially with the FCV-19S emotional dimension). In fact, even without exploring incremental validity, other authors have found that emotional exhaustion was the burnout dimension most strongly associated with fear of COVID-19 among medical personnel (Abdelghani et al., 2020). Therefore, it could be hypothesized that feelings of fear, nervousness and discomfort concerning illness, due to their demotivating effect, are more strongly associated with the perception that personal resources (emotional and physical) are exceeded than with a response of psychological distance from healthcare work and patients (i.e., cynicism) or with feelings of reduced competence and achievement at work (i.e., low personal accomplishment) (Algunmeeyn et al., 2020).
The findings of the present study also indicate that both the emotional and somatic response to fear of COVID-19 are factors capable of influencing the degree of burnout and psychological symptomatology among healthcare professionals to a higher extent than such determining aspects for this group as gender, age, professional category or work overload (Chutiyami et al., 2021). Moreover, the longitudinal results of the present study suggest that this level of fear of disease also has a specific impact on these well-being variables even after a period of one year has elapsed.
In relation to criterion validity, the level of fear of COVID-19 (both the total score and its two dimensions) was significantly higher among healthcare professionals experiencing high burnout, among those with generalized anxiety disorder (GAD), among those who had considered leaving the profession, and among those who had received psychological assistance. These differences were of particular magnitude for emotional exhaustion and GAD, and of moderate magnitude among those with thoughts of leaving the profession. However, to the best of the present authors’ knowledge, although there are no studies with healthcare personnel that have explored these differences, there is evidence of significantly higher scores on the FCV-19S among university students doing healthcare degrees who reported feeling more anxious and exhausted than usual during the pandemic (Zolotov et al., 2022). Therefore, considering the scale’s brevity, this instrument may help in future waves of disease and/or pandemics to identify those healthcare professionals who are at high risk of suffering burnout and anxiety or leaving their profession. It is specifically these at-risk professionals who would be the highest priority to treat through interventions aimed at improving mental health (Chutiyami et al., 2021). It is necessary to assess the vulnerability of health professionals to the fear of COVID-19 in order to establish interventions that protect their mental health. However, for these potential interventions to be effective, they must be developed and implemented with consideration for the cultural context (e.g., by studying their Hofstede's cultural dimensions) in which they will be employed (Shetty et al., 2023), in addition to the health aim and target professional group. Through the present study, the implication that the fear of COVID-19 was associated with burnout was found, establishing the need to assess the fear of healthcare professionals in order to avoid subsequent negative psycho-emotional consequences. Furthermore, any effort or initiative aimed at safeguarding the mental health of the healthcare workers will be even more imperative when dealing with confinement and quarantine scenarios associated with infectious diseases like COVID-19 (Hameed et al., 2023a, b).
Considerations and implications of the use of FCV-19S in Spanish healthcare professionals
Essential considerations regarding the characteristics of participants and the healthcare context must precede the practical use of FCV-19S in healthcare staff. First, the different proportion of healthcare professionals of both genders might seem a priori to be a point of improvement in this research. However, as a reflection of the gender distribution of the health sector, the fact that our study was predominantly female is consistent with World Health Organization data indicating women make up 70% of healthcare professionals (Boniol et al., 2019), a proportion that reaches 84% in the case of Spanish nurses (Instituto de la Mujer, 2020). This gender perspective is crucial because of the particular toll the pandemic has had on women, particularly those in lower paid medical roles, who experienced greater psychological distress (Lopez-Atanes et al., 2021). Concurrently, given that Spain has a decentralized healthcare system divided into 17 autonomous regions (each with its own authority in health matters), it is likely that, as has been demonstrated in previous instances (Campos et al., 2016), the effectiveness of the strategies implemented against COVID-19 in each region has been heterogeneous. Therefore, the confirmed variability in aspects such as transparency in political decisions or the communication of recommended preventive measures during the pandemic (Peña-Ramos et al., 2021) may have differently impacted (depending on the region) the perception of healthcare professionals regarding their working conditions and feeling of helplessness during this health crisis, consequently influencing their levels of fear of COVID-19. Taking this into account, the FCV-19S might be used to track the degree of fear towards the disease in different regions of the nation, acting as an instrument to pinpoint those health policies and strategies that result in a greater or lesser extent of vulnerability among healthcare staff.
In light of the present findings, healthcare organizations might use the FCV-19S as a preventative tool to not only monitor the somatic and emotional aspects of the fear of the disease among staff but also to early identify those professionals at a higher risk of mental health impairment. This could inform the design of targeted interventions, such as tailored mental health support or workload adjustments, to prevent attrition. Policymakers, on the other hand, might use these insights to shape healthcare workforce policies, focusing on mental health maintenance, professional development, and career sustainability in the face of present and upcoming healthcare challenges.
Limitations
There were several limitations in the present study, such as the use of a non-representative convenience sample of the Spanish healthcare professionals. This may have led to participant’s self-selection bias, potentially skewing the representation towards individuals more affected or interested in mental health due to the pandemic. In addition, the use of an online survey could have biased the sample towards a larger number of young participants (Zhang et al., 2023). Consequently, the results of the present validation study cannot necessarily be generalized to other population groups (e.g., health workers of other nationalities) without caution. Therefore, it is suggested that future studies focus on replicating the present findings in more diverse samples (e.g., with greater numbers of male healthcare workers and physicians, etc.). Moreover, although subjective experience is very important in psychological phenomena (Robinson et al., 2013), using self-report measures is also a limitation, since these measures are more susceptible to social desirability bias. Subsequent research utilizing the FCV-19S ought to control for social desirability bias among healthcare workers, since there could be a potential underestimation of their fear level of the disease, influenced by the self-stigma in the sector about manifesting psychological symptoms and pursuing psychological assistance (Huang et al., 2023). For a more comprehensive assessment of fear of COVID-19, in the future, the use of the FCV-19S could be combined with external observer rating or with the measurement of fear biomarkers (Waddimba et al., 2023). Despite the fact that one of the strengths of the present study is that it included longitudinal data for some of the variables, this does not allow the delineation of causal relationships between the variables. Additionally, since fear of COVID-19 was only assessed at T1, the present study was unable to assess FCV-19S stability over time. Therefore, considering that the study by Waddimba et al. (2023) remains the sole investigation into the temporal evolution of the FCV-19S to date, it becomes imperative for upcoming research endeavors to integrate test–retest reliability analyses. This inclusion will not only bolster the credibility of the research but also enhance our understanding of how the FCV-19S performs over time in different settings. Lastly, another limitation is not having employed other instruments specifically designed for use in the context of this health crisis, assessing variables such as anxiety or grief linked to COVID-19 (Kim et al., 2023; Zhang et al., 2023). This restricts our ability to identify specific vulnerability subgroups among healthcare staff related to the pandemic, beyond the fear of the disease measured by the FCV-19S.
Conclusion
Despite the aforementioned limitations, the present study demonstrates that the FCV-19S has a two-factor structure with consistent psychometric properties among Spanish health professionals, in addition to showing its important role as a risk variable associated with mental health symptoms, general health perception, burnout, thoughts of leaving the profession, and receiving of psychological assistance, even in prospective measures one year after its evaluation. Its factorial invariance is a strength of the instrument which allows its use in health professions irrespective of gender, professional category, age, and professional experience. Future lines of research are needed to develop programs or protocols aimed at protecting or strengthening the emotional health of healthcare professionals confronted at the bedside with infectious diseases such as COVID-19.
Data availability
The data that support the findings of this study is accessible via the Open Science Framework (https://osf.io/9tus4/?view_only=d7f5cfeab716411ab126577dd7687df8).
References
Abdelghani, M., El-Gohary, H. M., Fouad, E., & Hassan, M. S. (2020). Addressing the relationship between perceived fear of COVID-19 virus infection and emergence of burnout symptoms in a sample of Egyptian physicians during COVID-19 pandemic: A cross-sectional study. Middle East Current Psychiatry, 27(1), 70. https://doi.org/10.1186/s43045-020-00079-0
Ahorsu, D. K., Lin, C.-Y., Imani, V., Saffari, M., Griffiths, M. D., & Pakpour, A. H. (2020a). The fear of COVID-19 scale: Development and initial validation. International Journal of Mental Health and Addiction, 20(3), 1537–1545. https://doi.org/10.1007/s11469-020-00270-8
Ahorsu, D. K., Lin, C.-Y., & Pakpour, A. H. (2020b). The association between health status and insomnia, mental health, and preventive behaviors: The mediating role of fear of COVID-19. Gerontology & Geriatric Medicine, 6, 2333721420966081. https://doi.org/10.1177/2333721420966081
Ahorsu, D. K., Lin, C.-Y., Marznaki, Z. H., & Pakpour, A. H. (2022). The association between fear of COVID-19 and mental health: The mediating roles of burnout and job stress among emergency nursing staff. Nursing Open, 9(2), 1147–1154. https://doi.org/10.1002/nop2.1154
Algunmeeyn, A., El-Dahiyat, F., Altakhineh, M. M., Azab, M., & Babar, Z.-U.-D. (2020). Understanding the factors influencing healthcare providers’ burnout during the outbreak of COVID-19 in Jordanian hospitals. Journal of Pharmaceutical Policy and Practice, 13, 53. https://doi.org/10.1186/s40545-020-00262-y
Barrios, I., Ríos-González, C., O’Higgins, M., González-Urbieta, I., García, O., Almirón-Santacruz, J., Navarro, R., Melgarejo, O., Ruiz Díaz, N., Castaldelli-Maia, J. M., Ventriglio, A., & Torales, J. (2021). Psychometric properties of the Spanish version of the fear of COVID-19 scale in Paraguayan population. Irish Journal of Psychological Medicine, 38(4), 266–271. https://doi.org/10.1017/ipm.2021.5
Bitan, D. T., Grossman-Giron, A., Bloch, Y., Mayer, Y., Shiffman, N., & Mendlovic, S. (2020). Fear of COVID-19 scale: Psychometric characteristics, reliability and validity in the Israeli population. Psychiatry Research, 289, 113100.
Boniol, M., McIsaac, M., Xu, L., Wuliji, T., Diallo, K., & Campbell, J. (2019). Gender equity in the health workforce: Analysis of 104 countries (WHO/HIS/HWF/Gender/WP1/2019.1). World Health Organization. Available from: https://www.who.int/publications/i/item/gender-equity-in-the-health-workforce-analysis-of-104-countries
Cabarkapa, S., Nadjidai, S. E., Murgier, J., & Ng, C. H. (2020). The psychological impact of COVID-19 and other viral epidemics on frontline healthcare workers and ways to address it: A rapid systematic review. Brain Behavior Immunity Health, 8, 100144. https://doi.org/10.1016/j.bbih.2020.100144
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.
Campos, M. S., Fernández-Montes, A., Gavilan, J. M., & Velasco, F. (2016). Public resource usage in health systems: A data envelopment analysis of the efficiency of health systems of autonomous communities in Spain. Public Health, 138, 33–40. https://doi.org/10.1016/j.puhe.2016.03.003
Cárdenas Soriano, P., Rodriguez-Blazquez, C., Forjaz, M. J., Ayala, A., Rojo-Perez, F., Fernandez-Mayoralas, G., Molina-Martinez, M.-A., de Arenaza Escribano, C. P., & Rodriguez-Rodriguez, V. (2022). Validation of the Spanish version of the fear of COVID-19 scale (FCV-19S) in long-term care settings. International Journal of Environmental Research and Public Health, 19(23). https://doi.org/10.3390/ijerph192316183
Caycho-Rodríguez, T., Valencia, P. D., Vilca, L. W., Cervigni, M., Gallegos, M., Martino, P., Barés, I., Calandra, M., Rey Anacona, C. A., López-Calle, C., Moreta-Herrera, R., Chacón-Andrade, E. R., Lobos-Rivera, M. E., Del Carpio, P., Quintero, Y., Robles, E., Panza Lombardo, M., Gamarra Recalde, O., Buschiazzo Figares, A.,… Burgos Videla, C. (2022). Cross-cultural measurement invariance of the fear of COVID-19 scale in seven Latin American countries. Death Studies, 46(8), 2003–2017. https://doi.org/10.1080/07481187.2021.1879318
Chen F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Chutiyami, M., Cheong, A. M. Y., Salihu, D., Bello, U. M., Ndwiga, D., Maharaj, R., Naidoo, K., Kolo, M. A., Jacob, P., Chhina, N., Ku, T. K., Devar, L., Pratitha, P., & Kannan, P. (2021). COVID-19 pandemic and overall mental health of healthcare professionals globally: A meta-review of systematic reviews. Frontiers in Psychiatry, 12, 804525. https://doi.org/10.3389/fpsyt.2021.804525
Cohen J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Lawrence Erlbaum Associates.
Crowe, S., Howard, A. F., Vanderspank-Wright, B., Gillis, P., McLeod, F., Penner, C., & Haljan, G. (2021). The effect of COVID-19 pandemic on the mental health of Canadian critical care nurses providing patient care during the early phase pandemic: A mixed method study. Intensive & Critical Care Nursing, 63, 102999. https://doi.org/10.1016/j.iccn.2020.102999
Dadfar, M., Mohagegh, F., Sanadgol, S., & Eslami, M. (2021). The fear of COVID-19 scale (FCV-19S): A study of Iranian students. Mankind Quarterly, 61(3), 707–722. https://doi.org/10.46469/mq.2020.61.1.3
Daza, P., Novy, D. M., Stanley, M. A., & Averill, P. (2002). The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24, 195–205. https://doi.org/10.1023/A:1016014818163
Della Monica, A., Ferrara, P., Dal Mas, F., Cobianchi, L., Scannapieco, F., & Ruta, F. (2022). The impact of Covid-19 healthcare emergency on the psychological well-being of health professionals: A review of literature. Annali Di Igiene: Medicina Preventiva e Di Comunita, 34(1), 27–44. https://doi.org/10.7416/ai.2021.2445
Eid, M., Geiser, C., Koch, T., & Heene, M. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22(3), 541–562. https://doi.org/10.1037/met0000083
García-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Pérez-Páramo, M., López-Gómez, V., Freire, O., & Rejas, J. (2010). Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health and Quality of Life Outcomes, 8, 8. https://doi.org/10.1186/1477-7525-8-8
García-Hedrera, F. J., Gil-Almagro, F., Carmona-Monge, F. J., Peñacoba-Puente, C., Catalá-Mesón, P., & Velasco-Furlong, L. (2021). Intensive care unit professionals during the COVID-19 pandemic in Spain: Social and work-related variables, COVID-19 symptoms, worries, and generalized anxiety levels. Acute and Critical Care, 36(3), 232–241. https://doi.org/10.4266/acc.2021.00213
Garson, G. D. (2012). Structural Equation Modeling. Statistical Associates Publishers.
Gil-Monte, P. R. (2005). Factorial validity of the Maslach Burnout Inventory (MBI-HSS) among Spanish professionals. Revista de Saude Publica, 39(1), 1–8. https://doi.org/10.1590/s0034-89102005000100001
Goodhue, D. L., Lewis, W., & Thompson, R. (2012). Does PLS have advantages for small sample size or non-normal data? MIS Quarterly, 36(3), 981–1001. https://doi.org/10.2307/41703490
Green, Z. A., Noor, U., Ahmed, F., & Himayat, L. (2021). Validation of the fear of COVID-19 scale in a sample of Pakistan’s university students and future directions. Psychological Reports, 125(5), 2709–2732. https://doi.org/10.1177/00332941211016754
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis (7th ed.). Pearson Education Limited.
Hameed, BM, Eraghi, M. M., Filli, M. K., Dash, S., Ibrahim, S., Chandrika, M., & Jajodia, S. (2023a). Mitigating psychological impacts of quarantine during pandemics: A mini review. Journal of Computers, Mechanical and Management, 2(2), 23043. https://doi.org/10.57159/gadl.jcmm.2.2.23043
Hameed, B. M. Z., Talyshinskii, A., Naik, N., Ibrahim, S., Somani, B. K., Shah, M., Singh, A., Eraghi, M. M., Prasad, D., Filli, M. K., Tatkar, N. S., Chlosta, P., and Rai, B. P. (2023b). View of the impact of the COVID-19 pandemic and associated lockdowns on the mental and physical health of urologists. The Impact of the COVID-19 Pandemic and Associated Lockdowns on the Mental and Physical Health of Urologists, 2(2), 23045. https://doi.org/10.57159/gadl.jcmm.2.2.23045
Hawley, C. E., Iwanaga, K., Marmor, A., Adams, M., Schwartz, I., Sviri, S., Armstrong, A. J., Shiri, S., & Meiner, Z. (2022). Assessing the fear of COVID-19 scale among health care workers in Israel: A psychometric validation study. Death Studies, 46(10), 2530–2535. https://doi.org/10.1080/07481187.2021.1975175
Haynes, S. N., & Lench, H. C. (2003). Incremental validity of new clinical assessment measures. Psychological Assessment, 15(4), 456–466. https://doi.org/10.1037/1040-3590.15.4.456
Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternative. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Huang, R., Peng, X., Yu, S., Tian, Y., & Gao, C. (2023). Attitudes and intentions toward seeking professional psychological help among Chinese healthcare workers during the COVID-19 pandemic. Frontiers in Psychiatry, 14, 1223895. https://doi.org/10.3389/fpsyt.2023.1223895
Huarcaya-Victoria, J., Villarreal-Zegarra, D., Podestà, A., & Luna-Cuadros, M. A. (2022). Psychometric properties of a Spanish version of the fear of COVID-19 scale in general population of Lima, Peru. International Journal of Mental Health and Addiction, 20(1), 249–262. https://doi.org/10.1007/s11469-020-00354-5
Instituto de la Mujer (2020). La perspectiva de género, esencial en la respuesta a la COVID-19. Catálogo publicaciones la Administración General del Estado. (2020). Available from: https://www.inmujeres.gob.es/actualidad/noticias/2020/Mayo/InformeCOVID19.htm
Iversen, M. M., Norekvål, T. M., Oterhals, K., Fadnes, L. T., Mæland, S., Pakpour, A. H., & Breivik, K. (2022). Psychometric properties of the Norwegian version of the fear of COVID-19 scale. International Journal of Mental Health and Addiction, 20(3), 1446–1464. https://doi.org/10.1007/s11469-020-00454-2
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2014). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/10.1177/0049124114543236
Kim, J. H., Park, C. H. K., Ahmed, O., Hong, Y., Chung, S., Park, J., & Lee, S. A. (2023). Validation of the healthcare workers’ version of the pandemic grief scale among frontline nursing professionals during the COVID-19 pandemic in Korea. Frontiers in Psychiatry, 14, 1121546. https://doi.org/10.3389/fpsyt.2023.1121546
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). The Guilford Press.
Lin, C. Y., Griffiths, M. D., & Pakpour, A. H. (2023). Psychometric properties of the fear of COVID-19 scale: A response to Mercado-Lara et al. “Validity and reliability of the Spanish version of fear of COVID-19 scale in Colombian Physicians.” International Journal of Mental Health and Addiction, 21(2), 973–975. https://doi.org/10.1007/s11469-021-00635-7
Llorente-Alonso, M., García-Ael, C., Topa, G., Sanz-Muñoz, M. L., Muñoz-Alcalde, I., & Cortés-Abejer, B. (2021). Can psychological empowerment prevent emotional disorders in presence of fear of COVID-19 in health workers? A cross-sectional validation study. Journal of Clinical Medicine, 10(8). https://doi.org/10.3390/jcm10081614
López-Atanes, M., Pijoán-Zubizarreta, J. I., González-Briceño, J. P., Leonés-Gil, E. M., Recio-Barbero, M., González-Pinto, A., Segarra, R., & Sáenz-Herrero, M. (2021). Gender-based analysis of the psychological impact of the COVID-19 pandemic on healthcare workers in Spain. Frontiers in Psychiatry, 12, 692215. https://doi.org/10.3389/fpsyt.2021.692215
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3), 335–343. https://doi.org/10.1016/0005-7967(94)00075-u
Magano, J., Vidal, D. G., Sousa, H. F. P. E., Dinis, M. A. P., & Leite, Â. (2021). Validation and psychometric properties of the Portuguese version of the Coronavirus Anxiety Scale (CAS) and fear of COVID-19 scale (FCV-19S) and associations with travel, tourism and hospitality. International Journal of Environmental Research and Public Health, 18(2), 427. https://doi.org/10.3390/ijerph18020427
Mailliez, M., Griffiths, M. D., & Carre, A. (2022). Validation of the French version of the fear of COVID-19 scale and its associations with depression, anxiety, and differential emotions. International Journal of Mental Health and Addiction, 20(4), 2057–2071. https://doi.org/10.1007/s11469-021-00499-x
Martínez-Lorca, M., Martínez-Lorca, A., Criado-Álvarez, J. J., Armesilla, M. D. C., & Latorre, J. M. (2020). The fear of COVID-19 scale: Validation in Spanish university students. Psychiatry Research, 293, 113350. https://doi.org/10.1016/j.psychres.2020.113350
Maslach, C., Jackson, S., & Leiter, M. (1997). The Maslach Burnout Inventory Manual. In C. P. Zalaquett, & R. J. Wood (Eds.), Evaluating Stress: A Book of Resources (Vol. 3, pp. 191–218). Scarecrow Press.
Masuyama, A., Shinkawa, H., & Kubo, T. (2022). Validation and psychometric properties of the Japanese version of the fear of COVID-19 scale among adolescents. International Journal of Mental Health and Addiction, 20(1), 387–397. https://doi.org/10.1007/s11469-020-00368-z
McLean, C. P., & Anderson, E. R. (2009). Brave men and timid women? A review of the gender differences in fear and anxiety. Clinical Psychology Review, 29(6), 496–505. https://doi.org/10.1016/j.cpr.2009.05.003
Mercado-Lara, M. F., Campo-Arias, A., & Monterrosa-Castro, Á. (2022). Validity and reliability of the Spanish version of fear of COVID-19 scale in Colombian physicians. International Journal of Mental Health and Addiction, 20(2), 1122–1129. https://doi.org/10.1007/s11469-020-00430-w
Merino-Plaza, M. J., Carrera-Hueso, F. J., Arribas-Boscá, N., Martínez-Asensi, A., Trull-Maravilla, E., & Fikri-Benbrahim, N. (2018). Burnout in the staff of a chronic care hospital. Revista de Saude Publica, 52, 45. https://doi.org/10.11606/s1518-8787.2018052000242
Min, H., Kim, J., Moon, K., Lee, S., Kim, J.-Y., & Ko, Y.-G. (2022). Development and validation of COVID-19 impact scale. BMC Psychology, 10(1), 88. https://doi.org/10.1186/s40359-022-00793-w
Mobbs, D., Adolphs, R., Fanselow, M. S., Barrett, L. F., LeDoux, J. E., Ressler, K. J., & Tye, K. M. (2019). Viewpoints: Approaches to defining and investigating fear. Nature Neuroscience, 22(8), 1205–1216. https://doi.org/10.1038/s41593-019-0456-6
Nazari, N., Safitri, S., Usak, M., Arabmarkadeh, A., & Griffiths, M. D. (2021). Psychometric validation of the Indonesian version of the fear of COVID-19 scale: Personality traits predict the fear of COVID-19. International Journal of Mental Health and Addiction, 1–17. https://doi.org/10.1007/s11469-021-00593-0
Pang, N. T. P., Hadi, N. M. N., Mohaini, M. I., Kamu, A., Ho, C. M., Koh, E. B. Y., Loo, J. L., Theng, D. Q. L., & Wider, W. (2022). Factors contributing to burnout among healthcare workers during COVID-19 in Sabah (East Malaysia). Healthcare, 10(6), 1068. https://doi.org/10.3390/healthcare10061068
Pappa, S., Ntella, V., Giannakas, T., Giannakoulis, V. G., Papoutsi, E., & Katsaounou, P. (2020). Prevalence of depression, anxiety, and insomnia among healthcare workers during the COVID-19 pandemic: A systematic review and meta-analysis. Brain, Behavior, and Immunity, 88, 901–907. https://doi.org/10.1016/j.bbi.2020.05.026
Peña-Ramos, J. A., Recuero-López, F., Sánchez-Bayón, A., & Sastre, F. J. (2021). Evaluation of Spanish health system during the COVID-19 pandemic: accountability and wellbeing results. International Journal of Environmental Research and Public Health, 18(24), 12907. https://doi.org/10.3390/ijerph182412907
Perz, C. A., Lang, B. A., & Harrington, R. (2022). Validation of the fear of COVID-19 scale in a US college sample. International Journal of Mental Health and Addiction, 20(1), 273–283. https://doi.org/10.1007/s11469-020-00356-3
Pinilla, J., Barber, P., Vallejo-Torres, L., Rodríguez-Mireles, S., López-Valcárcel, B. G., & Serra-Majem, L. (2021). The economic impact of the SARS-COV-2 (COVID-19) pandemic in Spain. International Journal of Environmental Research and Public Health, 18(9), 4708. https://doi.org/10.3390/ijerph18094708
Piqueras, J. A., Gomez-Gomez, M., Marzo, J. C., Gomez-Mir, P., Falco, R., & Valenzuela, B. (2021). Validation of the Spanish version of fear of COVID-19 scale: Its association with acute stress and coping its association with acute stress and coping. International Journal of Mental Health and Addiction, 1–18. https://doi.org/10.1007/s11469-021-00615-x
Priede, A., Ópez-Álvarez, I., Carracedo-Sanchidrián, D., & González-Blanch, C. (2021). Mental health interventions for healthcare workers during the first wave of COVID-19 pandemic in Spain. Revista de Psiquiatría y Salud Mental (English Edition), 14(2), 83–89. https://doi.org/10.1016/j.rpsmen.2021.05.004
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review: DR, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Reznik, A., Gritsenko, V., Konstantinov, V., Khamenka, N., & Isralowitz, R. (2021). COVID-19 fear in Eastern Europe: validation of the fear of COVID-19 scale. International Journal of Mental Health and Addiction, 19(5), 1903–1908. https://doi.org/10.1007/s11469-020-00283-3
Robinson, M. E., Staud, R., & Price, D. D. (2013). Pain measurement and brain activity: Will neuroimages replace pain ratings? The Journal of Pain, 14(4), 323–327. https://doi.org/10.1016/j.jpain.2012.05.007
Rönkkö, M., & Cho, E. (2020). An updated guideline for assessing discriminant validity. Organizational Research Methods, 25(1), 6–14. https://doi.org/10.1177/1094428120968614
Rönkkö, M., McIntosh, C. N., Antonakis, J., & Edwards, J. R. (2016). Partial least squares path modeling: Time for some serious second thoughts. Journal of Operations Management, 47–48, 9–27. https://doi.org/10.1016/j.jom.2016.05.002
Satici, B., Gocet-Tekin, E., Deniz, M. E., & Satici, S. A. (2021). Adaptation of the fear of COVID-19 scale: Its association with psychological distress and life satisfaction in Turkey. International Journal of Mental Health and Addiction, 19(6), 1980–1988. https://doi.org/10.1007/s11469-020-00294-0
Shetty, D. K., Maddodi, C. B., Hameed, B. M. Z., Shah, M., Ibrahim, S. I., Sharma, A., Paul, R., Chłosta, P., & Somani, B. (2023). Leveraging Hofstede’s cultural dimensions for devising COVID-19 Control Strategies. Journal of Computers, Mechanical and Management, 2(1), 47–60. https://doi.org/10.57159/gadl.jcmm.2.1.23032
Soraci, P., Ferrari, A., Abbiati, F. A., Del Fante, E., De Pace, R., Urso, A., & Griffiths, M. D. (2022). Validation and psychometric evaluation of the Italian version of the fear of COVID-19 scale. International Journal of Mental Health and Addiction, 20(4), 1913–1922. https://doi.org/10.1007/s11469-020-00277-1
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Stănculescu, E. (2022). Fear of COVID-19 in Romania: Validation of the Romanian version of the fear of COVID-19 scale using graded response model analysis. International Journal of Mental Health and Addiction, 20(2), 1094–1109. https://doi.org/10.1007/s11469-020-00428-4
Stefanatou, P., Xenaki, L.-A., Karagiorgas, I., Ntigrintaki, A.-A., Giannouli, E., Malogiannis, I. A., & Konstantakopoulos, G. (2022). Fear of COVID-19 impact on professional quality of life among mental health workers. International Journal of Environmental Research and Public Health, 19(16). https://doi.org/10.3390/ijerph19169949
Troisi, A., Nanni, R. C., Riconi, A., Carola, V., & Di Cave, D. (2021). Fear of COVID-19 among healthcare workers: The role of neuroticism and fearful attachment. Journal of Clinical Medicine, 10(19). https://doi.org/10.3390/jcm10194358
Tsipropoulou, V., Nikopoulou, V. A., Holeva, V., Nasika, Z., Diakogiannis, I., Sakka, S., Kostikidou, S., Varvara, C., Spyridopoulou, E., & Parlapani, E. (2021). Psychometric properties of the greek version of FCV-19S. International Journal of Mental Health and Addiction, 19(6), 2279–2288. https://doi.org/10.1007/s11469-020-00319-8
Ullah, I., Tahir, M. J., Ali, S., Waseem, R., Griffiths, M. D., Mamun, M. A., Lin, C.-Y., & Pakpour, A. H. (2021). COVID-19 Fear among Pakistanis: Psychometric evaluation of the fear of COVID-19 scale using item response theory and confirmatory factor analysis. International Journal of Mental Health and Addiction, 1–16. https://doi.org/10.1007/s11469-021-00656-2
Waddimba, A. C., DeSpain, S., Bennett, M. M., Douglas, M. E., & Warren, A. M. (2023). Longitudinal validation of the Fear of COVID-19 scale in a nationwide United States sample: An item response theory model across three inflection points of the pandemic. Stress and Health. https://doi.org/10.1002/smi.3259
Winter, T., Riordan, B. C., Pakpour, A. H., Griffiths, M. D., Mason, A., Poulgrain, J. W., & Scarf, D. (2023). Evaluation of the English version of the fear of COVID-19 scale and its relationship with behavior change and political beliefs. International Journal of Mental Health and Addiction, 21(1), 372–382. https://doi.org/10.1007/s11469-020-00342-9
Yang, W., Li, P., Huang, Y., Yang, X., Mu, W., Jing, W., Ma, X., & Zhang, X. (2022). Cross-cultural adaptation and validation of the fear of COVID-19 Scale for Chinese university students: A cross-sectional study. International Journal of Environmental Research and Public Health, 19(14). https://doi.org/10.3390/ijerph19148624
Zhang, D., Wang, C., Yuan, T., Li, X., Yang, L., Huang, A., Li, J., Liu, M., Lei, Y., Sun, L., Zhang, J., & Zhang, L. (2023). Psychometric properties of the Coronavirus Anxiety Scale based on Classical Test Theory (CTT) and Item Response Theory (IRT) models among Chinese front-line healthcare workers. BMC Psychology, 11(1), 224. https://doi.org/10.1186/s40359-023-01251-x
Zolotov, Y., Reznik, A., Bender, S., & Isralowitz, R. (2022). COVID-19 fear, mental health, and substance use among Israeli university students. International Journal of Mental Health and Addiction, 20(1), 230–236. https://doi.org/10.1007/s11469-020-00351-8
Acknowledgements
Special thanks to all the healthcare personnel who participated in this study making it possible and who, during this time, have carried out their healthcare activity with COVID-19 patients. We would also like to thank all those who, in addition to participating in the study, helped in the dissemination of the questionnaire, thus making it possible to reach the greatest number of professionals. Special thanks to the Ethics Committee belonging to the Primary Care area, which showed special interest in our study.
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research has been carried out without funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical approval
The study was approved by the Ethics and Clinical Research Committee of the reference hospital of the research team and informed consent was obtained from the participants before the questionnaire was administered. In order to disseminate the study through Primary Care, the study was approved, in turn, by the Central Research Committee. This study was conducted in accordance with the national and international guidelines of the code of ethics, the declaration of Helsinki, the code of good practice, and SAS Order 3470/2009. The processing of personal data collected in this study complied with the Organic Law 15/1999 of 13 December on the Protection of Personal Data (LOPD) and with Regulation (EU) No. 2016/679 of the European Parliament and of the Council of 27 April 2016 on Data Protection (GDPR). All information collected, stored and processed has been collected anonymously.
Patient consent for publication
Participants consented to the publication of the results.
Conflicts of interest
The authors declare that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Cecilia Peñacoba-Puente and Octavio Luque-Reca shared co-first authorship.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Peñacoba-Puente, C., Luque-Reca, O., Griffiths, M.D. et al. The effects of fear of COVID-19 among Spanish healthcare professionals in three years after the pandemic onset via validation of the FCV-19S: a prospective study. Curr Psychol (2024). https://doi.org/10.1007/s12144-024-06113-2
Accepted:
Published:
DOI: https://doi.org/10.1007/s12144-024-06113-2