Abstract
Purpose
To evaluate compulsive exercise, researchers often rely on the widely used Compulsive Exercise Test (CET). However, the measure has shown unstable factor structure in several validation studies and is not available in Portuguese for use in Brazil. We aimed to describe the translation and cultural adaptation of the CET to Brazilian Portuguese, to test several factor structures among Brazilian and US samples of men and women, to test measurement invariance across countries, and to evaluate its internal consistency. Furthermore, we sought to evaluate convergent validity, correlating the CET with a measure of eating disorder symptoms, and to compare compulsive exercise symptoms between countries.
Methods
Four models of the latent structure of the CET were tested using confirmatory factor analyses (CFAs), three-factor structure with 15 items, three-factor structure with 18 items, four-factor structure with 21 items, and the original five-factor structure with 24 items, in a sample of 1,531 young adults (601 Brazilians and 930 Americans), aged 18–35 years.
Results
A series of CFAs demonstrated that the three-factor structure with 15 items showed a better fit to the data. This model demonstrated good convergent validity and internal consistency. Results from the CET multigroup CFA showed evidence for the invariance at the configural, metric, and scalar levels across Brazilians and Americans. Furthermore, significant differences were found between Brazilians and Americans, with Brazilians demonstrating higher scores on the Avoidance and rule-driven behavior and Mood improvement subscales, whereas US participants scored higher on the Weight control exercise subscale.
Conclusions
Results support the three-factor structure with 15 items to be used as a measure of compulsive exercise among Brazilians and Americans, allowing cross-cultural comparisons between these countries.
Level of evidence
Level V, Cross-sectional, Psychometric study.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Dysfunctional exercise encompasses behaviors or exercise routines considered harmful to health, such as exercise dependence, compulsive exercise, excessive exercise, exercise addiction [1,2,3,4,5]. Compulsive exercise can be understood as a driven behavior that is not easily interrupted or reduced [6]. It is not just uncontrolled exercise behaviors that classify compulsive exercise, but the motivation for which it is practiced [7]. It is believed that dissatisfaction with body weight and shape are the biggest motivators for maintaining exercise in compulsive exercise [6]. The compulsive exercise model proposed by Meyer and colleagues [6] suggests compulsive exercise as a condition characterized by an association of concerns about weight and body shape and continued engagement in order to alleviate extreme guilt and/or negative affect when exercise is carried out, and to avoid exercise withdrawal.
A recent systematic review identified 17 different dysfunctional exercise screening measures [8]. Of these, only six were classified as measures of compulsive exercise behaviors. These are: the Obligatory Exercise Questionnaire (OEQ) [9] and its later versions [10,11,12], the Excessive Exercise Scale (EES) [13], and the Compulsive Exercise Test (CET) [14].
Compulsive exercise has been proposed as one of the maladaptive elements that may relate to the development and maintenance an eating disorder [15]. Research shows that up to 80% of individuals with anorexia nervosa and 40% of individuals with bulimia nervosa report dysfunctional exercise behaviors [15,16,17]. Given the strong association between compulsive exercise and eating disorders in clinical and epidemiological data [15, 18], the CET has been widely used [19] to assess compulsive exercise behaviors. The measure was developed to assess the main factors for compulsive exercise, given the lack of an instrument that was sensitive to issues of connection between eating disorders and dysfunctional exercise [14]. Most of the available dysfunctional exercise measures were developed based on their addictive characteristics [8].
The Compulsive Exercise Test (CET)
The CET [14] is a measure of compulsive exercise composed of 24 items. Through principal component analysis with oblique oblimin rotation, Taranis et al. [14] found a five-factor structure: Avoidance and rule-driven behavior (items 9, 10, 11, 15, 16, 20, 22, and 23), Weight control exercise (items 2, 6, 8, 13, and 18), Mood improvement (items 1, 4, 14, 17, and 24), Lack of exercise enjoyment (items 5, 12, and 21), and Exercise rigidity (items 3, 7, and 19). The CET showed good internal consistency, content validity, and concurrent validity among university women from the United Kingdom and Australia [14]. The CET also demonstrated strong positive associations with a measure of eating disorders pathology (the Eating Disorder Inventory) [20] and another measure of dysfunctional exercise (the Commitment to Exercise Scale) [21].
The CET has been tested in athletes [22], adolescents [23,24,25], regular exercisers [26], university students [27], and adults diagnosed with eating disorders [4, 28,29,30,31]. It is worth noting that the original five factors structure with 24 items has rarely been confirmed [22, 26, 27]. In fact, only Goodwin et al. [24] was able to reproduce the original factorial structure. However, it must be noted that both Taranis et al. [14] and Goodwin et al. [24] performed principal component analysis (PCA) instead of factor analysis, and that the original factor structure was not confirmed through subsequent analysis (e.g., confirmatory factor analysis—CFA).
Principal component analysis (PCA) is a statistical method that aims to reduce the number of variables observed in “principal components,” while retaining as much variance as possible from the original item, while considering both common and specific variance [32, 33]. On the other hand, exploratory factor analysis (EFA) identifies the latent constructs and the underlying factor structure of a set of variables while taking into account only the common variance [32, 33]. Although both techniques have similarities, and in some cases, present similar results, they have different purposes [34].
Furthermore, during the development of the CET, Taranis et al. [14] found that the Lack of exercise enjoyment subscale did not correlate with the CET total score (r = 0.10, p > 0.05), indicating that this subscale was perhaps not significant as a measure of compulsive exercise. In fact, Plateau et al. [22] tested the CET among athletes finding a three-factor structure with 15 items after excluding all items from the Lack of exercise enjoyment and Exercise rigidity subscales. Rica et al. [27] also found good adjustment indices using the structure proposed by Plateau et al. [22] in a Spanish sample of university students. Interestingly, the study by Goodwin et al. [24] also highlights some concerns regarding the CET items. For example, item #11 (“I usually continue to exercise despite injury or illness, unless I am very ill or too injured”) and item #15 (“If I miss an exercise session, I will try and make up for it when I next exercise”)—from the Avoidance and rule-driven behavior subscale—showed low factor loadings. Low factor loadings were also found for eight items in the study of Vrabel and Bratland-Sanda [30] among adults diagnosed with eating disorders. Despite that, both Goodwin et al. [24] and Vrabel and Bratland-Sanda [30] chose to keep problematic items, which is a concern according to some guidelines [34].
Given the lack of consensus of the best factor structure of the CET, Limburg et al. [26] proposed to analyze and compare several different structures of the instrument (i.e., one-factor solution with a total of 18, 21, or 24 items; three-factors with a total of 18 items; four-factors with a total of 21 items; and a five-factor structure with a total of 24 items). Although the authors claim that all structures tested are adequate [26], most of the adjustment fit indices found were below recommended and acceptable values [35]. In fact, results show that the three-factor solution with 18 items (i.e., excluding the Lack of exercise enjoyment and Exercise rigidity subscales) was the most parsimonious one [26]. Although, Plateau et al. [22] and Limburg's [26] had found a three-factor solution, Plateau et al. [22] chose to exclude items that did not present adequate factor loading (i.e., items #8, #11 and #15).
Interestingly, Schlegl et al. [29] found a better fit of four-factor [26] and three-factor [22] solutions compared to the original five-factor model [14] in a large clinical sample of adolescent and adult inpatients with anorexia nervosa and bulimia nervosa. These authors also tested measurement invariance of the CET across diagnosis and age group. Not surprisingly, results show that only three subscales were satisfactorily invariant to measurement (i.e., Avoidance and rule-driven behavior, Weight control exercise, and Mood improvement subscales), but not the CET total score [29].
Measurement invariance of the CET was also evaluated across athletes performing at competitive levels [27]. However, the invariance of the CET across different linguistic and cultural contexts had not been explored. Given the results, it was recommended to further explore and/or revise the original CET, including investigation in other samples.
Additionally, it’s worth noting that the CET has been applied in clinical [4, 28,29,30,31] and non-clinical samples [14, 22,23,24,25,26,27]. When applied in clinical samples with ED the factors driving compulsive exercise differ according ED diagnostic subtype, so this should be taken into account during ED treatment [28]. In non-clinical samples, sensitivity analysis is necessary to assess patients with high risk factor for compulsive exercise and ED. Given all the concerns regarding the factorial structure of the CET, many researchers choose to use its factors in isolation, not the total score [22, 26].
The present study
Given the lack of stability of the CET factorial structure described in the literature, as well as the lack of a Brazilian Portuguese version of the CET, the objectives of this research were: (a) to examine the factor structure (i.e., CFAs) of previous CET models [14, 22, 26]; (b) to evaluate the convergent validity of the CET with a measure of eating disorder symptoms, and (c) to estimate the internal consistency of the CET scores. Furthermore, the present study sought to evaluate measurement invariance of the CET among Brazilians and a comparable sample of U.S. adults, with the aim of examining comparative profiles of compulsive exercise across different cultures. Finally, if invariance is assumed, comparison between U.S. and Brazilian samples will be conducted to test differences between Brazilians and Americans along to the CET total score and its subscales.
The choice for comparing adults from Brazil and the United States of America (USA) is deliberate. The U.S. is the global leader, as the country with the highest number of gyms/fitness facilities, followed by Brazil [36], showing that both countries have comparatively greater interest in physical exercise. The U.S. and Brazil also share the distinction of having the highest number of practices for aesthetic plastic surgeries [37] and the highest use of anabolic steroids [38]—all of which are common body-change strategies that may relate to body weight, shape, and appearance concerns. It is known that greater physical appearance concern can lead individuals to develop some behaviors that are harmful to health. Not surprisingly, both countries have a high frequency of people with body dissatisfaction and disordered eating [39].
In the present study we hypothesized that the CET three-factor solution with 15 items (i.e., Avoidance and rule-driven behavior, Weight control exercise, and Mood improvement) proposed by Plateau et al. [22] would present the best fit to the data (Hypothesis 1). We expected the CET subscales to be positively associated with a measure of eating disorder symptoms (Hypothesis 2), as found in previous studies [15, 22, 24,25,26]. We also hypothesized that the CET subscales would demonstrate adequate internal consistency (Hypothesis 3). Furthermore, we anticipated that the CET would show measurement invariance across Brazilians and Americans (Hypothesis 4). Finally, we expected the Brazilians and Americans would present similar scores of the CET subscales (Hypothesis 5).
Materials and methods
Ethical statement
This study is part of a larger cross-sectional, cross-cultural study conducted in Brazil and the U.S. that aimed to evaluate body image concerns, eating disorders, compulsive exercise, and psychological functioning. Ethics approval was obtained from each relevant Institutional Review Board. All procedures are in accordance with the principles specified in the Declaration of Helsinki. The study was conducted and data gathered consistent with the American Psychological Associations Journal Article Reporting Standards for Quantitative Data (JARS).
Participants
The total sample consisted of 1,531 young adults (601 Brazilians and 930 Americans), aged 18 and 35 years. The inclusion criteria were age and self-reported engagement in regular physical exercises. Exclusion criteria were not completing the full research protocol. The sample size exceeds the minimum sample size required for factor analyses (i.e., 10 people per item) [34].
Procedures
After ethics approval, the first step consisted of contacting the first author of the original CET validation study, who consented to our study. The translation, back-translation and cross-cultural adaptation of the CET for the Brazilian Portuguese were conducted according to standardized international recommendations [34]. Semantic, idiomatic, cultural, conceptual, and operational equivalence analyses were performed following the Herdman et al. (1998) proposal. Equivalences between the original and Brazilian versions were analyzed by an expert committee (i.e., the researchers responsible for the study, a language expert, a translator, and two exercise dependence specialists). Verbal understanding of the items and instructions for completing the scale were verified using two focus groups (one for each sex). All necessary adjustments were made, and the final instrument was rechecked by the expert committee. The cross-culturally adapted Brazilian version of the CET was used in the following study’s phases.
The study was advertised on social media, online forums, email lists, and communities. Potential participants received information about the research, and if interested, received a URL to the study. All participants were consented, and once consented, they were taken to a fully online survey was hosted on Qualtrics® platform and Internet Protocol (IP) addresses were recorded to ensure that no participant completed the survey more than once. The research was completely anonymous, the data were treated confidentially, and all participants participated voluntarily and were not remunerated or subsidized for their participation. In the U.S. sample, participants received one extra-credit research point for participation.
Measures
Demographics
All participants were asked to report their age, race/ethnicity, sex, gender identity, sexual orientation, education, and income. In addition, they were asked about meal preparation, health status, and presence of a diagnosis of illness or eating disorders.
Compulsive Exercise Test (CET)
The CET [15] is a self-report measure of compulsive exercise, composed of 24 items presented on a 6-point Likert-type scale, ranging from 0 (never true) to 5 (always true). The score of each of the CET subscales (i.e., Avoidance and rule-driven behavior, Weight control exercise, Mood improvement, Lack of exercise enjoyment, Exercise rigidity) are obtained by summing their items. The higher the score, the greater the compulsive exercise. The original English version of the CET (i.e., in English) was administered to the U. S. sample, and the cross-culturally adapted Portuguese version was administered to the Brazilian sample.
Eating disorder examination questionnaire (EDE-Q)
The EDE-Q is a 28-items questionnaire that assesses attitudes related to key features of eating disorders psychopathology over a 28-day period [40]. The original English version was used for the U.S. sample. The cross-culturally adapted Portuguese version of the EDE-Q [41] was administered for Brazilian sample. The EDE-Q presents good indicators of validity in both countries [40, 42]. The EDE-Q’s 22 items are rated on a 7-point Likert scale, ranging from 0 (Never or Not at all) to 6 (Every day or Markedly). The global score is obtained by averaging items’ scores. Higher scores indicate greater eating disorder symptom severity. The behavioral frequency items (i.e., items 13–18) were not included in the analyses. In the present study, the EDE-Q revealed good internal consistency for both the Brazilians (McDonald’s ω = 0.94 [95% CI = 0.93, 0.94]) and the Americans (ω = 0.95 [95% CI = 0.94, 0.96]).
Data analysis
As suggested by Parent [43], 420 Americans (31.1%) and 72 Brazilians (10.7%) were excluded because they had more than 80% missing data. Responses from remaining participants were inspected and showed to be consistent with Missing Completely at Random (χ2(79) = 95.432, p = 0.10) using Little's test [42]. We imputed missing values (4.7%; n = 68) using expectation–maximization method [43].
Descriptive statistics were performed for numerical data (means and standard deviations) and categorical data (absolute and relative frequencies). The items in the Brazilian and American versions of the CET were inspected for univariate normality. Skewness (< 3) and kurtosis (< 10) values, and multivariate normality (Mardia coefficients < 5) were considered adequate [44]. Multivariate outliers were inspected using Mahalanobis distance squared (D2). All analyzes were performed with JASP v. 0.16.4.0 [45] and a significance level of 5% (p < 0.05) was adopted.
Confirmatory factor analysis (CFA)
The weighted least square mean and variance adjusted (WLSMV) method was used to estimate the models for the Brazilian and American samples [44]. A total of four models were tested: (a) the original five-factor solution with 24 items [15]; (b) a three-factor solution with 15 items [22]; (c) a three-factor solution with 18 items [26]; and (d) a four-factor solution with 21 items [26].
The adequacy of the models was evaluated by using the chi-square corrected by degrees of freedom (χ2/df) and by multiple adjustment indexes: comparative fit index (CFI), Tucker-Lewis index (TLI), root mean squared error approximation (RMSEA), and standardized root mean square (SRMR) [35]. The following values are considered acceptable: χ2/df (≤ 5), CFI and TLI (close to 0.95), RMSEA (< 0.08; [95% confidence interval, p > 0.05]), and SRMR (< 0.08). The factor loading (λ) was analyzed, and a cutoff point of 0.50 was considered adequate [44].
Convergent validity
To analyze the evidence of convergent validity, the scores of the CET models and their factors were correlated with eating disorder symptoms (EDE-Q global score). The analyses were conducted using Spearman’s rank order correlation coefficient (rs). Correlations of 0.20, 0.40 and 0.60 were considered small, moderate, and large, respectively [44].
Internal consistency
The estimated internal consistency of the instruments applied in the present study was evaluated using McDonald's ω. Values of ω close to 0.70 were considered acceptable [46].
Measurement invariance
Measurement invariance analysis for the most parsimonious CET factor model (i.e., the three-factor solution with 15 items) [22] was conducted using the Brazilian and American samples to evaluate configural (assessing whether the hypothesized factor structure fits well across different samples), metric (assessing whether the factor loadings are equivalent across the samples), and scalar (assessing whether the item intercepts are equivalent across the samples) invarianceΔCFI < 0.005, ΔRMSEA < 0.010, and ΔSRMR < 0.025 were considered indicators of metric invariance, and scalar invariance was supported when ΔCFI < 0.005, ΔRMSEA < 0.010, and ΔSRMR < 0.005 [47, 48].
Comparison between U.S. and Brazilian samples
Multivariate analysis of covariance (MANCOVA) was performed to compare study variables in the two groups. Considering that age can influence the compulsive exercise behaviors [3], it was included as a covariate. The coefficient Partial n2 was used to report effect size for variables with 0.10–0.29 being considered small, 0.30–0.49 being considered medium, and ≥ 0.50 being considered large [49].
Results
Descriptive analysis
The sociodemographic characteristics of the two samples are shown in Table 1.
Confirmatory factor analysis (CFA)
Normality violation indicators were not identified after inspection of univariate and multivariate normality. Multivariate outliers (D2) were also not identified. Table 2 presents a comparison of the fit indices of the tested models based on estimation techniques.
As can be seen in Table 2, the original five-factor solution [15] did not show good fit indices in any of our samples. Values of χ2/df were high and CFI and TLI indices were very low. Moreover, items #5 (“I find exercise a chore”) and #8 (“I do not exercise to be slim”) had a factorial load below the adopted cut-off point (i.e., λ ≥ 0.50; [44]). The four-factor solution [26] did not show adequate indices for both samples due to high χ2/df values and low factor loading on some items. The three-factor solution with 18 items [26] did not show adequate indices for the American sample due to high χ2/df value and low factor loading on item #8. The most parsimonious model was the three-factor solution with 15 items [22], which showed good fit indices for both samples. All items presented high factor loadings (λ > 0.61).
Convergent validity
Table 3 shows evidence of convergent validity between the CET subscales and the EDE-Q global score. As expected, the CET subscales showed significant correlations with the EDE-Q, except for the Mood Improvement subscale, which did not show a significant correlation with the EDE-Q among Brazilians. Small and significant correlations were observed between the EDE-Q and the Avoidance and rule-driven behavior subscale in both samples. The Weight control exercise subscale showed a strong correlation with the EDE-Q in both samples. Finally, a small correlation was observed between the Mood improvement subscale and EDE-Q among Americans.
Internal consistency
In the total sample (i.e., Brazilians and Americans), the CET subscales demonstrated a good internal consistency (i.e., the Avoidance and rule-driven behavior (ω = 0.91 [95% CI = 0.90, 0.92]), the Weight control exercise (ω = 0.82 [95% CI = 0.80, 0.83]), and the Mood Improvement (ω = 0.87 [95% CI = 0.86, 0.88])). Similarly, in separate samples of Brazilians and Americans, the CET subscales also showed good internal consistency (i.e., the Avoidance and rule-driven behavior (Brazilians: ω = 0.92 [95% CI = 0.91, 0.93]; Americans: ω = 0.90 [95% CI = 0.89, 0.91]), the Weight control exercise (Brazilians: ω = 0.82 [95% CI = 0.79, 0.84]; Americans: ω = 0.81 [95% CI = 0.79, 0.83]), and the Mood Improvement (Brazilians: ω = 0.90 [95% CI = 0.89, 0.91]; Americans: ω = 0.84 [95% CI = 0.83, 0.86]). Taken together, these results provide support for the internal consistency reliability of the CET.
Measurement invariance
Results from the CET multigroup CFA showed evidence for the invariance at the configural level, indicating that the factorial structure is the same across Brazilians and Americans (Table 4). In addition, metric (ΔCFI = 0.002, ΔRMSEA = − 0.002, ΔSRMR = − 0.003) and scalar (ΔCFI = 0.002, ΔRMSEA = − 0.001, ΔSRMR = 0.001) invariance were supported.
Comparison between U.S. and Brazilian samples
The MANCOVA results (Pillai's trace = 0.07, f [3, 1525] = 38.5, p ≤ 0.001) indicate that there are significant differences among the countries regarding CET subscales (see Table 5). Brazilians scores higher on the Avoidance and rule-driven behavior and Mood improvement subscales; whereas Americans scored higher on the Weight control exercise subscale. In all comparisons the effect size was small.
Discussion
The number of studies on dysfunctional exercise has grown substantially in recent years. Thus, there is an increasing concern to develop/validate valid and reliable screening tools. Importantly, these instruments need to be stable and especially invariant across cultures, thus allowing for cross-cultural comparison. Therefore, this study aimed to describe the translation and cultural adaptation of the CET to Brazilian Portuguese, to test several factor structures among Brazilian and U.S. adults and to examine measurement invariance across countries, and finally, to evaluate the internal consistency of the CET. Furthermore, we sought to test convergent validity, correlating the CET with a measure of eating disorder symptoms, and to compare compulsive exercise symptoms between samples from both countries.
As hypothesized, the three-factor solution with 15 items [22] showed best fit to data. This factor structure proved to be invariant between Brazilians and Americans, and it showed good convergent validity and adequate internal consistency; confirming our hypotheses. In addition, Brazilians demonstrated higher scores on the Avoidance and rule-driven behavior and Mood improvement subscales, whereas Americans scored higher on the Weight control exercise subscale. It is worth noting that no statistically significant difference was observed between countries for the total CET score. This result is contrary to our hypothesis, however the practical significance (i.e., effect size) observed in these comparisons is small.
The original five-factor model proposed by Taranis et al. [14] showed poor fit indices for both samples. This result was expected, as previous validation studies showed that the Lack of exercise enjoyment and Exercise rigidity subscales are problematic [22, 26, 27, 29]. As previously mentioned, the use of PCA instead of EFA/CFA may potentially explain the differences in fit in our analyses compared to Taranis et al. [14]. Other studies that replicated the original five-factor solution with 24 items also violate some theoretical assumptions [24, 28, 30, 31].
The four-factor solution [26] did not show adequate indices for either sample due to high χ2/df values and low factor loading on some items. Furthermore, the three-factor solution with 18 items [26] did not show adequate fit indices for the Americans due to high χ2/df value and low factor loading on item #8. Previous validation studies also found low factor loadings in several items [22, 24, 26, 29, 30]. Despite that, some previous studies [24, 30] chose to keep problematic items.
After carefully analyzing several models, the only model that presented a good fit and adequate factor loadings for each item was the one proposed by Plateau et al. [22]. It is believed that removing the Lack of exercise enjoyment and Exercise rigidity subscales and the problematic items from the Avoidance and rule-driven behavior (items # 11 and 15) and Mood Improvement (item # 8) subscales generated a more robust structure for the CET. A similar result can be observed in the study by Rica et al. [27] who tested the three-factor structures for a sample of Spanish men and found a better fit for the model proposed by Plateau et al. [22].
Our findings in no way minimize the quality of the CET as an effective and important assessment tool. In fact, the original validation study of the CET [14] showed that the Lack of exercise enjoyment subscale did not correlate with the CET total score. Perhaps lack of exercise enjoyment do not discriminate individuals with and without compulsive exercise. Therefore, this subscale may not add value to the measurement of compulsive exercise. In addition, exercise rigidity seems to be a pattern of relationship with exercise (e.g., commitment to exercise), without necessarily being associated with the compulsive nature of the compulsive exercise. The modified structure of the CET showed good adjustment indices. Thus, it is believed that the CET was developed on a consistent theoretical basis and, in fact, is capable of capturing compulsive traits of dysfunctional exercise. This explains the wide use of the instrument.
We also examined the convergent validity of the CET using the EDE-Q global score as a convergent measure, as was done in previous validation studies [22, 26, 30]. We confirmed previous results, finding correlations between the EDE-Q and CET subscales scores. Specifically, we found small correlation between the EDE-Q and the Avoidance and rule-driven behavior subscale among Brazilians and Americans; and a strong correlation between the EDE-Q and the Weight control exercise subscale in both samples. A small correlation was observed between the Mood improvement subscale and EDE-Q among Americans, but this was non-significant for Brazilians. These results are expected as compulsive exercise is characterized as a compulsive behavior, usually related to body weight and shape concerns and disordered eating/eating disorders [15, 18]. Interestingly, the strongest associations were found between the EDE-Q and the Weight control exercise subscale in both samples. Our results provide initial evidence that compulsive exercise may be a relevant risk factor for eating disorders in the Brazilian context. Thus, future studies should assess the sensitivity of the CET in distinguishing participants or patients with small, medium, and high risk for eating disorders.
We found good estimated internal consistency of the CET subscales among Brazilian and American samples. Results are comparable with internal consistencies found in previous validation studies [22, 26, 27].
Previous studies have examined the CET invariance in several contexts, including with different ages, and various eating disorders diagnostic groups [29], as well as in athletes performing at competitive levels [27]. However, the invariance of the CET across different linguistic and cultural contexts had not been explored. Following the recommendation of Swami and Barron [34], we conducted a multigroup CFA to test the CET invariance across Brazilians and Americans. Our results showed the CET's invariance at the configural, metric, and scalar levels, indicating that the instrument presents similar parameters in both cultural contexts. Thereby, authors interested in understanding the cross-cultural differences between the two countries regarding compulsive exercise and correlate thoughts and behaviors now have an instrument with adequate indicators of valid and reliable for this purpose.
In addition to the result found in the invariance analysis, cultural differences must be considered. It should be noted that while there are many similarities among Brazilian and U.S. adults in the value they place on fitness and exercise, there are also important cultural factors within each country that may modulate the way each group values the engagement in exercise and the benefits derived from it. Similarly, cultural differences may relate to the mechanisms through which compulsive exercise coacts with eating pathology to elevate risk. Understanding such differences makes it possible to look at the similarity pointed out by the invariance analysis in a more appropriate way. For example, Forbes et al. [39] found higher scores for body dissatisfaction and lower scores for eating disorders in Brazilian women compared to U.S. women. A study by Carvalho et al. [50] highlights the importance of exercise in both countries yet shows that U.S. men have a higher weekly average of exercises than Brazilian men.
Regarding the comparison of the U.S. and Brazilian samples we found that although there were not significant differences among the groups in CET total score they did vary with higher subscale scores on mood and avoidance in Brazilian adults and higher scores on weight control for U.S. adults. In both samples CET total scores were significantly positively correlated with eating pathology scores. These cultural differences are intriguing and suggest that there are differences in the meaning of exercise among these two cultures. In a previous cross-cultural study by de Carvalho et al. [50] Brazilians were more likely to respond that they exercise for “weight loss” whereas Americans more often said “health.” Perhaps when it comes to compulsive exercise, the higher levels of concern for health among Americans is now reflected in concerns more explicitly for weight loss (given the obesity epidemic in the U.S. today). Perhaps Brazilians who exercise more compulsively find that their moods are affected when they do not or cannot exercise and that now is a stronger motivation that weight loss. In this study we did not examine any psychosocial predictors of compulsive exercise so we are unable to provide empirical evidence to explain these group differences. However, we did show that in both groups higher CET scores related to higher eating pathology and this is consistent with findings from other studies in both clinical and non-clinical samples [22, 26, 30]. Based upon our findings in this study, we found differential risk patterns of compulsive exercise that may be relevant for prevention/intervention efforts with individuals at risk for compulsive exercise and/or pathological eating behaviors.
In conclusion, the Brazilian three-factor-15-item version of the CET solution shows evidence of validity and reliability for Brazilian adults. Thus, the Brazilian CET can be used as a screening measure for dysfunctional exercise. Furthermore, this version was invariant across the Brazilian and American samples; allowing cross-cultural comparison between these countries.
Strength and limits
The results of the present study are promising in indicating a valid, reliable and invariant factorial structure of the CET between Brazil and the United States. Our findings demonstrate the value of using this measure to assess compulsive exercise in Portuguese-speaking Brazilian adults, and further confirmed its value as an effective measure for English-speaking American adults. Future studies may benefit from cross-cultural comparisons to better understand sociocultural aspects related to compulsive exercise and its role in disordered eating across different cultures.
Although the results found in this study are promising, it does have its limitations. First, the CET was not designed as a diagnostic instrument and thus does not purport to make a clinical diagnosis. However, it will be useful to access compulsive exercise symptoms in Brazilian and American contexts, given elevated risk for dysfunctional exercise in these groups. Second, a nonprobabilistic sample was used, which can limit the generalizability of the present results. Third, assessments were limited to self-report, which may reflect social bias [34]. However, this approach has been used in similar studies [14, 22, 24, 26, 27, 29, 30]. Fourth, differences were observed in the proportions of men and women, as well as individuals diagnosed with eating disorders between the samples from Brazil and the U.S. It is not possible to measure the impact of these sample differences on the data in the present study. It is noteworthy that studies indicate different prevalence of compulsive exercise between men and women [2, 3], as well as high compulsive exercise in individuals with eating disorders [6, 15, 18]. Finally, we used only one measure to investigate the convergent validity of the CET. Future studies should examine the relationship between the CET and other individual variables, such as obsessive–compulsive traits, depressive symptoms, and perfectionism.
What is already known on this subject?
Compulsive exercise is a compulsive behavior, usually related to body weight and shape concerns, and disordered eating/eating disorders. The Compulsive Exercise Test (CET) is a widely used measure of compulsive exercise, but its factor structure shown to be unstable in several validation studies, which limits conducting cross-cultural studies. Evaluating an adequate factorial structure and its invariance between cultures is of fundamental importance.
What this study adds?
This study presents important advances in the measurement of compulsive exercise, as well as the relationship between dysfunctional exercise and disordered eating/eating disorders. We tested several factor structures of the CET and its validity, reliability, and measurement invariance across Brazilians and Americans. Results support the CET as a measure of compulsive exercise among Brazilians and Americans, allowing cross-cultural comparisons between these countries.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Hausenblas HA, Downs DS (2002) Exercise dependence: a systematic review. Psychol Sport Exerc 3(2):89–123. https://doi.org/10.1016/S1469-0292(00)00015-7
Gonçalves Baptista J, Costa Filho PN, Faria Porretti M, do Espírito-Santo G, Assis M, Palma A (2019) Exercise Dependence: An Updated Systematic Review. J Exerc Physiol Online 22(5)
Colledge F, Buchner U, Schmidt A, Wiesbeck G, Lang U, Pühse U et al (2021) Individuals at risk of exercise addiction have higher scores for depression, ADHD, and childhood trauma. Front Sport Act Liv 3:761844–761844. https://doi.org/10.3389/fspor.2021.761844
Meneguzzo P, Dal Brun D, Cazzola C, Pillan A, Bonello E, Todisco P (2022) Compulsive exercise in eating disorders: Validation of the Italian scale and evaluation of its relationships with body image concerns and quality of life. Eat Behav 47:101675. https://doi.org/10.1016/j.eatbeh.2022.101675
APA American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders, 5th edn. American Psychiatric Association, Philadelphia
Meyer C, Taranis L, Goodwin H, Haycraft E (2011) Compulsive exercise and eating disorders. Eur Eat Disord Rev 19(3):174–189. https://doi.org/10.1002/erv.1122
Goodwin H, Haycraft E, Meyer C (2016) Disordered eating, compulsive exercise, and sport participation in a UK adolescent sample. Eur Eat Disord Rev 24(4):304–309. https://doi.org/10.1002/erv.2441
Sicilia Á, Paterna A, Alcaraz-Ibáñez M, Griffiths MD (2021) Theoretical conceptualisations of problematic exercise in psychometric assessment instruments: a systematic review. J Beh Addict 10(1):4–20. https://doi.org/10.1556/2006.2021.00019
Szabo A (2018) Addiction, passion, or confusion? New theoretical insights on exercise addiction research from the case study of a female body builder. Eur J Psychol 14(2):296–316. https://doi.org/10.5964/ejop.v14i2.1545
Pasman L, Thompson JK (1988) Body image and eating disturbances in obligatory runners, obligatory weightlifters, and sedentary individuals. Int J Eat Disord 7(6):759–769. https://doi.org/10.1002/1098-108X(198811)7:6%3c759::AID-EAT2260070605%3e3.0.CO;2-G
Ackard DM, Brehm BJ, Steffen JJ (2002) Exercise and eating disorders in college-aged women: profiling excessive exercisers. Eat Disord 10(1):31–47. https://doi.org/10.1080/106402602753573540
Duncan DR, Hall CR, Fraser SN, Rodgers WM, Wilson PM, Loitz CC (2012) Re-examining the dimensions of obligatory exercise. Meas Phys Educ Exerc Sci 16(1):1–22. https://doi.org/10.1080/1091367X.2012.641442
McCabe MP, Vincent MA (2002) Development of body modification and excessive exercise scales for adolescents. Assess 9(2):131–141. https://doi.org/10.1177/10791102009002003
Taranis L, Touyz S, Meyer C (2011) Disordered eating and exercise: development and preliminary validation of the compulsive exercise test (CET). Eur Eat Disord Rev 19(3):256–268. https://doi.org/10.1002/erv.1108
Scharmer C, Gorrell S, Schaumberg K, Anderson D (2020) Compulsive exercise or exercise dependence? Clarifying conceptualizations of exercise in the context of eating disorder pathology. Psychol Sport Exerc 46:e101586. https://doi.org/10.1016/j.psychsport.2019.101586
Brewerton TD, Stellefson EJ, Hibbs N, Hodges EL, Cochrane CE (1995) Comparison of eating disorder patients with and without compulsive exercising. Int J Eat Disord 17(4):413–416. https://doi.org/10.1002/1098-108X(199505)17:4%3c413::AID-EAT2260170414%3e3.0.CO;2-0
Dalle Grave R, Calugi S, Marchesini G (2008) Compulsive exercise to control shape or weight in eating disorders: prevalence, associated features, and treatment outcome. Compr Psychol 49(4):346–352. https://doi.org/10.1016/j.comppsych.2007.12.007
Cook BJ, Hausenblas HA (2008) The role of exercise dependence for the relationship between exercise behavior and eating pathology: mediator or moderator? J Health Psychol 13(4):495–502. https://doi.org/10.1177/1359105308088520
Harris A, Hay P, Touyz S (2020) Psychometric properties of instruments assessing exercise in patients with eating disorders: a systematic review. J Eat Disord 8(1):45. https://doi.org/10.1186/s40337-020-00315-2
Garner DM (1991) Eating Disorder Inventory-2: Professional manual. Odessa, FL: Psychological Assessment Resources
Davis C, Brewer H, Ratusny D (1993) Behavioral frequency and psychological commitment: necessary concepts in the study of excessive exercising. J Behav Med 16(6):611–628. https://doi.org/10.1007/BF00844722
Plateau CR, Shanmugam V, Duckham RL, Goodwin H, Jowett S, Brooke-Wavell KSF et al (2014) Use of the compulsive exercise test with athletes: norms and links with eating psychopathology. J Appl Sport Psychol 26(3):287–301. https://doi.org/10.1080/10413200.2013.867911
Formby P, Watson HJ, Hilyard A, Martin K, Egan SJ (2014) Psychometric properties of the Compulsive Exercise Test in an adolescent eating disorder population. Eat Behav 15(4):555–557. https://doi.org/10.1016/j.eatbeh.2014.08.013
Goodwin H, Haycraft E, Taranis L, Meyer C (2011) Psychometric evaluation of the compulsive exercise test (CET) in an adolescent population: links with eating psychopathology. Eur Eat Disord Rev 19(3):269–279. https://doi.org/10.1002/erv.1109
Swenne I (2016) Evaluation of the Compulsive Exercise Test (CET) in adolescents with eating disorders: factor structure and relation to eating disordered psychopathology. Eur Eat Disord Rev 24(4):334–340. https://doi.org/10.1002/erv.2439
Limburg K, Bodill K, Watson HJ, Kane RT, Hagger MS, Egan SJ (2021) Validity of the compulsive exercise test in regular exercisers. Eat Disord 29(5):447–462. https://doi.org/10.1080/10640266.2019.1677130
Rica R, Solar M, Sepúlveda AR (2022) Validation of the Spanish Compulsive Exercise Test version in male university students: a confirmatory factor analysis and invariance study. Cuad Psicol Dep 22(2):85–98. https://doi.org/10.6018/cpd.456501
Sauchelli S, Arcelus J, Granero R, Jiménez-Murcia S, Agüera Z, Del Pino-Gutiérrez A et al (2016) Dimensions of compulsive exercise across eating disorder diagnostic subtypes and the validation of the Spanish version of the compulsive exercise test. Front Psychol 7:e1852. https://doi.org/10.3389/fpsyg.2016.01852
Schlegl S, Vierl L, Kolar DR, Dittmer N, Voderholzer U (2022) Psychometric properties of the Compulsive Exercise Test in a large sample of female adolescent and adult inpatients with anorexia nervosa and bulimia nervosa. Int J Eat Disord 55(4):494–504. https://doi.org/10.1002/eat.23694
Vrabel K, Bratland-Sanda S (2019) Exercise obsession and compulsion in adults with longstanding eating disorders: validation of the norwegian version of the compulsive exercise test. Front Psychol 10:2370. https://doi.org/10.3389/fpsyg.2019.02370
Young S, Touyz S, Meyer C, Arcelus J, Rhodes P, Madden S et al (2017) Validity of exercise measures in adults with anorexia nervosa: the EDE, compulsive exercise test and other self-report scales. Int J Eat Disord 50(5):533–541. https://doi.org/10.1002/eat.22633
Henson RK, Roberts JK (2006) Use of exploratory factor analysis in published research: common errors and some comment on improved practice. Educ Psychol Meas 66(3):393–416. https://doi.org/10.1177/0013164405282485
Worthington RL, Whittaker TA (2006) Scale development research: a content analysis and recommendations for best practices. The Couns Psychol 34(6):806–838. https://doi.org/10.1177/0011000006288127
Swami V, Barron D (2019) Translation and validation of body image instruments: challenges, good practice guidelines, and reporting recommendations for test adaptation. Body Image 31:204–220. https://doi.org/10.1016/j.bodyim.2018.08.014
Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equation Model 6(1):1–55. https://doi.org/10.1080/10705519909540118
IHRSA, Global Report 2022. The state of the health club industry. [Internet]. https://www.ihrsa.org/publications/the-2022-ihrsa-global-report/
ISAPS. International Survey on Aesthetic/cosmetic Procedures performed in 2019. [Internet] https://www.isaps.org/discover/about-isaps/global-statistics/
Sagoe D, Pallesen S (2018) Androgen abuse epidemiology. Curr Opin Endocrinol Diabetes Obes 25(3):185–194
Forbes G, Jung J, Vaamonde J, Omar A, Paris L, Formiga N (2012) Body dissatisfaction and disordered eating in three cultures: Argentina, Brazil, and the U.S. Sex Roles 66(9):677–694. https://doi.org/10.1007/s11199-011-0105-3
Fairburn CG, Beglin SJ (1994) Assessment of eating disorders: interview or self-report questionnaire? Int J Eat Disord 16(4):363–370. https://doi.org/10.1002/1098-108X(199412)16:4%3c363::AID-EAT2260160405%3e3.0.CO;2-%23
Moser CM, Terra L, Behenck AS, Brunstein MG, Hauck S (2020) Cross-cultural adaptation and translation into Brazilian Portuguese of the instruments Sick Control One Stone Fat Food Questionnaire (SCOFF), Eating Disorder Examination Questionnaire (EDE-Q) and Clinical Impairment Assessment Questionnaire (CIA). Trends Psychiatry Psychother 43(2):267–271. https://doi.org/10.1590/2237-6089-2019-0083
Little RJA (1988) A test of missing completely at random for multivariate data with missing values. J Am Stat Assoc 83(404):1198–1202
Parent MC (2013) Handling item-level missing data: simpler is just as good. Couns Psychol 41(4):568–600. https://doi.org/10.1177/0011000012445176
Hair Junior JF, Black WC, Babin BJ, Anderson RE, Tatham RL (2009) Multivariate data analysis, 7th edn. Prentice Hall
JASP team (0.16.4.0 ed.) University of Amsterdam, Netherlands
Reise SP, Bonifay WE, Haviland MG (2013) Scoring and modeling psychological measures in the presence of multidimensionality. J Pers Assess 95(2):129–140. https://doi.org/10.1080/00223891.2012.725437
Chen FF (2007) Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct Equation Model 14(3):464–504. https://doi.org/10.1080/10705510701301834
Cheung GW, Rensvold RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equation Model 9(2):233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cohen J (1988) Statistical power analysis for the behavioral sciences. Academic press
Carvalho PHB, de Souza AC, de Santos Alvarenga M (2021) Reasons to exercise among college men from Argentina, Brazil, United States of America and France. Rev Bras Psicol Esporte. https://doi.org/10.31501/rbpe.v11i1.12342
Funding
The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by PFC, LDF and PHBdC. The first draft of the manuscript was written by PFC and MA and all authors commented on subsequent versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and was performed in line with the principles of the Declaration of Helsinki. Approval was granted by the Ethics Committee of Federal University of Juiz de Fora (Report number: 4.956.085) and Florida International University.
Consent for publication
Informed consent was obtained from all individual participants included in the study.
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Campos, P.F., Frazier, L.D., Almeida, M. et al. Validation and measurement invariance of the Compulsive Exercise Test among Brazilian and American young adults. Eat Weight Disord 29, 2 (2024). https://doi.org/10.1007/s40519-023-01627-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40519-023-01627-3