Abstract
The aim of this study is to gain insight into the interplay between attitudes, motivation, learning engagement, and perceived learning outcomes in massive open online courses (MOOCs). An online survey was administered to 232 MOOC learners. This study provided comprehensive explanations for individual differences in learning engagement and perceived learning outcomes in MOOCs with a modified model of the expectancy-value theory of achievement motivation. The structural equation modeling revealed that attitudes served as a precursor of participation in MOOCs that significantly influenced self-efficacy, intrinsic value, and task effort cost; self-efficacy and intrinsic value were positively associated with both learning engagement and perceived learning outcomes, while attitudes toward MOOC learning was positively related to perceived learning outcomes only. Furthermore, the mediation analyses highlighted that intrinsic value was a powerful mediator, which positively influenced the effects of attitudes and self-efficacy on learning engagement and perceived learning outcomes. The moderation analyses discovered that task effort cost moderated the effects of attitudes on learning engagement and perceived learning outcomes. Curriculum designers and instructors could benefit from this study to understand what rationales drive individuals to be engaged in MOOC learning and to reach greater perceived learning outcomes in MOOCs.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Introduction
Massive open online courses (MOOCs) have extended the accessibility and sustainability of tertiary education. MOOCs have become one of the popular online learning formats and their proliferation has attracted many learners who, by participating in a MOOC, can connect with global learners online. Yet progressively more learners drop out during the course and only a small proportion of learners complete course learning (Cagiltay et al., 2020). Risen attention has been paid to how to facilitate learning engagement (Joksimović et al., 2018; Kuo et al., 2021), which is confirmed to be critical to succeeding in MOOC learning and reducing the dropout ratio (Wang et al., 2019). Previous MOOC studies have also determined that attitudes and motivation significantly explained course completion (Dalipi et al., 2018; Zhou, 2016). Attitudes toward MOOC learning were a significant predictor of learners’ continuance intention and actual behavior toward course completion (Altalhi, 2021; Wu & Chen, 2017). Furthermore, prior studies confirmed that the relatively high dropout rates were inextricably related to the motivation that MOOC learners have (Badali et al., 2022; Watted & Barak, 2018). Learners’ motivation for participation in MOOCs is diverse, and individual learning success is not restricted to course completion and high course grades. Even though researchers discovered that MOOC learners vary in engagement (e.g., Kang, 2020; Khalil & Ebner, 2017; Li & Baker, 2018), they did not reveal what rationales drive individuals to be engaged or disengaged in MOOC learning. Course grades and course completion rates are useful to quantify learning outcomes, but they are not always adequate to demonstrate the full picture of individual learning outcomes in MOOC learning (Stephens-Martinez et al., 2014). Learners’ perception of learning outcomes might provide a lens for understanding the extent to which individuals perceive they have learned something from MOOCs (Wei et al., 2021). The aforementioned attitudes-engagement relationship suggests that attitudes serve as the evaluative predisposition to planned behavior (Ajzen, 1985). Learners may decrease their engagement in MOOCs and even may not initiate participation if they do not have positive attitudes toward MOOC learning. Simultaneously, learners’ engagement in MOOCs aligns with their self-determined motivation for MOOCs (Sicilia et al., 2015). As most learners participate in MOOCs with different attitudes and motivation, it is critical to investigate how attitudes and motivation are related to learning engagement and perceived learning outcomes.
Motivation and engagement in MOOCs have been thoroughly studied, yet little is known about the mechanism through which attitudes and motivational belief aspects work together to influence learning engagement and perceived learning outcomes in MOOCs. While existing MOOC studies have primarily focused on positive motivational values, less attention has been paid to negative motivational values, such as perceived cost. To examine MOOC learners’ motivation multidimensionally, this study is designed to investigate both positive and negative motivational beliefs by adopting the expectancy-value theory of achievement motivation (Wigfield & Eccles, 2000), which concerns the expectancy and value aspects of motivational beliefs (i.e., self-efficacy, task value, and perceived cost). Task value and perceived cost beliefs concern the valuable and detracted characteristics of a course that influence learners’ determinations to either engage or disengage with the course (Eccles et al., 1983). Part et al. (2020) and Flake et al. (2015) have argued that, for a multidimensional presentation of individuals’ motivational process, examining the benefits of robust predictors (i.e., self-efficacy, and task value) to educational outcomes is not enough, being aware of the negative effects of perceived cost is also essential. The weighting and role of the components of task value and perceived cost to influence academic outcomes vary in individuals and contexts (Eccles & Wigfield, 2020; Perez et al., 2019). However, considering the bi-direction of motivational beliefs, it is not clear the direct and indirect effects of task value and perceived cost on learners to be engaged in a MOOC. Given the context of teaching–learning asynchronously and learners’ self-determined learning in MOOCs, there is a need to identify the role of task value and perceived cost in learning engagement and perceived learning outcomes. Based on previous MOOC studies, considering the significance of attitudes in the attitudes-engagement relationship mentioned above, together with the motivation-engagement relationship in MOOC learning, it suggests that attitudes may play a role in motivation. Attitudes are integrated into the expectancy-value model to bridge the connection between attitudes and motivational beliefs. Therefore, firstly, the current study estimates the extent to which attitudes, self-efficacy, task value, and perceived cost directly influence learning engagement and perceived learning outcomes. Secondly, we examine the indirect effects of task value and perceived cost in the relationships between attitudes/self-efficacy and learning engagement/perceived learning outcomes. The findings will benefit MOOC researchers and practitioners in understanding the mechanism of attitudes and motivational beliefs working together, and the role of task value and perceived cost in learning engagement and perceived learning outcomes in MOOCs.
Theoretical framework
To further reveal individual MOOC learning, we first review studies on learning engagement and perceived learning outcomes. Next, we elaborate on how motivation and attitudes are associated with learning engagement and perceived learning outcomes. Motivation is a complicated construct, because it broadly concerns the reasons or goals related to making choices, persistence, and performance on achievement tasks (Littlejohn et al., 2016). Learners who attend MOOCs are driven by a variety of reasons, which cannot be solely interpreted by a single motivational belief. The expectancy-value theory of achievement motivation concerns expectancy and value aspects of motivation (i.e., self-efficacy, task value, and perceived cost; Wigfield & Eccles, 2000), which can provide comprehensive explanations for understanding MOOC learners’ engagement and perceived learning outcomes.
Learning engagement and perceived learning outcomes
Learning engagement
Learning engagement is defined as the exertion of one’s physical and psychological ongoing effort during the learning process to realize academic achievement or learning goals (Oh et al., 2017). It is important to be addressed in online learning as it is positively associated with academic achievement (Vayre & Vonthron, 2019). Learning engagement comprises three aspects: cognitive, behavioral, and emotional engagement (Fredricks et al., 2004). Cognitive engagement refers to learners exerting mental effort in MOOCs, which concerns employing high-order learning strategies and metacognitive self-regulation strategies, and aiming at acquiring content knowledge and mastering skills (Kuo et al., 2021; Reeve & Tseng, 2011). Behavioral engagement is presented as learners’ involvement in MOOC learning activities (e.g., course materials, video lectures, discussion forums, course assessments), on-task attention, and investment of effort within the learning process (Kang, 2020; Reeve & Tseng, 2011). Moreover, emotional engagement is regarded as learners expressing emotional feelings about their MOOC learning, such as interest, curiosity, enjoyment, and enthusiasm, which show the extent of positive evaluation on what they have learned (Skinner et al., 2008).
Perceived learning outcomes
In line with previous MOOC research, a multi-dimension perspective was adopted to consider perceived learning outcomes (i.e., cognitive, behavioral, and affective outcomes), which can provide more information on individual perceptions of knowledge and skills gained in MOOCs (Wei et al., 2023). Cognitive outcomes are defined as the acquisition of content knowledge and intellectual skills from MOOCs (Lan & Hew, 2020). Behavioral outcomes refer to the capabilities of applying knowledge and skills in MOOC learning, such as study skills, and self-regulated learning skills (Min & Foon, 2019). Furthermore, affective outcomes refer to learners’ satisfaction with the learning gains and appreciation of the interaction with instructors and peers (Hew et al., 2020; Li, 2019).
The expectancy-value theory
The expectancy-value theory of achievement motivation (Eccles et al., 1983; Wigfield & Eccles, 2000) provides a theoretical perspective to examine multiple aspects of motivation, in terms of self-efficacy, task value, and perceived cost. Prior expectancy-value studies have confirmed that self-efficacy and task value are positively associated with multiple outcomes (i.e., academic outcomes, engagement, and attrition), for example in STEM disciplines (Perez et al., 2019), but perceived cost has not been receiving full attention (Eccles & Wigfield, 2020). Moreover, different motivational beliefs hold differentiated weights and relations to outcomes, which vary in developmental time (i.e., Kosovich et al., 2017; Perez et al., 2019) and context (i.e., Nuutila et al., 2018). Yet, it is still unclear whether motivational beliefs differ in their prediction ability and relations to learning engagement and perceived learning outcomes in MOOCs. In the current study, considering the benefits and cost of motivational beliefs in MOOC learning, the expectancy-value theory provides a lens to understand and intervene individuals’ learning engagement and perceived learning outcomes.
The expectancy-value model comprises three major components in terms of expectancy (i.e., self-efficacy), task value, and perceived cost. All these three components are hypothesized to predict performance, choice, effort, and persistence (Wigfield & Eccles, 2000). Self-efficacy is one way to examine individual expectancy for learning and performance, which refers to one's confidence in capabilities of being well-performed and expectancy of being successful in tasks (Bandura & Wessels, 1994). Task value is described as the perceived valuable characteristics of the MOOC that influence learners making a choice to engage, perform, and persist in the task. It incorporates three indicators: (1) intrinsic value, which refers to individuals enjoying and being interested in the MOOC: (2) attainment value, which refers to doing well in the MOOC, which is vital to fulfilling individuals self-identity; and (3) utility value, which refers to achieving individuals’ short-term or future goals related to the MOOC (Wigfield & Eccles, 2000). Perceived cost is conceptualized as the detracted characteristics of the task that affect learners’ engagement in course learning. It comprises three indicators: (1) task effort cost, which refers to the anticipated time and effort investment required to succeed in the task or course; (2) loss of valued alternatives, which refers to completing the task or course keeps individuals away from other valued activities; and (3) emotional cost, which refers to the negative psychological states that are related to the potential failure or struggle in the task or course (Wigfield & Cambria, 2010).
Self-efficacy
According to Bandura (1993) and Zimmerman (2000), self-efficacy is a vital contributor of cognitive (e.g., personal goal setting, strategy use), motivational (e.g., motivation, task value), affective (e.g., stress, anxiety), and selection (e.g., activity choice) processes. Self-efficacy can influence one’s own self-regulated learning behavior and academic accomplishment. In the context of university students attending compulsory courses, for example, Fryer and Ainley (2019) discovered that self-efficacy was positively associated with task value. Nevertheless, as learners are voluntarily to attend a MOOC, few studies have examined the extent to which self-efficacy affects task value and perceived cost in MOOCs.
Within the online learning environment, it has been confirmed that self-efficacy has a significant influence on learning (e.g., Tseng et al., 2020; Vayre & Vonthron, 2017). In a MOOC study by Kuo et al. (2021), it was found that general Internet-based learning self-efficacy (i.e., general belief of one’s ability can master Internet-related activities) had a significant influence on behavioral and emotional engagement. Moreover, they discovered that functional Internet-based learning self-efficacy (i.e., specific belief of one’s internet skills can complete online tasks) was significantly associated with cognitive and emotional engagement. Min and Foon (2019) discovered that these MOOC learners who expressed low self-efficacy reported their worries on cognitive (i.e., comprehension monitoring), behavioral (i.e., effort expended), emotional (i.e., anxiety, boredom) engagement. In addition, Jung and Lee (2018) found that academic self-efficacy was significantly linked with learning engagement (i.e., cognitive, behavioral, and emotional engagement) in MOOCs.
Researchers have pointed out that self-efficacy is a vital predictor of perceived learning outcomes in MOOCs. For example, in the study of Rabin et al. (2020), MOOC learners’ self-efficacy was negatively related to their perceived barriers to satisfaction. Meanwhile, it was positively and significantly correlated with the perceptions of using self-regulated learning strategies. Furthermore, Ghazali et al. (2020) had set up a four-dimension of MOOC-efficacy (i.e., information searching, making queries, MOOC learning, MOOC usability). They identified that MOOC-efficacy had a positive influence on perceived learning outcomes, such as learners’ willingness to peer interaction and collaboration, knowledge and skills construction, self-regulated learning skills, etc.
Task value
Concerning the role of task value in online learning, several studies have pictured that task value is an effective predictor associated with learning engagement. For example, when teachers perceived that the learning activities were valuable for teaching practice and professional development, they were more likely behaviorally engaged in the online professional learning communities (Zhang & Liu, 2019). In MOOC settings, there is evidence that task value effectively facilitates learning engagement. Findings in studies by Liu et al. (2023) and Tang and Chaw (2019) showed that intrinsic interest, attainment, and utility value positively predicted behavioral engagement in MOOC learning. MOOC learners with positive perceptions of the task in the course they attend were actively engaged in learning. Perceived usefulness (i.e., utility value) was a robust factor related to learning engagement (i.e., cognitive, behavioral, and emotional engagement) in MOOCs (Jung & Lee, 2018). In the discussion forums, Tang et al. (2018) indicated that intrinsically motivated learners who perceive the MOOC as interesting and enjoyable were more willing to longitudinally persist in behavioral engagement in forum activities than their counterparts. Moreover, intrinsic interest toward a MOOC was found to positively impact psychological engagement (i.e., cognitive, and emotional engagement; Sun et al., 2019). These studies suggest that the more learners are intrinsically motivated, the greater their cognitive, behavioral, and emotional engagement in MOOC learning.
In online learning, previous studies (Artino, 2008, 2009) discovered that task value (i.e., intrinsic, attainment, and utility value) positively influenced university students’ perceived learning outcomes in terms of course satisfaction, continuing motivation, and the use of self-regulated learning strategies. Similarly, in the online university environment in South Korea, self-efficacy and task value significantly predicted both learner satisfaction and achievement scores (Joo et al., 2013). Moreover, Lee et al. (2020a) examined perceived effectiveness as learners’ perceived learning outcomes of a MOOC, which was an indicator to measure satisfaction with online learning. Influential factors, such as self-efficacy, and task value, affected successful MOOC learners’ perceived effectiveness. Particularly, the task value had a statistically significant effect on perceived effectiveness of learners who have fully completed the MOOC. With asynchronous instruction in MOOCs, how task value directly and indirectly impacts the perception of learners who have learned something needs further exploration.
Perceived cost
In the emerging research, researchers suggested that perceived cost was negatively linked with learning engagement in online learning (e.g., Santosa, 2015) and academic outcomes in offline learning (e.g., Perez et al., 2019). For example, Santosa (2015) examined how perceived cost influenced learning engagement with online tutorial activities. In that case, students perceived a high level of cost (e.g., reading materials make students feel like wasting time), which resulted in disengagement with online tutorial activities. Prior studies demonstrated that perceived cost was negatively associated with perceived learning outcomes in online settings. For example, researchers reported that perceived cost was a significant predictor of Chinese college student’s perception of adopting online learning (Chen et al., 2021) and the adoption of e-training in the Nigerian civil service (Zainab et al., 2017). Researchers have investigated the role of perceived cost in online learning, however, the knowledge of how perceived cost directly and indirectly shapes learning engagement and perceived learning outcomes in MOOCs is still unclear.
Attitudes
Attitudes refer to learners’ general beliefs of favorability and benefits of learning in MOOCs. Prior research highlights that attitude is one of the powerful determinants of continuance intentions to MOOC participation (e.g., Al-Rahmi et al., 2021; Joo et al., 2018). Attitudes toward MOOC learning might have effects on motivation and participation, because continuance intentions are consistent with personal motivation for MOOC participation and indicate individual willingness to continued participation. To our knowledge, in online learning context only a few studies examined how attitudes influence learners’ motivation, learning engagement, and perceived learning outcomes. For example, in online distance education, Prior et al. (2016) conducted an investigation of postgraduate students to identify to what extent attitudes, digital literacy and self-efficacy impact their online learning behavior. The findings showed that positive attitudes had a significant influence on self-efficacy. Ma and Lee (2019) discovered some learner-related barriers, in which lack of positive attitudes toward learning in MOOCs hindered learning engagement. Moreover, pertaining to perceived learning outcomes, it was found that positive attitudes toward learning in MOOCs contributed to satisfaction (Albelbisi, 2020), as well as the improvement in self-regulated learning skills (Albelbisi & Yusop, 2019). According to Prior et al. (2016), positive attitudes contributed to self-efficacy in online learning. To further build the knowledge of the role of attitudes in MOOC learning, in the current study attitudes toward MOOC learning is regarded as the antecedent of the self-efficacy, task value, perceived cost, learning engagement, and perceived learning outcomes.
Aim of this study
The present study aims to make contributions to the insight into how attitudes and motivation impact learning engagement and perceived learning outcomes in MOOCs. The expectancy-value theory offers a theoretical perspective to examine motivational beliefs (i.e., self-efficacy, task value, and perceived cost; Eccles et al., 1983), which is employed to construct the theoretical framework for measured variables in this study. We propose a research model that involves attitudes, self-efficacy, task value, and perceived cost to explain learning engagement and perceived learning outcomes in MOOCs (see Fig. 1). Although we do know that attitudes and motivation explain course completion in MOOC learning, not yet known is how attitudes, motivation, learning engagement, and perceived learning outcomes relate. Therefore, we first examine the relationships between independent variables (i.e., attitudes, self-efficacy, task value, and perceived cost) and dependent variables (i.e., learning engagement, and perceived learning outcomes) in MOOCs. Next, we estimate the indirect effects of task value and perceived cost on the relationships between attitudes/self-efficacy and learning engagement/perceived learning outcomes. Since previous studies discovered that the role of task value and perceived cost differed in contexts, we examine the mediating and moderating effects of task value and perceived cost in our research mode. To fulfill the aim of this study, we have formulated the main research question: How do attitude and achievement motivation affect learners’ learning engagement and perceived learning outcomes in MOOCs? This main research question is split into the following sub-questions to be addressed:
Firstly, we probe the relationships between every two latent variables presented in the research model (See Fig. 1).
RQ1: How are attitudes related to (a) self-efficacy, (b) task value, (c) perceived cost, (d) learning engagement, and (e) perceived learning outcomes in MOOCs?
RQ2: How is self-efficacy related to (a) task value, (b) perceived cost, (c) learning engagement, and (d) perceived learning outcomes in MOOCs?
RQ3: How is task value related to (a) learning engagement and (b) perceived learning outcomes in MOOCs?
RQ4: How is perceived cost related to (a) learning engagement and (b) perceived learning outcomes in MOOCs?
Task value and perceived cost were introduced by Eccles et al. (1983) as mediators that influence achievement-related outcomes. Yet, recent empirical research has documented that task value and perceived cost played either mediator or moderator to achievement-related outcomes (e.g., Edwards & Taasoobshirazi, 2022; Guo et al., 2015; Perez et al., 2019). These findings are contradictory to the roles of task value and perceived cost on achievement-related outcomes that are hypothesized in Eccles et al. (1983)’s expectancy-value model. To clarify the extent to which indirect effects task value and perceived cost have in MOOC learning, we examine their mediating and moderating roles in the proposed research model. Based on the hypotheses of mediators in the original expectancy-value model, we first came up with RQ 5 and RQ 6 to estimate the mediating effects of task value and perceived cost on learning engagement and perceived learning outcomes (See Fig. 1).
RQ5: How does task value mediate the relationships between attitudes, self-efficacy on the one hand, and learning engagement, on the other hand?
RQ6: How does perceived cost mediate the relationships between attitudes, self-efficacy, on the one hand, and perceived learning outcomes, on the other hand?
If there are no significant results of mediation analyses coming out, moderation analyses will be performed to estimate whether task value and perceived cost play a moderating role in learning engagement and perceived learning outcomes (See Fig. 2).
RQ7: How does task value moderate the relationships between attitudes, self-efficacy on the one hand, and learning engagement, on the other hand?
RQ8: How does perceived cost moderate the relationships between attitudes, self-efficacy, on the one hand, and perceived learning outcomes, on the other hand?
Methods
Procedure and participants
Data has been collected by administering an online questionnaire with university students who attended MOOCs during the academic year 2020–2021. The questionnaire has been piloted with 15 Chinese university students who attended MOOCs in the fall semester of 2020–2021. Then we administered the questionnaire to learners by Qualtrics using a convenience sampling method. We recruited participants in two universities in China, who reported they attended MOOCs during the academic year. Learners accessed the online questionnaires through an anonymous hyperlink or QR code. At the beginning of the questionnaire, participants were informed about the research purpose and terms of participation. All participants gave consent to the terms to indicate that they were willing to participate in the investigation voluntarily. The Research Ethics Committee has approved the current research. The data were collected in 2021. It took participants about 10–15 min to complete the questionnaire. Ultimately, the final sample of this study comprises 232 online learners who attended MOOCs during the academic year 2020–2021. Table 1 displays the demographic information of the participants.
Measuring instruments
The questionnaire that we adopted for data collection comprises all variables involved in the research model. All measuring items were adapted and modified from existing scales to fit the MOOC learning context. Furthermore, forward–backward translation procedures were employed to assure the equivalence of semantic and content of the questionnaires between English and Chinese version (Behling & Law, 2000; Brislin, 1986). Apart from demographic items, participants rated all items on a five-point Likert scale.
Attitudes
Attitudes toward learning in MOOCs was assessed with six items, which were adapted from Admiraal et al. (2017). Attitudes refer to the general belief of favorability and benefits of learning in MOOCs. Example items are “Learning in MOOCs makes my study more satisfying” and “I feel more motivated when I am learning in MOOCs”, answered on a five-point Likert scale, anchoring from 1 (Does not apply at all) to 5 (Does apply to a great deal).
Self-efficacy
In order to examine learners’ self-efficacy toward learning in MOOCs, the scale Self-efficacy of Pintrich et al. (1991) was adapted to match the MOOC learning context. Self-efficacy states learners’ competence beliefs to be well-performed and expectancy of success in MOOC tasks. The scale includes eight items that focus on the self-appraisal of learners of their capabilities to accomplish tasks as well as their confidence to master what was taught in MOOCs. For example, items are “I’m confident I can do an excellent job in MOOCs” and “Considering the difficulty of MOOCs and my skills, I think I can do well in MOOCs”. Participants scored all eight items on a five-point Likert scale, ranging from 1 (Very untrue for me) to 5 (Very true for me).
Task value
The scale Task value with 15 items was based on Perez et al. (2019) and was adapted to assess the task value for the MOOC that learners attended. The scale comprises three subscales including intrinsic value (7 items), attainment value (4 items), and utility value (4 items). Intrinsic value refers to how learners are interested in the MOOC with example items such as “This MOOC is interesting to me” and “Compared to other courses, I like this MOOC very much”. Attainment value aims to explain that how learners think about doing well in the MOOC is important for themselves. Example items are “Being good at solving problems in this MOOC is important to me” and “Being someone who does well at this MOOC is important to me”. Finally, utility value intends to capture the perception that the MOOC they attended is useful for their future with example items such as “This MOOC is useful for what I want to do after I graduate” and “What I am learning in this MOOC is useful because they will help me in the future”. Participants rated all 15 items on a five-point Likert scale anchored with 1 (Strongly disagree) to 5 (Strongly agree).
Perceived cost
Perceived cost toward learning in a MOOC was measured with the scale of Perceived cost from Flake et al. (2015). The scale examines three aspects of cost in terms of task effort cost (5 items), loss of valued alternatives (5 items), and emotional cost (6 items). Task effort cost refers to the perception of how much time and effort would be invested to complete tasks in a MOOC. For example, items are “I have to put too much energy into this MOOC” and “This MOOC takes up too much time”. Loss of valued alternatives assesses the extent to which doing tasks in a MOOC occupies one’s time or energy to do other valued things or activities. Example items are “I have to sacrifice too much to be in this MOOC” and “This MOOC requires me to give up too many other activities I value”. Emotional cost examines the negative appraisal of emotional and psychological state that results from doing tasks in the MOOC. For example, items are “This MOOC is too exhausting” and “This MOOC makes me feel too anxious”. All 16 item questions were formatted on a five-point Likert scale, scoring from 1 (Strongly disagree) to 5 (Strongly agree).
Learning engagement
Three aspects of learning engagement were measured by adapting the scales of Cognitive Engagement and Behavioral Engagement from Reeve and Tseng (2011), and the scale of Emotional Engagement from Skinner et al. (2008). Cognitive engagement assesses the use of cognitive learning strategies and meta-cognitive self-regulation strategies when learners were studying the MOOC. For example, items are “When I study this MOOC, I try to connect what I am learning with my own experiences” and “If what I am learning is difficult to understand, I change the way I learn the material”. Behavioral engagement examines behavior when learners were studying the MOOC with example items such as “I study this MOOC carefully” and “I work hard when I start something new in this MOOC”. Emotional engagement is conceptualized as the positive emotional states toward the course when learners were studying the MOOC with example items such as “I enjoy learning new things in this MOOC” and “When I study this MOOC, I feel curious about what I am learning”. Participants scored all 18 items on a five-point Likert scale which ranges from 1 (Strongly disagree) to 5 (Strongly agree).
Perceived learning outcomes
We assessed perceived learning outcomes using the adapted version of the scale Course Outcomes from Paechter et al. (2010), which was adopted in Wei et al. (2023). Perceived learning outcomes are composed of three sub-aspects including cognitive (3 items), behavioral (3 items), and affective outcomes (3 items). Cognitive outcomes refer to the extent to which learners mastered the content knowledge after they learned the course with an example item such as “I have understood the content and concepts in the subject matter of this MOOC”. Behavioral outcomes assess the extent to which learners gained the skills after they learned the course with an example item such as “I have developed skills on how to apply the knowledge in this MOOC”. Affective outcomes measure the extent to which learners appreciated what they learned from the MOOC with an example item such as “I am pleased with what I learned in this MOOC”. Participants responded to all 9 items on a five-point Likert scale which ranges from 1 (Strongly disagree) to 5 (Strongly agree).
Data analysis
The current study implemented structural equation modeling (SEM) analysis with maximum likelihood estimation (MLE) to explore the relationships among measured variables (Kline, 2015). Four steps of data analysis were employed.
First, exploratory factor analysis (EFA) was performed using IBM SPSS 25.0 to explore the underlying structure of task value, perceived cost, and learning engagement, separately. The values of Kaiser–Meyer–Olkin (KMO) Measure of Sampling Adequacy and Bartlett’s Sphericity Test indicated that the EFA was appropriate to be carried out (Kaiser, 1974; Tobias & Carlson, 1969). We performed principal component analysis (PCA) with Direct Oblimin rotation and looked for eigenvalues greater than 1.0. The items with factor loading values lower than 0.4 or cross-loadings above 0.4 were removed (Ferguson & Cox, 1993).
Second, we adopted confirmatory factor analysis (CFA) utilizing Mplus 8.3 to verify the measurement model. Based on the results of CFA, we obtained the descriptive statistics and relevant parameters of discriminant validity (i.e., the Pearson correlations, the square root of the average variance extracted), convergent validity (i.e., Composite reliability, the average of variance extracted, and standardized factor loading), and internal reliability (i.e., Cronbach’s alpha) of the constructs used in the measurement model (Kline, 2015).
Third, to answer RQ1 to RQ4, we implemented structural equation modeling (SEM) analysis with maximum likelihood estimation (MLE) to verify the structural model (Kline, 2015). The following fit indices were used to report an acceptable model fit for both measurement model and structural model: chi-square (χ2), chi-square divided by degrees of freedom (χ2/df < 3), the comparative fit index (CFI > 0.900), the Tucker-Lewis index (TLI > 0.900; Garver & Mentzer, 1999), the root mean square error of approximation (RMSEA ≤ 0.080, 95% CI), and the standardized root mean square residual (SRMR ≤ 0.080; Hu & Bentler, 1999).
Four, to answer RQ5 and RQ6, mediation analyses were carried out through bias-corrected bootstrapping of 5000 samples with a 95% confidence interval (Preacher & Hayes, 2008). Furthermore, to answer RQ7 and RQ8, moderation analyses were performed through bias-corrected bootstrapping of 5000 samples with a 95% confidence interval (Preacher & Hayes, 2008).
Results
Measurement validation
Separate EFAs were performed with attitudes, self-efficacy, task value, perceived cost, learning engagement, and perceived learning outcomes. First, after the separate EFAs, one component was extracted from each factor following: attitudes (6 items) with a total of 64.52% variance explained, self-efficacy (8 items) with a total of 51.72% variance explained, perceived learning outcomes (9 items) with a total of 59.96% variance explained. Second, fifteen task value items were entered into an EFA, yielding two components: (1) intrinsic value (7 items), and (2) attainment & utility values (8 items). These two factors explained 68.08% of the total variance. Third, regarding perceived cost, two items with low loading values were removed, and fourteen items in total from task effort cost (4 items), loss of valued alternatives (4 items), and emotional cost (6 items) yielded one component, with a total of 65.44% variance explained. Fourth, concerning learning engagement, a total of 18 items from cognitive engagement (8 items), behavioral engagement (5 items), and emotional engagement (5 items) were falling into one component, which explained 54.99% of the total variance.
To further verify the measurement model, we performed CFA to examine the corresponding relationship between factors and measurement items. After performing CFA, the subscale attainment & utility values, loss of valued alternatives, and emotional cost were removed from further analyses as they were not supported in the measurement model. Finally, the CFA confirmed a total of six latent variables namely attitudes, self-efficacy, intrinsic value, task effort cost, learning engagement, and perceived learning outcomes, and 31 observable indicators in total. Table 2 shows the overview of measurement instruments. Figure 3 presents the measurement model as the revised research model after CFA. The goodness-of-fit indices for the measurement model indicated a good fit with the data, χ2 = 830.328, df = 419, χ2/df = 1.982, CFI = 0.910, TLI = 0.900, RMSEA = 0.065, SRMR = 0.053.
Table 6 in Appendix A shows the means, standard deviations, and values of discriminant validity of the constructs in the measurement model. For each latent variable, the square root of the average variance extracted is greater than the Pearson correlation between any two latent variables, which confirmed the appropriate discriminant validity of all constructs (Fornell & Larcker, 1981). Table 7 in Appendix A shows that the convergent validity and internal reliability of all constructs were acceptable. The standardized factor loadings of all items were ranging from 0.655 to 0.883, and all items showed statistical significance at the p < 0.001 level. Values of composite reliability of all latent variables were above 0.900, and values of average of variance extracted of all latent variables were greater than 0.900. Furthermore, the internal reliability of all latent variables was supported by Cronbach’s alpha values which range from 0.792 to 0.932, indicating all constructs have an appropriate internal consistency (Nunnally & Bernstein, 1994). All measuring instruments utilized in the current study are displayed in Table 8 in Appendix B.
Structural model
To answer RQ1 to RQ4, we implemented SEM to examine the relationships among latent variables. The goodness-of-fit indices for the structural model indicated a good fit with the data, χ2 = 1.441, df = 1, χ2/df = 1.441, CFI = 0.999, TLI = 0.991, RMSEA = 0.044, SRMR = 0.015. Figure 4 and Table 3 display the relationships between every two latent variables, and the strength of the path coefficients. Concerning RQ1, we found that attitudes were positively and significantly associated with self-efficacy (β = 0.649, p < 0.001), intrinsic value (β = 0.340, p < 0.001) and perceived learning outcomes (β = 0.140, p < 0.05), and showed a negative effect on task effort cost (β = − 0.190, p < 0.05), but had a non-significant effect on learning engagement (β = 0.072, p = 0.235). Concerning RQ2, self-efficacy was to be found positively and significantly related to intrinsic value (β = 0.409, p < 0.001), learning engagement (β = 0.166, p < 0.01), and perceived learning outcomes (β = 0.169, p < 0.01), but it showed a non-significant association with task effort cost (β = 140, p = 0.171). When it comes to RQ3 and RQ4, the results entailed that intrinsic value had a positive and significant effect on learning engagement (β = 0.587, p < 0.001) and perceived learning outcomes (β = 0.493, p < 0.001). However, task effort cost non-significantly predicted learning engagement (β = 0.069, p = 0.165) and perceived learning outcomes (β = 0.089, p = 0.054).
Mediated relations
To examine the mediating effects of task value and perceived cost (RQ5 and RQ6), mediation analyses were performed through bias-corrected bootstrapping of 5000 samples with a 95% confidence interval. Table 4 depicts to what extent mediating variables carry the indirect effects of an independent variable on a dependent variable on each mediation path.
Regarding RQ5, the results indicated that attitudes showed slightly direct effect (β = 0.144, p < 0.05, 95% CI [0.023, 0.288]) and statistically significant indirect effect (β = 0.385, p < 0.001, 95% CI [0.301, 0.510]) on learning engagement. Self-efficacy had both a significant direct effect (β = 0.197, p < 0.01, 95% CI [0.088, 0.335]) and a significant indirect effect (β = 0.385, p < 0.001, 95% CI [0.295, 0.501]) on learning engagement. To be specific, intrinsic value significantly mediated the relationship between attitudes and learning engagement (β = 0.393, p < 0.001, 95% CI [0.316, 0.510]) as well as the relationship between self-efficacy and learning engagement (β = 0.384, p < 0.001, 95% CI [0.292, 0.497]), respectively. However, task effort cost failed to play the mediating role in the relationship between attitudes and learning engagement (β = − 0.008, p = 0.393, 95% CI [− 0.036, 0.005]), neither in the relationship between self-efficacy and learning engagement (β = 0.001, p = 0.856, 95% CI [− 0.007, 0.028]).
Regarding RQ6, it was found that both direct (β = 0.214, p < 0.001, 95% CI [0.109, 0.384]) and indirect effect (β = 0.327, p < 0.001, 95% CI [0.237, 0.450]) of attitudes on perceived learning outcomes were significant. Moreover, self-efficacy had both significant direct (β = 0.231, p < 0.001, 95% CI [0.116, 0.389]) and significant indirect effect (β = 0.340, p < 0.001, 95% CI [0.257, 0.448]) on perceived learning outcomes. When looking at the specific mediation paths, the results documented that the relationship between attitudes and perceived learning outcomes was significantly mediated only through intrinsic value (β = 0.337, p < 0.001, 95% CI [0.254, 0.451]), and the indirect effect of intrinsic value between self-efficacy and perceived learning outcomes showed statistical significance (β = 0.339, p < 0.001, 95% CI [0.257, 0.448]). Nevertheless, the indirect effect of self-efficacy on learning engagement (β = 0.010, p = 0.001, 95% CI [− 0.007, 0.028]) and perceived learning outcomes (β = 0.001, p = 0.840, 95% CI [− 0.008, 0.023]) through task effort cost were non-significant.
Moderated relations
We performed moderation analyses to all paths. Since the non-significant mediating effects of task effort cost were found on all mediation paths, we speculated that the interaction effects between task effort cost and other variables might exist. To verify this hypothesis, moderation analyses were implemented with task effort cost as the moderator and intrinsic value as the covariate variable for all these paths. The results in Table 5 show that attitudes by task effort cost is an interaction variable that significantly influenced learning engagement (β = − 0.092, p = 0.005, 95% CI [− 0.155, − 0.029]) and perceived learning outcomes (β = − 0.075, p = 0.036, 95% CI [− 0.146, − 0.005]). Attitudes were also found to be a positive predictor of learning engagement (β = 0.442, p < 0.001, 95% CI [0.231, 0.653]) and perceived learning outcomes (β = 0.403, p < 0.001, 95% CI [0.169, 0.638]). Specifically, the results suggest that the lower the task effort cost, the stronger the correlations of attitude with learning engagement and perceived learning outcomes in MOOC learning (See Figs. 5 and 6). However, the interaction variable of self-efficacy by task effort cost shows non-significant relationships with learning engagement and perceived learning outcomes, which indicates there are no moderating effects of task effort cost on the relationship between self-efficacy, learning engagement, and perceived learning outcomes.
Discussion
In the current study, we examined the relationships between attitudes/motivation and learning engagement/perceived learning outcomes in MOOC learning. Specifically, we estimated how attitudes, self-efficacy, task value, and perceived cost relate to (1) learning engagement and (2) perceived learning outcomes, (3) the mediating role of task value and perceived cost in the relationships between attitudes/self-efficacy and learning engagement/perceived learning outcomes, and (4) the moderating role of task effort cost in the relationships between attitudes/self-efficacy and learning engagement/perceived learning outcomes. The current study makes several contributions to the literature on MOOC learning. First, self-efficacy and intrinsic value were found to be the two significant factors that related to participants’ engagement in MOOC learning. Second, self-efficacy and intrinsic value were found to be also positively associated with perceived learning outcomes in MOOCs. Third, attitudes served as the precursor of participation in MOOCs, which extended knowledge about attitudes being a vital factor to impact self-efficacy, intrinsic value, task effort cost, and perceived learning outcomes. Fourth, we have shown a mediating role of intrinsic value in the relationships between attitudes/self-efficacy and learning engagement/perceived learning outcomes, highlighting the critical mediating role of intrinsic value in MOOC learning. Fifth, we contribute to the literature that the relationships between attitude and learning engagement/perceived learning outcomes vary in task effort cost. The main findings are summarized and discussed below.
Attitudes as the precursor of participation in MOOCs
The strong relationship between attitudes and self-efficacy suggests that MOOC learners with positive attitudes toward MOOC learning are more likely to demonstrate a higher level of self-efficacy for MOOC learning. Similarly, Prior et al. (2016) conducted a study with participants who enrolled in online distance courses at high costs offered by a business school, and they discovered that attitudes were a positive significant predictor of self-efficacy. Compared with Prior et al. (2016), our investigation approached learners who attended MOOCs for free or at affordable cost, and the effect of attitudes on self-efficacy was even stronger. This strong relationship between attitudes and self-efficacy, together with the significant relationship of attitudes with intrinsic value (positive) and task effort cost (negative) suggest that attitudes served as the precursor of motivational beliefs in MOOC context. Moreover, as in Albelbisi (2020), attitudes were also significantly associated with perceived learning outcomes.
The importance of self-efficacy for learning in MOOCs
The importance of self-efficacy for the extent in which participants are engaged in learning and perceived that they have learned relevant knowledge and skills is confirmed in this study. This importance of self-efficacy in learning engagement (Jung & Lee, 2018; Min & Foon, 2019) and perceived learning outcomes (Lee et al., 2020b; Rabin et al., 2020) was already established in previous work. But what the current study adds is the strong relationship between self-efficacy and intrinsic value. This finding suggests that self-efficacious MOOC learners are more motivated to undertake academic tasks in MOOCs.
The substantial direct and mediating effects of intrinsic value on learning in MOOCs
The strong association between intrinsic value and learning engagement aligns with the results of previous studies (Liu et al., 2023; Sun et al., 2019) indicating that intrinsic value is a positive incentive for learning engagement in MOOCs. Corresponding with the results of Artino’s prior work in online learning (Artino, 2008, 2009), the more learners were motivated by intrinsic value, the greater their perceived learning outcomes. In addition to these significant associations, the current study highlights the powerful effects of intrinsic value on learning engagement and perceived learning outcomes, which suggests that learners’ intrinsic value might effectively contributes to greater learning engagement and perceived learning outcomes in MOOCs.
The results of mediation analyses revealed that intrinsic value had substantial mediating effects on the relationships between attitude and self-efficacy, on the one hand, and learning engagement and perceived learning outcomes, on the other, in MOOC learning. Thus, it means that learners who are with positive attitudes and are self-efficacious show relatively greater learning engagement and perceived learning outcomes because they are more internally interested in the MOOC. The mediation results highlight that within the asynchronous learning environment in MOOCs, intrinsic value is substantially influential in fostering learning engagement and perceived learning outcomes.
Task effort cost as a moderator in the relationship between attitudes, learning engagement, and perceived learning outcomes in MOOCs
The non-significant correlation between task effort cost and learning engagement contradicts the results of Santosa (2015), who discovered a negative relationship between task effort cost and learning engagement in online tutorial activities. Within a different context from our study, where self-paced teaching and learning occur asynchronously, and the content delivered online, in that study students who perceived a relatively high level of effort cost to be paid were more likely to be less engaged with online tutorial activity. However, Santosa (2015) implemented a laboratory experiment with a single online tutorial activity regarding reading course materials instead of a MOOC with a series of learning activities. In our model, intrinsic value (positive) might take away the direct effect (negative) of task effort cost on learning engagement as its substantial direct and mediating effects on learning engagement. Possibly, one explanation might be that learners' perceptions of interest and enjoyment in a MOOC affect whether they perceive this MOOC as too effortful. In addition, the current study found a non-significant association between task effort cost and perceived learning outcomes. There is no other research that has investigated this correlation in MOOCs, but Perez et al. (2019) investigated the relationship of task effort cost with learning outcomes in an undergraduate biology course on campus. Perez et al. (2019) indicated that task effort cost was a negative contributor to final biology grades, which confirms the negative association between task effort cost and learning outcomes in the campus context. Unlike the study of Perez et al. (2019), we asked students to self-report their subjective perceptions of what they have learned something from a MOOC other than course grades. The findings of Perez et al. (2019) and the current study suggested that task effort cost can directly reveal the individual difference in course grades, but it cannot validly and solely explain individual subjective perceptions of learning outcomes. For these MOOC learners in our study, the effect of task effort cost needs to be considered under the interaction we discovered between subjective belief and task effort cost in relation to learning engagement and perceived learning outcomes. Task effort cost manifests the negative incentive of a MOOC, however, how it correlates to learning engagement and perceived learning outcomes still needs further exploration.
The findings of moderation analyses imply that at a low task effort cost, MOOC learners with positive attitudes are more engaged with academic tasks and have greater perceived learning outcomes, compared to the other learners. Perceiving a high task effort cost can disrupt the contribution of positive attitudes to learning engagement and perceived learning outcomes. The moderation analyses extend the knowledge of the moderating role of task effort cost in influencing individual perceptions of MOOC learning. For example, the main effect of task effort cost was confirmed in the study of Zielinski et al. (2019) that learners who perceived high-cost more frequently reported barriers that impact their learning engagement and success in a MOOC. Our findings indicate that task effort cost is a critical aspect of the motivational beliefs that would influence MOOC learners’ participation. What the current study adds to the literature is that the effects of attitudes on learning engagement and perceived learning outcomes vary with task effort cost.
Practical implications
Based on the main findings of this research, we offer three practical implications for stimulating learning engagement and perceived learning outcomes in MOOCs, which are elaborated below.
Firstly, it is essential to encourage learners to have positive attitudes toward learning in MOOCs since positive attitudes support self-efficacy and intrinsic value, which in turn further fosters learning engagement and perceived learning outcomes. To this end, for example, cultivate MOOC learners’ sense of community, encouraging learners to interact with peers and instructors through peer review assignments, collaborative coursework, and discussion forums. For example in MOOC discussion forums, Ramesh et al. (2014) discovered that learners' attitudes have changed to be positive when their posts get responded to and resolved in discussion forums. Positive interactions in the learning community can be effective to make MOOC learners feel more connected and sustain their motivation to learn the course.
Second, self-efficacy is a modifiable and task-oriented set of beliefs (Margolis & McCabe, 2003), therefore, we recommend curriculum instructors and designers support learners’ efficacy expectations of performance resulting in them feeling more confident and motivated in MOOC learning. According to Bandura (1977) self-efficacy can be modified through several methods, such as performance accomplishments, vicarious experience, and verbal persuasion. First, performance accomplishments can raise learners’ perceived mastery expectations. In learning tasks of a MOOC, instructors can offer learners successive levels of challenges from easy to difficult, which enables learners to acquire new subject knowledge built on their mastered knowledge. Learners would perceive the cumulated accomplishments when they address these challenges successfully, which could benefit learners to become self-efficacious for onward learning tasks. Second, vicarious experiences, or observing others perform a task or achieve a goal, can be a powerful tool in enhancing students’ self-efficacy. In the sharing section, it is suggested to encourage MOOC learners to share experiences in how to overcome difficulties with sustained effort to complete learning tasks or achieve learning goals, together with clear outcomes of their success stories, such as credit recognition, professional development, and earned promotions. These exemplifications might be helpful in inspiring learners to see their own possibilities of succeeding in MOOC learning. Third, verbal persuasion, or receiving encouragement and constructive positive feedback from others, can be helpful to progressively enhance learners’ performance capabilities. In the peer review assessments of a MOOC, the instructors embed well-designed rubrics that could guide learners in providing peers with effective feedback.
Third, one suggestion to motivate MOOC learners through intrinsic value could be to apply need supportive teaching (Leenknecht et al., 2017) that focuses on learners’ psychological needs for autonomy, competence, and relatedness. To support MOOC learners’ autonomy, for example, goal setting can be adopted to encourage individuals to formulate personal goals and enable them to choose valuable learning activities to shape learning paths. The need for competence refers to learners' experience of the effectiveness of competence growth, which is similar to learners’ efficacy expectations. The proposals mentioned above for enhancing self-efficacy are also practical to fulfill the need for competence. Meanwhile, considering problem-centeredness for MOOC learning activities could be an effective principle to enhance learners’ feelings of competence. Specifically, introducing learning activities with problem complexity-differentiation might cultivate learners’ competence in multiple aspects, such as factual knowledge, procedural knowledge and competence, performance, and application of knowledge and skills. Furthermore, the sense of relatedness can be enhanced through teacher-learner and learner-learner interactions, such as supported and trained peer activities, and structured interaction and communication in MOOC discussion forums.
Limitations and future research
Despite that the current study has gained insight into factors impacting learning engagement and perceived learning outcomes in MOOCs, several limitations of the study should be mentioned. Firstly, we collected quantitative data on perceived influential factors, learning engagement, and perceived learning outcomes via structured questionnaires. To understand the individual differences in learning engagement and perceived learning outcomes more thoroughly, future research could consider gathering additional qualitative data from focus group interviews or in-depth interviews. The interviews aim to reveal detailed explanations to understand the results and explore new points through open-ended questions. That allows researchers to take a closer look at individual perceptions of MOOC learning.
Second, the data collected of this study could not fully support all hypothesized relationships in the proposed research model (Fig. 1). We could not gain insight into how the subfactors of task value (i.e., attainment value, and utility value) and perceived cost (i.e., loss of valued alternatives, and emotional cost) affect learning engagement and perceived learning outcomes, because these subfactors dropped from the original research model after EFA and CFA. Our findings of mediation and moderation analyses suggest that motivational beliefs play different roles in influencing learning in MOOCs. Future MOOC research might adopt a mixed method, i.e., survey investigation (quantitative) and interviews (qualitative), to add more empirical evidence on what roles of other aspects of task value and perceived cost play in influencing learning engagement and perceived learning outcomes.
Third, although this study estimated the correlations between influential factors and learning engagement and perceived learning outcomes, it cannot reveal the causal relationships between independent and dependent variables. Future studies may adopt an experimental design to examine the causal relationships between independent variables (i.e., attitudes, and motivation) and dependent variables (i.e., learning engagement, and perceived learning outcomes).
Fourth, attitudes and motivation were measured at the same time as the measurement of the other variables, which examined MOOC learners’ retrospective view of the learning in MOOCs. We could not capture the attitudes and motivation at the time when MOOC learners started learning the course. Perez et al. (2019) found dynamic relationships among motivational beliefs of expectancy-value over the entire course period, and the interplay of these motivational beliefs was related to the final biology grades. A meaningful direction for future MOOC research could be employing longitudinal approaches to examine the dynamic relationships among motivational beliefs over the course period and how these relationships influence learning engagement and perceived learning outcomes.
Conclusions
The current study addressed the gap in the literature on how attitudes and self-efficacy influence learning engagement and perceived learning outcomes in MOOCs, and the mediating role of intrinsic value and the moderating role of task effort cost in these relationships. Firstly, this study established that MOOC learners’ attitudes and self-efficacy did have significant and positive effects on their learning engagement and perceived learning outcomes. Second, the findings highlight the considerable importance of intrinsic value in MOOC learning as it powerfully meditated the relationships between attitudes and self-efficacy on the one hand, and learning engagement and perceived learning outcomes on the other hand. Third, task effort cost was a significant moderator, which influenced the strength of the effects of attitudes on learning engagement and perceived learning outcomes. Based on our findings, we suggest cultivating MOOC learners’ sense of community through peer review assignments, collaborative coursework, and discussion forums, which would be helpful for promoting positive attitudes toward MOOC learning. Moreover, aiming at enhancing MOOC learners’ self-efficacy, curriculum instructors and designers can employ methods such as performance accomplishments, vicarious experience, and verbal persuasion to make them feel more confident and motivated in MOOC learning. Finally, fulfilling MOOC learners’ psychological needs for autonomy, competence, and relatedness through need-supportive teaching can be an effective way to arouse intrinsic value.
Availability of data and materials
Not applicable.
References
Admiraal, W., Louws, M., Lockhorst, D., Paas, T., Buynsters, M., Cviko, A., Janssen, C., de Jonge, M., Nouwens, S., & Post, L. (2017). Teachers in school-based technology innovations: A typology of their beliefs on teaching and technology. Computers & Education, 114, 57–68. https://doi.org/10.1016/j.compedu.2017.06.013
Ajzen, I. (1985). From intentions to actions: a theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control. SSSP Springer series in social psychology (pp. 11–39). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-69746-3_2
Albelbisi, N. A. (2020). Development and validation of the MOOC success scale (MOOC-SS). Education and Information Technologies, 25(5), 4535–4555. https://doi.org/10.1007/s10639-020-10186-4
Albelbisi, N. A., & Yusop, F. D. (2019). Factors influencing learners’ self–regulated learning skills in a massive open online course (MOOC) environment. Turkish Online Journal of Distance Education, 20(3), 1–16. https://doi.org/10.17718/tojde.598191
Al-Rahmi, W. M., Yahaya, N., Alamri, M. M., Alyoussef, I. Y., Al-Rahmi, A. M., & Kamin, Y. B. (2021). Integrating innovation diffusion theory with technology acceptance model: Supporting students’ attitude towards using a massive open online courses (MOOCs) systems. Interactive Learning Environments, 29(8), 1380–1392. https://doi.org/10.1080/10494820.2019.1629599
Altalhi, M. M. (2021). Towards understanding the students’ acceptance of MOOCs: A unified theory of acceptance and use of technology (UTAUT). International Journal of Emerging Technologies in Learning (iJET), 16(2), 237–253. https://doi.org/10.3991/ijet.v16i02.13639
Artino, A. R. (2008). Motivational beliefs and perceptions of instructional quality: Predicting satisfaction with online training. Journal of Computer Assisted Learning, 24(3), 260–270. https://doi.org/10.1111/j.1365-2729.2007.00258.x
Artino, A. R. (2009). Think, feel, act: Motivational and emotional influences on military students’ online academic success. Journal of Computing in Higher Education, 21(2), 146–166. https://doi.org/10.1007/s12528-009-9020-9
Badali, M., Hatami, J., Banihashem, S. K., Rahimi, E., Noroozi, O., & Eslami, Z. (2022). The role of motivation in MOOCs’ retention rates: A systematic literature review. Research and Practice in Technology Enhanced Learning, 17(1), 1–20. https://doi.org/10.1186/s41039-022-00181-3
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191
Bandura, A. (1993). Perceived self-efficacy in cognitive development and functioning. Educational Psychologist, 28(2), 117–148. https://doi.org/10.1207/s15326985ep2802_3
Bandura, A., & Wessels, S. (1994). Self-efficacy (Vol. 4, pp. 71–81). na.
Behling, O., & Law, K. S. (2000). Translating questionnaires and other research instruments: Problems and solutions (Vol. 133). SAGE Publications Inc.
Brislin, R. W. (1986). The wording and translation of research instruments. In W. J. Lonner & J. W. Berry (Eds.), Field methods in cross-cultural research (pp. 137–164). SAGE Publications Inc.
Cagiltay, N. E., Cagiltay, K., & Celik, B. (2020). An analysis of course characteristics, learner characteristics, and certification rates in MITx MOOCs. International Review of Research in Open and Distributed Learning, 21(3), 121–139. https://doi.org/10.19173/irrodl.v21i3.4698
Chen, M., Wang, X., Wang, J., Zuo, C., Tian, J., & Cui, Y. (2021). Factors affecting college students’ continuous intention to use online course platform. SN Computer Science, 2(2), 1–11. https://doi.org/10.1007/s42979-021-00498-8
Dalipi, F., Imran, A. S., & Kastrati, Z. (2018, April). MOOC dropout prediction using machine learning techniques: Review and research challenges. Paper presented at 2018 IEEE global engineering education conference (EDUCON; pp. 1007–1014), Santa Cruz de Tenerife, Spain. https://doi.org/10.1109/EDUCON.2018.8363340
Eccles, J. S., Adler, T. F., Futterman, R., Goff, S. B., Kaczala, C. M., Meece, J. L., & Midgley, C. (1983). Expectancies, values and academic behaviors. In J. T. Spence (Ed.), Achievement and achievement motives (pp. 75–146). San Francisco: Freeman.
Eccles, J. S., & Wigfield, A. (2020). From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation. Contemporary Educational Psychology, 61, 101859. https://doi.org/10.1016/j.cedpsych.2020.101859
Edwards, O. V., & Taasoobshirazi, G. (2022). Social presence and teacher involvement: The link with expectancy, task value, and engagement. The Internet and Higher Education, 55, 100869. https://doi.org/10.1016/j.iheduc.2022.100869
Ferguson, E., & Cox, T. (1993). Exploratory factor analysis: A users’ guide. International Journal of Selection and Assessment, 1(2), 84–94. https://doi.org/10.1111/j.1468-2389.1993.tb00092.x
Flake, J. K., Barron, K. E., Hulleman, C., McCoach, B. D., & Welsh, M. E. (2015). Measuring cost: The forgotten component of expectancy-value theory. Contemporary Educational Psychology, 41, 232–244. https://doi.org/10.1016/j.cedpsych.2015.03.002
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Fryer, L. K., & Ainley, M. (2019). Supporting interest in a study domain: A longitudinal test of the interplay between interest, utility-value, and competence beliefs. Learning and Instruction, 60, 252–262. https://doi.org/10.1016/j.learninstruc.2017.11.002
Garver, M. S., & Mentzer, J. T. (1999). Logistics research methods: employing structural equation modeling to test for construct validity. Journal of Business Logistics, 20(1), 33. https://www.proquest.com/scholarly-journals/logistics-research-methods-employing-structural/docview/212605730/se-2
Ghazali, N., Nordin, M. S., Abdullah, A., & Ayub, A. F. M. (2020). The relationship between students’ MOOC-efficacy and meaningful learning. Asian Journal of University Education, 16(3), 89–101. https://doi.org/10.24191/ajue.v16i3.11071
Guo, J., Parker, P. D., Marsh, H. W., & Morin, A. J. (2015). Achievement, motivation, and educational choices: A longitudinal study of expectancy and value using a multiplicative perspective. Developmental Psychology, 51(8), 1163–1176. https://doi.org/10.1037/a0039440
Hew, K. F., Hu, X., Qiao, C., & Tang, Y. (2020). What predicts student satisfaction with MOOCs: A gradient boosting trees supervised machine learning and sentiment analysis approach. Computers & Education, 145, 103724. https://doi.org/10.1016/j.compedu.2019.103724
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Joksimović, S., Poquet, O., Kovanović, V., Dowell, N., Mills, C., Gašević, D., Dawson, S., Graesser, A. C., & Brooks, C. (2018). How do we model learning at scale? A systematic review of research on MOOCs. Review of Educational Research, 88(1), 43–86. https://doi.org/10.3102/0034654317740335
Joo, Y. J., Lim, K. Y., & Kim, J. (2013). Locus of control, self-efficacy, and task value as predictors of learning outcome in an online university context. Computers & Education, 62, 149–158. https://doi.org/10.1016/j.compedu.2012.10.027
Joo, Y. J., So, H.-J., & Kim, N. H. (2018). Examination of relationships among students’ self-determination, technology acceptance, satisfaction, and continuance intention to use K-MOOCs. Computers & Education, 122, 260–272. https://doi.org/10.1016/j.compedu.2018.01.003
Jung, Y., & Lee, J. (2018). Learning engagement and persistence in massive open online courses (MOOCS). Computers & Education, 122, 9–22. https://doi.org/10.1016/j.compedu.2018.02.013
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
Kang, I. G. (2020). Heterogeneity of learners’ behavioral patterns of watching videos and completing assessments in massive open online courses (MOOCs): A latent class analysis. International Review of Research in Open and Distributed Learning, 21(4), 221–237. https://doi.org/10.19173/irrodl.v21i4.4645
Khalil, M., & Ebner, M. (2017). Clustering patterns of engagement in Massive Open Online Courses (MOOCs): The use of learning analytics to reveal student categories. Journal of Computing in Higher Education, 29(1), 114–132. https://doi.org/10.1007/s12528-016-9126-9
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publications.
Kosovich, J. J., Flake, J. K., & Hulleman, C. S. (2017). Short-term motivation trajectories: A parallel process model of expectancy-value. Contemporary Educational Psychology, 49, 130–139. https://doi.org/10.1016/j.cedpsych.2017.01.004
Kuo, T.M.-L., Tsai, C.-C., & Wang, J.-C. (2021). Linking web-based learning self-efficacy and learning engagement in MOOCs: The role of online academic hardiness. The Internet and Higher Education, 51, 100819. https://doi.org/10.1016/j.iheduc.2021.100819
Lan, M., & Hew, K. F. (2020). Examining learning engagement in MOOCs: A self-determination theoretical perspective using mixed method. International Journal of Educational Technology in Higher Education, 17(1), 1–24. https://doi.org/10.1186/s41239-020-0179-5
Lee, D., Watson, S. L., & Watson, W. R. (2020a). The influence of successful MOOC learners’ self-regulated learning strategies, self-efficacy, and task value on their perceived effectiveness of a massive open online course. International Review of Research in Open and Distributed Learning, 21(3), 81–98. https://doi.org/10.19173/irrodl.v21i3.4642
Lee, D., Watson, S. L., & Watson, W. R. (2020b). The relationships between self-efficacy, task value, and self-regulated learning strategies in massive open online courses. International Review of Research in Open and Distributed Learning, 21(1), 23–39. https://doi.org/10.19173/irrodl.v20i5.4389
Leenknecht, M. J., Wijnia, L., Loyens, S., & Rikers, R. (2017). Need-supportive teaching in higher education: Configurations of autonomy support, structure, and involvement. Teaching and Teacher Education, 68, 134–142. https://doi.org/10.1016/j.tate.2017.08.020
Li, K. (2019). MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Computers & Education, 132, 16–30. https://doi.org/10.1016/j.compedu.2019.01.003
Li, Q., & Baker, R. (2018). The different relationships between engagement and outcomes across participant subgroups in Massive Open Online Courses. Computers & Education, 127, 41–65. https://doi.org/10.1016/j.compedu.2018.08.005
Littlejohn, A., Hood, N., Milligan, C., & Mustain, P. (2016). Learning in MOOCs: Motivations and self-regulated learning in MOOCs. The Internet and Higher Education, 29, 40–48. https://doi.org/10.1016/j.iheduc.2015.12.003
Liu, Y., Zhang, M., Qi, D., & Zhang, Y. (2023). Understanding the role of learner engagement in determining MOOCs satisfaction: A self-determination theory perspective. Interactive Learning Environments, 31(9), 6084–6098. https://doi.org/10.1080/10494820.2022.2028853
Ma, L., & Lee, C. S. (2019). Understanding the barriers to the use of MOOCs in a developing country: An innovation resistance perspective. Journal of Educational Computing Research, 57(3), 571–590. https://doi.org/10.1177/0735633118757732
Margolis, H., & McCabe, P. P. (2003). Self-efficacy: A key to improving the motivation of struggling learners. Preventing School Failure: Alternative Education for Children and Youth, 47(4), 162–169. https://doi.org/10.1080/10459880309603362
Min, L., & Foon, H. K. (2019). Self-Regulated Learning Process in MOOCs: Examining the Indicators of Behavioral, Emotional, and Cognitive Engagement. Paper presented at the Proceedings of the 2019 4th International Conference on Distance Education and Learning (pp 99–105), Shanghai, China. https://doi.org/10.1145/3338147.3338161
Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
Nuutila, K., Tuominen, H., Tapola, A., Vainikainen, M.-P., & Niemivirta, M. (2018). Consistency, longitudinal stability, and predictions of elementary school students’ task interest, success expectancy, and performance in mathematics. Learning and Instruction, 56, 73–83. https://doi.org/10.1016/j.learninstruc.2018.04.003
Oh, C., Roumani, Y., Nwankpa, J. K., & Hu, H.-F. (2017). Beyond likes and tweets: Consumer engagement behavior and movie box office in social media. Information & Management, 54(1), 25–37. https://doi.org/10.1016/j.im.2016.03.004
Paechter, M., Maier, B., & Macher, D. (2010). Students’ expectations of, and experiences in e-learning: Their relation to learning achievements and course satisfaction. Computers & Education, 54(1), 222–229. https://doi.org/10.1016/j.compedu.2009.08.005
Part, R., Perera, H. N., Marchand, G. C., & Bernacki, M. L. (2020). Revisiting the dimensionality of subjective task value: Towards clarification of competing perspectives. Contemporary Educational Psychology, 62, 101875. https://doi.org/10.1016/j.cedpsych.2020.101875
Perez, T., Dai, T., Kaplan, A., Cromley, J. G., Brooks, W. D., White, A. C., Mara, K. R., & Balsai, M. J. (2019). Interrelations among expectancies, task values, and perceived costs in undergraduate biology achievement. Learning and Individual Differences, 72, 26–38. https://doi.org/10.1016/j.lindif.2019.04.001
Pintrich, P. R., Smith, D. A. F., Garcia, T. a., & McKeachie, W. J. (1991). A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ). Ann Arbor, Michigan: University of Michigan, National Center for Research to Improve Postsecondary Teaching and Learning. Retrieved from: https://eric.ed.gov/?id=ED338122
Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. https://doi.org/10.3758/BRM.40.3.879
Prior, D. D., Mazanov, J., Meacheam, D., Heaslip, G., & Hanson, J. (2016). Attitude, digital literacy and self efficacy: Flow-on effects for online learning behavior. The Internet and Higher Education, 29, 91–97. https://doi.org/10.1016/j.iheduc.2016.01.001
Rabin, E., Henderikx, M., Yoram, M. K., & Kalz, M. (2020). What are the barriers to learners’ satisfaction in MOOCs and what predicts them? The role of age, intention, self-regulation, self-efficacy and motivation. Australasian Journal of Educational Technology, 36(3), 119–131. https://doi.org/10.14742/ajet.5919
Ramesh, A., Goldwasser, D., Huang, B., Daumé III, H., & Getoor, L. (2014). Understanding MOOC discussion forums using seeded LDA. Paper presented at the Proceedings of the Ninth Workshop on Innovative Use of NLP for Building Educational Applications (pp 28–33), Baltimore, Maryland USA. Retrived from https://aclanthology.org/W14-1804.pdf
Reeve, J., & Tseng, C.-M. (2011). Agency as a fourth aspect of students’ engagement during learning activities. Contemporary Educational Psychology, 36(4), 257–267. https://doi.org/10.1016/j.cedpsych.2011.05.002
Santosa, P. I. (2015). Student engagement with online tutorial: A perspective on flow theory. International Journal of Emerging Technologies in Learning, 10(1), 60–67. https://doi.org/10.3991/ijet.v10i1.4348
Sicilia, Á., Sáenz-Alvarez, P., González-Cutre, D., & Ferriz, R. (2015). Analysing the influence of autonomous and controlling social factors within the theory of planned behaviour. Australian Psychologist, 50(1), 70–79. https://doi.org/10.1111/ap.12077
Skinner, E., Furrer, C., Marchand, G., & Kindermann, T. (2008). Engagement and disaffection in the classroom: Part of a larger motivational dynamic? Journal of Educational Psychology, 100(4), 765–781. https://doi.org/10.1037/a0012840
Stephens-Martinez, K., Hearst, M. A., & Fox, A. (2014, March). Monitoring moocs: which information sources do instructors value? Paper presented at the Proceedings of the first ACM conference on Learning@ scale conference (pp 79–88), Atlanta, GA, USA. https://doi.org/10.1145/2556325.2566246
Sun, Y., Ni, L., Zhao, Y., Shen, X. L., & Wang, N. (2019). Understanding students’ engagement in MOOCs: An integration of self-determination theory and theory of relationship quality. British Journal of Educational Technology, 50(6), 3156–3174. https://doi.org/10.1111/bjet.12724
Tang, C. M., & Chaw, L. (2019). Driving high inclination to complete massive open online courses (MOOCs): motivation and engagement factors for learners. Electronic Journal of E-Learning, 17(2), 118–130. https://doi.org/10.34190/JEL.17.2.05
Tang, H., Xing, W., & Pei, B. (2018). Exploring the temporal dimension of forum participation in MOOCs. Distance Education, 39(3), 353–372. https://doi.org/10.1080/01587919.2018.1476841
Tobias, S., & Carlson, J. E. (1969). Brief report: Bartlett’s test of sphericity and chance findings in factor analysis. Multivariate Behavioral Research, 4(3), 375–377. https://doi.org/10.1207/s15327906mbr0403_8
Tseng, H., Kuo, Y.-C., & Walsh, E. J. (2020). Exploring first-time online undergraduate and graduate students’ growth mindsets and flexible thinking and their relations to online learning engagement. Educational Technology Research and Development, 68(5), 2285–2303. https://doi.org/10.1007/s11423-020-09774-5
Vayre, E., & Vonthron, A.-M. (2017). Psychological engagement of students in distance and online learning: Effects of self-efficacy and psychosocial processes. Journal of Educational Computing Research, 55(2), 197–218. https://doi.org/10.1177/0735633116656849
Vayre, E., & Vonthron, A.-M. (2019). Relational and psychological factors affecting exam participation and student achievement in online college courses. The Internet and Higher Education, 43, 100671. https://doi.org/10.1016/j.iheduc.2018.07.001
Wang, W., Guo, L., He, L., & Wu, Y. J. (2019). Effects of social-interactive engagement on the dropout ratio in online learning: Insights from MOOC. Behaviour & Information Technology, 38(6), 621–636. https://doi.org/10.1080/0144929X.2018.1549595
Watted, A., & Barak, M. (2018). Motivating factors of MOOC completers: Comparing between university-affiliated students and general participants. The Internet and Higher Education, 37, 11–20. https://doi.org/10.1016/j.iheduc.2017.12.001
Wei, X., Saab, N., & Admiraal, W. (2021). Assessment of cognitive, behavioral, and affective learning outcomes in massive open online courses: A systematic literature review. Computers & Education, 163, 104097. https://doi.org/10.1016/j.compedu.2020.104097
Wei, X., Saab, N., & Admiraal, W. (2023). Do learners share the same perceived learning outcomes in MOOCs? Identifying the role of motivation, perceived learning support, learning engagement, and self-regulated learning strategies. The Internet and Higher Education, 56, 100880. https://doi.org/10.1016/j.iheduc.2022.100880
Wigfield, A., & Cambria, J. (2010). Students’ achievement values, goal orientations, and interest: Definitions, development, and relations to achievement outcomes. Developmental Review, 30(1), 1–35. https://doi.org/10.1016/j.dr.2009.12.001
Wigfield, A., & Eccles, J. S. (2000). Expectancy–value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. https://doi.org/10.1006/ceps.1999.1015
Wu, B., & Chen, X. (2017). Continuance intention to use MOOCs: Integrating the technology acceptance model (TAM) and task technology fit (TTF) model. Computers in Human Behavior, 67, 221–232. https://doi.org/10.1016/j.chb.2016.10.028
Zainab, B., Awais Bhatti, M., & Alshagawi, M. (2017). Factors affecting e-training adoption: An examination of perceived cost, computer self-efficacy and the technology acceptance model. Behaviour & Information Technology, 36(12), 1261–1273. https://doi.org/10.1080/0144929X.2017.1380703
Zhang, S., & Liu, Q. (2019). Investigating the relationships among teachers’ motivational beliefs, motivational regulation, and their learning engagement in online professional learning communities. Computers & Education, 134, 145–155. https://doi.org/10.1016/j.compedu.2019.02.013
Zhou, M. (2016). Chinese university students’ acceptance of MOOCs: A self-determination perspective. Computers & Education, 92, 194–203. https://doi.org/10.1016/j.compedu.2015.10.012
Zielinski, M., West, V., Merzdorf, H. E., Douglas, K. A., & Bermel, P. (2019). Motivation and perceived costs to achievement in advanced moocs: a mixed method study of advanced engineering mooc engineering learners’ motivation and perceived barriers. The International Journal of Engineering Education, 35(5), 1540–1550. https://www.ijee.ie/1atestissues/Vol35-5/26_ijee3818.pdf
Zimmerman, B. J. (2000). Self-efficacy: An essential motive to learn. Contemporary Educational Psychology, 25(1), 82–91. https://doi.org/10.1006/ceps.1999.1016
Acknowledgements
We would like to extend our great gratitude to all the participants who willingly joined our survey investigation and provided pretty much support during the data collection. Furthermore, we genuinely appreciate the insightful and constructive comments raised by the venerable anonymous reviewers. This work was supported by Leiden University Graduate School of Teaching, and The China Scholarship Council—Leiden University Joint Scholarship Program.
Funding
The China Scholarship Council—Leiden University Joint Scholarship Program [Grant number 201806990035].
Author information
Authors and Affiliations
Contributions
XW: Conceptualization, Methodology, Formal analysis, Investigation, Data curation, Writing—original draft, Writing—review and editing, Visualization, Funding acquisition, Project administration. NS: Conceptualization, Methodology, Formal analysis, Writing—review and editing, Supervision, Project administration. WA: Conceptualization, Methodology, Formal analysis, Writing—review and editing, Supervision, Project administration.
Corresponding author
Ethics declarations
Competing interest
The authors declare that they do not have any competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Wei, X., Saab, N. & Admiraal, W. What rationale would work? Unfolding the role of learners’ attitudes and motivation in predicting learning engagement and perceived learning outcomes in MOOCs. Int J Educ Technol High Educ 21, 5 (2024). https://doi.org/10.1186/s41239-023-00433-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s41239-023-00433-2