Abstract
This paper presents a multi-informant study on school climate with the aim of (a) comparing students’, teachers’, and parents’ perceptions of several school climate dimensions and (b) examining the associations between dimensions pertaining to classroom practices and school atmosphere in both students and teachers. Participants comprised 105 teachers, 320 parents, and 1070 students (49% female; Mage = 11.77) enrolled in four middle schools in Northern Italy. The latent mean comparison of students’, teachers’, and parents’ perceptions revealed many significant differences, with teachers generally reporting better perceptions of the quality of the school environment. A multigroup path analysis highlighted associations between classroom practices and school atmosphere dimensions of school climate which varied for students and teachers. The findings are discussed in terms of their implications for school intervention and the fostering of a supportive school environment.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
A multi-informant study of school climate: student, parent, and teacher perceptions
School climate is defined as “the quality and character of school life” (Cohen et al., 2009, p. 182), concerning both the psychosocial school atmosphere and intergroup interactions (Reyes et al., 2012). The vast literature in this field has come to agree that the construct of school climate is multidimensional, including aspects that range from didactic practices to learning processes, from relational quality to discipline and safety (for a review, see Wang & Degol, 2016). Also, many studies have provided evidence that the various school climate dimensions affect learning and academic achievement (Berkowitz et al., 2017) as well as more clinical outcomes, such as problem behaviours or violence in school (Reaves et al., 2018; Steffgen et al., 2013) and students’ and teachers’ mental health (Aldridge & McChesney, 2018; Gray et al., 2017).
Even if several authors provided theoretical frameworks suggesting ways of organizing the understanding of school climate (see, e.g., the authoritative school climate theory, Cornell et al., 2016), most empirical works on school climate still do not rely on solid theoretical foundations (Wang & Degol, 2016). Interesting suggestions able to inform research come especially from the system view of school climate (Rudasill et al., 2018), emphasizing that school is made of a series of nested and interactive systems that are entwined to promote or detract from students’ school experience. This view suggests that for a better comprehension of school climate we need to address two major weaknesses of the current literature. The first is that, to build a systemic understanding of school climate, we need studies including multiple perspectives, as the existing literature is based almost exclusively on student perceptions (Wang & Degol, 2016). The second regards the lack of distinction between aspects related to concrete practices experienced every day in the classroom and aspects related to the relational and educational atmosphere felt in the school (Grazia & Molinari, 2021a). These two aspects, often considered at the same level in empirical studies, would instead be better understood as different nested systems in a systemic perspective (Rudasill et al., 2018), offering a clearer path for interpretation.
The present study adopted a multi-informant approach to provide innovative insights in the direction of addressing both these weaknesses. More specifically, our first aim was to collect and compare different point of views on school climate, by including teachers and parents alongside students, to portray a comprehensive picture of school climate perceptions. Then, we examined the associations between classroom practices and school atmosphere components of school climate, considered as two distinct and yet related components of the school environment, and again compared how these associations varied for different informants.
A multi-informant perspective in school climate research
A recent cornerstone review of the literature on school climate highlighted that almost all school climate research has used students’ perceptions as the primary source of information (Wang & Degol, 2016). This is a major gap in the existing literature, as each of the various school actors, students, and teachers but also parents provides unique yet complementary visions of school climate. Several authors agree that, whenever possible, measurement of school climate should be based on collective and multiple perceptions (Marsh et al., 2012, Wang & Degol, 2016) in order to compose a truer and richer picture of the environment experienced in school. However, only few existing research have integrated multiple perspectives on different aspects and dimensions of school climate to study its links with school level contextual factors (Konold, 2018) and student outcomes such as student dropout (Kotok et al., 2016) and achievement (Konold et al., 2018; Maxwell et al., 2017) and none directly compared different perspectives on the same dimensions. Nonetheless, there are studies which, even if not explicitly focused on the study of school climate, provided evidence that students and teachers often do not share similar views of the learning environment and didactic practices, with teachers showing a more positive outlook (Mameli et al., 2020; Raviv et al., 1990). These findings further support the importance for school climate research to expand its reach by including multiple informants in order to compose and compare their perspectives.
The scarcity of multi-informant studies may be due in part to the methodological challenges related to their design, which may discourage or hinder their conduction and publication. Indeed, research with multiple perspectives requires adequate samples and multi-informant measures with sound psychometric properties, which are not always available (Grazia & Molinari, 2021a). This study aimed to fill in this gap of school climate literature by comparing students’, teachers’, and parents’ perceptions of many dimensions of their school’s climate. To achieve this, we used a multidimensional measure of school climate (the Multidimensional School Climate Questionnaire, MSCQ) including a student and parent version, already validated (Grazia & Molinari, 2021b, 2022), and a teacher version, of which we assessed psychometric properties and measurement invariance for this study. This measure, based on a systemic approach to school climate (Janosz et al., 1998) consistent with the theoretical view proposed by Rudasill et al. (2018), offers a methodologically sound ground to address this major weakness of school climate research.
School and classroom climate distinct yet related components
A second weakness of the existing literature on school climate concerns the theoretical conceptualization and assessment of school and classroom climate as two distinct yet related structural and organizational entities. The system view of school climate proposed by Rudasill et al. (2018) offers a clear conceptualization of these two entities. These authors argued that classrooms constitute the proximal nanosystem, made up of practices and interactions, in which the more distant school climate (microsystem), made up of beliefs and relational aspects, is created by means of the combined perceptions of its members. In other words, in the classroom everyday life, students interact among one another and, with the teachers, are involved and participate in didactic practices. Through all these actions, they build their experience as members of the school community and develop interpretations and perceptions that converge in their vision of school climate. Grasping the distinction and interdependence between these two entities is thus a necessary step for capturing the complexity of school climate.
However, on the empirical level, this distinction is not accounted for. As shown by previous reviews providing a reasoned description of school climate measures (Zullig et al., 2010), most of them include items and dimensions more closely related to what happens inside the classroom (e.g., teacher support) alongside items and dimensions regarding the broader school atmosphere such as school connectedness. To our knowledge, there is no study offering a comprehensive view of school climate capable of keeping these two entities distinct in order to assess their associations.
In the present study, we filled in this gap by studying the associations between classroom and school-related dimensions of school climate. The measure we used, the MSCQ, is useful to this aim because it is based on the conceptualization of school climate proposed by Janosz et al. (1998) who, consistently with the system view (Rudasill et al., 2018), argued that school climate is made up of two different components, one related to the concrete practices experienced every day in the classroom and another related to the more abstract features of the relational and educational climate felt in the school. Consistently with this view, the MSCQ is composed by two distinct sections, one including dimensions measuring classroom practices and another including dimensions related to the school atmosphere. This structure offers the possibility to clearly distinguish these components of school climate and assess their reciprocal associations (Grazia & Molinari, 2021b). Moreover, having adopted a multi-informant approach, we could also move a step further and compare these associations for students and teachers.
Research objectives
Research on school climate, while clearly establishing the importance of this construct for the study and improvement of learning environments, is affected by some weaknesses. First, scholars agree on the need to include multiple perspectives in the study of school climate (Wang & Degol, 2016), but a comparison of students, teachers, and parents points of view on the same dimensions was never conducted before. Second, while the systemic view of school climate suggests the importance of understanding the specificity of each nested level of the school environment (Rudasill et al., 2018), concrete classroom activities and the more abstract school atmosphere have never been clearly distinguished and studied in their reciprocal associations. In the present study, we adopted a multi-informant approach to address these weaknesses of the literature and provide new insights to school climate research.
This general purpose was achieved by pursuing three specific aims. First, we tested the psychometric properties of the teacher version of the MSCQ, made up of dimensions and items that mirrored those already comprised in the validated students’ and parents’ versions, and tested its measurement invariance with respect to student and parent versions. This first step was critical to ensure that our multi-informant approach was based on a sound measure, not only validated for different populations but also allowing for comparison among perspectives without the risk of systematic measurement differences. Our prediction was to find the same factorial structure and measurement invariance among the three groups. Second, we compared students, teachers, and parents’ perceptions of classroom practices and school atmosphere. Based on the results of previous studies (Mameli et al., 2020), we expected to find that the various actors have different perceptions, with teachers more positively evaluating most aspects. Third, we examined the associations, for students and teachers, between concrete components of the school climate related to classroom practices and the more abstract dimensions of school atmosphere. In line with the system approach (Rudasill et al, 2018), which emphasizes the interplay between nested contexts, we expected classroom practices to be associated with aspects of school atmosphere. Moreover, we tested whether these associations differed between students and teachers. As this comparison had never been done before, we advanced no predictions.
Method
Participants
The total populations of students, teachers and parents of four middle schools (sixth to eighth grade) in Northern Italy were involved in this study and asked to complete a questionnaire on a voluntary basis without incentives. The choice to focus on middle schools, which in Italy are a self-contained stage of transition from primary to secondary school, was motivated by a far-reaching interest in the educational implications of research. In these years, students experience a stable environment (with the same classmates and mostly the same teachers) helping them to move from the relational-centered approach of primary schools to the knowledge transmission approach of high school (Kim et al., 2014).
The families come from very heterogeneous social and cultural backgrounds. For this study, we did not directly assess their socio-economic status. However, from the Italian Ministry of University and Research (MIUR) official website providing information on every single school, we know that the four participating schools were attended by students from a varied socio-economic background, ranging from low to high, and that a relevant percentage (between about 10 and 20%) of them came from non-Italian families, mostly originating from Northern Africa and Eastern Europe.
The participants were 105 teachers (85% female; all of Italian origins; 3% with age ranging between 20 and 30 years old, 14% between 31 and 40, 37% between 41 and 50, 46% older), 320 parents (90% females, 92% of Italian origin; 1% aged 20 to 30 years, 14% aged 31 to 40, 75% aged 41 to 50, 10% older), and 1070 students (49% female; 93% born in Italy; Mage = 11.77, SDage = 0.72). Given the great difference in numbers for the three participant groups, we followed a procedure for balancing the group numbers while making the most of our total sample. We used SPSS software to automatically select smaller random samples of students for each multigroup analysis, extracting a percentage of the total sample that was comparable to that of the other groups (teachers or parents). The selected random samples were set up to be representative of the whole sample in terms of gender, Italian, or non-Italian origin and mean age. To accomplish our first and second aims, we considered a random sample of 206 students for the comparison with teachers and another sample of 339 students for the comparison with parents; finally, we accomplished our third aim by considering another sample of 117 students.
Procedures
In compliance with the ethical norms laid down by the Italian National Psychological Association, all participants were informed about the study’s aims, confidentiality of their answers, and the voluntary nature of their participation. For students, informed consent of both parents was collected (with about 1% of parents refusing). By means of an online platform, teachers and parents filled in the questionnaire individually, at a time of their choice during an allotted period, while students completed the questionnaire during school hours in the presence of a researcher who gave the same instructions to everyone and answered any questions.
Measures
The Multidimensional School Climate Questionnaire (MSCQ) is a multidimensional and multi-informant measure for school climate, with validated versions and measurement invariance achieved for students (Grazia & Molinari, 2021b) and for parents (Grazia & Molinari, 2022). The teacher version was developed for this study and its psychometric properties were evaluated (first aim). All versions are made up of two main sections, classroom practices and school atmosphere. The section classroom practices refers to what is actually done in everyday class activities. In the versions for students and for teachers, this section comprises six dimensions, namely, rules, student support, student involvement, positive teaching, encouragement, and class management. In the parent version, it only includes the dimension of student support, of which parents can have experience. The school atmosphere section refers to perceptions of intangible and abstract features of the school environment that individuals develop through repeated experiences. For students and teachers, this section includes five dimensions, that is, student relations, student–teacher relations, educational climate, sense of belonging, and interpersonal justice. The parent-version includes the same dimensions, with the exception of the sense of belonging. An overlook of the dimensions for each version can be found in Table 1.
Overall, the student and teacher versions include 49 items and the parent version 27 items. All items are worded in mirroring ways for the different informants (e.g., the student-version item “In my school, we are expected to do our best” is formulated in the teacher-version as “In my school, students are expected to do their best,” and in the parent-version as “In my child’s school, students are expected to do their best”). Participants were asked to answer on a 6-point Likert scale ranging from “completely disagree” to “completely agree,” so that higher scores indicate better perceptions of school climate. Cronbach’s alphas for each dimension are reported in the Results section.
Data analysis
All analyses were carried out with Mplus version 8.0 (Muthén & Muthén, 1998–2017) using maximum likelihood with robust standard error estimator (MLR). For our first aim, we explored the factorial structure and the psychometric properties of the teacher version of the questionnaire. In order to test whether the factorial structure for the student-version would fit the teacher-version as well, we conducted confirmatory factor analyses (CFA) on the classroom practices and school atmosphere sections separately. We considered the following indices of goodness of fit and cutoff criteria: root mean square error of approximation (RMSEA < 0.08), comparative fit index (CFI > 0.90), and standardized root mean squared residual (SRMR < 0.08) (Hu & Bentler, 1999; Lai & Green, 2016). We tested the internal consistency by computing Cronbach’s alphas and composite reliability scores (w) for each dimension (Dunn et al., 2014).
We then tested measurement invariance between the teacher-version of the MSCQ and the other two (for students and for parents), a necessary condition to carry out the subsequent comparisons. These analyses allowed us to test in steps whether the same questionnaire is invariant for different informants with regard to (a) the general factorial structure (configural invariance); (b) loadings of each item on the factor it is meant to measure (metric invariance); and (c) intercepts (i.e., mean scores) for each item (scalar invariance). Thus, we sequentially constrained model structure, factor loadings and item thresholds to be equal across groups (teachers and students; teachers and parents) and compared model fit indices for the resulting nested models to assess whether the deterioration of model fit in the more constrained model was acceptable. Cutoff criteria to keep the more constrained model were ΔCFI ≤ − 0.010 and ΔRMSEA < 0.015 (Chen, 2007; Cheung & Rensvold, 2002). We also tested the Satorra-Bentler scaled chi square difference (Satorra & Bentler, 2001), but, given its higher sensitivity to sample size, in case of disagreement among indices of fit, we considered the other indices sufficient (Cheung & Rensvold, 2002).
To accomplish our second aim, we conducted latent means comparisons, computed in the scalar invariance model by constraining the comparison group’s latent means to be zero and leaving the other’s latent means free to be estimated in terms of the difference between groups’ means. We then computed the critical ratio (CR) to assess whether the differences were significant, by dividing the parameter estimate for its standard error. A CR value larger than 1.96 indicates statistically significant differences in the latent means; if it is positive, the group has a latent mean higher than the comparison group, while if it is negative, the group has a latent mean lower than the comparison group. Lastly, Cohen’s d (parameter estimate divided by the standard deviation) was computed as a measure of effect size of the difference in latent means.
As for the third aim, we started with a path analysis with latent variables to test whether Classroom practices would be associated with school atmosphere for a sample of students and teachers together. We first tested a model with all dimensions of both sections and then eliminated non-significant paths to obtain a final model. Afterwards, we performed a multigroup analysis to evaluate differences in path coefficients between students and teachers. In a first model, no constraints were specified, then path coefficients were constrained to be equal across groups, and changes in model fit indices were compared with the same cut off criteria indicated above. If differences in the indices exceed the cutoff criteria, there is a deterioration in model fit, indicating that path coefficients are not invariant across groups.
Results
Factorial structure and measurement invariance of the MSCQ teacher version
The CFA on the six-dimensions model for the section classroom practices led to a few weighted adjustments. Modification indices suggested correlating a few residual errors, which can be considered as theoretically plausible (Gerbing & Anderson, 1984) as the items were mostly from the same dimension and tended to have similar formulations and meanings, which makes correlations plausible (e.g., “Most teachers appear to take pleasure from teaching” and “Most teachers appear to love their job”). One dimension (class management) and one item from the student-version (SS1, “There are professionals meant to help students with academic or personal problems”) showed unacceptable psychometric properties and largely worsened the model fit (respectively, RMSEA = 0.08, CFI = 0.83, SRMR = 0.13, and RMSEA = 0.07, CFI = 0.89, SRMR = 0.08), so we decided to remove them from the model and from subsequent comparison analysis for all participants. Information criteria supported this choice, as values for Akaike information criterion (AIC) and Bayesian information criterion (BIC) were higher for the six-dimension model (five-dimensions: AIC = 4964.786 and BIC = 5190.373; six dimensions: AIC = 6154.01 and BIC = 6414.099) and for the model including the item (model without the item: AIC = 4964.786 and BIC = 5190.373; model with the item: AIC = 5248.591 and BIC = 5482.139).
The resulting five-dimension model reported acceptable fit indices: MLR χ2 (190) = 279.38, p = 0.000; RMSEA = 0.07; CFI = 0.91; SRMR = 0.08. Factor loadings were all significant and are reported in Table 1. Also for the school atmosphere section, after consulting the modification indices and theoretical reflection, we correlated a few error terms (e.g., “In general, students get along with one another” and “In general, relations among students are friendly”). The expected five-dimension model obtained good fit indices: MLR χ2 (193) = 264.88, p = 0.001; RMSEA = 0.06; CFI = 0.93; SRMR = 0.07. Factor loadings are reported in Table 2.
Composite reliability scores (Table 1) and Cronbach’s alphas (Table 3) were all above 0.70, indicating good internal consistency. Pearson’s bivariate correlations (Table 3) showed that all dimensions were positively correlated.
The teacher-version questionnaire achieved full configural and metric invariance with both student and parent versions (Table 4). Full scalar invariance was also obtained between teachers and parents, while with the students some items appeared to have non-invariant thresholds. After consulting the modification indices and a theoretical evaluation, they were freed from constraints, obtaining a partial scalar invariance. Each step is reported in Table 4. On the whole, we collected evidence to support measurement invariance among the different informants.
A comparison of school climate perceptions of students, parents, and teachers
The latent means comparisons (Table 5) highlighted many significant differences across groups.
With regard to the comparison between students and teachers, we found that teachers reported significantly higher scores in all the dimensions, with the exception of student relations and educational climate. In the student–teacher relations and interpersonal justice dimensions, the difference reported a large effect size, while in the remaining dimension effects, sizes were medium or small. We also found significant differences when comparing students and parents, with parents reporting lower scores in student support and higher scores in interpersonal justice and student–teacher relations; however, effect sizes were small for the first two differences and medium for the third. Teachers and parents also differed significantly in student support, student–teacher relations, and interpersonal justice, with parents reporting worse perceptions on all dimensions. Effect sizes were small except for the differences in the perception of student support, which reported a medium effect size.
Associations between classroom practices and school atmosphere dimensions for students and teachers
After exploring the associations between classroom practices and school atmosphere, we removed nonsignificant paths to obtain a final simpler model. This model showed good fit to our data: MLRχ2 (17) = 24.621, p = 0.104; RMSEA = 0.05; CFI = 0.99; SRMR = 0.05. The dimensions rules and positive teaching emerged to be significantly associated with school atmosphere dimensions (path coefficients for the full sample are reported in Table 6).
Then we tested a multigroup unconstrained model on students and teachers separately, which reported good fit to our data (MLRχ2 (34) = 53.049, p = 0.020; RMSEA = 0.07; CFI = 0.99; SRMR = 0.06), even though path coefficients appeared to vary greatly. In fact, when we fixed them to be equal in a constrained multigroup model, the model fit reported an unacceptable deterioration (MLRχ2 (51) = 130.024, p = 0.000; RMSEA = 0.12; CFI = 0.97; SRMR = 0.19). Therefore, as the model indicated that the associations between classroom practices and school atmosphere were not invariant between teachers and students, it was rejected. Path coefficients for both groups from the unconstrained model are reported in Table 6.
Discussion
The purpose of this study, built upon a system approach to school climate (Janosz et al., 1998; Rudasill et al., 2018), was to address two main weaknesses of the literature on school climate, i.e., the scarcity of studies including multiple perspectives and considering separately classroom and school level components of school climate. The findings and their educational implications are discussed in the following sections.
The multi-informant perspective
With regard to our first aim, the MSCQ teacher-version was confirmed to have good psychometric properties, and the factorial structure resulted to be largely the same in the three considered groups of students, parents, and teachers. The dimensions of each questionnaire section reported substantial correlations among them, but not so high as to indicate discriminant validity issues. While acknowledging that these correlations should be interpreted with due caution, we note that they respect the nature of the questionnaire, measuring several closely related aspects of the school environment. Even more importantly, measurement invariance between the teacher version and the other two versions was found. This is an important and innovative result that promotes the use of this instrument for multiple informant studies and for score comparisons. A few items were not invariant on the scalar level between students and teachers, but they were scattered in different dimensions so that, in the end, no dimension had fewer than three fully invariant items, which are considered sufficient to compare latent means (Byrne et al., 1989). Overall we can conclude that MSCQ is a valid as well as reliable measure for multi-informant studies.
The good psychometric properties of MSCQ in the three versions allowed us to compare the points of view of different actors on the same dimensions, something that to our knowledge had never been done before. The findings were interesting and have a number of implications for research and practice. In the comparison between students and teachers, we found differences in their perception of student–teacher relations and interpersonal justice, both showing large effect sizes, with teachers scoring higher. Overall, even if with smaller effect sizes, teachers had a more positive view of almost every dimension. This finding is consistent with previous studies (Mameli et al., 2020) and has important practical implications, as teachers’ more favorable perceptions may limit their capacity to see and respond to the students’ needs and requests (Den Brok et al., 2006; Könings et al., 2014). Moreover, this finding seems to suggest that the quality of relationships between students and teachers and the perceived fairness of the educational environment may be weak points in the overall school climate perceived by students. Given the associations of these school climate components with student outcomes such as motivation (Chory-Assad, 2002) and engagement (Fatou & Kubiszewski, 2018), these results suggest the importance of implementing interventions for improvement in this direction.
In the comparison with their parents, students also showed a more negative view of student–teacher relations and interpersonal justice, further underlining that these school climate components are critical and sensitive aspects of the students’ lives. This finding shows that parents’ perceptions, which were mostly overlooked (Bear et al., 2015), offer a unique point of view, which may enrich the understanding of how school climate is built and perceived. Indeed, parents also appeared more negative, as compared to students and teachers, on student support. These differences suggest that interventions aimed at helping parents and teachers to share common views and take into account one another’s position may improve their collaboration and foster efficient joint actions.
Overall, these findings confirm the need to account for a multi-informant approach in the study of school climate (Wang & Degol, 2016) and the importance to plan and conduct interventions capable of considering and recomposing the different perceptions. In accordance with a systemic view of school life, all the actors want their voices to be heard, and all the points of view concur in the overall perception of the school environment. Developing awareness on the multiple views is undoubtedly a useful stepping stone towards promoting school climate change and improvement. Based on our findings, a practical and feasible way for school climate improvement would be to implement actions aimed at informing students, teachers, and parents about the multiple perspectives and fostering dialogue among them.
Interdependence of classroom practices and school atmosphere dimensions
A further novel element of the present study lies in considering classroom practices and school atmosphere as distinct and yet interrelated factors. This way of conceiving school climate has brought about a step forward in the understanding of the dynamics between these two structural and organizational school entities.
In line with the system theory principles (Rudasill et al., 2018), what individuals do in the classroom reverberate on how individuals feel at school. Indeed, our findings supported the hypothesis that classroom practices are associated with school atmosphere. More specifically, we found that participants (students and teachers together) who perceived better practices in relation to the clarity of rules and to a positive teaching approach also perceived a more stimulating educational environment, a greater sense of belonging and more positive feelings of interpersonal justice. While previous studies found that rules fairness plays a role in decreasing bullying and violent behaviours (Aldridge et al., 2018; Lindstrom Johnson et al., 2017), our findings add that this dimension is also important in building a good school atmosphere. As for positive teaching, consistently with our findings, previous research linked different but related dimensions (i.e., academic emphasis and academic support) with better achievement (Maxwell et el., 2017) and general school satisfaction (Zullig et al., 2011). In the present study, an interesting distinction between the two practices was that higher scores in the Rules dimension were related to the perception of better relations among students, while positive teaching was related to the perception of better relations with teachers. These findings are of great importance, as the perceptions of relationships inside the school are a central aspect of the school climate (Fraser & Walberg, 2005). Having clear and consistently enforced rules contributes to the creation of a learning environment in which good relations among students can thrive, while teachers’ enthusiasm is able to promote good student–teacher relations.
Ultimately, through the analysis of the different paths for students and teachers, the multi-informant approach has allowed us to go one step further in the understanding of the associations between practices and atmosphere. A multigroup path analysis (on students and teachers separately) from the classroom practices to the school atmosphere dimensions showed that the above-discussed model was not invariant across both groups. In particular, for the teacher sample, none of the associations emerged as significant. A possible interpretation of this result is that teachers, most of whom can count on many years of teaching experience, may perceive the activities to be carried out in the classroom as more crystallized and static and thus unchangeable. This raises some concern, because if teachers are convinced that changing their practices will not lead to any improvements, they may not make the effort to review such practices in order to exploit their potential for the purposes of improving the school environment. Reflecting on the differences in perceptions might be an important leverage that informs an intervention, and a starting point to ease what, according to our findings, is perceived as a static situation. More specifically, interventions aimed at improving the relational environment in the school might start with actions focused on raising teachers’ awareness about the associations in their pupils’ perceptions of their practices and the relational environment, which could motivate them on a path of reflection and improvement.
Limitations
The study does have several limitations. First, the data collection in four schools located in the same geographical area limits the scope of the results for two reasons. One is that the limited school sample did not allow us to conduct extensive multilevel analyses considering between-school variance. Starting from the insights provided by our findings, future studies might address this limitation with wider samples and multilevel analyses, as it was done before on other topics in school climate literature (see for an example Konold, 2018). Moreover, the study focus was on the Italian school context, while most of the reference work comes from the USA. In future research, cross-cultural studies might offer important cues on the links between school contexts and climate. Another limit is that the teacher sample in this study was relatively small and this did not allow us to conduct a rigorous validation of the measures. However, such a limitation is intrinsically related to the aim of comparing different points of views within the same schools, as the student–teacher ratio is necessarily and strongly unbalanced in favor of the former group. Future studies focusing specifically on teachers could address this limitation, providing further evidence of the psychometric properties of the measure, together with its predictive and discriminant validity. We should also note that, as our adult participants responded anonymously using an online platform (procedure employed for encouraging participation), we were unable to match parents, students, and teachers’ answers. This is certainly an important limitation that we hope will be addressed with future studies. However, given the absence of previous studies comparing different points of view, this research can still provide useful insights and encourage this new line of inquiry in the study of school climate. Lastly, this is a correlational and cross-sectional study that seeks to understand the processes that operate over time in schools. Therefore, longitudinal data are most certainly needed to confirm the direction of the effects.
Conclusion
In conclusion, we stress the importance to theoretically ground school climate research within a systemic framework, which highlights the importance of accounting for all school actors’ points of view and for the interdependence of the various nested levels (Bronfenbrenner, 1992; Rudasill et al., 2018). Notwithstanding the above-mentioned limitations, the multi-informant nature of the present study does offer interesting insights for both research and practice. For research, as this study can inform future studies by suggesting the importance of including different sources of information in order to truly capture the nuanced scenario of school climate. For practice, because reflecting on differences in perceptions and on the associations between everyday classroom practices and school atmosphere may be a first step for the implementation of interventions aimed at promoting a positive school environment.
References
Aldridge, J. M., & McChesney, K. (2018). The relationships between school climate and adolescent mental health and wellbeing: A systematic literature review. International Journal of Educational Research, 88, 121–145. https://doi.org/10.1016/j.ijer.2018.01.012
Aldridge, J. M., McChesney, K., & Afari, E. (2018). Relationships between school climate, bullying and delinquent behaviours. Learning Environments Research, 21(2), 153–172. https://doi.org/10.1007/s10984-017-9249-6
Bear, G. G., Yang, C., & Pasipanodya, E. (2015). Assessing school climate: Validation of a brief measure of the perceptions of parents. Journal of Psychoeducational Assessment, 33(2), 115–129. https://doi.org/10.1177/0734282914545748
Berkowitz, R., Moore, H., Astor, R. A., & Benbenishty, R. (2017). A research synthesis of the associations between socioeconomic background, inequality, school climate, and academic achievement. Review of Educational Research, 87(2), 425–469. https://doi.org/10.3102/0034654316669821
Bronfenbrenner, U. (1992). Ecological systems theory. In R. Vasta (Ed.), Six theories of child development: Revised formulations and current issues (pp. 187–249). Jessica Kingsley.
Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. https://doi.org/10.1037/0033-2909.105.3.456
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Chory-Assad, R. M. (2002). Classroom justice: Perceptions of fairness as a predictor of student motivation, learning, and aggression. Communication Quarterly, 50(1), 58–77. https://doi.org/10.1080/01463370209385646
Cohen, J., Mccabe, E. M., Michelli, N. M., & Pickeral, T. (2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111(1), 180–213.
Cornell, D., Shukla, K., & Konold, T. R. (2016). Authoritative school climate and student academic engagement, grades, and aspirations in middle and high schools. AERA Open. https://doi.org/10.1177/2332858416633184
Den Brok, P. J., Bergen, T. C. M., & Brekelmans, J. M. G. (2006). Convergence and divergence between students’ and teachers’ perceptions of instructional behaviour in Dutch secondary education. In D. L. Fisher & M. S. Khine (Eds.), Contemporary approaches to research on learning environments: World views (pp. 125–160). World Scientific.
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399–412. https://doi.org/10.1111/bjop.12046
Fatou, N., & Kubiszewski, V. (2018). Are perceived school climate dimensions predictive of students’ engagement? Social Psychology of Education, 21, 427–446. https://doi.org/10.1007/s11218-017-9422-x
Fraser, B. J., & Walberg, H. J. (2005). Research on teacher-student relationships and learning environments: Context, retrospect and prospect. International Journal of Educational Research, 43, 103–109. https://doi.org/10.1016/j.ijer.2006.03.00
Gerbing, D. W., & Anderson, J. C. (1984). On the meaning of within-factor correlated measurement errors. Journal of Consumer Research, 11, 572–580. https://doi.org/10.1086/208993
Gray, C., Wilcox, G., & Nordstokke, D. (2017). Teacher mental health, school climate, inclusive education and student learning: A review. Canadian Psychology/psychologie Canadienne, 58(3), 203–210. https://doi.org/10.1037/cap0000117
Grazia, V., & Molinari, L. (2021a). School climate multidimensionality and measurement: a systematic literature review. Research Papers in Education, 36(5), 561-587. https://doi.org/10.1080/02671522.2019.1697735
Grazia, V., & Molinari, L. (2021b). School climate research: Italian adaptation and validation of a multidimensional school climate questionnaire. Journal of Psychoeducational Assessment, 39(3) 286–300. https://doi.org/10.1177/0734282920967141
Grazia V., & Molinari L. (2022). The Multidimensional School Climate Questionnaire (MSCQ) parent-version: factorial structure and measurement invariance. International Journal of School & Educational Psychology, 10(2), 243-247. https://doi.org/10.1080/21683603.2020.1828205
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Janosz, M., Georges, P., & Parent, S. (1998). L’environnement socioéducatif à l’école secondaire: Un modèle théorique pour guider l’évaluation du milieu [The socio-educational environment in secondary schools: A theoretical model for evaluating the context]. Revue Canadienne De Psychoeducation, 27(2), 285–306.
Kim, H. Y., Schwartz, K., Cappella, E., & Seidman, E. (2014). Navigating middle grades: Role of social contexts in middle grade school climate. American Journal of Community Psychology, 54, 28–45. https://doi.org/10.1007/s10464-9659-x
Könings, K. D., Seidel, T., & van Merriënboer, J. J. (2014). Participatory design of learning environments: Integrating perspectives of students, teachers, and designers. Instructional Science, 42(1), 1–9. https://doi.org/10.1007/s11251-013-9305-2
Konold, T. (2018). A Multilevel MTMM Approach to estimating the influences of contextual factors on trait and informant-based method effects in assessments of school climate. Journal of Psychoeducational Assessment, 36(5), 464–476. https://doi.org/10.1177/0734282916683286
Konold, T., Cornell, D., Jia, Y., & Malone, M. (2018). School climate, student engagement, and academic achievement: A latent variable, multilevel multi-informant examination. AERA Open. https://doi.org/10.1177/2332858418815661
Kotok, S., Ikoma, S., & Bodovski, K. (2016). School climate and dropping out of school in the era of accountability. American Journal of Education, 122(4), 569–599. https://doi.org/10.1086/687275
Lai, K., & Green, S. B. (2016). The problem with having two watches: Assessment of Fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51(2–3), 220–239. https://doi.org/10.1080/00273171.2015.1134306
Lindstrom Johnson, S., Waasdorp, T. E., Cash, A. H., Debnam, K. J., Milam, A. J., & Bradshaw, C. P. (2017). Assessing the association between observed school disorganization and school violence: Implications for school climate interventions. Psychology of Violence, 7(2), 181–191. https://doi.org/10.1037/vio0000045
Mameli, C., Grazia, V., & Molinari, L. (2020). Agency, responsibility and equity in teacher vs student-centred activities: a comparison between teachers' and learners’ perceptions. Journal of Educational Change, 21, 345-361. https://doi.org/10.1007/s10833-019-09366-y
Marsh, H. W., Ludtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Koller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group level effects. Educational Psychologist, 47, 106–124. https://doi.org/10.1080/00461520.2012.670488
Maxwell, S., Reynolds, K. J., Lee, E., Subasic, E., & Bromhead, D. (2017). The impact of school climate and school identification on academic achievement: Multilevel modeling with student and teacher data. Frontiers in Psychology, 8, 1–21. https://doi.org/10.3389/fpsyg.2017.02069
Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus user’s guide (8th ed.). Los Angeles, CA: Muthén & Muthén.
Raviv, A., Raviv, A., & Reisel, E. (1990). Teachers and students: Two different perspectives? Measuring social climate in the classroom. American Educational Research Journal, 27(1), 141–157. https://doi.org/10.3102/00028312027001141
Reaves, S., McMahon, S. D., Duffy, S. N., & Ruiz, L. (2018). The test of time: A meta-analytic review of the relation between school climate and problem behavior. Aggression and Violent Behavior, 39, 100–108. https://doi.org/10.1016/j.avb.2018.01.006
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104, 700–712. https://doi.org/10.1037/a0027268
Rudasill, K. M., Snyder, K. E., Levincon, H., & Adelson, J. L. (2018). Systems view of school climate: A theoretical framework for research. Educational Psychology Review, 30, 35–60. https://doi.org/10.1007/s10648-017-9401-y
Satorra, A., & Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507–514. https://doi.org/10.1007/BF02296192
Steffgen, G., Recchia, S., & Viechtbauer, W. (2013). The link between school climate and violence in school: A meta-analytic review. Aggression and Violent Behavior, 18(2), 300–309. https://doi.org/10.1016/j.avb.2012.12.001
Wang, M. T., & Degol, J. L. (2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315–352. https://doi.org/10.1007/s10648-015-9319-1
Zullig, K. J., Koopman, T. M., Patton, J. M., & Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(2), 139–152. https://doi.org/10.1177/0734282909344205
Zullig, K. J., Huebner, E. S., & Patton, J. M. (2011). Relationships among school climate domains and school satisfaction. Psychology in the Schools, 48(2), 133–145. https://doi.org/10.1002/pits.v48.2
Funding
Open access funding provided by Università degli Studi di Parma within the CRUI-CARE Agreement.
Author information
Authors and Affiliations
Contributions
LM participated in conceiving the study design, scientifically supervised the study, contributed to the interpretation of the results, and drafted the manuscript. VG participated in conceiving the study design, conducted the statistical analysis, contributed to the interpretation of the results, and drafted the methodological and results sections of the manuscript. All authors contributed to the final manuscript.
Corresponding author
Ethics declarations
Consent to participate
Informed consent was obtained from all individual participants included in the study and their legal guardians. The research was conducted in accordance with the ethical norms of the Italian National Psychological Association.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Valentina Grazia. A Junior Researcher in Developmental and Educational Psychology at the Department of Humanities, Social Sciences and Cultural Industry, University of Parma, Italy.
Current themes of research:
Student engagement, academic emotions, well-being and social relations in school and school climate.
Most relevant recent publications:
Grazia, V., Molinari, L. (2021). School climate multidimensionality and measurement: A systematic literature review. Research Papers in Education. 10.1080/02671522.2019.1697735.
Grazia, V., Mameli, C., & Molinari, L. (2021). Being bored at school: Trajectories and academic outcomes. Learning and Individual Differences, 90, 102049. 10.1016/j.lindif.2021.102049.
Grazia, V., Mameli, C., & Molinari, L. (2020). Adolescents’ Profiles Based on Student Agency and Teacher Autonomy Support: Does Interpersonal Justice Matter? European Journal of Psychology of Education. 10.1007/s10212-020-00504-2.
Grazia V., & Molinari L. (2020). The Multidimensional School Climate Questionnaire (MSCQ) Parent-Version: Factorial Structure and Measurement Invariance. International Journal of School & Educational Psychology. 10.1080/21683603.2020.1828205.
Luisa Molinari. Full Professor of Developmental and Educational Psychology at the University of Parma and the coordinator of the PhD Program in Psychology.
Current themes of research:
Classroom justice, responsibility and rights, observational methods, the quality of educational processes, school climate.
Most relevant recent publications:
Mameli, C., Grazia, V., Passini, S., Molinari, L. (2021). Student perceptions of interpersonal justice, engagement, agency and anger: A longitudinal study for reciprocal effects. European Journal of Psychology of Education. 10.1007/s10212-021-00559-9.
Molinari, L., Grazia, V. (2021). Students’ school climate perceptions: Do engagement and burnout matter? Learning Environments Research. Advance online publication. 10.1007/s10984-021-09384-9.
Molinari, L., Grazia, V., Corsano, P. (2020). School relations and solitude in early adolescence: A mediation model involving Rejection Sensitivity. Journal of Early Adolescence, 40(3), 426-448.
Mameli, C., Caricati, L., Molinari, L. (2020). That’s not fair! The effects of teacher justice and academic achievement on Self and Other’s resistant agency. British Journal of Educational Psychology, 90, 933-947. 10.1111/bjep.12335.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Molinari, L., Grazia, V. A multi-informant study of school climate: student, parent, and teacher perceptions. Eur J Psychol Educ 38, 1403–1423 (2023). https://doi.org/10.1007/s10212-022-00655-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10212-022-00655-4