Abstract
Non-formal learning settings like out-of-school labs provide students with insights into authentic learning situations. For example, in physics, students are engaged in experimenting as an authentic method. However, increasing the authenticity in experimentation can lead to overwhelming demands and hinder concept development and does not even need to be perceived as more authentic. We investigated the role of authenticity in experimenting in an out-of-school lab. Specifically, we explored (a) what influence the level of guidance has on students’ perceived authenticity (RQ1), (b) which references students use in their assessment judging perceived authenticity (RQ2), and (c) to what extent perceived authenticity predicts students’ learning outcomes (RQ3). To address these issues, a mixed methods study was carried out. One hundred forty-two students of seventh and eighth grade experimented in small groups and investigated the pattern that occurs when different apertures are placed between various light sources and a screen. Students were randomly assigned to one of two variants of the learning setting. In the guided experimentation group, students performed five pre-designed experiments and one freely chosen experiment, while the self-determined experimenting students freely designed all six experiments. A questionnaire was administered for perceived authenticity and interviews were conducted about the experimentation process. The learning outcome was measured with a pre- and post-test. We found no significant difference in perceived authenticity and learning outcomes of the two groups. To explain this, we conducted and analyzed interviews in terms of students’ understandings of authentic research to determine the views their authenticity judgments were based on.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Non-formal learning
Formal learning in institutions like schools or universities is based on a curriculum that usually focuses on knowledge acquisition and ends with a certification of learning goals and qualifications (Aßmann, 2013; Leu, 2014). In contrast, non-formal learning is also goal-oriented but takes place outside the formal learning systems. Its content is not determined through a curriculum and the learning process does not require final certification (Rogers, 2014). Non-formal learning has a complementary and sometimes compensatory function to formal learning (Commission of the European Communities, 2001). One institution that can complement school-based formal learning is the out-of-school lab. As an institution especially addressing schoolchildren, it offers additional and different learning opportunities compared to schools (Glowinski & Bayrhuber, 2011; Haupt et al., 2013). In out-of-school labs, the contents of projects do not need to be part of a (school) curriculum (Euler, 2005) but can be a thematic continuation or deepening (Euler & Schüttler, 2020). Participation in the projects is optional and the topics are thus freely selectable. Another important characteristic of out-of-school labs is that depending on the project, they aim to offer students the opportunity to act like real researchers and, therefore, to learn authentically (Betz, 2018; Glowinski & Bayrhuber, 2011; Sommer et al., 2018). According to LernortLabor (2019) as well as Haupt et al. (2013), the Alfried Krupp-Schülerlabor der Wissenschaften, in which we conducted our study, meets in our study conception the criteria of a classical out-of-school lab as students are visiting the lab with their whole class and the topic of this project is an extension of the school curriculum in physics. Further, the project day was didactically preplanned, and the goal of the day students should have reached by experimenting was already set.
Authenticity in learning situations
Working (authentically) in out-of-school labs means that students’ learning is inspired by researchers’ working approaches. Such inquiry learning involves using methods from the respective discipline (Betz, 2018; Glowinski & Bayrhuber, 2011; Haupt et al., 2013). In science, for example, this means “planning and conducting investigations, drawing conclusions, revising theories, and communicating results” (Lee & Songer, 2003, p. 923), but also working collaboratively and using typical materials of the respective discipline (Nachtigall et al., 2022). This is also in line with students’ expectations when visiting an out-of-school learning setting in the context of science lessons: students expect more time for experimentation than in school as well as working collaboratively (Nachtigall & Rummel, 2022). Further, they expect that the experiments are student-centered and that they can pursue their own ideas during the experimentation process (Garner & Eilks, 2015; Schwarzer & Parchmann, 2015). Additionally, students also expect a visit to an out-of-school lab to be authentic in the sense that it is similar to working like real researchers (Schwarzer & Parchmann, 2015).
Authentic learning, and along with it the perceived authenticity, has different advantages compared to school learning: It has a motivating effect on students (Betz, 2018; Glowinski & Bayrhuber, 2011; Nachtigall et al., 2018) as well as effects on students’ (situational) interest (Nachtigall & Rummel, 2021; Pawek, 2009), which are factors relevant for learning (Krapp, 1992), and especially important for making career decisions (Woods-McConney et al., 2013). It allows students to experience natural contexts addressing real problems, and thereby links the more abstract learning at school with the application of knowledge to the real world (Gerstenmaier & Mandl, 1995; Herrington & Oliver, 2000; Stamer et al., 2021). This should lead to the acquisition of scientific knowledge (Scharfenberg & Bogner, 2014). Further, through authentic learning situations, students can gain insights into the real work of scientists (Euler, 2005; Reimann et al., 2020; Scharfenberg & Bogner, 2014) and break down corresponding stereotypes, for example, that scientists are primarily male and wear a white coat (Christidou, 2011; Hagenkötter et al., 2021; Höttecke, 2001). This is important so that students can, for example, make informed decisions about their future careers (Euler, 2005; Scharfenberg & Bogner, 2014; Stamer et al., 2019, 2021) as well as to learn scientific reasoning for everyday life problems (Chinn & Malhotra, 2002; Mansfield & Reiss, 2020). Recent studies showed that students did not know about important aspects of scientists’ work, like interpreting data or collaboration between different researchers, and therefore, their judgments of authenticity in a learning situation were biased by their limited knowledge (Stamer et al., 2021).
Undoubtedly, there is a difference between researchers and students, for example regarding prior knowledge about the content and the inquiry process, but also regarding time and resource restrictions. Because of this, real research can be overwhelming for students (Lee & Songer, 2003). Therefore, it must be acknowledged that the authenticity of a learning situation can be classified on a continuum between a didacticized learning situation and the real world of scientists (Betz et al., 2016; Sommer et al., 2020).
Betz et al. (2016) suggested a model where perceived authenticity in learning situations is shaped by personal and learning setting characteristics. The perceived authenticity again may have an influence, for example, on students’ situational interest, concept development, and competencies. According to the model, aspects of the teaching situation such as location, method, content, material, innovation, and the instructor may influence on perceived authenticity and can be influenced through the instructor, whereas personal characteristics such as gender, prior knowledge, epistemic beliefs, and individual interest of the students are not selectable for the instructor. For example, a location could seem more authentic, if it has been prepared primarily for scientific purposes. A method is considered authentic if it is part of the scientific methods used in the discipline (Finger et al., 2022; Sommer et al., 2020). In any case, the teaching situation needs to be evaluated regarding its authenticity against the background of the discipline. The model has already been tested in the context of out-of-school labs through various studies in different subjects (history: Mierwald, 2020; linguistics: Betz, 2018; social sciences: Nachtigall et al., 2018; for an overview, see Nachtigall & Rummel, 2021)—however, empirical results on the assumptions postulated by the model were rather mixed. Betz (2018) conducted a study with the same tasks, but at two different places: in schools and in an out-of-school lab. When comparing the effects of the location on students’ perceived authenticity and their situational interest, the out-of-school lab was perceived as more authentic, and the situational interest was higher in the out-of-school lab. Nachtigall et al. (2018) as well as Nachtigall and Rummel (2021), for instance, varied the authenticity of the method from direct instruction to an approach closer to (social) scientists, namely productive failure and assessed students’ perceived authenticity as well as their situational interest. The productive failure approach simulated features of scientific inquiry, in which students worked in an initial phase on a complex problem without prior guidance and received canonical solutions to discover the limitations of their own ideas and to learn from their mistakes later on. In the direct instruction approach, typical solution strategies were presented to students before they worked on the problem. In contrast to their hypotheses, students in the more authentic productive failure approach did not report higher perceived authenticity than students who participated in the less authentic direct instruction approach. Additionally, Stamer et al. (2021) conducted a study in an out-of-school lab in which they compared two conditions with each other: watching videos of authentic scientists working and afterwards conducting the experiments versus just conducting the experiments. They found that students also watching the experiments have a better idea of scientists’ activities. Concerning the material, Schüttler et al. (2021) conducted a study in physics that compared students’ perceived authenticity of low-cost versus high-end laboratory equipment. As expected, they found that students’ perceived authenticity was significantly higher when the material was equivalent to that of real researchers. As can be seen, there are different possibilities to foster perceived authenticity in out-of-school learning opportunities. The rather mixed results for the variation of the method led us to conduct a study with varying methods in physics.
Experimenting as a learning method in physics
Experimenting is established with different functions in physics classes (Euler et al., 2015; Lazonder & Harmsen, 2016). To foster learning, it is necessary that students work not only hands-on but also with their minds, following their own ideas (Hofstein & Lunetta, 2004). This can be achieved through inquiry-based learning by allowing students to investigate a phenomenon in a “more authentic [way]” (Hofstein & Lunetta, 2004, p. 30), which means similar to the way used by scientists. According to the definition of Lazonder and Harmsen (2016), inquiry is a method where:
students conduct experiments, make observations or collect information in order to infer the principles underlying a topic or domain. These investigations are governed by one or more research questions, either provided by the teacher or proposed by the students; adhere (loosely) to the stages outlined in the scientific method; and can be performed with […] tangible materials […]. (p. 682)
Nevertheless, it is discussed whether inquiry-based learning supports effective learning of physical concepts (Hattie, 2009; Kirschner et al., 2006; Lazonder & Harmsen, 2016). In their meta-analysis, Lazonder and Harmsen (2016) conclude that guidance seems to be necessary for concept development through inquiry-based learning. However, students can be supported with different levels of guidance depending on their level of knowledge and experiences during the experimentation process (Bell et al., 2005). Bell et al. (2005), for example, distinguish in their model between four levels depending on the information about the research question, the method, and the solution that is given to the students. Further, Tesch and Duit (2004) found that in German physics lessons, the level of openness is rather low as students have nearly no opportunity to plan or analyze an experiment on their own. Chinn and Malhotra (2002) found similar results when analyzing textbook tasks as well as tasks designed by researchers: students mostly do not follow their own research questions, often do not need to conduct several studies, or do not have the task to develop a theory based on their experimental results. This is in line with the findings of Börlin (2012) that students in German physics classes have only seldom the chance to decide which experiments to conduct or in which order they want to conduct the experiments during station learning. Thus, students cannot conduct an inquiry process directly without any instructional support, for example by the teachers. They rather need especially at the beginning more support which then can decrease (Bell et al., 2005). Further, Horstendahl et al. (2000) postulated that students with high competencies and high motivation can conduct experiments with fewer instructions whereas students with low competencies and high motivation better receive more instructions to avoid overwhelming them. In line with this, Euler (2005) found that students with less interest in science need more guidance during an experimentation process. Overall, it must be considered that inquiry for school students is relatively authentic compared to the work of scientists as it is not close to authentic inquiry tasks (Chinn & Malhotra, 2002).
When using experimentation for concept acquisition, the predict-observe-explain-approach (POE) by White and Gunstone (1992) is often suggested (Hofstein & Lunetta, 2004) as it specifies the question and the task. During POE, students first need to predict the outcome of an experiment, then conduct the experiment and observe it, and afterwards, give explanations for the observed situation. In the last step, there may occur differences between predictions and observations and students receive the possibility to discuss these discrepancies. As a result, POE helps students to investigate on their own with the goal to work minds-on as well as hands-on (Hofstein & Lunetta, 2004; White & Gunstone, 1992).
The present study
In the present mixed methods study, we examined students’ perceived authenticity and their perception of authentic research by varying the intended authenticity of the method. Therefore, we used an experimentation process with two different levels of guidance in an out-of-school lab. The students investigated through an experimentation process the optical phenomenon of the so-called sun thalers (Schlichting, 1995). This refers to the round spots of light that appear on the ground under a canopy of leaves when sunlight passes through the holes. We decided to use this phenomenon as students have no prior knowledge about it because varying the light source is not part of the German school curriculum and, furthermore, because the experimental setup is simple and not dangerous. Students were asked to investigate this phenomenon in small groups: They were given four different light sources (single and multiple LED spots, one elongated and one extended bulb) and three differently shaped apertures (circular, triangular, and rhombic) to examine the pattern that occurs (Wosilait et al., 1998). We had two different intervention groups: Guided experimenting students received instruction on which five combinations of light source and aperture they should use in which order. The combinations considered the variable control strategy and the bridging strategy (Clement, 1993). The sequence of the combinations got increasingly cognitively demanding and closer to the real situation of sun thalers. For the sixth and final experiment, the light source and aperture were freely selectable for guided experimenting students. Self-determined working students needed to select the combinations of light source and aperture for all six experiments on their own since they were not given any specifications for this.
Research questions and hypotheses
Our research was led by three research questions and their related hypotheses: In Research Question 1, we aimed to explore the influence that the level of guidance has on students’ perceived authenticity. With regard to this question, we hypothesized the following:
H1.1: Self-determined experimenting students experience their learning as being more authentic than guided experimenters.
Following Betz et al. (2016) and Finger et al. (2022), we assumed that self-determined experimentation can be located closer to the work of researchers on the continuum between a didactic learning setting and the real professional world. Furthermore, we expected the following in particular:
H1.2: Self-determined experimenters have especially on the dimension “methods” a higher perceived authenticity then guided experimenters.
The difference between the self-determined and the guided intervention was the method during the experimentation process with the self-determined intervention intended to be relatively more authentic due to less instructions and, thus, being closer to the real world of scientists. Further, as students expect student-centered experimentation processes in small groups in out-of-school learning settings (Garner & Eilks, 2015; Schwarzer & Parchmann, 2015), the self-determined intervention was closer to this expectation of students for out-of-school lab visits. Therefore, in addition to H1.1, we especially expected a difference regarding this component of the perceived authenticity in favor of self-determined experimenters as their experimentation process was with less instructions and accordingly was more open for students pursuing their own ideas.
In Research Question 2, we examined what reference students use in their assessment judging their perceived authenticity. The questionnaire for the assessment of perceived authenticity in science education by Finger et al. (2022), which is used in this study, is based on a specific understanding of authentic research, but there is no guarantee that students completing the questionnaire will have the same understanding of research in mind. Even when students are really working like researchers, it is probable that they do not recognize it, because they have limited knowledge about the work of researchers (Stamer et al., 2021). Previous studies have already shown that students have different ideas about science and scientists, for example, that scientists are mostly men in a laboratory, who can be role models for society, but their personality can also be eccentric and their actions immoral (for an overview see Christidou, 2011). Thus, we complemented the quantitative assessment of perceived authenticity with student interviews to explore the understanding of authentic research of students from our sample and to better understand their judgments. This analysis was explorative.
Finally, in Research Question 3, we investigated to what extent perceived authenticity predicts students’ learning outcomes. Thereby, we hypothesized the following:
H3.1: Students with higher perceived authenticity show higher learning outcomes than students with lower perceived authenticity.
According to the model by Betz et al. (2016), perceived authenticity has, among other things, an impact on knowledge acquisition, and therefore, with a higher perceived authenticity, the learning outcomes should be higher. Nevertheless, empirical findings are ambiguous in this regard: Scharfenberg et al. (2007) found a significantly higher learning success for groups experimenting in a laboratory in comparison to groups learning non-experimental in school, which includes a difference in favor to the laboratory regarding a more authentic location as well as a more authentic method. For example, Nachtigall et al. (2018) could not find a significant effect of perceived authenticity on the learning outcome.
Methods
Conceptualization of the mixed methods study
In order to gain a deeper understanding of students’ learning through authentic experimenting in a non-formal learning setting and their perceptions of authentic research, we conducted a mixed methods study (Johnson et al., 2007). We used a (convergent) parallel design for our study as both qualitative and quantitative methods are performed independently, but the respective data were collected (nearly) simultaneously and were combined in the interpretation of the results (Schoonenboom & Johnson, 2017; Teddlie & Tashakkori, 2010). Both sets of data were used to focus on the research questions from different perspectives.
Sample
Our sample consists of N = 142 seventh and eighth grade students (female = 63, male = 77, diverse = 2; \({M}_{{\text{Age}}}\) = 13.04, \({SD}_{{\text{Age}}}\) = 0.65) from six different classes of two German secondary schools. Teachers voluntarily registered for the project day based on their interests. The participating classes were randomly divided into small groups that were alternately assigned to one of the two interventions. In each class, one group per intervention was randomly selected to be videographed during the experimentation process and interviewed after the project day. For the quantitative data analysis, the sample was reduced to N = 139 valid cases, where each instrument was filled out. N = 69 students in 25 different groups experimented guided, while N = 70 students distributed over 23 different groups experimented self-determined. The interviews were voluntary and took place a few days after the visit to the out-of-school lab in the afternoon during the students’ free time. Thus, the sample for the qualitative content analysis is based on N = 24 students from 11 different groups.
Study design
In the following, the design of the intervention as well as the procedure will be presented.
Design of the intervention
In our study, students experimented guided or self-determined during an unassisted experimentation process for exploring the phenomenon of the sun thalers. To create a cognitive conflict, the students in both groups were first shown that behind a triangular aperture, there is a triangular light spot if it is illuminated with a punctual light source, but surprisingly, a circular light spot if an extended circular light source is used. Then, they were instructed to solve this in a series of experiments. Guided experimenting students received a prescribed sequence of the combinations of light sources (punctual light source, multiple (i.e., 28) LED spots, elongated light source, and one extended circular bulb) and apertures (circular, triangular, rhombic) for the first five of their six experiments. Thereby, the sequence is based on the variable control strategy combined with the bridging strategy (Clement, 1993) closing stepwise the gap between the two initial experiments. Only for the sixth experiment students were allowed to freely select the combination of light source(s) and aperture. In contrast, self-determined experimenters received the same materials but no instruction on when to use which light source respectively which aperture. Therefore, they needed to decide for all their six experiments which material they wanted to use to investigate the phenomenon.
When using the introduced authenticity model by Betz et al. (2016) for classifying our study design into their proposed learning setting characteristics, we varied the method. The self-determined intervention is intended to be relatively more authentic as students, like researchers, did not receive direct instructions about which materials to use and when. Therefore, self-determined experimenters are not able to follow a more “simple, algorithmic procedure” (Hodson, 1999), which is one of the myths about science which is often propagated in science classes (Hodson, 1999). It must be noted that the given materials (i.e., light sources and apertures) may not perceived as particular authentic materials by the students, since they are quite ordinary and (partly) familiar to the students (Braund & Reiss, 2006; Nachtigall et al., 2022). But they are not dangerous and thus can be used by students independently without strict supervision for experimenting in small groups. Working in small groups should contribute to the authenticity (Betz et al., 2016), because it can be regarded to be more similar to researchers’ work mode (Chinn & Malhotra, 2002). However, the limited amount of time in the out-of-school lab project can be seen as a restriction compared to authentic research because there is a difference between an authentic timeframe and an educational timeframe for an inquiry process (Hod & Sagy, 2019), and in our study, the authentic timeframe was limited by the project day.
With regard to the other aspects of authenticity, i.e., location, instructor, and innovation, the following applied: students worked in a real laboratory in an out-of-school lab at a university as location. The instructor was a real researcher, even if her appearance did not correspond to typical students’ conceptions about scientists (Hagenkötter et al., 2021; Höttecke, 2001) as the instructor was younger and female and did not wear glasses. The context of the sun thalers is a real-life phenomenon, which can be observed in students’ everyday life. Investigating such an observable phenomenon through simplified model experiments in the laboratory is a common approach for inquiry tasks in classrooms, even when the simplification is a known limitation of model experiments (Chinn & Malhotra, 2002). However, the novelty value for science is low since the phenomenon has already been explored. Nevertheless, the phenomenon was unknown to the students and, therefore, could be an innovative topic for experimentation.
Overall, the self-determined intervention is intended to be relatively more authentic on the continuum between a didacticized learning setting and the world of real researchers (Betz et al., 2016; Hod & Sagy, 2019; Sommer et al., 2020), but it needs to be noted that it is still not authentic research in the eyes of scientists as they are some restrictions (i.e., less authentic material due to its characteristics) for the project day as explained above.
Procedure
Each participating class completed the same project day, which lasted 4.5 h in total with an additional 1.5 h of break time. The day started with the pre-test, which was to be filled out on a computer. This was followed by a repetition of rectilinear light propagation and light ray paths were considered from the various light sources to be used in the experimental process. Further, we tried to induce a cognitive conflict through two demonstration experiments. First, we showed a punctual light source directed at a triangular-shaped aperture which resulted in a triangular-shaped light spot, and afterwards, we used the extended circular light source, which produced a circular image for the same aperture. This image is formed because the triangular images of the many point-like light sources of the extended light source overlap in a circle (Schlichting, 1995). Since imaging with extended light sources is rarely considered in school, this image was not expected by students, causing surprise and a cognitive conflict. Thus, the students were challenged to solve this in their small groups with experiments following the question: What influence do the shape of the light source and aperture have on the image?
After the necessary experimental material had been distributed, all students were given 10 min to freely explore the materials and develop their first ideas. Next came a period of 64 to 87 min (\({M}_{\mathrm{Length Exp}.\mathrm{ process}}\) = 80 min, \({SD}_{\mathrm{Length Exp}.\mathrm{ process}}\) = 9 min) with more structured investigations in which students conducted six experiments according to the POE scheme in their small groups (White & Gunstone, 1992). Each participant was encouraged to write down his or her predictions, discoveries, and explanations in a prepared lab book.
Having finished the experiments, the students answered the post-test and the questionnaire about perceived authenticity on the computer. Finally, the results of the experimentation process were discussed with the whole class and the results were applied to the phenomenon of the sun thalers. For organizational reasons, interviews with two randomly selected small groups of each class could not take place on the same day. For eight groups, the interview was conducted between 1 and 3 days after the project day, three groups had the interview 16 respectively 25 days later, and one group dropped out. Usually, the interviews were conducted via the video conferencing system Zoom. In one case, the interview took place at the school. The interviews lasted between 13:23 and 36:20 min.
Measures
Perceived authenticity
We measured students’ perceived authenticity with the questionnaire of Finger et al. (2022) which is based on the model of authenticity by Betz et al. (2016). The questionnaire allowed a validated multidimensional assessment of perceived authenticity for out-of-school lab learning settings. The basis of the questionnaire is the understanding that authentic research in an out-of-school lab is when students experience the everyday life and working methods of researchers in their discipline as well as the complexity of their field of work (Finger et al., 2022). The questionnaire consists of 13 items (Cronbach’s α = 0.84) that reflect the four dimensions of authenticityFootnote 1: method (4 items; Cronbach’s α = 0.70; “I myself proceeded as one proceeds in research.”), location (3 items; Cronbach’s α = 0.82; “I worked at a place where research was being done.”), instructor (3 items; Cronbach’s α = 0.67; “I was assisted by a real researcher.”), and innovation (3 items; Cronbach’s α = 0.79; “I helped research answer an important question.”). Each item was assessed on a 5-point Likert scale from 1 = completely wrong to 5 = completely correct. Further, all items are on the authenticity-continuum scale close to the reality of scientists.
Implicit subjective understanding of authentic research
We conducted group interviews with the small groups that were selected to be videographed. Each interview consisted of five parts regarding the experimentation process and students’ perception of it: We started the interviews with an open question about the way of experimenting and whether the students had already experience, plus what was different regarding experimenting in school. Next, we asked students to describe and explain their specific procedure during the experimentation process. This was followed by questions about authentic research. In the fourth part, students told us about their knowledge gained through the experiments, and finally, we finished the interviews with students reporting their personal challenges. All interviews were semi-structured and each part started with an open conversation prompt that was followed up by more specific questions if topics were not already covered in the talk (Brenner, 2006). This allowed us to strengthen the comparability between the different group interviews. Furthermore, students of that age are used to a certain level of guidance in discussions from school which makes the situation more familiar (adapted from Grecu et al., 2022). In this paper, our focus for the analysis is on the part about what is authentic research for the participating students. This part of the interviews covered the students’ ideas of what research is and if they think they conducted research during the project day. Through this, we wanted to analyze students’ implicit subjective understandings of authentic research (König & Volmer, 2020).
Prior and post knowledge test
Prior to and after the experimentation process, students answered a knowledge test about geometrical optics. In the pre-test, four different areas from geometrical optics were covered by 19 items: light propagation (5), shadow (5), aperture (5), and reflection (4) ((adapted) items of Teichrew & Erb, 2019; Haagen-Schützenhöfer & Hopf, 2013; Mavanga, 2001; McDermott & Shaffer, 2009; self-constructed items). We used two-tier items: The first tier assessed students’ knowledge about the topic and the second tier assessed students’ conceptual reasoning. Due to Rasch analysis and classical discriminatory power analysis applied to the pre-test data, eight items had to be excluded. Thus, the pre-test results of the students are calculated based on 11 items (Cronbach’s α = 0.59).
To keep the test time short, only items related to aperture imaging were used in the post-test. For this purpose, four additional items were added to the five items of the pre-test. Due to the results of the Rasch analysis and the discriminatory power analysis, we had to exclude three items. Thus, all results related to the post-test are based on the remaining six items (Cronbach’s α = 0.56).
For each item, students could receive up to two points in our rating: one for the correct first tier and the second point if both tiers were answered correctly. If just the second tier was answered correctly, students did not receive a point. Since we dropped the items concerning light propagation in the post-test, we do not expect the repetition of rectilinear light propagation and light ray paths to have a direct impact on the post-test results.
Results
For all calculations (except the preliminary analyses), the sample is based on N = 139 valid cases. The sample for the qualitative content analysis is based on N = 24 students from 11 small groups. Quantitative analyses were conducted with SPSS 28 and the Rasch analysis software Winsteps (version 4.5.4). For qualitative analyses, MAXQDA 2020 was used.
Before more in-depth analyses, a χ2-test regarding gender, an ANOVA regarding students’ grades in physics, mathematics, and German, and regarding prior knowledge were calculated to ensure that both intervention groups are comparable. It has to be noted that not all students wanted to share their grades (valid cases out of N = 139 students—physics: N = 105; mathematics: N = 133; German: N = 135).
The samples for the two interventions did not differ statistically significantly regarding gender (χ2 (2) = 2.63, p = .27, ϕ = 0.14). Neither differences in grades (physics, F(1,103) = 1.29, p = .26, η2 = 0.01, 95% CI [0.00; 0.08]; mathematics, F(1,131) = 1.59, p = .21, η2 = 0.01, 95% CI [0.00; 0.07]; German, F(1,133) < 1) nor in the pre-test (F(1,137) = 1.07, p = .30 (two-tailed), η2 = 0.01, 95% CI [0.00; 0.06]) were found between guided and self-determined experimenting groups.
What influence does the level of guidance have on students’ perceived authenticity (RQ1)?
First, descriptive statistics will be presented in Table 1. Since not all dimensions were assessed with the same number of items in the FEWAW, the mean score is calculated for each dimension. This makes the dimensions comparable on the same scale from 1 (completely wrong) to 5 (completely correct).
We then calculated a multivariate analysis of variance (MANOVA) with the four scales of the questionnaire as dependent variables and the intervention groups as factors, for comparing students’ perceived authenticity based on their level of guidance. The MANOVA revealed no differences between guided and self-determined experimenting students on the combined dimensions of perceived authenticity (F(4, 134) = 0.90, p = .464, \({\eta }_{p}^{2}\) = 0.026, Wilk’s Λ = 0.974) (H1.1). Furthermore, as can be seen in Table 1, even for the dimension method where we expected a difference in perceived authenticity depending on the level of guidance, no significant difference was found (H1.2).
Accordingly, our hypotheses that self-determined experimenting students perceived the learning situation as more authentic (H1.1), especially with respect to the method (H1.2), cannot be confirmed. Guided experimenters even reported slightly higher scores on all scales, although the differences were minimal and not significant.
What reference do students use in their assessment judging their perceived authenticity (RQ2)?
For the qualitative analysis, we first created anonymous transcripts of the interviews according to the guidelines of Lamnek and Krell (2016). Afterwards, we conducted a qualitative content analysis (Kuckartz & Rädiker, 2022) with the goal to extract students’ individual subjective understanding (König & Volmer, 2020) of research and to cluster these statements into a category system we developed deductively-inductively. We began by marking statements of students that referred to what they understand by research and what they do not evaluate as such. These statements were then assigned to the categories of method, location, instructor, and innovation from the questionnaire of Finger et al. (2022). We also found statements which did not belong to either of the four dimensions; these were first marked as such and later categorized into our inductively developed categories. For this purpose, we have elaborated on the implicit subjective understanding concealed behind a statement by examining the students’ expressed perception of research for each statement. Furthermore, similar statements were clustered into categories. The coding process was iteratively done in multiple coding cycles by the first author and results were discussed in the team several times.
Finally, the created codes of students’ implicit subjective understanding of authentic research could be assigned to 13 categories (for an overview, see Table 2). These categories are presented in the following and are illustrated by short quotations from students’ statements in the interviewsFootnote 2 (Elo et al., 2014; Kuckartz, 2019). The quotations were translated from German and were smoothed out linguistically. We first consider the categories used in the FEWAW questionnaire.
-
1.
Method
The dimension method refers to statements about the guidelines during a research process. These ranged from researchers having no guidelines at all (“We had instructions. And researchers have these mostly I think probably not” (January 17, 2022, guided)) to researchers sticking to predefined processes (“[it was typical for research that] we got a chronological order of the experiments” (December 6, 2021, guided)).
-
2.
Location with specific rules
For the second dimension location, we found students’ statements expressing the idea that researchers work in special professional laboratories (“we were sitting in a laboratory where actually other things are being researched” (February 7, 2022, self-determined)) where certain rules apply (“I find that is so typical for research that you have rules that you have to follow.” (December 7, 2021, guided)). Students were unanimous in this regard.
-
3.
Instructor
Regarding the dimension instructor from the questionnaire, no references were found in the interview data.
-
4.
Innovation
The category innovation includes statements that refer to the extent to which research or the subject of research and the resulting outcome must be something new. Thereby, students differentiated between something new for themselves (“so for us, I think it was already research, because we didn’t know what the outcome would be” (December 6, 2021, guided)) and for researchers (“that’s something that quite a few people have done before us and for me, that would be when you really find something new.” (December 13, 2021, guided)). Two statements also indicated that it is research even when contents are already explored if you get closer to the true answer (“that we have researched for ourselves, but we came closer to the correct result, so we could already guess the result a little bit, therefore I would say that we have already researched but not like real scientists.” (December 13, 2021, guided)).
In addition to the four dimensions from the questionnaire, we extracted the following categories inductively from the material: 5. research interest, 6. topic, 7. scientific practices including the subcategory experimenting, 8. working mode, 9. time constraints, 10. material and devices, 11. collaboration, 12. hints, and 13. belonging to our data acquisition. The categories 7 to 12 are all part of the work of researchers, but we decided not to categorize them as subcategories of “method.” Statements in the category “method” were especially focused on the level of openness in guidelines during a research process, while statements in the categories 7 to 12 were independent from the different levels of guidance.
-
5.
Research interest
While the category innovation includes statements about the degree of novelty, the category research interest includes statements about the goal and purpose respectively motives of research and researchers, i.e., the interest in knowledge in general. Students in our sample have the understanding that researchers ask themselves questions and find answers to these questions, for example by using experiments. This self-questioning is assumed to be intrinsically motivated as can be seen by the following statement: so you ask yourself all your life questions about it and then you just want to find out, so then you do research, and you also think not only about the possible things, but also about the things that are actually not possible and then you just investigate it. (December 9, 2021, self-determined)
-
6.
Topic
The category topic covers statements about researchers having different subjects and contents of interest in knowledge such as “[Researchers] work with carbon dioxide or so” (January 17, 2022, self-determined) and “Everything can be the content of research” (December 6, 2021, self-determined). These statements range from less to more specific ideas of topics.
-
7.
Scientific practices including the subcategory experimenting
Statements about scientific practices include, for example, documenting or testing hypotheses, “[we] really researched, because everything that was done was documented. One has also, so at least WE have also documented in detail, so that one can derive something from it afterwards” (December 9, 2021, self-determined) or “we just proceeded according to such a scheme, always justified [our results], we have thought about why […] and just also have made sketches” (December 7, 2021, guided). Further, statements specifically about experimenting as a scientific practice were assigned to the subcategory experimenting. Examples from this category are “[Researchers] experiment” (December 13, 2021, self-determined) and “[It speaks for research that] we found out everything on our own with experiments.” (December 6, 2021, self-determined).
-
8.
Working mode
In contrast, statements about the working mode emphasize the behavior like “[we did not work like researchers,] our concentration speaks against it, I would say.” (December 7, 2021, self-determined).
-
9.
Time constraints
Students’ statements unanimously indicate that researchers have no time constraints, for example, “They don’t have such time constraints, of course, so I think they’re freer with time” (December 7, 2021, guided) and “[I do not think it is typical that] we always had to wait for the others until they had finished their experiment and we always only had a given time how long we [were allowed to] need” (February 7, 2022, self-determined).
-
10.
Material and devices
Statements in the category material and devices refer to the subjective understanding of the equipment used by researchers such as “[Research is] with things that you don’t have in your everyday household, that you need certain material for it” (January 17, 2022, self-determined). Students were in agreement that research equipment is not commonplace but can be used in other research projects as well.
-
11.
Collaboration
Students think that researchers are working together in groups (collaboration) as was the case during the out-of-school project day. An example is “[…] in research to what I have noticed so far, often [one] researches among other people, that you discuss with, and that was for me just quite like research on that day, that you did something in a group” (December 6, 2021, self-determined).
-
12.
Hints
However, the interviewed students have the understanding that researchers (unlike in the out-of-school project) do not receive feedback or advice from outside of their research group (hints): “Not typical for research was that you got support […] if you had questions, they were answered” (December 9, 2021, self-determined).
-
13.
Belonging to our data acquisition
Statements related to our testing such as “[that we needed to answer] a knowledge test on a computer” (February 7, 2022, self-determined) were categorized as belonging to our data acquisition.
To what extent does perceived authenticity predict students’ learning outcomes (RQ3)?
Descriptive results of the learning outcome in the form of the post-test results can be seen in Table 3. As the ANOVA shows, there is no significant difference in the learning outcome depending on the received level of guidance.
A mediation analysis was conducted to analyze whether learners’ perceived authenticity of the method (M) mediates the effect of the intervention (X) on the post-test results (Y) (H3.1). Considering the bootstrap confidence interval (see Fig. 1), the mediation analysis revealed no indirect effects of the intervention on the post-test results. Further, the mediation analysis demonstrated that students who perceived the method as more authentic achieved better post-test results (see Fig. 1).
Discussion
Authentic learning situations allow students to work like real researchers and apply their knowledge to the real world, which is usually not possible through more abstract learning in school (Gerstenmaier & Mandl, 1995; Herrington & Oliver, 2000). This has, for example, motivating effects as well as effects on conceptual development and competencies (Betz et al., 2016; Glowinski & Bayrhuber, 2011). But a learning situation intended to be more authentic is not always subjectively perceived as more authentic by the students (Gulikers et al., 2008; Nachtigall et al., 2018), and therefore, the expected effects could not always be measured (Nachtigall et al., 2018). Consequently, subjectively perceived authenticity must be taken into account for finding effects on, for example, conceptual development in analyses. In this mixed methods study, we compared the effects of different levels of guidance on perceived authenticity (RQ1). In addition, the understanding of authentic research that students expressed in the interviews was analyzed (RQ2). Finally, we investigated whether students with a higher perceived authenticity have a higher learning outcome than students with a lower perceived authenticity (RQ3).
For RQ1, we did not find a difference in the perceived authenticity depending on the level of guidance (H1.1). This applies both to the summarized perceived authenticity and to the single dimensions method, location, instructor, and innovation. Although this result stands in contrast to our hypotheses (H1.1, overall perceived authenticity; H1.2, perceived authenticity of the method), it is consistent with the results of Nachtigall and Rummel (2021) for learning activities in an out-of-school lab for social sciences in which the authenticity level of learning activities did likewise not affect students’ perceived authenticity. These findings could be explained by the proposal of Nachtigall (2019) that more prominent factors may overshadow the other dimensions of an authentic learning situation. In our case, this would refer to the location, which was perceived as most authentic from students. Following Hod and Sagy (2019), the timeframe has an impact on the authenticity of a learning situation. Thereby, we had two different timeframes: Overall, our project day was from 9 am to 3 pm and students worked all day on the same topic. This is closer to a normal working day and could be in favor of the perceived authenticity. On the other hand, the time for experimenting was limited for each experiment, and thus, this could lower the perceived authenticity. Therefore, it is possible that the timeframe had a limiting influence on students’ perceived authenticity.
Considering RQ2, it can be assumed that students have a different perception of research and how researchers work than the questionnaire of Finger et al. (2022) expects. For instance, the item “I myself proceeded as one proceeds in research.” does not specify how one in research proceeds, and therefore, students needed to use their own understanding of authentic research for answering this item; as can be seen in the qualitative analysis, students had different understandings of an authentic method. Gulikers et al. (2008) found similar results: When students and teachers were asked about their perception of authenticity of the same learning situation, students rated the authenticity significantly lower than teachers. Further, the overview of Christidou (2011) is in line with our ambiguous results as in her meta-analysis, students had different images of science as well as of scientists. When interpreting the results of the questionnaire, it must be considered that students may have different understandings of research. Consequently, the results cannot simply be aggregated by intervention and compared with each other, when we cannot guarantee that they have the same understanding of research. Hence, the test instrument should be supplemented with the request that students explain their understanding of research for being able to properly interpret the results. Thus, the mixed method approach was beneficial to gain a deeper understanding of students’ responses and their interpretation of authentic research.
Regarding the learning outcome, we did not find a difference depending on the intervention. Further, while analyzing the effect of the perceived authenticity of the method on the learning outcome with a mediation analysis (RQ3), the mediation analysis demonstrated a significant, positive effect of the perceived authenticity of the method on the post-test results. This result suggests that the mediator variable exerted a higher effect on the post-test results than the intervention during the experimentation process. As there was no mediation effect of the perceived authenticity of the method, mediation through other variables seems to be a possible solution for being better able to explain our results. Such variables could be personal characteristics such as situational interest or motivation, which were not assessed in this study. Both may be improved through authentic learning situations (Betz et al., 2016; Itzek-Greulich et al., 2017; Schüttler et al., 2021) and correlate with perceived authenticity (Nachtigall & Rummel, 2021). It was shown previously that self-determined experimenting had a positive effect on students’ intrinsic motivation which itself often leads to a better learning outcome (Euler, 2005).
Surprisingly, however, the different interventions themselves did not have an impact on the learning outcome. This result might be attributable to three possible reasons: (a) lack of prior knowledge to produce learning-relevant situations when experimenting self-determined, (b) lack of preparation and post-processing of the project day, and (c) our measures did not capture the differences in authenticity as well as in the learning outcome. With regard to students’ lack of prior knowledge (a), we observed that the sequence of experiments of self-determined experimenting groups was mostly not based on the variable control strategy for choosing the next combination of light source and aperture. When counting how many self-determined experimenting groups selected experiments based on variable control strategies, just nine out of 23 groups were able to control the variables for three successive experiments. No group conducted experiments with at least four out of the six experiments based on the variable control strategy. Thus, it is possible that self-determined experimenters did not produce learning-relevant situations in which they could have better investigated the phenomenon of sun thalers. This could be explained by students’ missing prior experiences from school learning regarding conducting their own experiments. Out of the 70 self-determined experimenters, 54 reported that they conduct experiments (really) seldom in school, which may be enhanced by the restrictions during the corona pandemic. But with the rather limited scope for action due to the limited possibilities for the combination of light source and aperture as well as the restriction to six experiments, it seems to be of no difference for the learning outcome whether the guided experimenters systematically investigated the phenomenon or the self-determined experimenters unsystematically. Future studies could therefore examine whether the intervention has a significant impact on the perception of the authenticity as well as on the learning outcome in a more complex setting, with correspondingly a greater scope for action. In more complex learning settings, students may, in fact, require a less authentic but more supportive approach, particularly if it offers them the necessary structure to facilitate learning. Repeated visits might be beneficial, especially for self-determined experimentation, as it is then possible to learn how to systematically create situations that are relevant to learning (Zehren et al., 2013).
Regarding the lack of preparing or post-processing the project day in school (b), we did not offer teachers such material. Previous studies have found that the effects of the out-of-school lab are more sustainable when students received materials and time at school for preparing as well as post-processing the project day (Euler, 2005; Guderian, 2007; Reimann et al., 2020). For example, Reimann et al. (2020) found a stabilization in knowledge for students with preparation as well as follow-up phases while students’ knowledge without preparation or follow-up at school decreased. Garner and Eilks (2015) emphasized the relevance of integration into the school “as essential elements for the success of out-of-school learning” (p. 1199) as students then perceive the experiences as less unrelated events. However, even if student laboratory projects are integrated in such a way, positive effects do not automatically occur and may even fail to appear (Schwarzer, 2020).
Finally, we cannot guarantee that our measures were able to capture differences between the self-determined and the guided experimenting students regarding their perceived authenticity as well as their learning outcome (c) as the difference between both interventions was rather small. It has to be noted that it is possible that there were differences between both interventions, for example, in regard to students’ perceived autonomy as self-determined students were allowed to make more decisions than guided students, which we did not measure.
Overall, the results of this study show little impact of the method on the perceived authenticity and of the perceived authenticity on the learning outcome. We found in our study that the reason might be that students do not really know what it means to work like a researcher. This is in line with the findings of Stamer et al. (2021). This means that there is a need to improve students’ understanding of authentic science to achieve the goals of authentic learning. Namely, these goals are effects on motivation (Betz, 2018; Glowinski & Bayrhuber, 2011; Nachtigall et al., 2018) as well as (situational) interest in science (Nachtigall & Rummel, 2021; Pawek, 2009), informed (career) decisions (Euler, 2005; Scharfenberg & Bogner, 2014; Stamer et al., 2019, 2021; Woods-McConney et al., 2013), acquisition of scientific knowledge (Scharfenberg & Bogner, 2014), and scientific reasoning (Chinn & Malhotra, 2002; Mansfield & Reiss, 2020).
Limitations
The present study has some important limitations. Firstly, our knowledge tests each have rather low reliability. Even after item exclusion by reliability and Rasch analyses, reliabilities are Cronbach’s α = 0.59 (pre-test) and Cronbach’s α = 0.56 (post-test). This means that our knowledge tests did not measure peoples’ knowledge about geometrical optics in general (pre-test) and aperture illustrations in particular (post-test) consistently (Boone et al., 2014). The low reliability in both tests can be explained by the response behavior of the students if they do not have a stable concept. The problem of a rather low reliability regarding knowledge tests in this age group is not untypical (see for example the studies of Chu et al. (2009) and Härtig et al. (2019)). Another limitation is that according to the model by Betz et al. (2016), the perceived authenticity is influenced by personal characteristics such as interest which we did not assess. Therefore, we cannot analyze our sample regarding personal characteristics as predictors for perceived authenticity. Further, as already discussed, students’ perceived authenticity may vary and even be lower than the perception of teachers of the same situation (Gulikers et al., 2008). Students’ perception of authenticity was not assessed in advance, but only at the end through the questionnaire respectively after the project day through the interviews. Finally, the students in our sample are only from two different schools. Thus, the generalizability of the results may be limited.
Implications for further research
After conducting the study, there are several implications for future research. First of all, due to the positive effects of preparation as well as follow-up of student lab projects on interest, motivation, and knowledge development (Euler, 2005; Guderian, 2007; Reimann et al., 2020), both should be integrated. A possibility for this could be the preparation of a lesson, including materials, for schools in which basic knowledge like light propagation is repeated so that students are more familiar with this. For the follow-up, students could discuss open questions with their teachers respectively the instructors of the project day. When using the videoconference system Zoom for this, this would even make it easier as research showed (Yonai et al., 2022).
Additionally, the interaction between the different dimensions of authenticity (location, method, instructor, and innovation) should be examined. In the present study as well as in the studies by Nachtigall and Rummel (2021) and Nachtigall et al. (2018), the perceived authenticity of the location may have overshadowed the perception of the learning method and have thus led to nonsignificant results. It remains to be investigated whether the method, as a conceptual aspect during a research process, is perceived as more authentic by the students when the location, as a physically tangible aspect during a research process, is (perceived) less authentic, for example, because the project day takes place in the school and not in an out-of-school lab.
Further, as our interview data showed, students had different understandings of research and did not use the same understanding as a basis for answering the questionnaire. Another implication for further research could be to explain to students explicitly what research is and which domain-specific methods are used, so that they have a comparable idea of research.
In addition, it would be interesting to identify different types that cluster students with similar understandings of research. Therefore, a larger sample may be needed than the one used in the qualitative sample as well as a selection of the developed categories that should be answered by the students for easier comparability, either during an interview or through a questionnaire. The questionnaire could be created based on our results. Further, we conducted a qualitative content analysis of students’ subjective understanding of authentic research due to the scope of our data. Another possibility would be a more reconstructive way of analyzing students’ understanding as this would allow them to gain a deeper insight.
Finally, we did not examine whether the different groups had a productive, collaborative experimentation experience with relevant learning situations. Based on this, we also did not analyze the effect of group work on individual perceptions of authenticity. This seems to be interesting as different group constellations could have an influence on the learning experience, for example, when in one group one member takes the role of the teacher and guides the remaining group members. This could have a negative impact on the perceived authenticity of the method as it became less open.
Data availability
The participants of this study did not give written consent for their data to be shared publicly, so due to the sensitive nature of the research (data from underage students) supporting data is not available.
Notes
The items are self-translated from German.
The dates after each statement refer to the day of participation at the out-of-school lab project day, not the date of the interview as then it is more comparable which statements are from the same class (adapted from APA 7th edition). Due to anonymization, no names are given, only the groups as such.
References
Bell, R. L., Smetana, L., & Binns, I. (2005). Simplifying inquiry instruction. The Science Teacher, 72(7), 30–33.
Betz, A. (2018). Der Einfluss der Lernumgebung auf (wahrgenommene) Authentizität der linguistischen Wissenschaftsvermittlung und das Situationale Interesse von Lernenden [The influence of the learning environment on learners’ (perceived) authenticity of science communication and on their situational interest]. Unterrichtswissenschaft, 46(3), 261–278. https://doi.org/10.1007/s42010-018-0021-0
Betz, A., Flake, S., Mierwald, M., & Vanderbeke, M. (2016). Modelling authenticity in teaching and learning contexts: A contribution to theory development and empirical investigation of the construct. In C. K. Looi, J. L. Polman, U. Cress, & P. Reimann (Eds.), Transforming learning, empowering learners. The International Conference of the Learning Sciences (ICLS) 2016 (Vol. 2, pp. 815–818). International Society of the Learning Sciences. https://doi.org/10.22318/icls2016.110
Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences. Springer.
Börlin, J. (2012). Das Experiment als Lerngelegenheit. Vom interkulturellen Vergleich des Physikunterrichts zu Merkmalen seiner Qualität [The experiment as a learning opportunity. From cross-cultural comparison of physics teaching to characteristics of its quality.]. [Doctoral dissertation, University of Basel]. https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwi3nZrXofCBAxUPov0HHXqfBZsQFnoECBkQAQ&url=https%3A%2F%2Fedoc.unibas.ch%2F21283%2F1%2FBoerlin_online_final.pdf&usg=AOvVaw06uR8JOlGvuNb3ziBYTI_T&opi=89978449
Braund, M., & Reiss, M. (2006). Towards a more authentic science curriculum: The contribution of out-of-school learning. International Journal of Science Education, 28(12), 1373–1388. https://doi.org/10.1080/09500690500498419
Brenner, M. E. (2006). Interviewing in educational research. In J. L. Green, G. Camilli, & P. B. Elmore (Eds.), Handbook of complementary methods in education research (pp. 357–370). Routledge.
Chinn, C. A., & Malhotra, B. A. (2002). Epistemologically authentic inquiry in schools: A theoretical framework for evaluating inquiry tasks. Science Education, 86, 175–218. https://doi.org/10.1002/sce.10001
Christidou, V. (2011). Interest, attitudes and images related to science: Combining students’ voices with the voices of school Science, teachers, and popular science. International Journal of Environmental & Science Education, 6(2), 141–159.
Chu, H.-E., Treagust, D. F., & Chandrasegaran, A. L. (2009). A stratified study of students’ understanding of basic optics concepts in different contexts using two-tier multiple-choice items. Research in Science & Technological Education, 27(3), 253–265. https://doi.org/10.1080/02635140903162553
Clement, J. (1993). Using bridging analogies and anchoring intuitions to deal with students’ preconceptions in physics. Journal of Research in Science Teaching, 30(10), 1241–1257. https://doi.org/10.1002/tea.3660301007
Aßmann, S. (2013). Medienhandeln zwischen formalen und informellen Kontexten: Doing connectivity [Media activities between formal and informal contexts: Doing connectivity]. Springer. https://doi.org/10.1007/978-3-658-01940-2
Commission of the European Communities (2001). Making a European area of lifelong learning a reality. http://aei.pitt.edu/42878/1/com2001_0678.pdf
Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014). Qualitative content analysis: A focus on trustworthiness. SAGE Open, 4(1), 1–10. https://doi.org/10.1177/2158244014522633
Euler, M. (2005). Schülerinnen und Schüler als Forscher: Informelles Lernen im Schülerlabor [Students as scientists: Informal learning in a student lab]. Naturwissenschaften Im Unterricht: Physik, 16(90), 4–12.
Euler, M., & Schüttler, T. (2020). Schülerlabore [Student labs]. In E. Kircher, R. Girwidz, & H. E. Fischer (Eds.), Physikdidaktik: Methoden und Inhalte (4th ed., pp. 127–166). Springer Spektrum.
Euler, M., Schüttler, T., & Hausamann, D. (2015). Schülerlabore: lernen durch forschen und entwickeln [student labs: learning through researching and developing]. In E. Kircher, R. Girwidz, & P. Häußler (Eds.), Physikdidaktik: Theorie und Praxis (3rd ed., pp. 759–782). Springer Spektrum.
Finger, L., van den Bogaert, V., Fleischer, J., Raimann, J., Sommer, K., & Wirth, J. (2022). Das Schülerlabor als Ort authentischer Wissenschaftsvermittlung? Entwicklung und Validierung eines Fragebogens zur Erfassung der Authentizitätswahrnehmung der Wissenschaftsvermittlung im Schülerlabor [Out-of-school labs as places for authentic science education? Construction and validation of a questionnaire for measuring the perception of authenticity of science education in out-of-school labs]. Zeitschrift Für Didaktik Der Naturwissenschaften, 28(2), 1–15. https://doi.org/10.1007/s40573-022-00139-4
Garner, N., & Eilks, I. (2015). The expectations of teachers and students who visit a non-formal student chemistry laboratory. Eurasia Journal of Mathematics, Science & Technology Education, 11(5), 1197–1210. https://doi.org/10.12973/eurasia.2015.1415a
Gerstenmaier, J., & Mandl, H. (1995). Wissenserwerb unter konstruktivistischer Perspektive [Knowledge acquisition from a constructivist perspective]. Zeitschrift für Pädagogik, 41(6), 867–888. https://doi.org/10.25656/01:10534
Glowinski, I., & Bayrhuber, H. (2011). Student labs on a university campus as a type of out-of-school learning environment: Assessing the potential to promote students’ interest in science. International Journal of Environmental and Science Education, 6(4), 371–392.
Grecu, A. L., Hadjar, A., & Simoes Loureiro, K. (2022). The role of teaching styles in the development of school alienation and behavioral consequences: A mixed methods study of Luxembourgish primary schools. SAGE Open, 12(2), 1–15. https://doi.org/10.1177/21582440221105477
Guderian, P. (2007). Wirksamkeitsanalyse außerschulischer Lernorte: Der Einfluss mehrmaliger Besuche eines Schülerlabors auf die Entwicklung des Interesses an Physik [Effectiveness analysis of out-of-school learning sites: The influence of repeated visits to science labs on the development of interest in physics] [Doctoral dissertation, Humboldt University Berlin]. edoc-Server. https://doi.org/10.18452/15610
Gulikers, J. T. M., Bastiaens, T. J., Kirschner, P. A., & Kester, L. (2008). Authenticity is in the eye of the beholder: Student and teacher perceptions of assessment authenticity. Journal of Vocational Education & Training, 60(4), 401–412. https://doi.org/10.1080/13636820802591830
Haagen-Schützenhöfer, C., & Hopf, M. (2013). Testheft Optik [Test booklet optics] [Unpublished work]. University of Vienna.
Hagenkötter, R., Nachtigall, V., Rolka, K., & Rummel, N. (2021). „Meistens sind Forscher älter, meist tragen die eine Brille“ – Schülervorstellungen über Wissenschaftler*innen [“Scientists are usually older and wear glasses” – Students’ conceptions about scientists]. Unterrichtswissenschaft, 49(4), 603–626. https://doi.org/10.1007/s42010-021-00110-1
Härtig, H., Fraser, N., Bernholt, S., & Retelsdorf, J. (2019). Kann man Sachtexte vereinfachen? – Ergebnisse einer Generalisierungsstudie zum Textverständnis [Is there a possibility making science texts easier? – Trying to generalize findings regarding text comprehension]. Zeitschrift Für Didaktik Der Naturwissenschaften, 25(1), 273–287. https://doi.org/10.1007/s40573-019-00105-7
Hattie, J. A. C. (2009). Visible learning. A synthesis of over 800 meta-analyses relating to achievement. Routledge.
Haupt, O. J., Domjahn, J., Martin, U., Skiebe-Corrette, P., Vorst, S., Zehren, W., & Hempelmann, R. (2013). Schülerlabor – Begriffsbestimmung und Kategorisierung [Student lab – Definition and categorization]. MNU, 66(6), 324–330.
Herrington, J., & Oliver, R. (2000). An instructional design framework for authentic learning environments. Educational Technology Research and Development, 48(3), 23–48. https://doi.org/10.1007/BF02319856
Hod, Y., & Sagy, O. (2019). Conceptualizing the designs of authentic computer-supported collaborative learning environments in schools. International Journal of Computer-Supported Collaborative Learning, 14(2), 143–164. https://doi.org/10.1007/s11412-019-09300-7
Hodson, D. (1999). Going beyond cultural pluralism: Science education for sociopolitical action. Science Education, 83(6), 775–796. https://doi.org/10.1002/(SICI)1098-237X(199911)83:6%3c775::AID-SCE8%3e3.0.CO;2-8
Hofstein, A., & Lunetta, V. N. (2004). The laboratory in science education: Foundations for the twenty-first century. Science Education, 88(1), 28–54. https://doi.org/10.1002/sce.10106
Horstendahl, M., Fischer, H. E., & Rolf, R. (2000). Konzeptuelle und motivationale Aspekte der Handlungsregulation von Schülerinnen und Schülern im Experimentalunterricht der Physik [Conceptual and motivational aspects of students’ regulation of action in experimental physics classes]. Zeitschrift Für Didaktik Der Naturwissenschaften, 6, 7–25.
Höttecke, D. (2001). Die Vorstellungen von Schülern und Schülerinnen von der „Natur der Naturwissenschaften“ [Students’ conceptions of the „nature of science“]. Zeitschrift Für Didaktik Der Naturwissenschaften, 7(1), 7–23.
Itzek-Greulich, H., Flunger, B., Vollmer, C., Nagengast, B., Rehm, M., & Trautwein, U. (2017). Effectiveness of lab-work learning environments in and out of school: A cluster randomized study. Contemporary Educational Psychology, 48, 98–115. https://doi.org/10.1016/j.cedpsych.2016.09.005
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A. (2007). Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1(2), 112–133. https://doi.org/10.1177/1558689806298224
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86. https://doi.org/10.1207/s15326985ep4102_1
König, E., & Volmer, G. (2020). Einführung in das systemische Denken und Handeln [Introduction to systemic thinking and acting] (2nd ed.). Beltz.
Krapp, A. (1992). Interesse, Lernen und Leistung: Neue Forschungsansätze in der Pädagogischen Psychologie [Interest, learning, and achievement: Recent research approaches in pedagogical psychology]. Zeitschrift für Pädagogik, 38(5), 747–770. https://doi.org/10.25656/01:13977
Kuckartz, U., & Rädiker, S. (2022). Qualitative Inhaltsanalyse. Methoden, Praxis, Computerunterstützung [Qualitative content analysis. Methods, practice, computer support] (5th ed.). Beltz.
Kuckartz, U. (2019). Qualitative analysis: A systematic approach. In G. Kaiser & N. Presmeg (Eds.), Compendium for early career researchers in mathematics education (pp. 181–197). Springer. https://doi.org/10.1007/978-3-030-15636-7
Lamnek, S., & Krell, C. (2016). Online-Material – Transkriptionsregeln [Online-Material – Guidelines for Transcription]. In S. Lamnek & C. Krell (Eds.), Qualitative Sozialforschung (6th ed., online-material). Beltz. https://www.beltz.de/fachmedien/psychologie/online_material/qualitative_sozialforschung.html
Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 86(3), 681–718. https://doi.org/10.3102/0034654315627366
Lee, H.-S., & Songer, N. B. (2003). Making authentic science accessible to students. International Journal of Science Education, 25(8), 923–948. https://doi.org/10.1080/09500690305023
LernortLabor (2019). Schülerlabor-Atlas 2019: Schülerlabore im deutschsprachigen Raum [Student lab atlas 2019: Student labs in German-speaking countries]. LernortLabor.
Leu, H. R. (2014). Non-formales und informelles Lernen – unverzichtbare Elemente frühpädagogischer Professionalisierung. Eine Analyse vor dem Hintergrund des Deutschen Qualifikationsrahmens [Non-formal and informal learning – indispensable elements of early childhood education professionalization. An analysis against the background of the German qualifications framework]. Weiterbildungsinitiative Frühpädagogische Fachkräfte.
Mansfield, J., & Reiss, M. J. (2020). The place of values in the aims of school science education. In D. Corrigan, C. Buntting, A. Fitzgerald, & A. Jones (Eds.), Values in science education: The shifting sands (Vol. 1, pp. 191–209). Springer. https://doi.org/10.1007/978-3-030-42172-4_12
Mavanga, G. G. (2001). Entwicklung und Evaluation eines experimentell- und phänomenorientierten Optikcurriculums. Untersuchung zu Schülervorstellungen in der Sekundarstufe I in Mosambik und Deutschland [Development and evaluation of an experiment- and phenomenon-oriented optics curriculum. Investigation of student perceptions in lower secondary school in Mozambique and Germany.]. Logos.
McDermott, L. C., & Shaffer, P. S. (2009). Tutorien zur Physik [Tutorials on physics]. Pearson.
Mierwald, M. (2020). Historisches Argumentieren und epistemologische Überzeugungen. Eine Interventionsstudie zur Wirkung von Lernmaterialien im Schülerlabor [Historical reasoning and epistemological beliefs. An intervention study on the effect of learning materials in the out-of-school lab]. Springer. https://doi.org/10.1007/978-3-658-29955-2
Nachtigall, V., & Rummel, N. (2021). Investigating students’ perceived authenticity of learning activities in an out-of-school lab for social sciences: A replication study. Instructional Science, 49, 779–810. https://doi.org/10.1007/s11251-021-09556-3
Nachtigall, V., Rummel, N., & Serova, K. (2018). Authentisch ist nicht gleich authentisch – Wie Schülerinnen und Schüler die Authentizität von Lernaktivitäten im Schülerlabor einschätzen [Authentic does not equal authentic – How students evaluate the authenticity of learning activities in an out-of-school lab]. Unterrichtswissenschaft, 46(3), 299–319. https://doi.org/10.1007/s42010-018-0020-1
Nachtigall, V., Shaffer, D. W., & Rummel, N. (2022). Stirring a secret sauce: A literature review on the conditions and effects of authentic learning. Educational Psychology Review, 34(3), 1479–1516. https://doi.org/10.1007/s10648-022-09676-3
Nachtigall, V., & Rummel, N. (2022). “Learning experiences, technology, and no grades” – What students expect from a non-formal learning setting outside of school. In C. Chinn, E. Tan, C. Chan & Y. Kali (Eds.), International collaboration toward educational innovation for all: overarching research, development, and practices, Proceedings of the 16th International Conference of the Learning Sciences (ICLS) 2022 (pp. 139–146). International Society of the Learning Sciences.
Nachtigall, V. (2019). Failing just as scientists do? The effectiveness of productive failure for learning in an out-of-school lab for social sciences (Publication No. rub.3281666) [Doctoral dissertation, Ruhr University Bochum]. University Library Bochum.
Pawek, C. (2009). Schülerlabore als interessefördernde außerschulische Lernumgebungen für Schülerinnen und Schüler aus der Mittel- und Oberstufe [Promoting the interest of secondary I and II students through student laboratories as out-of-school learning environments] [Doctoral dissertation]. IPN Kiel. https://macau.uni-kiel.de/receive/diss_mods_00003669
Reimann, M., Herzog, S., Parchmann, I., & Schwarzer, S. (2020). Wirksamkeit der schulischen Vor- und Nachbereitung eines Schülerlaborbesuches [Effectiveness of preparation and follow-up lessons in school of a student lab visit]. Zeitschrift Für Didaktik Der Naturwissenschaften, 26(1), 227–240. https://doi.org/10.1007/s40573-020-00121-y
Rogers, A. (2014). The base of the iceberg. Barbara Budrich Publishers. https://doi.org/10.3224/84740632
Scharfenberg, F.-J., & Bogner, F. X. (2014). Outreach science education: Evidence-based studies in a gene technology lab. Eurasia Journal of Mathematics, Science and Technology Education, 10(4), 329–341. https://doi.org/10.12973/eurasia.2014.1086a
Scharfenberg, F.-J., Bogner, F. X., & Klautke, S. (2007). Learning in a gene technology laboratory with educational focus: Results of a teaching unit with authentic experiments. Biochemistry and Molecular Biology Education, 35(1), 28–39. https://doi.org/10.1002/bmb.1
Schlichting, H. J. (1995). Sonnentaler fallen nicht vom Himmel [Sun thalers do not fall from the sky]. Der Mathematische Und Naturwissenschaftliche Unterricht, 48(4), 199–207.
Schoonenboom, J., & Johnson, R. B. (2017). How to construct a mixed methods research design. Kölner Zeitschrift Für Soziologie Und Sozialpsychologie, 69(Suppl 2), 107–131. https://doi.org/10.1007/s11577-017-0454-1
Schüttler, T., Watzka, B., Girwidz, R., & Ertl, B. (2021). Die Wirkung der Authentizität von Lernort und Laborgeräten auf das situationale Interesse und die Relevanzwahrnehmung beim Besuch eines naturwissenschaftlichen Schülerlabors [Effects of an authentic location and laboratory equipment for the situational interest and the perception of content relevance when visiting an out-of-school science lab]. Zeitschrift Für Didaktik Der Naturwissenschaften, 27(1), 109–125. https://doi.org/10.1007/s40573-021-00128-z
Schwarzer, S. (2020). Gestaltungsprinzipien der Alltagsnähe in Schülerlaboren [Design principles of proximity to everyday life in student laboratories]. In K. Sommer, J. Wirth, & M. Vanderbeke (Eds.), Handbuch Forschen im Schülerlabor (pp. 39–49). Waxmann.
Schwarzer, S., & Parchmann, I. (2015). Erwartungen von Schülern und Wissenschaftlern an Schülerlaborbesuche [Student and scientist expectations of student lab visits]. In S. Bernholt (Ed.), Heterogenität und Diversität-Vielfalt der Voraussetzungen im naturwissenschaftlichen Unterricht: Gesellschaft für Didaktik der Chemie und Physik, Jahrestagung in Bremen 2014 (Vol. 35, pp. 232–234).
Sommer, K., Wirth, J., & Rummel, N. (2018). Authentizität der Wissenschaftsvermittlung im Schülerlabor – Einführung in den Thementeil [Authenticity of science education in the school laboratory – Editorial of the special issue]. Unterrichtswissenschaft, 46(3), 253–260. https://doi.org/10.1007/s42010-018-0022-z
Sommer, K., Firstein, A., & Rothstein, B. (2020). Authentizität (der Wissenschaftsvermittlung) im Schülerlabor [Authenticity (of science education) in the school laboratory]. In K. Sommer, J. Wirth, & M. Vanderbeke (Eds.), Handbuch Forschen im Schülerlabor (pp. 21–30). Waxmann.
Stamer, I., Pönicke, H., Tirre, F., Laherto, A., Höffler, T., Schwarzer, S., & Parchmann, I. (2019). Development & validation of scientific video vignettes to promote perception of authentic science in student laboratories. Research in Science and Technological Education, 38(2), 168–184. https://doi.org/10.1080/02635143.2019.1600491
Stamer, I., David, M. A., Höffler, T., Schwarzer, S., & Parchmann, I. (2021). Authentic insights into science: Scientific videos used in out-of-school learning environments. International Journal of Science Education, 43(6), 868–887. https://doi.org/10.1080/09500693.2021.1891321
Teddlie, C., & Tashakkori, A. (2010). Overview of contemporary issues in mixed methods research. In A. Tashakkori & C. Teddlie, Mixed methods in social & behavioral research (2nd ed., pp. 1–41). SAGE.
Teichrew, A., & Erb, R. (2019). Entwicklung und Evaluation eines zweistufigen Testinstruments für Schülervorstellungen zur Anfangsoptik [Development and evaluation of a two-step test instrument for student conceptions of initial optics.]. In V. Nordmeier & H. Grötzebauch (Eds.), Didaktik der Physik – Beiträge zur DPG-Frühjahrstagung. Fachverband der Deutschen Physikalischen Gesellschaft.
Tesch, M., & Duit, R. (2004). Experimentieren im Physikunterricht – Ergebnisse einer Videostudie [Experimentation in physics lessons - results of a video study]. Zeitschrift Für Didaktik Der Naturwissenschaften, 10, 51–69.
White, R. T., & Gunstone, R. F. (1992). Probing understanding. Falmer Press.
Woods-McConney, A., Oliver, M. C., McConney, A., Schibeci, R., & Maor, D. (2013). Science engagement and literacy: A retrospective analysis for indigenous and non-indigenous students in Aotearoa New Zealand and Australia. Research in Science Education, 43(1), 233–252. https://doi.org/10.1007/s11165-011-9265-y
Wosilait, K., Heron, P. R. L., Shaffer, P. S., & McDermott, L. C. (1998). Development and assessment of a research-based tutorial on light and shadow. American Journal of Physics, 66(10), 906–913. https://doi.org/10.1119/1.18988
Yonai, E., Shimoni, E., Kahil, K., & Blonder, R. (2022). Authentic science learning during COVID-19: The adaptive design of a SEM outreach activity. The Biophysicist, 3(1), 35–48. https://doi.org/10.35459/tbp.2021.000206
Zehren, W., Neber, H., & Hempelmann, R. (2013). Forschendes Experimentieren im Schülerlabor: Kognitive und motivationale Effekte [Inquiry-experimentation in a student lab: Cognitive and motivational effects]. Der Mathematische Und Naturwissenschaftliche Unterricht, 66(7), 416–423.
Acknowledgements
This research was funded within the doctoral program “Metacognitive Monitoring in Authentic Learning Environments in Out-Of-School Labs (MeMo-akS)” by the Professional School of Educational Studies of Ruhr University Bochum. We thank the members for their feedback on the design of this study. Further, we would like to thank the team of the Alfried Krupp-Schülerlabor der Wissenschaften (out-of-school lab) for their cooperation and all the teachers and students who participated in our study. We thank our student research assistants for their help in collecting the data, transcribing the interviews, and proofreading this manuscript.
Funding
Open Access funding enabled and organized by Projekt DEAL. Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Conceptualization: Sarah Hohrath, Sandra Aßmann, Heiko Krabbe, Maria Opfermann; methodology: Sarah Hohrath, Sandra Aßmann, Heiko Krabbe, Maria Opfermann; formal analysis and investigation: Sarah Hohrath; writing—original draft preparation: Sarah Hohrath; writing—review and editing: Sarah Hohrath, Sandra Aßmann, Heiko Krabbe, Maria Opfermann; funding acquisition: Sandra Aßmann, Heiko Krabbe, Maria Opfermann; supervision: Sandra Aßmann, Heiko Krabbe, Maria Opfermann.
Corresponding author
Ethics declarations
Ethical approval
Data collection followed the standards of the German Psychological Society (DGPs) and ethical approval was given by the Faculty of Philosophy and Educational Sciences of the Ruhr University Bochum as students’ personal data such as their voices were recorded.
Consent to participate
Written informed parental consent was given for all participants.
Conflict of interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Current themes of research.
Sarah Hohrath. Her current themes of research are non-formal learning in out-of-school labs, perceived authenticity in out-of-school labs, metacognitive monitoring during experimentation, concept development through experimentation, and (shared) regulation processes when experimenting.
Sandra Aßmann. Her research areas include learning with digital media and the connection between formal, non-formal, and informal learning processes.
Heiko Krabbe. His research areas include learning process-oriented design of physics lessons, professional vision, and language support in physics teaching.
Maria Opfermann. Her activities are focused on multimedia learning, self-regulation, and cognitive load. She has contributed to research on cognitive load measurement (especially the question, when cognitive load should be assessed), generative learning activities such as drawing, and the role of decorative pictures for learning. As part of the elementary school department, she is now especially interested in ways to optimize learning and cognitive load for very young learners.
Most relevant publications.
No previous publications.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Hohrath, S., Aßmann, S., Krabbe, H. et al. Students’ perceived authenticity and understanding of authentic research while experimenting in a non-formal learning setting. Eur J Psychol Educ (2024). https://doi.org/10.1007/s10212-024-00810-z
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10212-024-00810-z