A Multi-disciplinary Empirical Investigation of Active Learning Classroom ’ s Effects on Student Learning

Corresponding author: Xiaoshan Zhu Gordy, School of Graduate Studies, University of Mississippi Medical Center, USA. E-mail: xgordy@umc.edu Citation: Gordy, X.Z., Zhang L., Sullivan, A.L., Haynie, L., Richards-Moore, L., Bailey, J.H.(2018). A Multi-Disciplinary Empirical Investigation of Active Learning Classroom’s Effects on Student Learning. Interdisciplinary Education and Psychology, 2(1):3. Open Access Interdisciplinary Education and Psychology


Introduction
Technology has undoubtedly permeated every aspect of our daily lives.Its ubiquitous availability today has put education systems of all levels at an unprecedented advantage with access to boundless information and possibility of new exploration and invention.Many educators believed that technology could potentially transform learning environments from feature multiple flat-panel screens or projectors, movable furniture, and advanced portable device-based technology.
In 2014, a school within a U.S. southeastern academic medical center transformed a traditional classroom into an ALC named the Collaboratory (see definition in Figure 1).When compared to a typical traditional classroom, the design of the Collaboratory was of a total overhaul.It was equipped with 12 large interconnected flat screens, a large wall projector, rectangular and semicircular movable tables with access points to power outlets and smart device hookups, individual swivel chairs with built-in work surfaces and storage in the tripod base, both large and small portable white boards on rollers.For instructors, this space has offered them opportunities to quickly switch from one mode of teaching (e.g.lecturing) to another (e.g.individual or group work).For students, this space has provided an unobstructed view of class content from anywhere in the room, allowed connectivity and mobility, and enabled dynamic collaboration and interactive learning.(Beichner et al., 2007;Beichner, Saul, Allain, Deardorff, & Abbott, 2000), Massachusetts Institute of Technology's Technologyenabled active learning (TEAL) project (Dori & Belcher, 2005;Dori et al., 2003), and the University of Minnesota's Active Learning Classrooms (ALCs) research (Baepler & Walker, 2014;Brooks, 2011Brooks, , 2012;;Brooks & Solheim, 2014).The SCALE-UP Project results showed that interactive learning environments improved students' problem-solving skills, attitude development, class attendance rates, and reduced failure rates.The TEAL project found that students involved in TEAL demonstrated improved conceptual understanding and lower failure rates.The ALC research by the University of Minnesota discovered that active learning spaces alone had significant and positive impact on student learning.Similar research has also recently been conducted in other countries around the globe, such as Korea (Park & Choi, 2014), Hongkong (Chiu & Cheng, 2017), Canada (Chen, 2015;Gebre, Saroyan, & Aulls, 2015).They discovered that active learning environments were more inspirational than traditional classrooms and more conducive to students' critical thinking or open-minded thinking skills.These existing studies were conducted in various disciplines such as finance, biology, physics, chemistry, and education.However, we were not aware of published studies of ALCs in allied health educational settings.Moreover, many of the existing research focused on only perceptional measures.A few provided empirical evidences on ALCs' impact on learning outcomes.Building upon previous research, in this study we collected data from both perceptional and empirical perspectives aiming to gain a more holistic view, narrow the gap in the literature, and provide a deeper insight into the effectiveness of ALCs.

Methods
Since the Collaboratory was put in use, faculty and administrators were eager to find out how the room affected teaching and learning and whether it made a positive academic impact.In a recent qualitative study with faculty and students from various disciplines (Gordy, Jones, & Bailey, 2018), our findings indicated that the Collaboratory promoted student engagement, increased classroom interaction, enhanced group work efficiency, and fostered the development of creativity.To cross-validate the qualitative findings, we referred to a quantitative measurement -student survey -to see whether students' perceptions of the Collaboratory regarding those aspects were consistent with our qualitative findings.In the meantime, we sought to investigate whether teaching and learning in the Collaboratory yielded better student learning outcomes through comparing course grades earned in the Collaboratory and TCs respectively.All research activities involved in the study were approved by the Institutional Review Board at the current medical center.

Student Survey
The student survey in the current study contained 25 questions that were adapted from Park and Choi's study (2014).The survey was shared by one of the authors and was originally in Korean.It was then translated and sent back, along with adaptions made suitable for the current study, to the Korean authors for verification of accuracy and advice.The final survey included four demographical questions, two academic attitudinal questions, fifteen educational effects questions comparing the ALC and TC which required responses on fivepoint Likert scale, and four open-ended questions related to students' learning space experiences.All of the questions were entered into a survey software (Qualtrics) and an online survey was generated through the tool.
In this study, we did not intend to survey students who took occasional classes in the Collaboratory, as they might not have in-depth experiences with the room to give valid answers.In order to find out which students took weekly classes in the Collaboratory, we inquired into the Collaboratory schedule at the beginning of 2015-2016 academic year and identified five instructors who were scheduled to teach classes in the room every week.The corresponding students in those five instructors' classes, 275 in total, were then identified as the sample for our survey.They were from five different allied health disciplines: Dental Hygiene (DH), Physical Therapy (PT), Occupational Therapy (OT), Medical Laboratory Sciences (MLS), Radiologic Sciences (RS).The students were surveyed towards the end of the academic year when they had almost a full year of experience in the Collaboratory.The survey was anonymous and completely voluntary.A total of 246, nearly 90% of the students, responded.After excluding 12 incomplete ones, we extracted 234 (85.1%) valid student responses.In the current study, only questions pertinent to our research questions were included for analysis.

Course Grades
To find out whether the design of the Collaboratory was more conducive to student learning outcomes, we intended to compare course grades earned in the Collaboratory from the 2015-2016 academic year with five-year historical grades (2010)(2011)(2012)(2013)(2014)(2015) of the same courses taught by the same instructors in the TCs.After checking with all five instructors mentioned previously, one was not to give numerical grades (only "pass" or "fail"), two were only to teach a portion of their courses in the Collaboratory (other portions were taught in the TCs or labs), and one never taught in the TC before to offer historical data, so they were excluded from the study.The instructor in dental hygiene was scheduled to teach two consecutive courses (Dental Radiology I and II) in the Collaboratory in the 2015-2016 academic year.Prior to that, she had taught the same two courses in the traditional setting for five years.Therefore, grades from her classes were the only suitable ones for our study.For the study purpose, she graciously agreed, per our request at the beginning of the fall semester, not to change class content, teaching styles and tests so that we could control as many variables as possible.We followed the instructor for the entire academic year to make class observations in the Collaboratory.At the end of the academic year, we collected grades from current and historical courses.After further examining the historical data, we excluded the grades from 2010-2011 year because the courses were combined in one at the time.Therefore, four-year historical grades earned in the TCs by 80 students and one-year grades earned in the Collaboratory by 19 students were included in the final analysis.

Data Management and analysis
The survey data were exported in SPSS format from Qualtrics.All analyses were conducted using IBM SPSS Statistics 23.Independent-samples t-tests were used to compare the results of students' perceptions towards educational effects of ALC and TC.The same tests were used to compare the course grades earned in those two separate classroom settings.The statistical tests were considered significant if p-values from the tests were less than 0.05.All tests were two sided.

Results
The majority of students who answered the survey came from the PT program (44%).More than 70% of students were female.Over 80% of students were white, and about two-thirds (67%) had an incoming GPA in the range of 3.5 to 3.9.

Design of the Collaboratory and Classroom Improvement
Table 1 presents student responses to five survey questions that are related to our research interest.In these questions, participants were asked how strongly they agreed or disagreed with the same statement twice, once for how the statement applied to TC and once for how it applied to ALC.Mean scores by classroom type (strongly agree =5, strongly disagree =1), differences of mean scores and p-value from independent t-tests are shown.
From Table 1, we can see that students' perception regarding whether they could concentrate for a long time differed by classroom type (p < 0.001).ALC received a mean score of 3.70, about 28.5% higher than TC (2.88).Two questions were asked regarding classroom interaction, one on peer interaction and one on student-teacher interaction.The results indicated that students' attitudes toward the easiness of peer interaction differed by the classroom type (p < 0.001).ALC again had a higher mean score of 4.29, compared to 3.38 for TC.As to student-teacher interaction, no significant difference (p = 0.193) was found between two types of classrooms.Student attitudes toward the efficiency of learning space differed significantly (p < 0.001) with the highest mean difference (1.3) among all the five questions.ALC achieved a mean score of 4.36, whereas TC only had a mean score of 3.06.In regard to the development of creative ideas, students' answers differed significantly by classroom type as well (p < 0.001).ALC demonstrated a mean score of 4.22, about 22.0% higher than TC (3.46).

Design of the Collaboratory and the Learning Outcomes
The Dental Hygiene program enrolled about 20 students per year.In the past five years, mainly females chose the profession, with only two male students enrolled.Approximately 85% of the students were under 25 years old.Three quarters of them were white.Almost 60% of the students scored between 20 and 24 in ACT and half of them had an incoming GPA in the range of 3.0 to 3.4.
Dental Hygiene is a lockstep program, and Dental Radiology I and II were required courses in the first year of the program.From Table 2, we can see a slight mean score increase between grades earned in TC and ALC, 1.5 for Dental Radiology I (TC: M=85.2,SD=5.3;ALC: M=86.7,SD=5.5) and 1.6 for Dental Radiology II (TC: M=85.2,SD=5.3;ALC: M=86.7,SD=5.5).However, the increases were not significant (Dental Radiology I, t (97) = -1.096,p = 0.276; Dental Radiology II, t (97) = -1.598,p = 0.113).

Discussion
Students' attention span is roughly fifteen minutes (Wankat, 2002).After that, most students' attention level tends to drop dramatically resulting in declined knowledge retention (Hartley & Davies, 1978;Newble & Cannon, 1995).Our results suggested that more students believed that they could stay focused for a long time in the classroom setting of ALC than TCs, which is consistent with Park and Choi's finding (2014).This could be the result of natural occurrences of increased peer interaction and group activities in the ALC.The presence of those activities broke lectures into segments and engaged students' visual, auditory, and kinesthetic (VAK) senses, which herein helped involve students in the learning process and keep them focused longer (Whiteley, 2007).
The results of this study suggested that students perceived that information sharing with peers was easier in the ALC than TCs.This concurred with both Park and Choi's finding (2014) and Brooks' (Brooks, 2012) research findings.However, as to student-teacher interaction, the ALC and TCs were on a par.The increased peer interaction in the ALC could be induced by easiness of moving about, screen sharing capability, and face-to-face seating arrangement.The similar amount of student-teacher interaction in the ALC and TCs was actually a positive finding as it indicated that instructors made themselves available regardless of the classroom types.
The results of the current study also indicated that more students agreed that learning space like ALC enhanced the efficiency of group work.Group work has been exalted as an effective teaching approach and its positive effects on student engagement, knowledge retention, and the development of work-related skills have been reported in numerous studies (Bonwell & Eison, 1991;Puma & Abt Associates, 1996;Sherman, 1991;Smith & Cardaciotto, 2011;Swaray, 2012).This finding was expected as the intention of the ALC design was to allow instructors to be able to quickly huddle or break out for different types of group work.
Studies on the importance of creativity has been long established in the literature and it was believed that individuals with creative talent tended to display a love for challenges, higher satisfaction from what they were doing, and greater lifetime achievements (Guilford, 1950(Guilford, , 1977;;Mackinnon, 1962;Torrance, 1966;Torrance, 1970;Torrance, 1983).In Bloom's Taxonomy (Anderson et al., 2001), creativity has been placed on the top of the learning pyramid and considered as the ultimate learning objective.Making learning environments a breeding ground for creativity has become one of highly valued but yet often unfulfilled educational goals (Beghetto & Kaufman, 2014).The fact that the majority of students considered the ALC conducive to the development of creativity implies that ALCs hold promises for realizing this educational goal and paving the road for students' future success.
The cohort comparison of course grades earned in the ALC and TCs for both courses displayed a slight mean score increase but no statistical differences, which was contradictory to many previous studies and definitely added a different voice to the body of existing literature.Several factors may have contributed to this result.First, the overall student population was small due to the limited enrollment size in the dental hygiene program at the current institution.Second, we only collected one-year course grades earned in the ALC when both the instructor and students were at the stage of groping for better utilization of the room.Continuing to collect data for a few more years with increased sample size might lead to results that are more promising.Third, the instructor was asked not to change her class content, teaching styles and tests so that we could better test the effects of the ALC.This may have limited the usage of the classroom facilities to their full extent.Fourth, the tests used for both courses may have been designed to evaluate student learning in TCs but may not There are some limitations to this study.First, the ALC under study was the first and only one at the institution.The novelty of the design could have contributed to some positive perceptions but may wear off over time.Second, the study was quasi-experimental as random sampling was not applicable, especially in the selection of sample for course grade comparison.Larger sample size or longer study duration might produce a more convincing outcome.Third, teaching in a totally different environment was inherently such a complex phenomenon that it was impossible to single out any confounding factors to fully evaluate the effect of the space alone.
In conclusion, the current study indicated that student perceptions with respect to their ability to maintain concentration, peer interaction, group work efficiency and the development of creativity differed significantly by the classroom type.The active learning space gained higher mean scores than traditional settings in all of those aspects.However, no significant differences were found from grades earned in the ALC and TCs.Future educators are encouraged to employ ALC appropriate teaching approaches to optimize student learning.They are also encouraged to design ALC appropriate tests to effectively evaluate student learning.Moreover, future research should be conducted with a larger sample size at multiple educational settings to further investigate the impact of active learning classrooms in order to better enlighten forthcoming pedagogical reform and classroom redesign.

Figure 1 .
Figure 1.Definition of Collaboratory Even though the adoption of technology-rich classroom design remains slow today, avantgarde educators started research in this field over a decade ago.The primary examples in the U.S. included North Carolina State University's Student-Centered Activities for Large Enrollment Undergraduate Physics (SCALE-UP) project(Beichner et al., 2007;Beichner, Saul, Allain, Deardorff, & Abbott, 2000), Massachusetts Institute of Technology's Technologyenabled active learning (TEAL) project(Dori & Belcher, 2005;Dori et al., 2003), and the University of Minnesota's Active Learning Classrooms (ALCs) research(Baepler & Walker, 2014;Brooks, 2011Brooks, , 2012;;Brooks & Solheim, 2014).The SCALE-UP Project results showed that interactive learning environments improved students' problem-solving skills, attitude development, class attendance rates, and reduced failure rates.The TEAL project found that students involved in TEAL demonstrated improved conceptual understanding and lower failure rates.The ALC research by the University of Minnesota discovered that active learning spaces alone had significant and positive impact on student learning.Similar research has also recently been conducted in other countries around the globe, such as Korea(Park & Choi, 2014), Hongkong(Chiu & Cheng, 2017), Canada(Chen, 2015;Gebre, Saroyan, & Aulls, 2015).They discovered that active learning environments were more inspirational than traditional classrooms and more conducive to students' critical thinking or open-minded thinking skills.These existing studies were conducted in various disciplines such as finance, biology, physics, chemistry, and education.However, we were not aware of published studies of ALCs in allied health educational settings.Moreover, many of the existing research focused on only perceptional measures.A few provided empirical evidences on ALCs' impact on learning outcomes.Building upon previous research, in this study we collected data from both perceptional and empirical perspectives aiming to gain a more holistic view, narrow the gap in the literature, and provide a deeper insight into the effectiveness of ALCs.

Table 1 .
Survey responses to research questions (N=234)

Table 2 .
Independent-samples t-tests Comparing Dental Radiology I and II Grades Earned in TC and ALC Interdisciplinary Education and Psychology 5 of 8 Gordy et al.Interdisciplinary Education and Psychology.2018, 2(1):3.