We present the impact on student self-efficacy of an introductory physics for life-science students course taught using a Team-Based Learning pedagogy. We measured self-efficacy using the validated quantitative Sources of Self-Efficacy in Science Courses - Physics, SOSESC-P, survey developed by Fencl and Scheel. Data were collected both at the beginning and end of the semester to evaluate the impact of shifts in individual self-efficacy. After describing the key features of the pedagogy, we find that the Team-Based Learning system at University of Massachusetts Amherst, results in significant improvements for she-identifying individuals from three of the four sources of self-efficacy identified by Bandura as well as in three of four investigated attributes of the course. We also investigated the predictive power of self-efficacy on individual student performance using logarithmic regression. For our course, the shift in self-efficacy between the beginning and end of the semester is more important that a student's pronouns in predicting attaining at least a B on individual assignments.
In this paper, we describe how we transformed our large-enrollment introductory physics sequence for life-science students to a Lecture/Studio format and aligned the physics concepts with authentic biological applications. We have reformed the pedagogy to include research-validated practices in interactive engagement, and accomplished our goals of enhanced learning gains, sustainability, and adoptability of our course reforms. The active engagement at the heart of the Lecture/Studio format results in comparable or enhanced learning gains (as measured by validated concept surveys) when compared…
Most STEM students experience the introductory physics sequence in large-enrollment (N $\gtrsim$ 100 students) classrooms, led by one lecturer and supported by a few teaching assistants. This work describes methods and principles we used to create an effective "flipped classroom" in large- enrollment introductory physics courses by replacing a majority of traditional lecture time with in-class student-driven activity worksheets. In this work, we compare student learning in courses taught by the authors with the flipped classroom pedagogy versus a more traditional pedagogy. By comparing identic…
Analysis of institutional data for physics majors showing predictive relationships between required mathematics and physics courses in various years is important for contemplating how the courses build on each other and whether there is need to make changes to the curriculum for the majors to strengthen these relationships. We use 15 years of institutional data at a large research university to investigate how introductory physics and mathematics courses predict male and female physics majors' performance on required advanced physics and mathematics courses. We used Structure Equation Modeling…
The University of Maryland (UMD) Biology Education and Physics Education Research Groups are investigating students' views on the role of physics in introductory biology courses. This paper presents data from an introductory course that addresses the fundamental principles of organismal biology and that incorporates several topics directly related to physics, including thermodynamics, diffusion, and fluid flow. We examine how the instructors use mathematics and physics in this introductory biology course and look at two students' responses to this use. Our preliminary observations are intended…
Recently, there has been increased attention to improving laboratory instruction at all levels. At the introductory level, research results have shown differing levels of success based on the nature of the desired learning outcomes. In response to these findings, the University of Colorado's introductory physics lab course was transformed to improve students' development of experimental skills and experimental physics epistemology. We describe the details of the transformation process and initial self-reported learning gains from the first implementation of the transformed course.
Educators and policy-makers have advocated for reform of undergraduate biology education, calling for greater integration of mathematics and physics in the biology curriculum. While these calls reflect the increasingly interdisciplinary nature of biology research, crossing disciplinary boundaries in the classroom carries epistemological challenges for both instructors and students. In this paper we expand on the construct of authenticity to better describe and understand disciplinary practices, in particular to examine those used in physics and biology courses. We then apply these ideas to exa…
The research presented in this thesis was motivated by the need to improve introductory physics courses. Introductory physics courses are generally the first courses in which students learn to create models to solve complex problems. However, many students taking introductory physics courses fail to acquire a command of the concepts, methods and tools presented in these courses. The reforms proposed by this thesis focus on altering the content of introductory courses rather than content delivery methods as most reforms do. This thesis explores how the performance on a widely used test of conce…
Enhancing motivation and learning attitudes in an introductory physics course is an important but difficult task that can be achieved through class blogging. We incorporated into an introductory course a blog operated by upper-level physics students. Using the Colorado Learning Attitudes about Science Survey (CLASS), periodic in-class surveys, analysis of student blog comments, and post-instructional interviews, we evaluate how the blog combined with class instruction provided the students with a better sense of relevance and confidence and outline recommendations for future use of this strate…
Grades provide students with their primary performance feedback: signals which affect academic choices. Variations in grading practice among courses impose grade penalties (and bonuses) on students who take them. These grade penalties are sometimes gendered. Using extensive data from the University of Michigan, we report on patterns of grade penalty and gendered performance difference across 116 large courses. We find that significant gendered performance differences are ubiquitous in large introductory STEM lecture courses. They are largely absent in both STEM labs and in lecture courses in o…
Social distancing due to the Covid-19 pandemic deeply impacted on education worldwide, since schools and universities had to rapidly organise lessons and courses on line. Traditional interactions between teachers and students and, also among students, had to change and was substituted by on line connections. In this context, laboratory work and tutoring, which have an important role in the peer instruction model, needed to be redesigned. Here, we discuss an on line tutoring model adopted for the introductory physics courses at Turin Polytechinc University and evaluate its effectiveness by anal…
Student-to-student interactions are foundational to many active learning environments, but are most often studied using qualitative methods. Network analysis tools provide a quantitative complement to this picture, allowing researchers to describe the social interactions of whole classrooms as systems. Past results from introductory physics courses have suggested a sharp division in the formation of social structure between large lecture sections and small studio classroom environments. Extending those results, this study focuses on calculus-based introductory physics courses at a large public…
A recent paper used structural equation modeling to infer effects of gender-dependent student attitudes on several outcomes of introductory physics courses. The model used is precisely Markov equivalent to an equally plausible approximation in which a key gender-dependent coefficient in determining attitudes is indistinguishable from zero. I also argue that the qualitative framing may attribute to students motivations that actually belong to their teachers.
Since 2010, the Yale physics department has offered a novel calculus-based introductory physics for the life science (IPLS) sequence, that re-imagines the IPLS syllabus to include a selection of biologically and medically relevant topics, that are highly meaningful to its audience of biological science and premedical undergraduates. The first semester, in particular, differs considerably from traditional first-semester introductory physics. Here, we highlight the novel aspects of Yale's first-semester course, and describe student feedback about the course, including a comparison between how st…
We report on research carried out to improve teaching and student engagement in the introductory astronomy course at the University of Cape Town. This course is taken by a diverse range of students, including many from educationally disadvantaged backgrounds. We describe the development of an instrument, the Introductory Astronomy Questionnaire (IAQ), which we administered as pre- and post-tests to students enrolled in the course. The instrument comprised a small number of questions which probed three areas of interest: student motivation and expectations, astronomy content, and worldview. Amo…
The Georgia Tech blended introductory calculus-based mechanics course emphasizes scientific communication as one of its learning goals, and to that end, we gave our students a series of four peer-evaluation assignments intended to develop their abilities to present and evaluate scientific arguments. Within these assignments, we also assessed students' evaluation abilities by comparing their evaluations to a set of expert evaluations. We summarize our development efforts and describe the changes we observed in student evaluation behavior.
Laboratory courses are key components of most undergraduate physics programs. Lab courses often aim to achieve the following learning outcomes: developing students' experimental skills, engaging students in authentic scientific practices, reinforcing concepts, and inspiring students' interest and engagement in physics. Some of these outcomes can be measured by the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), a research-based assessment that measures students' views about experimental physics. We used E-CLASS at the University of Colorado Boulder to measu…
Peer Influence on Physics Self-Efficacy and Grades: A comparative study of students in an introductory calculus-based course who typically worked alone or in groups before and during the pandemic
Proficiency with calculating, reporting, and understanding measurement uncertainty is a nationally recognized learning outcome for undergraduate physics lab courses. The Physics Measurement Questionnaire (PMQ) is a research-based assessment tool that measures such understanding. The PMQ was designed to characterize student reasoning into point or set paradigms, where the set paradigm is more aligned with expert reasoning. We analyzed over 500 student open-ended responses collected at the beginning and the end of a traditional introductory lab course at the University of Colorado Boulder. We di…
With inspiration from the classic study by Chi, Feltovich, and Glaser [1], we asked introductory physics students in three introductory physics classes to categorize mechanics problems based upon similarity of solutions. To evaluate the effect of problem context on students' ability to categorize, two sets of problems were developed for categorization. Some problems in one of the problem sets that students were asked to categorize included those available from the prior study by Chi et al. Our findings, which contrast from those of Chi et al., suggest that there is a much wider distribution of…
This article quantitatively examines the effects that different incentives have on students' homework completion rates in introductory physics courses at the United States Air Force Academy. Our data suggest that no more than 10-15% of the total course points need to be allocated to homework to maximize completion of homework through a grade incentive. In addition, we find that there is a strong relationship between students' perception of the benefits of homework and homework completion rates. Students completed nearly 20% more homework when their average perception of homework increased by 0…
In the Fall of 2013, Georgia Tech offered a 'flipped' calculus-based introductory mechanics class as an alternative to the traditional large-enrollment lecture class. This class flipped instruction by introducing new material outside of the classroom through pre-recorded, lecture videos. Video lectures constituted students' initial introduction to course material. We analyze how students engaged with online lecture videos via 'clickstream' data, consisting of time-stamped interactions (plays, pauses, seeks, etc.) with the online video player. Analysis of these events has shown that students ma…
We have designed an introductory laboratory course that engaged first-year undergraduate students in two complementary types of iteration: (1) iterative improvement of experiments through cycles of modeling systems, designing experiments, analyzing data, and refining models and designs; and (2) iterative improvement of self through cycles of reflecting on progress, soliciting feedback, and implementing changes to study habits and habits of mind. The course consisted of three major activities: a thermal expansion activity, which spanned the first half of the semester; final research projects, w…
Many STEM degrees require passing an introductory physics course. Physics courses often have high failure rates that may disproportionately harm students who are marginalized by racism, sexism, and classism. We examined the associations between Learning Assistant (LA) supported courses and equity in non-passing grades (i.e., d, drop, fail, or withdrawal; DFW) in introductory physics courses. The data used in the study came from 2312 students in 41 sections of introductory physics courses at a regional Hispanic serving institution. We developed hierarchical generalized linear models of student …
Societal stereotypes and biases pertaining to who belongs in physics and who can excel in physics can impact motivational beliefs, e.g., of women and racial and ethnic minority students in physics courses. This study investigates how the learning environment predicts male and female students' motivational beliefs including physics self-efficacy, interest, and identity at the end of year long (spanning two-semester) algebra-based introductory physics courses. These were courses at a large university in the US taken primarily by biological science majors many of whom are interested in health pro…
In this study, we adapt prior identity framework to investigate the effect of learning environment (including perceived recognition, peer interaction and sense of belonging) on students' physics self-efficacy, interest and identity by controlling for their self-efficacy and interest at the beginning of a calculus-based introductory physics course. We surveyed 1203 students, 35% of whom were women. We found that female students' physics self-efficacy and interest were lower than male students' at the beginning of the course, and the gender gaps in these motivational constructs became even large…
Students taking introductory physics are rarely exposed to computational modeling. In a one-semester large lecture introductory calculus-based mechanics course at Georgia Tech, students learned to solve physics problems using the VPython programming environment. During the term 1357 students in this course solved a suite of fourteen computational modeling homework questions delivered using an online commercial course management system. Their proficiency with computational modeling was evaluated in a proctored environment using a novel central force problem. The majority of students (60.4%) suc…
We have analyzed the impact of taking an associated lab course on the scores on final exam questions in two large introductory physics courses. Approximately a third of the students who completed each course also took an accompanying instructional lab course. The lab courses were fairly conventional, although they focused on supporting the mastery of a subset of the introductory physics topics covered in the associated course. Performance between students who did and did not take the lab course was compared using final exam questions from the associated courses that related to concepts from th…
As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participation over the first five weeks of the eleven-week course.
A goal of Introductory Physics for Life Sciences (IPLS) curricula is to prepare students to effectively use physical models and quantitative reasoning in biological and medical settings. To assess whether this goal is being met, we conducted a longitudinal study of the impact of IPLS on student work in later biology and chemistry courses. We report here on one part of that study, a comparison of written responses by students with different physics backgrounds on a diffusion task administered in a senior biology capstone course. We observed differences in student reasoning that were associated …
The effect of class size on student learning has numerous policy implications and has been a major subject of conversation and research for decades. Despite this, few studies have been done on class size in the context of university settings or physics courses. After discussing some of the reasoning behind hierarchical linear modeling (HLM) as well as how to interpret the results of an HLM analysis while grounding this study in measurement theory as it applies to course grades, this paper goes on to examine the effect of class size in active-learning based introductory physics courses using a …
Creating equitable performance outcomes among students is a focus of many instructors and researchers. One focus of this effort is examining disparities in physics student performance across genders, which is a well-established problem. Another less common focus is disparities across racial and ethnic groups, which may have received less attention due to low representation rates making it difficult to identify gaps in their performance. In this investigation we examined associations between Learning Assistant (LA) supported courses and improved equity in student performance. We built Hierarchi…
Increasing student retention (successfully finishing a particular course) and persistence (continuing through a sequence of courses or the major area of study) is currently a major challenge for universities. While students' academic and social integration into an institution seems to be vital for student retention, research into the effect of interpersonal interactions is rare. We use network analysis as an approach to investigate academic and social experiences of students in the classroom. In particular, centrality measures identify patterns of interaction that contribute to integration int…
Introductory mechanics ("physics 1") is a critical gateway course for students desiring to pursue a STEM career. A major challenge with this course is that there is a large spread in the students' incoming physics preparation, and this level of preparation is strongly predictive of a students' performance. The level of incoming preparation is also largely determined by a student's educational privilege, and so this course can amplify inequities in K-12 education and provide a barrier to a STEM career for students from marginalized groups. Here, we present a novel introductory course design to …
The physics instruction at UC Davis for life science majors takes place in a long-standing reformed large-enrollment physics course in which the discussion/lab instructors (primarily graduate student teaching assistants) implement the interactive-engagement (IE) elements of the course. Because so many different instructors participate in disseminating the IE course elements, we find it essential to the instructors professional development to observe and document the student-instructor interactions within the classroom. Out of this effort, we have developed a computerized real-time instructor o…
In an Introductory Physics for Life Science (IPLS) course that leverages authentic biological examples, student ideas about entropy as "disorder" or "chaos" come into contact with their ideas about the spontaneous formation of organized biological structure. It is possible to reconcile the "natural tendency to disorder" with the organized clustering of macromolecules, but doing so in a way that will be meaningful to students requires that we take seriously the ideas about entropy and spontaneity that students bring to IPLS courses from their prior experiences in biology and chemistry. We draw …
Assessing student performance becomes challenging when course enrollment becomes very large (~10^4 students). As part of a Massive Open Online Course (MOOC) in introductory physics offered by Georgia Tech in 2013, students submitted video reports on mechanics labs. Peer evaluation of these reports provided the primary method for evaluating student laboratory work. This paper describes the methods developed and used to guide students in evaluating each other's video lab reports. We also discuss how students' peer evaluation behavior changed with different interventions provided in the course.
One desired outcome of introductory physics instruction is that students will develop facility with reasoning quantitatively about physical phenomena. Little research has been done regarding how students develop the algebraic concepts and skills involved in reasoning productively about physics quantities, which is different from either understanding of physics concepts or problem-solving abilities. We introduce the Physics Inventory of Quantitative Literacy (PIQL) as a tool for measuring quantitative literacy, a foundation of mathematical reasoning, in the context of introductory physics. We p…
Computation is a central aspect of modern science and engineering work, and yet, computational instruction has yet to fully pervade university STEM curricula. In physics, we have begun to integrate computation into our courses in a variety of ways. Here, we discuss a method for integrating computation into calculus-based mechanics where the lecture and laboratory for the course are decoupled. At Michigan State University, we have developed a "lecture" course, called "Projects and Practices in Physics", where science and engineering students solve complex problems in groups of four using analyt…
At many universities, astronomy is a popular way for non-science majors to fulfill a general education requirement. Because general-education astronomy may be the only college-level science course taken by these students, it is the last chance to shape the science attitudes of these future journalists, teachers, politicians, and voters. I report on an attempt to measure and induce changes in science attitudes in my general-education astronomy course. I describe construction of the attitude survey, classroom activities designed to influence attitudes, and give numerical results indicating a sig…
Our recent study showed that two lab courses, whose goals were exclusively to reinforce material developed in the lecture courses, do not have any impact on exam performance at the 1% level. In this study, we replicated this analysis with a modified version of one of these lab courses whose goals also included modeling, designing experiments, and analyzing and visualizing data. This modified course used the same sets of apparatus as the previous version, but changed the pre-lab and in-lab activities to focus on developing and testing models with data. The study evaluated the impact of these ad…
