We discuss the development of a research-based conceptual multiple-choice survey related to magnetism. We also discuss the use of the survey to investigate gender differences in students' difficulties with concepts related to magnetism. We find that while there was no gender difference on the pre-test, female students performed significantly worse than male students when the survey was given as a post-test in traditionally taught calculus-based introductory physics courses (similar results in both the regular and honors versions of the course). In the algebra-based courses, the performance of the female students and the male students has no statistical difference in the pre-test or the post-test.
It has been found that activation of a stereotype, for example by indicating one's gender before a test, typically alters performance in a way consistent with the stereotype, an effect called "stereotype threat". On a standardized conceptual physics assessment, we found that asking test takers to indicate their gender right before taking the test did not deteriorate performance compared to an equivalent group who did not provide gender information. Although a statistically significant gender gap was present on the standardized test whether or not students indicated their gender, no gender gap …
We present results of a combined study from three UK universities where we investigate the existence and persistence of a performance gender gap in conceptual understanding of Newtonian mechanics. Using the Force Concept Inventory, we find that students at all three universities exhibit a statistically significant gender gap, with males outperforming females. This gap is narrowed but not eliminated after instruction, using a variety of instructional approaches. Furthermore, we find that before instruction the quartile with the lowest performance on the diagnostic instrument comprises a disprop…
We have investigated the long-term effect of student-centered instruction at the freshman level on juniors' performance on a conceptual survey of Electricity and Magnetism (E&M). We measured student performance on a research-based conceptual instrument -- the Brief Electricity & Magnetism Assessment (BEMA) -- over a period of 8 semesters (2004-2007). Concurrently, we introduced the University of Washington's Tutorials in Introductory Physics as part of our standard freshman curriculum. Freshmen took the BEMA before and after this Tutorial-based introductory course, and juniors took it after co…
We discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): the knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to (1) identify the most common incorrect answer choice of introductory physics students and (2) predict the percentage of introductory students who would answer the question correctly in a post-test. Then, we used the CSEM post-test data from approximately 40…
Massive Open Online Courses are an exciting new avenue for instruction and research, yet they are full of unknowns. In the Spring of 2013, MITx released its first introductory physics MOOC through the edX platform, generating a total enrollment of 43,000 students from around the world. We describe the population of participants in terms of their age, gender, level of education, and country of origin, highlighting both the diversity of 8.02x enrollees as well as gender gap and retention. Using three midterm exams and the final as waypoints, we highlight performance by different demographic subp…
Several prior studies in introductory physics have found a gender gap on conceptual assessments such as the Force Concept Inventory (FCI) and the Conceptual Survey of Electricity and Magnetism (CSEM) with male students performing better than female students. Moreover, prior studies in the context of mathematics have also found that activation of a negative stereotype about a group can lead to deteriorated performance of the stereotyped group. Here, we describe two studies in which we investigated the impact of interventions on the gender gap on the FCI and CSEM in large introductory physics co…
Many prior studies have found a gender gap between male and female students' performance on conceptual assessments such as the Force Concept Inventory (FCI) and the Conceptual Survey of Electricity and Magnetism (CSEM) with male students performing better than female students. Prior studies have also found that activation of a negative stereotype about a group or stereotype threat, e.g., asking test-takers to indicate their ethnicity before taking a test, can lead to deteriorated performance of the stereotyped group. Here, we describe two studies in which we investigated the gender gap on the …
Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account common student difficulties in their instructional design. Here, we discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to identify the most common incor…
We describe a retrospective study of the responses to the Brief Electricity and Magnetism Assessment (BEMA) collected from a large population of 3480 students at a large public university. Two different online testing setups were employed for administering the BEMA. Our tale focuses on the interpretation of the data collected from these two testing setups. Our study brings new insight and awareness to the effect of the randomization on the BEMA test results. Starting from an a priori common sense model, we show simple methods to detect and separate guessing from the genuinely thought responses…
Conceptual inventory surveys are routinely used in education research to identify student learning needs and assess instructional practices. Students might not fully engage with these instruments because of the low stakes attached to them. This paper explores tests that can be used to estimate the percentage of students in a population who might not have taken such surveys seriously. These three seriousness tests are the pattern recognition test, the easy questions test, and the uncommon answers test. These three tests are applied to sets of students who were assessed either by the Force Conce…
We analyze the effectiveness of working in pairs on the Conceptual Survey of Electricity and Magnetism test in a calculus-based introductory physics course. The group performance shows large normalized gain and evidence for co-construction. We discuss the effect of pairing students with different individual achievements.
A large body of research shows that using interactive engagement pedagogy in the introductory physics classroom consistently results in significant student learning gains; however, with a few exceptions, those learning gains tend not to be accompanied by more expertlike attitudes and beliefs about physics and learning physics. In fact, in both traditionally taught and active learning classroom environments, students often become more novicelike in their attitudes and beliefs following a semester of instruction. Further, prior to instruction, men typically score higher than women on conceptual …
Studies examining gender differences in introductory physics show a consensus when it comes to a gender gap on conceptual assessments; however, the story is not as clear when it comes to differences in gendered performance on exams. This study examined whether gendered differences exist on midterm and final exams in introductory physics courses and if such differences were correlated with a gender difference in final course grades. The population for this study included more than 10,000 students enrolled in algebra- and calculus-based introductory physics courses between spring 2007 and spring…
As part of a large-scale assessment project at a large university, we administered weekly pre-tests and bi-weekly post-tests in the recitation sections of our introductory classes over four semesters from Spring 2010 through Fall 2011. The post-tests were administered as graded quizzes and were developed to assess problem solving, laboratory, calculational and conceptual skills that had been the focus of instruction in lab, lecture and recitation sessions. They were not comprehensive, but gave us 'snapshots' of students' abilities throughout the semester. They were used in conjunction with oth…
The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students' preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been test…
We review the literature on the gender gap on concept inventories in physics. Across studies of the most commonly used mechanics concept inventories, the Force Concept Inventory (FCI) and Force and Motion Conceptual Evaluation (FMCE), mens average pretest scores are always higher than womens, and in most cases mens posttest scores are higher as well. The weighted average gender difference on these tests is 13% for pretest scores, 12% for posttest scores, and 6% for normalized gain. This difference is much smaller than the average difference in normalized gain between traditional lecture and in…
We analyze the effectiveness of working in pairs on the Conceptual Survey of Electricity and Magnetism test in a calculus-based introductory physics course. Students who collaborated with a peer showed significantly larger normalized gain on individual testing than those who did not collaborate. We did not find statistically significant differences between the performance of students who were given an opportunity to formulate their own response before the peer discussions, compared to those who were not. Peer collaboration also shows evidence for co-construction of knowledge. Discussions with …
The Force Concept Inventory (FCI) can be used as an assessment tool to measure conceptual gains in a cohort of students. The FCI uses a conceptions/"misconceptions" lens rather than a context dependent perspective, such as "knowledge-in-pieces". In this study it was given to first year students ($N=256$ students) pre- and post-mechanics lectures, at the University of Johannesburg. From these results we examine the effect of switching mid-semester from traditional classes to online classes, as imposed by the COVID-19 lockdown in South Africa. Overall results indicate no appreciable difference o…
Standardized assessment tests that allow researchers to compare the performance of students under various curricula are highly desirable. There are several research-based conceptual tests that serve as instruments to assess and identify students' difficulties in lower-division courses. At the upper-division level, however, assessing students' difficulties is a more challenging task. Although several research groups are currently working on such tests, their reliability and validity are still under investigation. We analyze the results of the Colorado Upper-Division Electrostatics diagnostic fr…
This study investigates how faculty, student, and course features are linked to student outcomes in Learning Assistant (LA) supported courses. Over 4,500 students and 17 instructors from 13 LA Alliance member institutions participated in the study. Each participating student completed an online concept inventory at the start (pre) and end (post) of their term. The physics concept inventories included Force and Motion Concept Evaluation (FMCE) and the Brief Electricity and Magnetism Assessment (BEMA). Concepts inventories from the fields of biology and chemistry were also included. Our analyses…
We investigated the intersectional nature of race/racism and gender/sexism in broad scale inequities in physics student learning using a critical quantitative intersectionality. To provide transparency and create a nuanced picture of learning, we problematized the measurement of equity by using two competing operationalizations of equity: Equity of Individuality and Equality of Learning. These two models led to conflicting conclusions. The analyses used hierarchical linear models to examine student's conceptual learning as measured by gains in scores on research-based assessments administered …
This study investigated whether and how Learning Assistant (LA) support is linked to student outcomes in Physics courses nationwide. Paired student concept inventory scores were collected over three semesters from 3,753 students, representing 69 courses, and 40 instructors, from 17 LA Alliance member institutions. Each participating student completed an online concept inventory at the beginning (pre) and end (post) of each term. The physics concept inventories tested included the Force Concept Inventory (FCI), Conceptual Survey of Electricity and Magnetism (CSEM), Force and Motion Concept Eval…
This study investigates how Learning Assistants (LAs) and related course features are associated with inequities in student learning in introductory university physics courses. 2,868 physics students' paired pre- and post-test scores on concept inventories from 67 classes in 16 LA Alliance member institutions are examined in this investigation. The concept inventories included the Force Concept Inventory, Force and Motion Conceptual Evaluation, and the Conceptual Survey of Electricity and Magnetism. Our analyses include a multiple linear regression model that examines the impact of student (e.…
The Colorado Upper-Division Electrostatics (CUE) Diagnostic is an exam developed as part of the curriculum reform at the University of Colorado, Boulder (CU). It was designed to assess conceptual learning within upper-division electricity and magnetism (E&M). Using the CUE, we have been documenting students' understanding of E&M at Oregon State University (OSU) over a period of 5 years. Our analysis indicates that the CUE identifies concepts that are generally difficult for students, regardless of the curriculum. The overall pattern of OSU students' scores reproduces the pattern reported by Ch…
This article describes a curricular innovation designed to help students experience authentic physics inquiry with an emphasis on computational modeling and scientific communication. The educational design centers on a new type of assignment called a computational essay, which was developed and implemented over the course of two semesters of an intermediate electricity and magnetism course at the University of Oslo, Norway. We describe the motivation, learning goals, and scaffolds used in the computational essay project, with the intention that other educators will be able to replicate and ada…
This study investigates differences in student responses to in-class and online administrations of the Force Concept Inventory (FCI), Conceptual Survey of Electricity and Magnetism (CSEM), and the Colorado Learning Attitudes about Science Survey (CLASS). Close to 700 physics students from 12 sections of three different courses were instructed to complete the concept inventory relevant to their course, either the FCI or CSEM, and the CLASS. Each student was randomly assigned to take one of the surveys in class and the other survey online using the LA Supported Student Outcomes (LASSO) system ho…
Group work is becoming increasingly common in introductory physics classrooms. Understanding how students engage in these group learning environments is important for designing and facilitating productive learning opportunities for students. We conducted a study in which we collected video of groups of students working on conceptual electricity and magnetism problems in an introductory physics course. In this setting, students needed to negotiate a common understanding and coordinate group decisions in order to complete the activity successfully. We observed students interacting in several dis…
We investigate the difficulties that students in calculus-based introductory physics courses have with the concepts of symmetry, electric field, and electric flux which are important for applying Gauss's law. The determination of the electric field using Gauss's law requires determining the symmetry of a particular charge distribution and predicting the direction of the electric field everywhere if a high symmetry exists. Effective application of Gauss's law implicitly requires understanding the principle of superposition for electric fields. Helping students learn when Gauss's law can be read…
The Modeling Instruction (MI) approach to introductory physics manifests significant increases in student conceptual understanding and attitudes toward physics. In light of these findings, we investigated changes in student self-efficacy while considering the construct's contribution to the career-decision making process. Students in the Fall 2014 and 2015 MI courses at Florida International University exhibited a decrease on each of the sources of self-efficacy and overall self-efficacy (N = 147) as measured by the Sources of Self-Efficacy in Science Courses-Physics (SOSESC-P) survey. This he…
