Physics in Films is an alternative version of the physical science course offered to non-science majors at the University of Central Florida. The course uses the popularity of Hollywood films to generate interest in science and to engage students that have traditionally been resistant to taking science courses. Scenes that lead to teachable science moments are identified in films and then used in class to concretize abstract physical concepts. With the wide variety of movies available, different "flavors" of the course, each specializing in a certain genre of film, have been created. This creates an audience of students with a high level of interest in the teaching tool and helps enhance their learning experience. In addition to the films, the course uses electronic student response systems to increase class participation. Although the course was first developed during the academic year 2002-2003, we continue to develop and assess it. After a brief outline of the motivation for the development of the course, we will discuss the different versions of the course and the teaching techniques used, including the use of the student response systems, and present data on the performance of the students in the course. Moreover, we will present feedback on the course acquired from video interviews with participating students.
Tiered assessment is a differentiated assessment strategy where students can choose to attempt advanced assessment tasks. We discuss the use of tiered assessment in second and third year electromagnetics courses.
This Resource Letter provides a guide to research-based assessment instruments (RBAIs) for physics and astronomy classes, but goes beyond physics and astronomy topics to include: attitudes and beliefs about physics, epistemologies and expectations, the nature of physics, problem solving, self-efficacy, reasoning skills and lab skills. We also discuss RBAIs in physics and astronomy cognate fields such as mathematics and observation protocols for standardized observation of teaching. In this Resource Letter, we present an overview of these assessments and surveys including research validation, i…
This resource letter provides a guide to research-based assessment instruments (RBAIs) of physics and astronomy content. These are standardized assessments that were rigorously developed and revised using student ideas and interviews, expert input, and statistical analyses. RBAIs have had a major impact on physics and astronomy education reform by providing a universal and convincing measure of student understanding that instructors can use to assess and improve the effectiveness of their teaching. In this resource letter, we present an overview of all content RBAIs in physics and astronomy by…
Science education at all levels is currently undergoing dramatic changes to its curricula and developing assessments for these new curricula is paramount. We have used the basis of many of these new changes (scientific practices, crosscutting concepts, and core ideas) to develop sets of criteria that can be used to guide assessment development for this new curriculum. We present a case study that uses the criteria we have developed to revise a traditional physics assessment item into an assessment item that is much more aligned with the goals of current transformation efforts. Assessment items…
Calls to transform introductory college physics courses to include scientific practices require assessments that can measure the extent to which these transformations are effective. Such assessments should be able to measure students' abilities to blend conceptually important concepts with practices scientists engage in. To design assessment tasks that can measure these abilities, we leveraged Evidence-Centered Design and the Three-Dimensional Learning Assessment Protocol with the focal scientific practice of "Using Mathematics." We conducted video recorded one-on-one think-aloud interviews to…
Evidence is presented that offering introductory physics courses with an explicit focus on mastery can reduce the gender gap to zero. Taken together with a previous study showing that a concepts-first course may zero out another demographic gap leads one to speculate that demographic grade gaps in introductory physics are just artifacts of the design of the courses and that none of these classes/grades should be assumed to be demographically neutral.
Despite the significant amount of time undergraduate students spend in introductory physics labs, there is little consensus on instructional goals and accepted diagnostic assessments for these labs. In response to these issues, we have developed the Physics Lab Inventory of Critical thinking (PLIC) to assess students' proficiency with critical thinking in a physics lab context. Specifically, the PLIC aims to evaluate students' skills in making sense of data, variability, models, and experimental methods and to assess the effectiveness of lab courses at developing these skills. Here, we discuss…
Assessments are usually thought of as ways for instructors to get information from students. In this work, we flip this perspective and explore how assessments communicate information to students. Specifically, we consider how assessments may provide information about what faculty and/or researchers think it means to know and do physics, i.e. their epistemologies. Using data from students completing assessment questions during one-on-one think aloud interviews, we explore how assessment features impact (or did not impact) student engagement with the assessment problems. We analyze video record…
Testing knowledge is an integral part of summative assessment at schools. It can be performed in many different ways. In this study we propose assessment of physics knowledge by using a tournament approach. Prior to a statistical analysis of the results obtained over a tournament organized in one of Polish high schools, all its specifics are discussed at length, including the types of questions assigned, as well as additional self- and peer-evaluation questionnaires, constituting an integral part of the tournament. The impact of the tournament upon student improvement is examined by confrontin…
To help faculty use research-based materials in a more significant way, we learn about their perceived needs and desires and use this information to suggest ways for the Physics Education Research community to address these needs. When research-based resources are well aligned with the perceived needs of faculty, faculty members will more readily take them up. We used phenomenographic interviews of ordinary physics faculty and department chairs to identify four families of issues that faculty have around research-based assessments (RBA). First, many faculty are interested in using RBAs but hav…
There is an increasing pressure for lecturers to work with two goals. First, they need to ensure their undergraduate students have a good grasp of the knowledge and skills of the intellectual field. In addition, they need to prepare graduates and postgraduates for careers both within and outside of academia. The problem addressed by this paper is how assessments may reveal a shift of focus from a mastery of knowledge to a work-focused orientation. This shift is examined through a case study of physics and the sub-discipline of theoretical physics as intellectual fields. The evidence is assessm…
Research-based assessments represent a valuable tool for both instructors and researchers interested in improving undergraduate physics education. However, the historical model for disseminating and propagating conceptual and attitudinal assessments developed by the physics education research (PER) community has not resulted in widespread adoption of these assessments within the broader community of physics instructors. Within this historical model, assessment developers create high quality, validated assessments, make them available for a wide range of instructors to use, and provide minimal …
What kind of problem-solving instruction can help students apply what they have learned to solve the new and unfamiliar problems they will encounter in the future? We propose that mathematical sensemaking, the practice of seeking coherence between formal mathematics and conceptual understanding, is a key target of successful physics problem-solving instruction. However, typical assessments tend to measure understanding in more disjoint ways. To capture coherence-seeking practices in student problem solving, we introduce an assessment framework that highlights opportunities to use these problem…
A thoughtful approach to designing and improving labs, particularly at the advanced level, is critical for the effective preparation of physics majors for professional work in industry or graduate school. With that in mind, physics education researchers in partnership with the physics faculty at the University of Colorado Boulder have overhauled the senior-level Advanced Physics Lab course. The transformation followed a three part process of establishing learning goals, designing curricula that align with the goals, and assessment. Similar efforts have been carried out in physics lecture cours…
Bioscience Students in Physics Courses With Higher Test Anxiety Have Lower Grades on High-Stakes Assessments, and Women Report More Test Anxiety Than Men
The existence of gender differences in student performance on conceptual assessments and their responses to attitudinal assessments has been repeatedly demonstrated. This difference is often present in students' preinstruction responses and persists in their postinstruction responses. However, one area in which the presence of gender differences has not been extensively explored is undergraduate laboratory courses. For example, one of the few laboratory focused research-based assessments, the Colorado Learning Attitudes about Science Survey for Experimental Physics (E-CLASS), has not been test…
Free-response research-based assessments, like the Colorado Upper-division Electrostatics Diagnostic (CUE), provide rich, fine-grained information about students' reasoning. However, because of the difficulties inherent in scoring these assessments, the majority of the large-scale conceptual assessments in physics are multiple-choice. To increase the scalability and usability of the CUE, we set out to create a new version of the assessment that preserves the insights afforded by a free-response format while exploiting the logistical advantages of a multiple-choice assessment. We used our exten…
The use of validated conceptual assessments alongside more standard course exams has become standard practice for the introductory courses in many physics departments. These assessments provide a more standard measure of certain learning goals, allowing for comparisons of student learning across instructors, semesters, and institutions. Researchers at the University of Colorado Boulder have developed several similar assessments designed to target the more advanced physics content of upper-division classical mechanics, electrostatics, quantum mechanics, and electrodynamics. Here, we synthesize …
The observed performance difference between women and men on assessments in physics---the "gender gap"---is a significant and persistent inequity which has broad implications for the participation of women in physics. Research also shows that gender-based inequities extend to affective measures, such as self-efficacy. In this exploratory study, we report on gender disparities in self-efficacy and test anxiety and their relationship to assessment scores in our active-learning introductory physics course. Overall, gender-based differences in favour of men are observed in all our measures, with w…
Evaluating GPT- and Reasoning-based Large Language Models on Physics Olympiad Problems: Surpassing Human Performance and Implications for Educational Assessment
Leibniz Institute for Science and Mathematics Education（莱布尼茨科学与数学教育研究所）；Free University of Berlin（柏林自由大学）；Ruprecht Karl University of Heidelberg（鲁普莱希特-卡尔斯海德堡大学）；Ludwigsburg University of Education（路德维希堡教育大学）
