Student performance of virtual introductory physics class (calculus-based mechanics) is analyzed. A fully web-enhanced class was done synchronously. The analysis is done in two categories, averaging all mid-exams (or chapter exams) and cumulative final exams. It shows that students perform well with shorter timed mid-semester assessments (or chapter exams) than the longer timed assessments. Results were then compared with two survey questions to investigate the effect of the background knowledge of physics and calculus on their performance. It shows two interesting results, a) students with basic conceptual background knowledge of physics perform well, b) calculus knowledge does not correlate well with student performance. These findings can be used to rethink and redesign the assessments for calculus-based introductory physics classes. Also, the findings can be used to develop a supplemental support program to enhance student performance.
We examined how introductory physics students' attitudes and approaches to problem solving compare to those of introductory astronomy students, using a previously validated survey, the Attitudes and Approaches to Problem Solving (AAPS) survey. In addition, we compared the performance of the introductory physics and astronomy students on the factors which were identified in a factor analysis in the original validation study. We found that introductory astronomy students' overall average AAPS score was significantly more favorable than that of introductory physics students (p < 0.01), and the ef…
This note details a minimal effort program, Cash Participation, that quantifies class participation while increasing class energy, decreasing student apathy and removing student embraced anonymity.
The Test of Understanding Graphs in Kinematics (TUG-K) is a multiple choice test developed by Beichner to assess students' understanding of kinematics graphs. Many of the items on the TUG-K have strong distractor choices which correspond to introductory students' common difficulties with kinematics graphs. Instruction is unlikely to be effective if instructors do not know these common difficulties and take them into account in their instructional design. We evaluate the performance of first year physics graduate students at identifying introductory students' common difficulties related to kine…
Students' attitudes and approaches to problem solving in physics can greatly impact their actual problem solving practices and also influence their motivation to learn and ultimately the development of expertise. We developed and validated an attitudes and approaches to problem solving (AAPS) survey and administered it to students in the introductory physics courses in a typical large research university in the US. Here, we discuss the development and validation of the survey and analysis of the student responses to the survey questions in introductory physics courses. The introductory physics…
Students' attitudes and approaches to problem solving in physics can profoundly influence their motivation to learn and development of expertise. We developed and validated an Attitudes and Approaches to Problem Solving survey by expanding the Attitudes towards Problem Solving survey of Marx and Cummings and administered it to physics graduate students. Comparison of their responses to the survey questions about problem solving in their own graduate level courses vs. problem solving in the introductory physics courses provides insight into their expertise in introductory and graduate level phy…
We discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): the knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to (1) identify the most common incorrect answer choice of introductory physics students and (2) predict the percentage of introductory students who would answer the question correctly in a post-test. Then, we used the CSEM post-test data from approximately 40…
With inspiration from the classic study by Chi, Feltovich, and Glaser [1], we asked introductory physics students in three introductory physics classes to categorize mechanics problems based upon similarity of solutions. To evaluate the effect of problem context on students' ability to categorize, two sets of problems were developed for categorization. Some problems in one of the problem sets that students were asked to categorize included those available from the prior study by Chi et al. Our findings, which contrast from those of Chi et al., suggest that there is a much wider distribution of…
The ability to categorize problems based upon underlying principles, rather than contexts, is considered a hallmark of expertise in physics problem solving. With inspiration from a classic study by Chi, Feltovich, and Glaser, we compared the categorization of 25 introductory mechanics problems based upon similarity of solution by students in large calculus-based introductory courses with physics faculty and Ph.D. students. Here, we summarize the study and suggest that a categorization task, especially when conducted with students working with peers in small groups, can be an effective pedagogi…
The University of Maryland (UMD) Biology Education and Physics Education Research Groups are investigating students' views on the role of physics in introductory biology courses. This paper presents data from an introductory course that addresses the fundamental principles of organismal biology and that incorporates several topics directly related to physics, including thermodynamics, diffusion, and fluid flow. We examine how the instructors use mathematics and physics in this introductory biology course and look at two students' responses to this use. Our preliminary observations are intended…
Investigations related to expertise in problem solving and ability to transfer learning from one context to another are important for developing strategies to help students perform more expert-like tasks. Here we analyze written responses to a pair of non-intuitive isomorphic problems given to introductory physics students and discussions with a subset of students about them. Students were asked to explain their reasoning for their written responses. We call the paired problems isomorphic because they require the same physics principle to solve them. However, the initial conditions are differe…
Enhancing motivation and learning attitudes in an introductory physics course is an important but difficult task that can be achieved through class blogging. We incorporated into an introductory course a blog operated by upper-level physics students. Using the Colorado Learning Attitudes about Science Survey (CLASS), periodic in-class surveys, analysis of student blog comments, and post-instructional interviews, we evaluate how the blog combined with class instruction provided the students with a better sense of relevance and confidence and outline recommendations for future use of this strate…
Most STEM students experience the introductory physics sequence in large-enrollment (N $\gtrsim$ 100 students) classrooms, led by one lecturer and supported by a few teaching assistants. This work describes methods and principles we used to create an effective "flipped classroom" in large- enrollment introductory physics courses by replacing a majority of traditional lecture time with in-class student-driven activity worksheets. In this work, we compare student learning in courses taught by the authors with the flipped classroom pedagogy versus a more traditional pedagogy. By comparing identic…
We present a model for competency-based grading for calculus-based introductory physics that encourages students to obtain proficiency with all course content. By allowing students to continually improve their proficiency with skills and content throughout the semester, this formative grading system is designed to create a more flexible learning environment that better accommodates the varying schedules and needs of students. While all students show improvement in their performance following the implementation of this grading system, the largest gains were found for women and first generation …
Several prior studies in introductory physics have found a gender gap on conceptual assessments such as the Force Concept Inventory (FCI) and the Conceptual Survey of Electricity and Magnetism (CSEM) with male students performing better than female students. Moreover, prior studies in the context of mathematics have also found that activation of a negative stereotype about a group can lead to deteriorated performance of the stereotyped group. Here, we describe two studies in which we investigated the impact of interventions on the gender gap on the FCI and CSEM in large introductory physics co…
There is some evidence that conceptual inquiry-based introductory physics lab curricula, such as RealTime Physics, may improve students' understanding of physics concepts. Thus, these curricula may be attractive for instructors who seek to transform their physics labs to improve student learning. However, the impact of conceptual inquiry-based lab instruction on students' attitudes and beliefs about experimental physics, as measured by the E-CLASS survey, is not yet fully understood. We present data from three curricular approaches over four semesters ($n=701$). We saw no change in E-CLASS sco…
Peer Influence on Physics Self-Efficacy and Grades: A comparative study of students in an introductory calculus-based course who typically worked alone or in groups before and during the pandemic
A recent paper used structural equation modeling to infer effects of gender-dependent student attitudes on several outcomes of introductory physics courses. The model used is precisely Markov equivalent to an equally plausible approximation in which a key gender-dependent coefficient in determining attitudes is indistinguishable from zero. I also argue that the qualitative framing may attribute to students motivations that actually belong to their teachers.
We discuss the development and validation of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws (STPFaSL) suitable for introductory physics courses. The survey instrument uses common student difficulties with these concepts as resources in that the incorrect answers to the multiple-choice questions were guided by them. After the development and validation of the survey instrument, the final version was administered at six different institutions. It was administered to introductory physics students in various traditionally taugh…
As part of a larger research project into massively open online courses (MOOCs), we have investigated student background, as well as student participation in a physics MOOC with a laboratory component. Students completed a demographic survey and the Force and Motion Conceptual Evaluation at the beginning of the course. While the course is still actively running, we have tracked student participation over the first five weeks of the eleven-week course.
A recent paper by Salehi et al. claims that the differences found between major demographic groups on scores in introductory college physics tests are due to differences in pre-college preparation. No evidence is produced, however, to show that preparation differences are more causally important than any other differences. In one case, the male/female difference, the paper actually provides evidence that preparation gaps are unimportant.
Students taking introductory physics are rarely exposed to computational modeling. In a one-semester large lecture introductory calculus-based mechanics course at Georgia Tech, students learned to solve physics problems using the VPython programming environment. During the term 1357 students in this course solved a suite of fourteen computational modeling homework questions delivered using an online commercial course management system. Their proficiency with computational modeling was evaluated in a proctored environment using a novel central force problem. The majority of students (60.4%) suc…
In this study, we adapt prior identity framework to investigate the effect of learning environment (including perceived recognition, peer interaction and sense of belonging) on students' physics self-efficacy, interest and identity by controlling for their self-efficacy and interest at the beginning of a calculus-based introductory physics course. We surveyed 1203 students, 35% of whom were women. We found that female students' physics self-efficacy and interest were lower than male students' at the beginning of the course, and the gender gaps in these motivational constructs became even large…
We report on research carried out to improve teaching and student engagement in the introductory astronomy course at the University of Cape Town. This course is taken by a diverse range of students, including many from educationally disadvantaged backgrounds. We describe the development of an instrument, the Introductory Astronomy Questionnaire (IAQ), which we administered as pre- and post-tests to students enrolled in the course. The instrument comprised a small number of questions which probed three areas of interest: student motivation and expectations, astronomy content, and worldview. Amo…
Proficiency with calculating, reporting, and understanding measurement uncertainty is a nationally recognized learning outcome for undergraduate physics lab courses. The Physics Measurement Questionnaire (PMQ) is a research-based assessment tool that measures such understanding. The PMQ was designed to characterize student reasoning into point or set paradigms, where the set paradigm is more aligned with expert reasoning. We analyzed over 500 student open-ended responses collected at the beginning and the end of a traditional introductory lab course at the University of Colorado Boulder. We di…
In the Fall of 2013, Georgia Tech offered a 'flipped' calculus-based introductory mechanics class as an alternative to the traditional large-enrollment lecture class. This class flipped instruction by introducing new material outside of the classroom through pre-recorded, lecture videos. Video lectures constituted students' initial introduction to course material. We analyze how students engaged with online lecture videos via 'clickstream' data, consisting of time-stamped interactions (plays, pauses, seeks, etc.) with the online video player. Analysis of these events has shown that students ma…
Drawing appropriate diagrams is a useful problem solving heuristic that can transform a given problem into a representation that is easier to exploit for solving it. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solution. We conducted an investigation in which 111 students in an algebra-based introductory physics course were subjected to two different interventions during recitation quizzes throughout the semester. They were either (1) asked to solve problems in which the diagrams were drawn …
The ability to categorize problems based upon underlying principles, rather than surface features or contexts, is considered one of several proxy predictors of expertise in problem solving. With inspiration from the classic study by Chi, Feltovich, and Glaser, we assess the distribution of expertise among introductory physics students by asking three introductory physics classes, each with more than a hundred students, to categorize mechanics problems based upon similarity of solution. We compare their categorization with those of physics graduate students and faculty members. To evaluate the …
The research presented in this thesis was motivated by the need to improve introductory physics courses. Introductory physics courses are generally the first courses in which students learn to create models to solve complex problems. However, many students taking introductory physics courses fail to acquire a command of the concepts, methods and tools presented in these courses. The reforms proposed by this thesis focus on altering the content of introductory courses rather than content delivery methods as most reforms do. This thesis explores how the performance on a widely used test of conce…
Assessing student performance becomes challenging when course enrollment becomes very large (~10^4 students). As part of a Massive Open Online Course (MOOC) in introductory physics offered by Georgia Tech in 2013, students submitted video reports on mechanics labs. Peer evaluation of these reports provided the primary method for evaluating student laboratory work. This paper describes the methods developed and used to guide students in evaluating each other's video lab reports. We also discuss how students' peer evaluation behavior changed with different interventions provided in the course.
Educators and policy-makers have advocated for reform of undergraduate biology education, calling for greater integration of mathematics and physics in the biology curriculum. While these calls reflect the increasingly interdisciplinary nature of biology research, crossing disciplinary boundaries in the classroom carries epistemological challenges for both instructors and students. In this paper we expand on the construct of authenticity to better describe and understand disciplinary practices, in particular to examine those used in physics and biology courses. We then apply these ideas to exa…
We present the findings of a pilot plan of active learning implemented in introductory physics in a Chilean public university. The model is research based as it considered a literature review for adequate selection and design of activities, consistent with the levels of students' reasoning skills. The level of scientific reasoning is positively correlated to student success. By contrast to a control group of students following traditional lectures, we observed a significant reduction in failure rate for students that do not yet posses formal scientific reasoning. This profile of student being …
In this study, we examine introductory physics students' ability to perform analogical reasoning between two isomorphic problems which employ the same underlying physics principles but have different surface features. Three hundred and sixty two students from a calculus-based and an algebra-based introductory physics course were given a quiz in the recitation in which they had to first learn from a solved problem provided and take advantage of what they learned from it to solve another problem (which we call the quiz problem) which was isomorphic. Previous research suggests that the multiple-c…
We investigated the common difficulties that students have with concepts related to rotational and rolling motion covered in the introductory physics courses. We compared the performance of calculus- and algebra-based introductory physics students with physics juniors who had learned rotational and rolling motion concepts in an intermediate level mechanics course. Interviews were conducted with six physics juniors and ten introductory students using demonstration-based tasks. We also administered free-response and multiple-choice questions to a large number of students enrolled in introductory…
It is well-known that introductory physics students often have alternative conceptions that are inconsistent with established physical principles and concepts. Invoking alternative conceptions in quantitative problem-solving process can derail the entire process. In order to help students solve quantitative problems involving strong alternative conceptions correctly, appropriate scaffolding support can be helpful. The goal of this study is to examine how different scaffolding supports involving analogical problem solving influence introductory physics students' performance on a target quantita…
The Physics Inventory of Quantitative Literacy (PIQL), a reasoning inventory under development, aims to assess students' physics quantitative literacy at the introductory level. The PIQL's design presents the challenge of isolating types of mathematical reasoning that are independent of each other in physics questions. In its current form, the PIQL spans three principle reasoning subdomains previously identified in mathematics and physics education research: ratios and proportions, covariation, and signed (negative) quantities. An important psychometric objective is to test the orthogonality o…
The Test of Understanding Graphs in Kinematics (TUG-K) is a multiple choice test developed by Beichner in 1994 to assess students' understanding of kinematics graphs. Many of the items on the TUG-K have strong distractor choices which correspond to students' common difficulties with kinematics graphs. Instruction is unlikely to be effective if instructors do not know the common difficulties of introductory physics students and explicitly take them into account in their instructional design. We evaluate the pedagogical content knowledge of first year physics graduate students enrolled in a teac…
We investigate introductory physics students' difficulties in translating between mathematical and graphical representations and the effect of scaffolding on students' performance. We gave a typical problem that can be solved using Gauss's law involving a spherically symmetric charge distribution (a conducting sphere concentric with a conducting spherical shell) to 95 calculus-based introductory physics students. We asked students to write a mathematical expression for the electric field in various regions and asked them to graph the electric field. We knew from previous experience that studen…
Identifying the relevant physics principles is a central component of problem solving. A major goal of most introductory physics courses is to help students discern the deep similarities between problems based upon the physics principles so that they can transfer what they learned by solving one problem to solve another problem which involves the same principle. We conducted an investigation in which 251 calculus- and algebra-based introductory physics students were asked explicitly in the recitation quiz to learn from a solved problem and then solve another problem that has different surface …
An appropriate diagram is a required element of a solution building process in physics problem solving and it can transform a given problem into a representation that is easier to exploit for solving the problem. A major focus while helping introductory physics students learn problem solving is to help them appreciate that drawing diagrams facilitates problem solving. We conducted an investigation in which two different interventions were implemented during recitation quizzes throughout the semester in a large enrollment, algebra-based introductory physics course. Students were either (1) aske…
The lack of diversity and the under-performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under-representation and under-performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors: 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students' environments. While there has been much rese…
This is the first in a series of papers that analyze college student beliefs in realms where common astronomy misconceptions are prevalent. Data was collected through administration of an inventory distributed at the end of an introductory college astronomy course. In this paper, we present the basic mathematics of item response theory (IRT), and then we use it to explore concepts related to galaxies. We show how IRT determines the difficulty of each galaxy topic under consideration. We find that the concept of galaxy spatial distribution presents the greatest challenge to students of all the …
Physics graduate teaching assistants (TAs) are often responsible for grading. Physics education research suggests that grading practices that place the burden of proof for explicating the problem solving process on students can help them develop problem solving skills and learn physics. However, TAs may not have developed effective grading practices and may grade student solutions in introductory and advanced courses differently. In the context of a TA professional development course, we asked TAs to grade student solutions to introductory physics and quantum mechanics problems and explain why…
We discuss the effect of administering conceptual and quantitative isomorphic problem pairs (CQIPP) back to back vs. asking students to solve only one of the problems in the CQIPP in introductory physics courses. Students who answered both questions in a CQIPP often performed better on the conceptual questions than those who answered the corresponding conceptual questions only. Although students often took advantage of the quantitative counterpart to answer a conceptual question of a CQIPP correctly, when only given the conceptual question, students seldom tried to convert it into a quantitati…
A clinical study was performed comparing the efficacy of multimedia learning modules with traditional textbooks for the first few topics of a calculus based introductory electricity and magnetism course. Students were randomly assigned to three different groups experiencing different presentations of the material; one group received the multimedia learning module presentations and the other two received the presentations via written text. All students were then tested on their learning immediately following the presentations as well as two weeks later. The students receiving the multimedia lea…
Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account common student difficulties in their instructional design. Here, we discuss research involving the Conceptual Survey of Electricity and Magnetism (CSEM) to evaluate one aspect of the pedagogical content knowledge of teaching assistants (TAs): knowledge of introductory students' alternate conceptions in electricity and magnetism as revealed by the CSEM. For each item on the CSEM, the TAs were asked to identify the most common incor…
In an Introductory Physics for Life Science (IPLS) course that leverages authentic biological examples, student ideas about entropy as "disorder" or "chaos" come into contact with their ideas about the spontaneous formation of organized biological structure. It is possible to reconcile the "natural tendency to disorder" with the organized clustering of macromolecules, but doing so in a way that will be meaningful to students requires that we take seriously the ideas about entropy and spontaneity that students bring to IPLS courses from their prior experiences in biology and chemistry. We draw …
Covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity -- has been examined extensively in mathematics education research. Little research has been done, however, on covariational reasoning in introductory physics contexts. We explore one aspect of covariational reasoning: ``goes like'' reasoning. ``Goes like'' reasoning refers to ways physicists relate two quantities through a simplified function. For example, physicists often say that ``the electric field goes like one over r squared.'' While this reasoning mode is used regularly by physi…
As research-based self-paced e-learning tools become increasingly available, a critical issue educators encounter is implementing strategies to ensure that all students engage with them as intended. Here, we discuss the effectiveness of research-based e-learning tutorials as self-paced learning tools in large enrollment brick and mortar introductory physics courses. These interactive tutorials were developed via research in physics education and were found to be effective for a diverse group of introductory physics students in one-on-one implementation. Instructors encouraged the use of these …
