Background: Dataset skills are used in STEM fields from healthcare work to astronomy research. Few fields explicitly teach students the skills to analyze datasets, and yet the increasing push for authentic science implies these skills should be taught.
Purpose: The overarching motivation is to understand learning of dataset skills within an astronomy context. Specifically, when participants work with a 200-entry Google Sheets dataset of astronomical data about quasars, what are they learning, how are they learning it, and who is doing the learning?
Sample: The authors studied a matched set of participants (n=87) consisting of 54 university undergraduate students (34 male, 18 female), and 33 science educators (16 male, 17 female).
Design and methods: Participants explored a three-phase dataset activity and were given an eight-question multiple-choice pre/post-test covering skills of analyzing datasets and astronomy content, with questions spanning Bloom's Taxonomy. Pre/post-test scores were compared and a t-test performed for subsamples by population.
Results: Participants exhibited learning of both dataset skills and astronomy content, indicating that dataset skills can be learned through this astronomy activity. Participants exhibited gains in both recall and synthesis questions, indicating learning is non-sequential. Female undergraduate students exhibited lower levels of learning than other populations.
Conclusions: Implications of the study include a stronger dataset focus in post-secondary STEM education and among science educators, and the need for further investigation into how instructors can ameliorate the challenges faced by female undergraduate students.
Grades provide students with their primary performance feedback: signals which affect academic choices. Variations in grading practice among courses impose grade penalties (and bonuses) on students who take them. These grade penalties are sometimes gendered. Using extensive data from the University of Michigan, we report on patterns of grade penalty and gendered performance difference across 116 large courses. We find that significant gendered performance differences are ubiquitous in large introductory STEM lecture courses. They are largely absent in both STEM labs and in lecture courses in o…
Efforts to promote equity and inclusion using evidence-based approaches are vital to correct long-standing societal inequities that have disadvantaged women and discouraged them from pursuing studies, e.g., in many STEM disciplines. We use 10 years of institutional data at a large public university to investigate trends in the majors that men and women declare, drop after declaring, and earn degrees in as well as the GPA of the students who drop or earn a degree. We find that the majors with the lowest number of students also have the highest rates of attrition. Moreover, we find alarming GPA …
Efforts to promote equity and inclusion using evidence-based approaches are vital to correcting long-standing societal inequities that have disadvantaged women and discouraged them from pursuing studies, including in many STEM disciplines. We used 10 years of institutional data from a large public university to investigate the grade point average trends in different STEM disciplines for men and women who declared a major and then either completed the degree or dropped the major after declaring it. We found alarming trends, such as that women who dropped majors on average earned higher grades t…
An analysis of institutional data to understand the outcome of the many obstacles faced by students from historically disadvantaged backgrounds is important in order to work towards promoting equity and inclusion for all students. We use 10 years of institutional data at a large public research university to investigate the grades earned (both overall and in STEM courses only) by students categorized on four demographic characteristics: gender, race/ethnicity, low-income status, and first-generation college student status. We find that on average across all years of study and for all clusters …
Current trends suggest that significant gender disparities exist within Science, Technology, Engineering, and Mathematics (STEM) education at university, with female students being underrepresented in physics, but more equally represented in life sciences (e.g., biology, medicine). To understand these trends, it is important to consider the context in which students make decisions about which university courses to enrol in. The current study seeks to investigate gender differences in STEM through a unique approach that combines network analysis of student enrolment data with an interpretive le…
In D(L)akota star knowledge, the Sun is known as Wi and the Moon is Han-Wi. They have an important relationship, husband and wife. The pattern of their ever-changing relationship is mirrored in the motions of Sun and Moon as seen from our backyards, also called the lunar phases. The framework of the cultural teaching is storytelling and relationships. Cultural perspectives in astronomy such as this remind us of how indigenous ways of knowing are rooted in inclusion, engagement, and relevancy. Designed by A. Lee in 2007, the Native Skywatchers initiative seeks to remember and revitalize indigen…
Instructional physics labs are critical junctures for many STEM majors to develop an understanding of experimentation in the sciences. Students can acquire useful experimental skills and grow their identities as scientists. However, many traditionally-instructed labs do not necessarily involve authentic physics experimentation features in their curricula. Recent research calls for a reformation in undergraduate labs to incorporate more student agency and choice in the learning processes. In our institution, we have adopted open-ended lab teaching in the introductory physics courses. By using r…
Instructional labs are being transformed to better reflect authentic scientific practice, often by removing aspects of pedagogical structure to support student agency and decision-making. We explored how these changes impact men's and women's participation in group work associated with labs through clustering methods on the quantified behavior of students. We compared the group roles students take on in two different types of instructional settings; (1) highly structured traditional labs, and (2) less structured inquiry-based labs. Students working in groups in the inquiry-based (less structur…
The limited representation of women in STEM workforce is a concerning national issue. It has been found that the gender stratification is not due to the lack of talent amongst young females, but due to the lack of access to female role models. To this end, "remote mentoring" is an effective way to offer nation-wide personalized STEM mentoring to young females from all segments of the society. In this paper, we introduce MAGIC, an organization dedicated to mentoring young females in STEM through remote methods. We conduct a retrospective study of MAGIC's formative years and present our experien…
Trends and Gender Disparities in Grades and Grade Penalties Among Bioscience and Health-Related Major Students Before, During, and After COVID-19 Remote Instruction
Creating equitable performance outcomes among students is a focus of many instructors and researchers. One focus of this effort is examining disparities in physics student performance across genders, which is a well-established problem. Another less common focus is disparities across racial and ethnic groups, which may have received less attention due to low representation rates making it difficult to identify gaps in their performance. In this investigation we examined associations between Learning Assistant (LA) supported courses and improved equity in student performance. We built Hierarchi…
The NASA/IPAC Teacher Archive Research Program (NITARP) provides a year-long authentic astronomy research project by partnering a research astronomer with small groups of educators. NITARP has worked with a total of 103 educators since 2005. In this paper, surveys are explored that were obtained from 74 different educators, at up to four waypoints during the course of 13 months, from the class of 2010 through the class of 2017; those surveys reveal how educator participants describe the major changes and outcomes in themselves fostered by NITARP. Three-quarters of the educators self-report som…
The NASA/IPAC Teacher Archive Research Program (NITARP) partners small groups of educators with a research astronomer for a year-long authentic research project. This program aligns well with the characteristics of high-quality professional development (PD) programs and has worked with a total of 103 educators since 2005. In this paper, surveys were explored that were obtained from 74 different educators, at up to four waypoints during the course of 13 months, incorporating data from the class of 2010 through the class of 2017. This paper investigates how participating teachers describe their …
Bioscience Students in Physics Courses With Higher Test Anxiety Have Lower Grades on High-Stakes Assessments, and Women Report More Test Anxiety Than Men
The lack of diversity and the under-performance of underrepresented students in STEM courses have been the focus of researchers in the last decade. In particular, many hypotheses have been put forth for the reasons for the under-representation and under-performance of women in physics. Here, we present a framework for helping all students learn in science courses that takes into account four factors: 1) characteristics of instruction and learning tools, 2) implementation of instruction and learning tools, 3) student characteristics, and 4) students' environments. While there has been much rese…
We investigated the intersectional nature of race/racism and gender/sexism in broad scale inequities in physics student learning using a critical quantitative intersectionality. To provide transparency and create a nuanced picture of learning, we problematized the measurement of equity by using two competing operationalizations of equity: Equity of Individuality and Equality of Learning. These two models led to conflicting conclusions. The analyses used hierarchical linear models to examine student's conceptual learning as measured by gains in scores on research-based assessments administered …
Research experience and mentoring has been identified as an effective intervention for increasing student engagement and retention in the STEM fields, with high impact on students from undeserved populations. However, one-on-one mentoring is limited by the number of available faculty, and in certain cases also by the availability of funding for stipend. One-on-one mentoring is further limited by the selection and self-selection of students. Since research positions are often competitive, they are often taken by the best-performing students. More importantly, many students who do not see themse…
Gender representation in the physical sciences remains inequitable and continues to lag behind other fields. Even though there exists adequate documentation regarding programmatic postures and innovations, difficulties persist within the physics discipline. In this paper, we present innovative, programmatic implementations over an eight-year period at an undergraduate, liberal arts physics program. Some of these innovations accord with nationally-published, `best practices' for undergraduate physics programs, while others are novel to the program's context. Within this eight-year period, alter…
There is consistent and growing evidence that physics instruction disproportionately harms female students' self-efficacy, their beliefs about their ability to learn and do physics. This harm is problematic because self-efficacy supports student learning and persistence. Nissen and Shemwell (PhysRevPER, 12, 2016) investigated this harm using an in-the-moment measure of student's self-efficacy states, which are dynamic judgments of one's ability to succeed in the activity at hand. Their results indicated that female students experienced much lower self-efficacy states in physics than male stude…
The Pulsar Search Collaboratory (PSC) is a collaboration between the Green Bank Observatory and West Virginia University, funded by the National Science Foundation. The PSC program is currently expanding nationwide and engages high school students, teachers, and undergraduate mentors in real-world research by searching for pulsars in data collected with the 100-m Green Bank Telescope. In the process, students learn about observational radio astronomy, radio frequency interference, pulsar timing, and data analysis procedures. The primary goals of the PSC are to stimulate student interest in Sci…
