IES Predoctoral Program Seminar: Dr. Andrew Ho

The University of Pennsylvania Predoctoral Training Program in Interdisciplinary Research Methods for Field-based Research in Education, sponsored by the Institute for Education Sciences (IES), welcomes Dr. Andrew Ho to our weekly seminar series.

Five Principles for  Reporting Test Score Trends through a Crisis
Presented by Dr. Andrew Ho, Charles William Eliot Professor of Education, Harvard School of Education

The COVID-19 pandemic prevented U.S. state test score collection in the spring of 2020. As states return to a semblance of census testing in the spring of 2021 and 2022, I present five principles for state reporting of test scores through a crisis. First, I offer a "three metrics" solution for transparent accounting of changes in test populations over time. Second, I describe approaches for distinguishing between changes in student knowledge and skills and changes in test engagement and motivation. Third, I argue for transparent documentation of changes in test administration over time, including testing windows, testing modes, and testing protocols. Fourth, I explain the necessity of improving "test equating' documentation to ensure that measured constructs remain stable. Fifth, I discuss the importance of contextualized reporting of test scores alongside other trends that remind users that declines are not solely the responsibility of schools and students to address. I argue that these five principles are essential, especially during a crisis like COVID-19, but also more generally as we continually face the challenge of measuring change in a changing world.

 More information
The IES Predoctoral Program’s weekly seminar series connects program fellows and affiliates to scholars and practitioners who engage in educational research and the development of research methods.

Seminars are likely of greatest interest to doctoral students and faculty but are open to all members of the Penn community. If you are interested in attending virtually, please email Melanie Bahti for Zoom information.