Aligning Test Scoring Procedures with Test Uses: A Balancing Act

Authors

  • Leanne R. Ketterlin Geller Southern Methodist University
  • Lindsey Perry Southen Methodist univeristy
  • Linda M. Platas San Francisco State University
  • Yasmin Sitabkhan RTI, International Education Division

Keywords:

Early Grade Mathematics Assessment, EGMA, test scoring procedures, testing programs

Abstract

Test scoring procedures should align with the intended uses and interpretations of test results. In this paper, we examine three test scoring procedures for an operational assessment of early numeracy, the Early Grade Mathematics Assessment (EGMA). Current test specifications call for subscores to be reported for each of the eight subtests on the EGMA. This test scoring procedures has been criticized as being difficult for stakeholders to use and interpret, thereby impacting the overall usefulness of the EGMA for informing decisions. We examine the psychometric properties including the reliability and distinctiveness of the results and usefulness of reporting test scores as (1) total scores, (2) subscores, and (3) composite scores. These test scoring procedures are compared using data from an actual administration of the EGMA. Conclusions and recommendations for test scoring procedures are made. Generalizations to other testing programs are proposed.

Author Biographies

Leanne R. Ketterlin Geller, Southern Methodist University

Leanne Ketterlin Geller, PhD, is the Texas Instruments Endowed Chair in Education and professor in the Simmons School of Education and Human Development at Southern Methodist University. Her research focuses on supporting student achievement in mathematics through developing technically rigorous formative assessment procedures and effective classroom practices. Her work emphasizes valid
decision-making systems for students with diverse needs.

Lindsey Perry, Southen Methodist univeristy

Lindsey Perry, PhD, is a Research Assistant Professor at Southern Methodist University. Her current research interests focus on investigating children's spatial and relational reasoning abilities, developing mathematics assessments for young children, and training educators on how to use data from assessments to make instructional decisions.

Linda M. Platas, San Francisco State University

Linda M. Platas, PhD, is the associate chair of the Child and Adolescent Development Department at SF State University. She has participated in the development of child assessment instruments including the Early Grades Math Assessment (EGMA) and the Measuring Early Learning Quality and Outcomes (MELQO) and served as an expert in mathematics and literacy development on many technical and policy groups. She is a member of the Development and Research in Early Math Education (DREME) Network.

Yasmin Sitabkhan, RTI, International Education Division

Dr. Yasmin Sitabkhan, PhD, is a Senior Early Childhood Education Researcher and Advisor in RTI’s International Education Division. In her current role at RTI, Dr. Sitabkhan provides technical support to projects in low- and middle-income countries in early mathematics. Her research interests focus on children’s development of early mathematical concepts and instructional strategies to support learning in low- and middle-income contexts. Dr. Sitabkhan has a Ph.D. in Education from the University of California, Berkeley.

Downloads

Published

2018-10-11

Issue

Vol. 5 No. 3 (2018): Policies and Practices in Support of Mathematics Learning

Section

Theme Articles

License

Authors who publish with this journal agree to the following terms:

Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

    1. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

 

  1. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).