Treffer: Psychometric Evaluation of brightwheel's Experience Assessment

In March of 2025, brightwheel, a San Francisco-based educational technology company, partnered with the Center for Research and Reform in Education (CRRE) at Johns Hopkins University to test brightwheel's product, the Experience Assessment. The assessment was designed to provide early childhood educators with an objective and systematic way to collect information resulting in a comprehensive and multidimensional view of young children's learning experiences and skills. The primary focus of this report is on the evidence for the assessment's reliability and validity as demonstrated by indicators of domain score distributions, internal consistency reliability, measurement invariance, and item-test correlations. To evaluate the validity and utility of the Experience Assessment, CRRE conducted a psychometric study using data collected by educators across various early childhood education centers in several U.S. states and used a purposive sample of 593 students 0-5 years of age. Trained educators used the assessment to rate students, collecting data during a 5-week period in the spring of 2025. The assessment measure consisted of eight domains divided into 73 sub-skills. Overall, the findings provided strong evidence regarding the reliability and validity of the Experience Assessment across all assessment domains and curriculum product lines, contributing initial support for the assessment as a tool to measure early learning milestones.

ERIC