This webinar discusses the challenges and opportunities involved in validating quality ratings and improvement systems (QRIS). Focus is on the alignment of quality indicators, both indirect and direct, with child academic and socio-emotional outcomes. A simulated QRIS study based on two datasets (National Center for Early Development and Learning multi-state study and the State-Wide Early Education Programs study) is presented as an example of validating existing QRIS using various state rating structures such as a point, building block, or hybrid system. In addition, a meta-analysis study is featured to illustrate psychometric properties of scale development. The psychometric issues examined include item selection, dimensionality, item scoring, and reliability standards.