Child Care and Early Education Research Connections

Skip to main content

Randomization inference for treatment effect variation

Share
Description:
Applied researchers are increasingly interested in whether and how treatment effects vary in randomized evaluations, especially variation that is not explained by observed covariates. We propose a model-free approach for testing for the presence of such unexplained variation. To use this randomization-based approach, we must address the fact that the average treatment effect, which is generally the object of interest in randomized experiments, actually acts as a nuisance parameter in this setting. We explore potential solutions and advocate for a method that guarantees valid tests in finite samples despite this nuisance. We also show how this method readily extends to testing for heterogeneity beyond a given model, which can be useful for assessing the sufficiency of a given scientific theory. We finally apply our method to the National Head Start impact study, which is a large-scale randomized evaluation of a Federal preschool programme, finding that there is indeed significant unexplained treatment effect variation. (author abstract)
Resource Type:
Reports & Papers
Country:
United States

- You May Also Like

These resources share similarities with the current selection.

The effects of an undergraduate programme of preschool teaching on preservice teachers' attitudes towards early mathematics education in Turkey: A longitudinal study

Reports & Papers

Early childhood educators working with children who have lesbian, gay, bisexual and transgender parents: What does the literature tell us?

Literature Review

Developing leadership for early childhood professionals through oral inquiry: Strengthening equity through making particulars visible in dilemmas of practice

Reports & Papers

Improving QRISs through the use of existing data: A virtual pilot of the California QRIS

Reports & Papers
Release: 'v1.24.0' | Built: 2023-01-23 14:56:35 EST