The late pretest problem in randomized control trials of education interventions

Resource Type: Reports & Papers
Author(s): Schochet, Peter
Date Issued: August, 2010
Description: Pretest-posttest experimental designs often are used in randomized control trials (RCTs) in the education field to improve the precision of the estimated treatment effects. For logistic reasons, however, pretest data often are collected after random assignment, so that including them in the analysis could bias the posttest impact estimates. Thus, the issue of whether to collect and use late pretest data in RCTs involves a variance-bias trade-off. This article addresses this issue both theoretically and empirically for several commonly used impact estimators using a loss function approach that is grounded in the causal inference literature. The key finding is that for RCTs of interventions that aim to improve student test scores, estimators that include late pretests will typically be preferred to estimators that exclude them or that instead include uncontaminated baseline test score data from other sources. This result holds as long as the growth in test score impacts do not grow very quickly early in the school year. (author abstract)
show entire record ↓
Journal Title: Journal of Educational and Behavioral Statistics
Volume Number: 35
Issue Number: 4
Page Range: 379-406
Topics: Research & Evaluation Methods
Country: Not Specified
ISSN: 1935-1054 Electronic
1076-9986 Paper
Peer Reviewed: yes
hide record ↑

More Like This

what is this? These resources were found by comparing the title, description, and topics of the currently selected resource to the rest of the Research Connections holdings.

Effectiveness of a child's fable on the cognition of preschools when used to address childhood obesity Reports & Papers
Building strong evidence in challenging contexts: Alternatives to traditional randomized controlled trials Fact Sheets & Briefs
The comparative regression discontinuity (CRD) design: An overview and demonstration of its performance relative to basic RD and the randomized experiment Reports & Papers
Assessing the performance of nonexperimental estimators for evaluating Head Start Reports & Papers
Reducing bias and increasing precision by adding either a pretest measure of the study outcome or a nonequivalent comparison group to the basic regression discontinuity design Reports & Papers

Disclaimer: Use of the above resource is governed by Research Connections' Terms of Use.