Child Care and Early Education Research Connections

Skip to main content

Using multisite experiments to study cross-site variation in treatment effects: A hybrid approach with fixed intercepts and a random treatment coefficient

Share
Description:
The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates several biases that can arise from unbalanced sample designs for multisite randomized trials. The article then describes how the approach operates, explores its assumptions, and applies the approach to data from three large welfare-to-work trials. The article also illustrates how to report cross-site impact findings and presents diagnostics for assessing these findings. To keep the article manageable, it focuses on experimental estimates of effects of program assignment (effects of intent to treat), although the ideas presented can be extended to analyses of multisite quasi-experiments and experimental estimates of effects of program participation (complier average causal effects). (author abstract)
Resource Type:
Reports & Papers
Country:
United States
State(s):
California; Florida

Related resources include summaries, versions, measures (instruments), or other resources in which the current document plays a part. Research products funded by the Office of Planning, Research, and Evaluation are related to their project records.

- You May Also Like

These resources share similarities with the current selection.

Prek-3rd: Next steps for state longitudinal data systems

Fact Sheets & Briefs

Early childhood education professional development: Adult education glossary

Other

Long term impacts of compensatory preschool on health and behavior: Evidence from Head Start

Reports & Papers

Adult outcomes as a function of an early childhood educational program: An Abecedarian Project follow-up

Reports & Papers
Release: 'v1.24.0' | Built: 2023-01-23 14:56:35 EST