Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015 (ICPSR 35510)

Alternate Title:  Head Start Cares

Principal Investigator(s):

Summary:

Low-income preschool children experience greater risks to their social and emotional development than their more affluent peers. These gaps are observed before children begin their formal schooling, and they remain or increase during the elementary school years. Since social and emotional risks may compromise children's future mental health and peer relationships, addressing them is important in its own right. In addition, social-emotional competence may aid learning: children who have difficulty regulating their emotions and behaviors have been found to receive less instruction, to be less engaged in and less positive about their role as learners, and to have fewer opportunities for learning from peers.

The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system - the largest federally funded early-childhood education program in the United States. Conceived and sponsored by the Office of Head Start and the Office of Planning, Research and Evaluation in the Administration for Children and Families within the United States Department of Health and Human Services, the Head Start CARES demonstration was conducted by MDRC, a nonprofit, nonpartisan education and social policy research organization, in collaboration with MEF Associates and several academic partners.

The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind- Play (Tools). The interventions are referred to as "enhancements" because they enriched and complemented existing practices and curricula used in Head Start classrooms. These enhancements represent three "types" of social-emotional programming. That is, while all three were aimed at children's social-emotional development, they varied in their approach to changing this set of child outcomes by targeting somewhat different teacher practices, because they were built on differing theories about how social and emotional skills develop.

Baseline and Follow-up Class-level Impact Analysis Data Files

Data included in class-level data files were collected from external observers and teachers through two sources: Classroom Observations and Teacher Self-Surveys.

Classroom Observations were conducted by observers blind to treatment status who observed the classrooms participating in the study in four different sessions at Spring Baseline and Pre-K Follow-up. This source includes the Classroom Assessment Scoring System (CLASS) scores and the Adapted Teaching Style Rating Scale (Adapted-TSRS) scores.

Teacher Self-Surveys were collected from lead teachers at Spring Baseline and Pre-K Follow-up. This data source includes information on classroom composition as well as teacher demographics, teaching experience, level of stress and depression, and professional relationship with peers and supervisors.

Child-level Impact Analysis Data File

Data included in this file were collected at Fall Baseline, Pre-K Follow-up and K Follow-up from teachers, children and their parents through three sources: Teacher Reports on Individual Children, Direct Child Assessments and Parent Surveys.

Teacher Reports on Individual Children (Teacher Reports) were collected at Fall Baseline, Pre-K Follow-up and K Follow-up. Lead teachers filled out surveys for each child separately, including questions about the child's social skills and behavior, the child's specific knowledge and skills, and the teacher's relationship with the child. Teacher reports were collected for both 4-year-olds and 3-year-olds at Fall Baseline and Pre-K Follow-up, but were not collected for 3-year-olds at K Follow-up. As a cover page to the Teacher Report, a shortened version of the Teacher Self-Survey was collected at K Follow-up and those data are included in this dataset.

Direct Child Assessments were conducted at Fall Baseline and Pre-K Follow-up. The dataset comprises data on a set of tasks measuring different skills for each child separately, including social and emotional skills, self-regulation skills and academic skills. Direct Child Assessments were collected for 4-year- olds only.

Parent Surveys were collected at Fall Baseline and K Follow-up. The survey was administered by phone and includes information on family demographics, parent-teacher involvement, parent's perception of school safety, child's social skills and behavior problems, parental level of stress and depression, and household composition and income. Parent Surveys were collected for 4-year-olds only.

Class-level Implementation Analysis Data File

This data file includes data collected from coaches, trainers and teachers on teacher training, classroom-based coaching, and classroom implementation. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Coach Weekly Logs, (3) Coach Monthly Fidelity Logs, (4) Trainer Fidelity Logs, and (5) Teacher's View of the Enhancement. Data collected from the first four data sources were collected multiple times during the implementation year while the fifth was collected once at the beginning of the implementation year. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper. The file also includes some Teacher Self-Survey variables. Data were collected for program group classrooms only.

Coach-level Implementation Analysis Data File

This data file includes data collected from coaches and trainers on classroom-based coaching. The data included in this dataset were collected through five separate instruments: (1) Teacher Training Attendance Forms, (2) Trainer Supervision Logs, (3) Trainer Logs of Coach Quality, (4) Coach Demographics Survey, and (5) Coach End-of-Year Reflections. The instruments were administered through the Head Start CARES management information system (MIS) with the exception of the Teacher Training Attendance Forms, which were collected on paper.

Audiotape Analysis Data File

The audiotape data file includes data created using qualitative information (audiotape transcripts of coach-teacher meetings) that can be used to conduct analyses on one of the two components of the professional development model for the Head Start CARES demonstration: classroom-based coaching.

Child-level Tracking Data File

The child-level tracking data file includes parent-reported data collected in elementary school for children from the Head Start CARES sample. It includes information from parents about children's location and grade, social skills and problem behaviors at home, and receipt of special services.

Access Notes

  • One or more files in this data collection have special restrictions ; consult the restrictions note to learn more. You can apply online for access to the restricted-use data. A login is required to apply.

    This data collection may not be used for any purpose other than statistical reporting and analysis. Use of these data to learn the identity of any person or establishment is prohibited.

    Public Use Files: The Head Start CARES documentation is public use and is available for download. Documentation includes the User Guide, Questionnaires and Codebooks.

    Restricted Use Files: To protect respondent privacy, the Head Start CARES data are restricted from general dissemination. Access to parts of this study requires a signed User Agreement. To obtain the file(s), researchers must agree to the terms and conditions of the Restricted Data Use Agreement, found via ICPSR's online Restricted Data Contracting System, by clicking the "apply online for access to the data" link above.

    Any public-use data files in this collection are available for access by the general public. Access does not require affiliation with an ICPSR member institution.

  • These data have been updated since their release as https://doi.org/ICPSR35510.v1, which you used to locate the data. If you need access to a previous version of the data (e.g., to replicate results in an article or report), you can contact ICPSR User Support to find out if a prior version is available.

  • Child Care & Early Education Research Connections

    This study is provided by Child Care & Early Education Research Connections.

Citation

Morris, Pamela. Head Start CARES Demonstration: National Evaluation of Three Approaches to Improving Preschoolers' Social and Emotional Competence, 2009-2015. ICPSR35510-v3. Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributor], 2017-03-06. https://doi.org/10.3886/ICPSR35510.v3

Persistent URL:

Export Citation:

  • RIS (generic format for RefWorks, EndNote, etc.)
  • EndNote XML (EndNote X4.0.1 or higher)

Dataset(s)

DS0:  Study-Level Files
Documentation:
DS1:  Baseline Class-level Impact Analysis File
Download:
No downloadable data files available.
DS2:  Follow-up Class-level Impact Analysis File
Download:
No downloadable data files available.
DS3:  Child-level Impact Analysis File
Download:
No downloadable data files available.
DS4:  Class-level Implementation Analysis File
Download:
No downloadable data files available.
DS5:  Coach-level Implementation Analysis File
Download:
No downloadable data files available.
DS6:  Audiotape Analysis File
Documentation:
Download:
No downloadable data files available.
DS7:  Child-level Tracking Data File
Download:
No downloadable data files available.

Study Description

Funding

This study was funded by:

  • United States Department of Health and Human Services. Administration for Children and Families. Office of Planning, Research and Evaluation

Scope of Study

Subject Terms:   children, curriculum evaluation, early childhood education, emotional development, Head Start, learning, mental health, peer groups, poverty, professional development, teachers, teaching methods

Smallest Geographic Unit:   State

Geographic Coverage:   United States

Time Period:  

  • 2009--2015

Date of Collection:  

  • 2009--2015

Unit of Observation:   Classrooms, Teachers, Students, Parents

Universe:   Head Start teachers, students, and parents

Data Types:   observational data, survey data

Data Collection Notes:

Data used to estimate the impacts of the Head Start CARES enhancements on teachers, classrooms, and children were collected from multiple sources at four different points in time: (1) in the spring before the preschool year in which the enhancements were implemented (Spring Baseline); (2) at the beginning of the implementation year (Fall Baseline); (3) at the end of the implementation year (Pre-K Follow-up); and (4) in the spring of the kindergarten year, one year after the enhancements were implemented (K Follow-up). Data collected from coaches and trainers submitted through the Head Start CARES management information system (MIS) for monitoring implementation were collected either one time or multiple times throughout the Head Start CARES academic year.

Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two.

Methodology

Study Purpose:   The Head Start CARES (Classroom-based Approaches and Resources for Emotion and Social skill promotion) demonstration tests three distinct approaches to enhancing children's social-emotional development on a large scale within the Head Start system. The three evidence-based social-emotional interventions selected for the Head Start CARES evaluation included: The Incredible Years Teacher Training Program (IY), Preschool PATHS (PATHS), and a one-year version of Tools of the Mind-Play (Tools).

Study Design:  

The Head Start demonstration was conducted over the course of one academic year with 17 Head Start grantees selected to reflect the geographic, racial, and ethnic diversity of the national Head Start population. Grantees were distributed fairly equally across four regions of the country, with four grantees in the Northeast, four in the West, three in the South, and six in the Midwest/Plains states. Also, they were distributed across community action agencies, stand-alone non-profit entities, and large local school systems. Four grantees that participated during the 2009-2010 school year were in Cohort One, and 13 grantees that participated during the 2010-2011 school year were in Cohort Two. Grantees varied on a number of characteristics, including organizational setting, geographic location, urban/rural status, size, and racial or ethnic composition.

Within each grantee, groups of 4 or 8 similar centers (in terms of their racial/ethnic composition, part-day/full-day programming, and age classroom composition) were randomly assigned to one of the three enhancements or to a control group that conducted business as usual. In some cases, all centers within a grantee were similar enough in their characteristics that all centers within grantees could be randomly assigned in a single block. However, for some larger grantees, there were differences among groups of centers in racial/ethnic composition, part-day/full-day programming, and/or age classroom composition. The centers in these grantees were grouped into smaller 4- or 8-center random assignment blocks so that all the centers in each block were comparable across these characteristics. A total of 104 centers across 22 blocks were randomly assigned to one of these four groups. Eighteen blocks included four centers in the study, and four blocks included eight centers. Up to six classrooms and an average of 12 children per classroom were included in the study.

The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). For the child-level tracking effort, the study attempted to track 3,588 children: all 4-year-olds that were located in kindergarten (2,655) and the 933 3-year-olds in the preschool sample. Of these children, data was collected on 2,875 at least once during the two-year long-term follow-up period (when the children were in grades 1 to 3).

Sample:  

The preschool sample included 307 classrooms and 3,603 children (2,670 four-year-old children and 933 three-year-old children). The study attempted to follow the 2,670 four-year-old children into kindergarten for further data collection. Of these children, 2,599 were tracked to their kindergarten classrooms.

The sample of classrooms participating in the audiotape study was not intended to be a representative sample of classrooms. Classrooms were selected from the full set of Cohort 2 sites that represented all three curriculum enhancements: Incredible Years (IY), Preschool PATHS (PATHS), or Tools of the Mind--Play (Tools-Play). A total of 21 coach-teacher pairs from 11 Head Start grantees participated in the effort. The audiotape data are restricted to classrooms with audiotaped recordings at all three time periods. Of the 21 coach-teacher pairs that participated in the effort, 18 submitted complete recordings, producing a total of 54 recorded coach-teacher meetings.

Time Method:   Longitudinal: Trend / Repeated Cross-section

Mode of Data Collection:   computer-assisted telephone interview (CATI), coded on-site observation, face-to-face interview, on-site questionnaire, web-based survey

Response Rates:   Specific response rates for each collection of each instrument can be found in the codebooks for each dataset. In general, base-line and follow-up impact response rates were > 90 percent, coach-level implementation and child-level impact response rates were > 80 percent and class-level implementation response rates were > 60 percent.

Presence of Common Scales:  

Classroom Assessment Scoring System

Adapted Teaching Style Rating Scale

Woodcock-Johnson III

Expressive One-Word Picture Vocabulary Test

Extent of Processing:  ICPSR data undergo a confidentiality review and are altered when necessary to limit the risk of disclosure. ICPSR also routinely creates ready-to-go data files along with setups in the major statistical software formats as well as standard codebooks to accompany the data. In addition to these procedures, ICPSR performed the following processing steps for this data collection:

  • Performed consistency checks.
  • Created variable labels and/or value labels.
  • Standardized missing values.
  • Created online analysis version with question text.
  • Checked for undocumented or out-of-range codes.

Version(s)

Original ICPSR Release:  

Version History:

  • 2017-03-06 Added updated data and documentation for Child-level Tracking Data File to include an additional School ID variable.
  • 2017-02-01 Added data and documentation for Child-level Tracking Data File.
  • 2015-07-17 A variable-search function was added to the study home-page, and additional question text was added to the codebooks.

Variables

List all 3984 variables in this study



Resources Related to this Study

Understanding and using the Head Start CARES Data: An introductory webinar Multimedia



More Like This

what is this? These resources were found by comparing the title, description, and topics of the currently selected resource to the rest of the Research Connections holdings.

Understanding and using the Head Start CARES Data: An introductory webinar [PowerPoint] Other
Understanding and using the Head Start Impact Study (HSIS) Center Analysis File: Part 1: Head Start Impact Study Center Analysis File overview [PowerPoint] Other
Understanding and using the Head Start Impact Study (HSIS) Center Analysis File: Part 2: Working with the Head Start Impact Study Center Analysis File [PowerPoint] Other
Head Start Impact Study Center Analysis File overview Multimedia
Working with the Head Start Impact Study Center Analysis File Multimedia

Utilities

Metadata Exports

If you're looking for collection-level metadata rather than an individual metadata record, please visit our Metadata Records page.

Download Statistics