Study 1
Stormshak and colleagues (2011) conducted an evaluation of the Family Check-Up (FCU) intervention using a sample of (n = 593) students, ages 11–13, from three schools in an urban area of the country. All three schools were Title I schools, and approximately 20 percent of the school population qualified for special education services. Youth and families were recruited in sixth grade across two cohorts. Parents of all sixth-grade students were invited to participate in the study, and 80 percent of all parents agreed to do so. The sample comprised 51 percent male participants and 49 percent female participants. The ethnicity of the sample was as follows: European American (36 percent), Latino ⁄ Hispanic (18 percent), African American (16 percent), Asian (8 percent), American Indian (3 percent), and biracial ⁄ mixed ethnicity (19 percent).
An unbalanced approach to randomization was used to enhance the power to detect intervention effects specifically for families electing to engage with the selected level of intervention. As such, 386 families (65 percent) were randomly assigned to the intervention condition, and 207 families (35 percent) were randomly assigned to the control condition in which families experienced ‘‘school as usual,’’ including regular services offered by the schools, but no access to any of the intervention services available to families in the intervention condition.
Assessments in the form of a questionnaire, which measured a variety of problem behaviors, were given to students over the 3-year time frame, from grades 6 to 8, in the spring semester of each year. The outcomes of interest included substance abuse and antisocial behavior of adolescents.
Outcomes were analyzed using a complier average casual effect (CACE) analysis. The CACE model, most commonly used a studies that include randomized control trials, addressing issues of noncompliance by the reduction of threats and biases. The CACE analysis measured the impact of the intervention on adolescent self-reported substance abuse and antisocial behavior. Substance abuse included alcohol, tobacco, and marijuana usage over the 3-year period. Engagement status was focused on the families in the intervention group who either elected to receive services or opted out of the intervention. Using the CACE model, the effects of the intervention were examined on a linear rate of change in problem behaviors within the families who engaged in the FCU. Subgroup analyses were conducted to determine potential effects gender had on program outcomes.
Study 2
In the 2009 study by Stormshak, Connell, and Dishion, FCU intervention services were examined in a longitudinal study using students and their families recruited from the 6th grade of three different middle schools in a diverse, northwestern metropolitan community of the United States. Students were assessed over three years, between grades 6 and 9, and participated in a follow-up session in grade 11. The overall purpose of the study was to assess the long-term impact on academic outcomes associated with the FCU intervention, particularly grade point average (GPA) and school absences.
Parents of all sixth grade students in two cohorts were approached for participation using an active consent protocol, and 90 percent (n = 998) agreed to participate in the study. The control group (n = 498) and the intervention group (n = 500) were assigned randomly during the spring semester of the 6th grade. Approximately 80 percent of these youth were retained across the majority of the study (wave 2, n = 857; wave 3, n = 829; wave 4, n = 820; wave 6, n = 794). Of the intervention group, 25 percent (n = 115) were successfully engaged and received the intervention, whereas the remaining families decided to not engage in the intervention; however, there is no specific information on the characteristics of the families who were randomized to the FCU intervention group but did not engage in services.
The study authors collected data on outcome measurements using a student survey questionnaire, which was given in the spring semester from the 6th through 9th grades, and again in the 11th grade. The measurements included yearly GPA and yearly school absences. Although both groups completed the follow-up in the 11th grade, there was a significant loss in student participation (control group, n = 99; intervention group, n = 106). The CACE analysis was used to conduct a series of analyses for youth outcomes, examining indicated levels of the FCU intervention on yearly GPA and yearly school absences over the span of the study. No subgroup analyses were conducted.
