Program Profile: Experience Corps

This is a tutoring and mentoring program to improve the literacy outcomes of elementary school-aged children at risk of academic failure. This program is rated Promising. Program participants made statistically significantly greater gains in reading comprehension scores and teacher-assessed reading skills over an academic year, as compared with the control group. However, there were no differences in vocabulary and word attack scores from pre- to postintervention.

A Promising rating implies that implementing the program may result in the intended outcome(s).

This program's rating is based on evidence that includes at least one high-quality randomized controlled trial.

Program Goals/Target Population

Through the Experience Corps (EC) program, community volunteers aged 55 and above tutor and mentor public elementary school children who are at risk of academic failure.

Program Components

The program has two essential components: tutoring and mentoring.

Older adults recruited from the community are trained to provide tutoring to enhance literacy in low-performing elementary school children in grades K–3, while also focusing on building relationships with the children. EC volunteers are trained in using a structured curriculum for the tutoring component, although the curriculum varies from site to site (for more information about the implementation of the program and training of the volunteers, see Implementation Information).

Each EC volunteer is part of a volunteer team assigned to a local elementary school participating in the program. Children at risk of academic failure are referred by their teachers at the beginning of the school year. EC volunteers then meet regularly with the children over the academic year, providing one-to-one tutoring and mentoring.

Program Theory

Most EC programs across the country follow the key elements of a successful reading program outlined by Wasik (1998) that include 1) a designated coordinator who knows about reading instruction, 2) structured tutoring/mentoring sessions, 3) volunteer training, and 4) coordination between the volunteer program and classroom instruction.

Study

Morrow-Howell and colleagues (2009) evaluated the impact of the Experience Corps (EC) program on the reading outcomes of children who participated in the program in three cities: Boston, Mass.; New York, N.Y.; and Port Arthur, Texas. All eight schools offering the EC program in Port Arthur participated in the evaluation. In New York, there were 16 EC schools, of which 6 participated in the evaluation. In Boston, eight of the nine schools offering the EC program participated in the evaluation.

At the beginning of the school year, teachers in the participating schools referred students in grades 1–3 who needed assistance with reading. After parental consent, each student was randomly assigned by a lottery system to either the program (n = 434) or a control group (n = 454). The participating students were 51 percent male and 49 percent female. Most students were African American (58 percent), followed by students of Hispanic origin (36 percent), followed by students of other race/ethnicity (6 percent). Close to one quarter of the students had limited English proficiency, and 14 percent had special education needs. The proportion of students across the grades who participated in the program was fairly comparable: 41 percent were in 1st grade, 36 percent were in 2nd grade, and 23 percent were in 3rd grade. All study participants were pretested in the first 2 months of the school year. Posttest data was collected beginning at 1 month before the end of the school year.

The students in the program group were assigned tutors who engaged them in one-to-one tutoring sessions and provided mentoring relationships over the course of a school year. The control group did not participate in the Experience Corps program but were not limited in receiving other available support services.

Standardized reading tests were used to assess various reading skills of the participating children. The tests included the Woodcock-Johnson Word Attack Subscale (WJ-WA), Woodcock-Johnson Passage Comprehension Subscale (WJ-PC), and the Peabody Picture Vocabulary Test (PPVT-III). The standardized reading tests were administered individually during a 30-minute, face-to-face interview session with the children by research staff. In addition, 10 grade-specific reading skills were assessed by the students’ teachers using a task-specific measure developed for the evaluation. 

Independent sample t-tests were conducted to test for baseline equivalency of the program and the control groups on the outcomes. The reading abilities of the two groups at baseline were equivalent. The two groups also did not differ significantly on demographics and other variables such as school absences and classroom behavior. The impact of the EC program on each outcome was estimated by comparing the posttest scores for the EC and the control groups, after controlling for pretest scores on the outcome and other covariates such as gender, ethnicity, grade, program site, and classroom behavior. Further, to account for clustering within classrooms and schools, the Generalized Estimating Equation method was used.

Thirty students from the program group and 29 from the control group dropped out of the study after pretests. This attrition was equally distributed between the groups, and those who completed the posttests did not differ from those who dropped out, in terms of major demographic characteristics. Missing data due to student attrition and incomplete surveys was imputed using a Markov Chain Monte Carlo multiple imputation method. Students whose dates of birth were incorrect or missing at pretest were excluded from the analyses after imputations. Data was analyzed for 430 students in the program group and 451 from the control group. Effect sizes were calculated using Hedges’ g.

The Experience Corps (EC) program began in 1995 as a pilot and has grown to engage more than 2,000 volunteer members serving over 22,000 students in 19 cities across the country (http://www.aarp.org/experience-corps/about-us/).

The 2009 evaluation by Morrow-Howell and colleagues focused on the EC program in Boston, New York City, and Port Arthur, Texas. All three sites were similar with regard to implementation of the core elements of the EC program: 1) teachers referred students in need of reading assistance; 2) EC program coordinators took applications, conducted interviews, checked references, and required a criminal background check for all volunteers; 3) volunteers received training ranging from 15 to 32 hours; 4) a one-to-one pullout format was used for sessions in which volunteers worked individually with children in the school both outside and occasionally inside the classroom; 5) EC participation was tracked via records of attendance and lesson or student progress logs; and 6) EC staff members provided coordination between the volunteers and the classroom teachers.

However, there were some differences in the EC program as implemented in the three cities. For example, New York volunteers provided 45-minute tutoring/mentoring sessions to children 4 times a week, whereas Boston volunteers provided 40-minute sessions 2 times per week on average, and Port Arthur volunteers provided 25- to 45-minute sessions 3 days a week. Also, all volunteers in New York and Port Arthur received a part- or full-time stipend, whereas some volunteers in Boston did not receive a stipend. In addition, the three sites used different curricula for student tutoring. Finally, the EC staff at the three sites differed in their involvement with the volunteers. In New York, one staff member was present and observed volunteers daily. Staff for the other two sites monitored the volunteers 2 or 3 times a month.

In terms of dosage, the average number of tutoring/mentoring sessions received by each student across the three sites was 45. Over 75 percent of students received at least 35 sessions.

Over 97 percent of the teachers (n = 127) of participating students saw EC as beneficial to the students, and a majority did not see the program as a burden on teachers. A large majority of the volunteers (82 percent, n = 174) reported that their overall relationships with students were good (a rating of 4 or 5 on 5-point scale ranging from poor to excellent).

Subgroup Analysis

Morrow-Howell and colleagues (2009) also examined subgroup differences in program effects by gender, grade, ethnicity, program site, classroom behavior, being in special education, or limited English proficiency. In general, findings indicated a lack of differences in program effects in association with these factors. However, for children at the New York site, there was a greater positive program effect on word attack scores in comparison with children at the Boston and Port Arthur sites. In addition, benefits of the program for passage comprehension varied based on whether the student was in special education. Specifically, findings indicated that special education students received fewer benefits from the program on this measure in comparison with students not in special education.

The evaluation also explored whether there was evidence of differential program effects for EC students who received more adequate dosages of the intervention. Results showed that EC students who had at least 35 sessions scored significantly higher than control group students on three of the four outcome measures. Effect sizes for these outcomes were larger than those found for the full sample. The researchers cautioned, however, that the students who received more sessions may not have been comparable to the control students due to selection bias.

Finally, the evaluation explored whether the quality of the volunteer–student relationship, as reported by the volunteers, was associated with reading outcomes. Results showed that a greater reported volunteer–student relationship quality predicted greater gains by EC students on passage comprehension and Peabody Picture Vocabulary Test scores. However, the researchers cautioned that students who formed strong relationships with their volunteers may be inclined toward positive relationships with all adults and therefore be better situated to improve their reading abilities for this

These sources were used in the development of the program profile:

These sources were used in the development of the program profile:

Following are CrimeSolutions-rated programs that are related to this practice:

Mentoring for Youth Development

This practice provides youth with a positive and consistent adult or older youth relationship to promote healthy youth development and social functioning and to reduce risk factors. The practice is rated Effective in reducing delinquency and improving educational outcomes; Promising in improving psychological outcomes and cognitive functioning; and No Effects in reducing substance use.

Evidence Ratings for Outcomes

	Crime & Delinquency - Multiple crime/offense types
	Education - Multiple education outcomes
	Mental Health & Behavioral Health - Psychological functioning
	Mental Health & Behavioral Health - Cognitive functioning
	Mental Health & Behavioral Health - Social functioning
	Drugs & Substance Abuse - Multiple substances

Why might a practice's outcome ratings differ from the ratings of specific programs encompassed by that practice?