Evidence of City Year's impact
We seek to accelerate organizational progress and continuous improvement by leading an equity-based approach to research and evaluation that informs practice improvements, builds our evidence of impact, and advances systemic change.
The goal of this work is to help ensure that City Year—and the broader educational community—can more effectively support students and adults who work in schools, from AmeriCorps members to teachers.
Through our research and evaluation work, we aim to understand how to create learning environments and educational systems that accelerate educational equity by enabling all students to reach their full potential. We do so by exploring our outcomes on multiple levels, from our impact on systems, schools and students to the effectiveness of our practices to our impact on our AmeriCorps members and alumni and the communities we serve.
To help guide this work, City Year has developed a research and learning agenda to serve as a roadmap for our future research and learning. Our agenda, which is updated regularly, specifies the research questions that will guide City Year’s current and future projects, allowing us to continually improve our services by applying existing evidence of what works, generating new knowledge, and innovating on new approaches to program delivery.
The studies and reports highlighted below are produced by independent research organizations and researchers. Collectively, they cover a wide range of impact and implementation of City Year’s holistic services, demonstrate evidence of City Year’s impact in areas like supporting improvements on state tests, improving students’ social-emotional skills and reducing early warning indicators, such as chronic absenteeism, and shed light on how to accelerate student success in systemically under-resourced schools.
Funded by the Bill & Melinda Gates Foundation, the Everyone Graduates Center at Johns Hopkins University conducted an analysis to understand the relationship between students’ social-emotional and academic outcomes and to explore if there is a City Year effect.Download
- There is a statistically significant, consistent relationship between student social-emotional skills and academic outcomes, with an enhanced impact in the ninth grade. The study found that making gains in social-emotional skills is like gaining an entire school year of achievement growth in math or English for students in grades 3-10.
- More time spent with a City Year AmeriCorps member is associated with improvements in social, emotional, academic, and attendance outcomes.
- Greater impact is seen when social-emotional skills are integrated into academic interventions, such as incorporating goal-directed behavior while building math and English Language Arts (ELA) skills. Time spent with an AmeriCorps member in math or ELA had direct impact on those areas and also significant indirect impacts by improving social-emotional outcomes.
In a white paper, Deloitte's Bill Copeland and Michael E. Raynor set out to explore whether City Year’s success is replicable and how constraints might affect the integrity and effectiveness of its model. This paper, "From downward spiral to virtuous cycle: City Year's breakthrough innovation in education" presents City Year as a leading education innovation and uses a business innovation lens to examine its value and growth potential of City Year’s services.Download
- Deloitte’s analysis found that City Year is breaking constraints on four dimensions of performance: consistency, customization, continuity and cost, allowing City Year to be highly effective in a wide range of settings.
Policy Studies Associates examined the impact of City Year’s Whole School Whole Child services on City Year’s partner schools’ performance in comparison to similar schools without City Year, analyzing data from approximately 600 schools in 22 cities. The study used publicly available data that local education agencies (LEAs), State and U.S. Departments of Education use to assess school performance.Download
- Schools that partner with City Year were two times more likely to improve proficiency rates in English Language Arts and up to three times more likely to improve proficiency rates in math than schools that did not partner with City Year.
- Schools that partnered with City Year gained the equivalent of approximately one month of additional math and English Language Arts learning compared with non-City Year schools.
This most recent report demonstrated that schools with Diplomas Now partners saw a positive, statistically significant impact on the percentage of sixth and ninth graders exhibiting no early warning indicators as compared to similar schools without Diplomas Now.Download
In 2010, Diplomas Now received a $30 million Investing in Innovation grant from the U.S. Department of Education to implement the program in schools across the country. The grant also supports one of the largest randomized control studies ever conducted of a secondary school model—schools from 11 large urban districts—led by MDRC. The PepsiCo Foundation, Diplomas Now’s founding private sector investor, provided $11 million to support the study.
The first two reports from the evaluation, published in 2014 and 2015, focus on the implementation of the Diplomas Now model. MDRC’s third and most recent report, “Addressing Early Warning Indicators,” explores the early impacts of the Diplomas Now model on student and school outcomes.
- Schools with Diplomas Now partners achieved a positive, statistically significant impact on the percentage of sixth and ninth graders exhibiting no early warning indicators as compared to similar schools without Diplomas Now.
- The study also found statistically significant impact on reducing chronic absenteeism—defined as missing more than 10 percent of school days in a single academic year—in middle schools.
- Students at Diplomas Now schools reported participating in more academically focused afterschool activities, and more reported having a positive relationship with an adult at school who is not a teacher, than their peers in the comparison schools.
- Other contrasts include differentiated use of evidence-based practices in schools implementing the model. For teachers, increased frequency of: using data to drive instruction and target struggling students, teacher collaboration, support from instructional coaches. For students, increased frequency of: coordinated academic and non-academic services, Math/English academic help and in-class behavioral support.
Policy Studies Associates conducted three interlocking studies designed to assess City Year’s impact on alumni at various intervals of time after the completion of a year of full-time community service with City Year. Together, these studies assess the ways in which alumni exhibit civic engagement and amass social capital following their participation in City Year.Download
- City Year alumni excelled on every measure of civic engagement, had greater social capital and were more likely to develop lasting relationships with people from different backgrounds, as compared to similar service-minded peers.
- City Year alumni are 45% more likely to be civically engaged or belong to a community organization.
Research in progress
City Year has a number of studies in progress, including one with American Institutes for Research and MDRC who are collaborating to conduct an Institute of Education Sciences (IES)-funded evaluation of Whole School Whole Child. City Year is looking forward to learning from the results as we continuously seek to improve our practices.