Measurement for Quality Improvement

Common measures across organizations reveal trends and help individual organizations build on strengths and address weaknesses.   Boston After School & Beyond is driving the adoption of common measures of program quality and student skill gain.  A comprehensive view of programs involves the perspectives of trained observers, teachers and program staff, and students.

 

Spotlight:  Common measures for summer learning programs

Building on the measurement platform of the Boston Summer Learning Project, 29 programs serving some 2,700 students during the summer of 2013 collected and shared common data for the purpose of improvement.

The “heat maps” below are a visual display of key aspects of program quality.  The darker the color, the higher the score a program received in the domain.  As a cohort, programs exceeded the research-based benchmark in 10 of 14 areas and in 6 of 8 areas assessed using youth feedback.  These results inform training throughout the year.

Third-Party Program Observations

While individual organizations excelled in different areas, it is clear that “staff promoting engagement” in learning is an area for improvement as a system.

image 1

BELL programs operated summer school sites for the Boston Public Schools. Other programs included some students who attended for credit.

Youth Surveys

While youth rate programs highly in most areas, this chart shows that they would like more opportunity for choice.

image 2

BELL programs operated summer school sites for the Boston Public Schools. Other programs included some students who attended for credit.

 

 

Research and Reports

 

Collective Ideas to Collective Impact: A Guide to Data Collaboration in CommunitiesYouthservices.netDeveloping a Vision and Plan to Use Data to Drive Academic Success (The Parthenon Group)After-School Data: What Cities Need to Know (The Wallace Foundation)Data Integration Survey

Collective Ideas to Collective Impact: A Guide to Data Collaboration in Communities

When organizations within a community come together to address specific social problems, it is defined as Collective Impact. A Collective Impact initiative means setting community-wide goals and carefully coordinating program strategies in an attempt to produce a positive, long-lasting impact that no single organization could achieve on its own.

 Click here to read the full report.

 

Youthservices.net

YouthServices.net is a data collection and reporting system designed to meet the needs of youth service programs. Youth service providers and funders use our software to manage participant information, track services and evaluate outcomes with greater efficiency.
Click here to view more information.

Developing a Vision and Plan to Use Data to Drive Academic Success

Objectives of this Presentation

Review the project scope and process for completing Phase I
• Share the vision for data usage developed by BPS team
• Discuss recommendations and decisions emerging from Phase I:
− Actions regarding external data sharing
− BPS internal capacity and organization

Click here to view the presentation.

After-School Data: What Cities Need to Know 

Data, smartly employed, can help after-school decision-makers with everything from allocating resources fairly to improving program quality. But what information is needed? How should it be collected? And what are the best ways to put it to use? A set of easy-to-read tip sheets answers these questions and more, giving city agencies, after-school program providers, intermediary organizations, and others a jump-start on making the most of data in after-school programming.

Click here to read more. 

Data Integration Survey

In 2010, Boston After School & Beyond conducted a survey regarding data fields collected, technology used to collect and analyze data, and willingness and ability to share data.  This document contains the questions asked of survey participants.

Click here to read the full report.