Page 4 of 8
Introduction to White Paper 3
Greetings friends! In this third White Paper, Realist(ic) Evaluation Tools for OST Programs: The Quality-Outcomes Design and Methods (Q-ODM) Toolbox, we extend from the neuroperson framework for socio-emotional skills to a focus on evaluation design and impact evidence. Focusing on the methods used to evaluate out-of-school time (OST) programs and to assess the impact on student skill growth is … Continue reading Introduction to White Paper 3
January 10, 2022
Linking after-school instructional practices to youth engagement: A pattern-centered approach
Youth participation in after-school settings has been linked to numerous positive outcomes but this is inconsistent across studies. Two necessary ingredients for this link are proposed: appropriate instructional practices and youth engagement. Both are profiled user cluster analysis in a dataset including observations of staff instructional practices in 151 youth program offerings and 1176 surveys … Continue reading Linking after-school instructional practices to youth engagement: A pattern-centered approach
Tags: instructional practice, pattern-centered analysis, youth engagement
January 1, 2010
Linking Management Practices to Instructional Performances in OST Organizations
Abstract Youth participation in after-school settings has been linked to numerous positive outcomes but this is inconsistent across studies. Two necessary ingredients for this link are proposed: appropriate instructional practices and youth engagement. Both are profiled user cluster analysis in a dataset including observations of staff instructional practices in 151 youth program offerings and 1176 … Continue reading Linking Management Practices to Instructional Performances in OST Organizations
January 1, 2009
Management Practices Self-Assessment (MPSA)
The Management Practices Self-Assessment (MPSA) is a measurement instrument created to empower Michigan 21st CCLC Project Directors, who manage at least one program site. The MPSA provides Project Directors with the opportunity to check-in with themselves and their team by identifying practices and policies that are well-documented and working well, or that could be updated … Continue reading Management Practices Self-Assessment (MPSA)
July 8, 2020
Management Practices Self-Assessment (MPSA) Guidebook
The Management Practices Self-Assessment (MPSA) is a measurement instrument created to empower Michigan 21st CCLC Project Directors to be (a) reflective and intentional about organizational practices and culture; (b) quality improvement leaders at their sites; (c) engaged with youth, families, and their communities; and (d) well-informed about state-wide requirements and guidance. The MPSA provides a … Continue reading Management Practices Self-Assessment (MPSA) Guidebook
January 27, 2020
Measure Once, Cut Twice: Using Data For Continuous and Impact Evaluation in Education Programs
Frustration and confusion often occur when practitioners require detailed information about program processes for continuous quality improvement (CQI) while policy-makers require evidence of outcome effects for accountability and funding. Impact studies are often preferred over continuous improvement studies, but they seldom offer useful information to practitioners. Per the conference theme, this situation leads to a … Continue reading Measure Once, Cut Twice: Using Data For Continuous and Impact Evaluation in Education Programs
Tags: measurement, quality-outcomes design
April 9, 2019
Measuring Socio-Emotional Skill, Impact, and Equity Outcomes
The positivist theory and methodology used by most researchers and evaluators is poorly suited for addressing the formative explanations that guide continuous quality improvement (CQI) processes and the nuanced impact models that pertain to questions about how and how much. QTurn’s Quality-Outcomes Design and Methods (Q-ODM) toolbox (Peck & Smith, 2020b) was created to address fundamental problems in the evaluation … Continue reading Measuring Socio-Emotional Skill, Impact, and Equity Outcomes
Tags: Q-ODM Toolbox, SEL
May 16, 2024
Measuring Youth Skills in Expanded Learning Systems: Case Study for Reliability and Validity of YDEKC Skill Measures and Technical Guidance for Local Evaluators
Weikart Center Expanded Learning Initiative, Technical Working Paper #4 for the Ready by 21 Project at the Forum for Youth Investment Summary
January 1, 2013
Moving the Needle on “Moving the Needle”
Summary This paper introduces the nomenclature of performance-based accountability systems (PBAS) to the expanded learning field, provides a policy case study for a countywide system in southern Florida and uses data from that system to explore the issue of quality thresholds. We present an expanded design standard to guide development and improvement of PBAS policies … Continue reading Moving the Needle on “Moving the Needle”
Tags: performance based accountability, Theory and Evidence for QIS
December 1, 2013
Original Validation of the Youth Program Quality Assessment (Youth PQA)
Summary The Youth Program Quality Assessment (PQA) is an assessment of best practices in afterschool programs, community organizations, schools, summer programs, and other places where you have fun, work, and learn with adults. The Youth PQA creates understanding and accountability focused on the point of service — where youth and adults come together to coproduce … Continue reading Original Validation of the Youth Program Quality Assessment (Youth PQA)
Tags: assessment, methodology, observation, PQA, quality, reliability, validation
January 1, 2005