Quality-Outcomes Study for Seattle Public Schools Summer Programs

January 11, 2018
Charles Smith, Ph.D., Leanne Roy, Stephen Peck, Ph.D., Colin Macleod, Katherine Helegda, and John Hughes

This quality-outcomes study was designed to both (a) describe performance in Seattle Public Schools (SPS) summer learning programs in ways that are useful to staff and (b) provide evaluative evidence (i.e., validity) for an instructional model that includes challenging academic content and responsive instructional practices.

Preparing Youth to Thrive: Methodology and Findings from the SEL Challenge

January 25, 2016
Charles Smith, Gina McGovern, Stephen C. Peck, Reed Larson, Barbara Hillaker, and Leanne Roy

This technical report describes methodology and findings for (1) best-practice SEL standards, (2) validation of a suite of SEL performance measures for use in QIS, and (3) performance benchmarks for out-of-school time programs focused on building SEL skills with vulnerable children/youth.

Afterschool Quality

December 23, 2014
Charles Smith, Tom Akiva, Gina McGovern, and Stephen Peck

This research article discusses efforts to define and improve the quality of afterschool services, highlighting areas of agreement and identifying leading-edge issues. We conclude that the afterschool field is especially well positioned to deliver high-quality services and demonstrate effectiveness at scale because a strong foundation has been built for continuous improvement of service quality.

Moving the Needle on “Moving the Needle”

December 1, 2013
Charles Smith

This paper introduces the nomenclature of performance-based accountability systems (PBAS) to the expanded learning field, provides a policy case study for a countywide system in southern Florida and uses data from that system to explore the issue of quality thresholds. We present an expanded design standard to guide development and improvement of PBAS policies and further develop a theory of lower-stakes accountability to guide effective use of incentives of various types. Findings suggest that (1) the PBAS framework defines critical concepts and improves our ability to describe existing quality improvement systems, (2) the Youth Program Quality Assessment (Youth PQA) can be used to produce a program rating of sufficient reliability for use in a PBAS, and (3) that the Palm Beach County PBAS design is an exemplar for expanded learning policies.

Measuring Youth Skills in Expanded Learning Systems: Case Study for Reliability and Validity of YDEKC Skill Measures and Technical Guidance for Local Evaluators

January 1, 2013
Charles Smith

This paper uses pattern-centered methods to increase the usefulness of information available from survey-based skill measures, with a focus on using survey-based skills measures to detect skill change over time.