QTurn’s Quality-Outcomes Design and Measure (Q-ODM) toolbox includes a comprehensive suite of evidence-informed measures designed to assess the quality and impact of out-of-school time (OST) programs. This manual provides information about an observational rating instrument designed to assess children’s and adolescents’ core socio-emotional skill sets. We also provide some technical information about the measure and general guidance about how to administer, score, and interpret it.
The Adult Rating of Youth (ARY) was developed by first selecting and modifying items from the Adult Rating of Youth Behavior that pertained specifically to schemas or awareness and then developing additional items aligned primarily to schemas and awareness. Each item was refined by iterating variations in wording and examples with experienced OST staff. The ARY is generally applicable to, and can be used for, any and all types of OST program offerings.
The ARY can also be used with children and youth classified as having an individualized education program (IEP) or similar designation in the same way you would use it for anyone else. We generally recommend using the ARY as the primary outcome variable for typical OST program impact studies because we believe that it is the most likely to detect socio-emotional skill growth.
Please keep in mind that the ARY does not provide a clinical assessment of children or youth. It is intended only for lower-stakes planning, improvement, and program evaluation purposes (e.g., where low scores signal areas of focus and support for children and youth but not failure, sanctions, or other disciplinary action).