Balancing Standardization and Ecological Validity in the Measurement of Social Communication Intervention Outcomes.

Researchers studied whether autism intervention outcomes look different when measured using toys families choose at home versus standard research toys. After an 8-week parent training program with 22 families, they found similar results in both settings. However, families often used materials at home that weren't in the standard toy set, suggesting current assessments might miss important aspects of how interventions work in real family life.

This study examined whether intervention outcomes for autistic toddlers and caregivers differ when measured using family-selected activities versus standardized toy sets. Following an 8-week caregiver-mediated telehealth intervention with 22 dyads, researchers measured caregiver fidelity in using responsive communication strategies and child spontaneous communication during both contexts. Results showed no significant differences in outcomes between family-selected and standardized contexts. However, most families chose materials or activities during family-selected contexts that weren't available in the standardized toy set, suggesting current standardized assessments may not fully capture the breadth of family interactions and intervention translation to everyday routines.

Practitioners should consider using both standardized and family-selected contexts when measuring intervention outcomes to capture the full scope of treatment effects and generalization to daily routines.

Small sample size of 22 dyads limits generalizability. Study design details and specific statistical analyses are not fully described in the abstract. The study focuses on measurement contexts rather than intervention effectiveness itself.

Caregiver-mediated communication intervention outcomes are inconsistently measured, varying by assessment settings, materials, and activities. Standardized materials are often used for measuring outcomes, yet it remains unknown whether such standardized contexts equitably capture caregiver and child intervention outcomes representative of dyads' typical interactions. This within-subject study investigates how intervention outcomes differ between family-selected and standardized interactional contexts for autistic toddlers and their caregivers. Following an 8-week caregiver-mediated telehealth intervention delivered to 22 dyads, caregiver outcomes (fidelity of using responsive communication facilitation strategies) and child outcomes (total spontaneous directed communicative acts) were measured during two interactional contexts using (a) family-selected activities and (b) a standardized toy set.

A routines checklist surveyed the activities dyads value, enjoy, complete frequently, and/or find difficult with their child. Caregiver outcomes and child outcomes did not significantly differ between the family-selected and standardized interactional contexts. Descriptive results suggest that the types of toys commonly included in standardized toy sets are representative of the materials many families choose when playing with their child at home. However, during the family-selected interactional context, the majority of dyads also chose materials or activities that were not available to them during the standardized context.

It is necessary to carefully consider a more expansive approach to standardization in which intervention outcomes are measured in ecologically valid contexts, which meaningfully, accurately, and equitably capture caregiver and child functional outcomes, and the translation of interventions to families' everyday routines.