Agreement between Evaluation Methods Used in Brief Experimental Analysis

Publication Date

Summer 2017

Advisor(s) - Committee Chair

Elizabeth Jones (Director), Carl Myers, Ryan Farmer

Degree Program

Department of Psychology

Degree Type

Specialist in Education


Brief experimental analysis (BEA) is a well-documented analysis strategy that rapidly manipulates instructional variables to identify the most effective intervention to support a student’s academic needs. However, consensus on how BEA data should be evaluated is not evident in published BEA articles. This study investigated the agreement between evaluation methods (i.e., visual analysis, no assumptions effect size, percentage of nonoverlapping data, nonoverlap of all pairs) used in BEA. Overall, the measures of effect size resulted in a higher percentage of positive agreement with other measures of effect size, in comparison to visual analysis paired with effect size measures. Use of effect size measures also resulted in less equivalency between intervention outcomes within a BEA. These data suggest that using a measure of effect size can be a beneficial component to visual analysis; however, each measure of effect size has its own strengths and limitations and should be used cautiously when interpreting results of a BEA.


Applied Behavior Analysis | School Psychology

This document is currently not available here.