Agreement between Evaluation Methods Used in Brief Experimental Analysis
Advisor(s) - Committee Chair
Elizabeth Jones (Director), Carl Myers, Ryan Farmer
Department of Psychology
Specialist in Education
Brief experimental analysis (BEA) is a well-documented analysis strategy that rapidly manipulates instructional variables to identify the most effective intervention to support a student’s academic needs. However, consensus on how BEA data should be evaluated is not evident in published BEA articles. This study investigated the agreement between evaluation methods (i.e., visual analysis, no assumptions effect size, percentage of nonoverlapping data, nonoverlap of all pairs) used in BEA. Overall, the measures of effect size resulted in a higher percentage of positive agreement with other measures of effect size, in comparison to visual analysis paired with effect size measures. Use of effect size measures also resulted in less equivalency between intervention outcomes within a BEA. These data suggest that using a measure of effect size can be a beneficial component to visual analysis; however, each measure of effect size has its own strengths and limitations and should be used cautiously when interpreting results of a BEA.
Applied Behavior Analysis | School Psychology
Scharklet, Jennifer D., "Agreement between Evaluation Methods Used in Brief Experimental Analysis" (2017). Masters Theses & Specialist Projects. Paper 2042.