View & Download Full Text
Achieving Better Educational Practices Through Research Evidence: A Critical Analysis and Case Illustration of Benefits and Challenges - Steven M. Ross, Jennifer R. Morrison, 2021 (sagepub.com)
Article Information
Article first published online: May 7, 2020; Issue published: March 1, 2021
Received: November 21, 2019; Accepted: March 12, 2020
Author
Steven M. Ross
Johns Hopkins University
Jennifer R. Morrison
Johns Hopkins University
Abstract
Purpose: We examine considerations regarding the positive contributions of evidence accountability and challenges that frustrate educators in gaining access to the needed product information.
Design/Approach/Methods: We review the research literature on the multiple characteristics of evidence relative to consumer (practitioner) interests. We then examine, through a “case illustration” of an initiative in a large school district, a second challenge for evidence usage—conducting viable studies and interpreting outcomes from comprehensive interventions in complex educational systems.
Findings: Despite attention being given to rigorous evidence, consumers report preferring peer recommendations and local pilot studies as sources. In our case illustration, we found that the availability of evidence from comprehensive formative evaluation studies was viewed by stakeholders as positively contributing to program implementation quality and sustainability over time.
Originality/Value: We use a real-world “case illustration” of a complex initiative in a large, diverse school district to illustrate how current policies and expectations regarding evidence support for educational programs is filtered through multiple agendas and personal needs of key stakeholders. Consequently, evaluators acquire nontraditional roles that go beyond routine execution of rigorous studies. Given these factors, we offer recommendations for fostering more meaningful and objective interpretations and usage of evidence by local stakeholders.
Keywords
Evidence of effectiveness, program evaluation, technology integration