Assessing the degree of ecological validity of your study: Introducing the Multidimensional Assessment of Research in Context (MARC) Tool
Year: 2020
Type: preprint
Abstract: In cognitive neurosciences, fundamental principles of mental processes and functional brain organization have been established with highly controlled tasks and testing environments. Recent technical advances allowed the investigation of these functions and their brain mechanisms in naturalistic settings. The diversity in those approaches has been recently (Matusz et al. 2019a) classified via a three-category cycle including controlled laboratory, partially naturalistic laboratory, and naturalistic real-world research. Based on this model, we developed the Multidimensional Assessment of Research in Context (MARC) tool to easily delineate the approach researchers have taken in their study. MARC provides means to describe the degree of ecological validity for each component of a study (e.g. sample, location, stimuli, measures, etc.) and the study’s location on the cycle. The tool comprises seven questions concerning study’s characteristics. It outputs a summary of those and a compass plot, which can be used for presentations, pre-registration, grant proposals, and papers. It aims to improve drawing conclusions across studies, and raise awareness about generalizability of research findings.
Institutions: Humboldt-Universität zu Berlin, University of Oregon, Monash University, Consejo Nacional de Investigaciones Científicas y Técnicas, Favaloro University, Universidad de Buenos Aires, Instituto de Neurología Cognitiva, Instituto de Física de Buenos Aires, National Institute of Mental Health, National Institute of Mental Health, Erasmus University Rotterdam, The University of Texas at Austin, Harvard University, Vrije Universiteit Amsterdam, HES-SO University of Applied Sciences and Arts Western Switzerland, Vanderbilt University, HES-SO Valais-Wallis, The Sense Innovation and Research Center, University of Lausanne
Language: English
Subfield: Experimental and Cognitive Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W3162936216