Transparency and reproducibility in the Adolescent Brain Cognitive Development (ABCD) study
Year: 2024
Type: article
Abstract: BACKGROUND: Transparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings. METHODS: Articles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsement of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. RESULTS: There were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30 % of full-length articles. The number of participants excluded due to missing data was reported in 60 % of articles, and information on missing data for individual variables (e.g., household income) was provided in 38 % of articles. A table describing the analytic sample was included in 83 % of articles. A race and/or ethnicity variable was included in 78 % of reviewed articles, while its inclusion was justified in only 41 % of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10 % of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10 % of LOC scores (β=-0.77, 95 % -1.02, -0.51; p-value < 0.0001). CONCLUSION: These findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.
Authors: Daniel A. Lopez, Carlos Cardenas-Iniguez, Punitha Subramaniam, Shana Adise, Katherine L. Bottenhorn, Paola Badilla, Ellen Mukwekwerere, Laila Tally, Omoengheme Ahanmisi, Isabelle L. Bedichek, Serena D. Matera, Gabriela Mercedes Perez-Tamayo, Nicholas Sissons, Owen Winters, Anya Harkness, Elizabeth Nakiyingi, Jennell Encizo, Zhuoran Xiang, Isabelle G. Wilson, Allison N. Smith, Anthony R. Hill, Amanda K. Adames, Elizabeth Robertson, Joseph R. Boughter, Arturo Lopez-Flores, Emma R. Skoler, Lyndsey Dorholt, Bonnie J. Nagel, Rebekah S. Huber
Institutions: Oregon Health & Science University, University of Southern California, University of Utah, Children's Hospital Los Angeles, University of Colorado Boulder, University of Colorado System, Washington University in St. Louis, Florida International University, University of Maryland, Baltimore, Virginia Commonwealth University, University of Rochester Medicine, University of Rochester, University of Vermont, Medical University of South Carolina, SRI International, Yale University, University of Wisconsin–Milwaukee, University of Michigan, University of California San Diego, University of Minnesota
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,440
Funders: National Institutes of Health, Saban Research Institute, National Institute of Mental Health, National Institute on Drug Abuse, National Institute of Diabetes and Digestive and Kidney Diseases, National Institute of Environmental Health Sciences, National Institute on Minority Health and Health Disparities
Awards: Urban air pollution and neurobehavioral trajectories in the ABCD study, Environmental Genomics, The role of air pollution in emotional neurodevelopment and risk for psychiatric disorders, 9/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT U MICHIGAN, 20/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT VCU, 3/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT U MINNESOTA, 4/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT FIU, 7/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT YALE, Neurodevelopment of executive function, appetite regulation, and obesity in children and adolescents, Endocrine-mediated pubertal brain network development: Bridging datasets with machine learning, 17/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT UCLA, 15/21 ABCD-USA Consortium: Research Project Site at LIBR, 16/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT UNIVERSITY OF ROCHESTER, 8/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT CHLA, ABCD-USA Consortium: Coordinating Center, 6/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT OHSU, 10/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT SRI, 12/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT U PITTSBURGH, 19/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT UVM, 1/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT U UTAH, 11/21 ABCD-USA Consortium: Research Project Site at UWM, ABCD-USA Consortium: Data Analysis, Informatics and Resource Center, 21/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT WUSTL, 13/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT MUSC, 5/21 ABCD-USA Consortium: Research Project Site at UC San Diego, 18/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT THE UNIVERSITY OF FLORIDA, 2/21 ABCD-USA CONSORTIUM: RESEARCH PROJECT SITE AT UMB, 14/21 ABCD-USA Consortium: Research Project Site at CU Boulder, Southern California Center for Chronic Health Disparities in Latino Children and Families.
OpenAlex ID: W4399771647