Using the ODD protocol and NetLogo to replicate agent-based models
Year: 2024
Type: article
Abstract: • ODD protocol and NetLogo were used for model replication • 15 out of 18 agent-based models from different disciplines were successfully replicated • Model replication can support theory development • A checklist to support model replication is provided • Standards such as ODD and quasi-standards such as NetLogo support Good Modelling Practice. Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca .
Source: Ecological Modelling
Authors: Volker Grimm, Uta Berger, Justin M. Calabrese, Ainara Cortés-Avizanda, Jordi Ferrer, Mathias Franz, Jürgen Groeneveld, Florian Hartig, Oliver Jakoby, Roger Jovani, Stephanie Kramer-Schadt, Tamara Münkemüller, Cyril Piou, L.S. Premo, Sandro Pütz, Thomas Quintaine, Christine Rademacher, Nadja Rüger, Amelie Schmolke, Jan C. Thiele, Julia Touza, Steven F. Railsback
Institutions: Helmholtz Centre for Environmental Research, University of Potsdam, Technische Universität Dresden, Helmholtz-Zentrum Dresden-Rossendorf, Center for Advanced Systems Understanding, University of Maryland, College Park, Consejo Superior de Investigaciones Científicas, Estación Biológica de Doñana, Max Planck Institute for Evolutionary Anthropology, Freie Universität Berlin, University of Regensburg, RIFCON GmbH (Germany), Leibniz Institute for Zoo and Wildlife Research, Technische Universität Berlin, Centre National de la Recherche Scientifique, Laboratoire d'Écologie Alpine, Centre de Coopération Internationale en Recherche Agronomique pour le Développement, Institut Agro Montpellier, Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement, Centre de Biologie pour la Gestion des Populations, Institut de Recherche pour le Développement, Washington State University, Federal Agency for Nature Conservation, Université de Reims Champagne-Ardenne, Georg Simon Ohm University of Applied Sciences Nuremberg, Smithsonian Tropical Research Institute, German Centre for Integrative Biodiversity Research, Leipzig University, University of Göttingen, University of York
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,860
OpenAlex ID: W4405100247