Work

Robustness Measurement of Comprehensive Evaluation Model Based on the Intraclass Correlation Coefficient

Year: 2025

Type: article

Abstract: This study proposes a standardized robustness measurement framework for comprehensive evaluation models based on the Intraclass Correlation Coefficient (ICC(3,1)), The framework aims to address two key issues: (1) the non-unique evaluation results caused by the abundance of such models, and (2) the lack of standardization and the arbitrariness in existing robustness testing procedures. Theoretical derivation and simulation confirm that ICC(3,1) exhibits a positive correlation with Kendall’s Coefficient of Concordance (Kendall’s W) and a negative correlation with Root Mean Square Error (RMSE) and Normalized Inversion Index (NII), demonstrating superior stability, discrimination, and interpretability. Under increased noise levels, ICC(3,1) maintains a balance between robustness and sensitivity, supporting its application in robustness evaluation and method selection.

Source: Mathematics

DOI: 10.3390/math13111748

Authors: Shilai Xian, Li Zhang

Institution: Yunnan University

Language: English

Topic: Evaluation Methods in Various Fields

Subfield: Ecological Modeling

Field: Environmental Science

Domain: Physical Sciences

Open Access status: gold

Estimated APC paid: $3,137

Funder: Yunnan University