Uncovering and Correcting Shortcut Learning in Machine Learning Models for Skin Cancer Diagnosis
Year: 2021
Type: article
Abstract: Machine learning models have been successfully applied for analysis of skin images. However, due to the black box nature of such deep learning models, it is difficult to understand their underlying reasoning. This prevents a human from validating whether the model is right for the right reasons. Spurious correlations and other biases in data can cause a model to base its predictions on such artefacts rather than on the true relevant information. These learned shortcuts can in turn cause incorrect performance estimates and can result in unexpected outcomes when the model is applied in clinical practice. This study presents a method to detect and quantify this shortcut learning in trained classifiers for skin cancer diagnosis, since it is known that dermoscopy images can contain artefacts. Specifically, we train a standard VGG16-based skin cancer classifier on the public ISIC dataset, for which colour calibration charts (elliptical, coloured patches) occur only in benign images and not in malignant ones. Our methodology artificially inserts those patches and uses inpainting to automatically remove patches from images to assess the changes in predictions. We find that our standard classifier partly bases its predictions of benign images on the presence of such a coloured patch. More importantly, by artificially inserting coloured patches into malignant images, we show that shortcut learning results in a significant increase in misdiagnoses, making the classifier unreliable when used in clinical practice. With our results, we, therefore, want to increase awareness of the risks of using black box machine learning models trained on potentially biased datasets. Finally, we present a model-agnostic method to neutralise shortcut learning by removing the bias in the training dataset by exchanging coloured patches with benign skin tissue using image inpainting and re-training the classifier on this de-biased dataset.
Source: Diagnostics
Authors: Meike Nauta(Conceptualization, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing), Ricky Walsh(Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing), Adam Dubowski(Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing), Christin Seifert(Conceptualization, Supervision, Writing – review & editing)
Institutions: University of Duisburg-Essen, University of Twente
Language: English
Subfield: Oncology
Field: Medicine
Domain: Health Sciences
Open Access status: gold
Estimated APC paid: $1,666
OpenAlex ID: W4200331719
