Work

Development and validation of a methodology to simulate interobserver variability

Year: 2026
Type: article
Abstract: OBJECTIVE: Contouring for radiotherapy planning remains time intensive. As such, interobserver contour variation (IOV) studies are limited in patient and/or observer numbers (1). This study provides a methodology to simulate IOV on images containing a single contour. Approach. 14 gynaecological cancer radiotherapy target volumes delineated by five observers on T2W-MRI scans were used to develop an AI-based approach and three rule-based (simple, normal, adapted) approaches to generate estimated minimum and maximum (min/max) contours. The rule-based approaches used delineation uncertainty of the observers' contours. The AI-based approach combined seven nnU-Net models into an ensemble. The development of the AI-based and rule-based approaches utilised 7-fold and leave-one-out cross validation, respectively. Validation used a separate/second dataset with the same characteristics and six observers. A single contour was used as the basis and the remaining five contours were used to generate the min/max contours Performance of each approach was assessed using dice similarity coefficient (DSC), mean surface distance (MSD), surface DSC (sDSC) and Hausdorff distance (HD). The best approach was utilised in a pipeline to generate a min/max contour. Multiple contours were generated between these by applying non-uniform expansions and contractions to a single contour. The comparison metrics of the observers' and simulated contours were computed in pairwise, with a mean and standard deviation calculated. Main Results. The adapted rule-based approach performed best across all metrics and was used in the subsequent pipeline. The AI-based approach had comparative median values to the rule-based approaches, but a much wider range of values. The observers' and simulated contours had a DSC of 0.77±0.13 and 0.78±0.20, respectively and an MSD of 2.4±1.7 mm and 2.2±1.5 mm, respectively. Significance. This study provides a methodology to generate additional observer contours from a single observer contour based on IOV data.
Language: English
Subfield: Radiation
Open Access status: hybrid
Estimated APC paid: $2,400
OpenAlex ID: W7234875314
FWCI:
Cites: 29
Cited by:
Related to: 10