Get started
Work

Assessing clinical decision support system tools in precision oncology: piloting ring testing

Year: 2026
Type: article
Abstract: Background: The EU4Health project PCM4EU aimed to improve survival rates and quality of life of patients with cancer based on precision cancer medicine. To achieve this, enhanced expertise and quality of molecular cancer diagnostics are key. Clinical decision support systems (CDSS) have become increasingly important after the introduction of comprehensive genomic diagnostic profiling. While external quality assessment schemes are mandatory for most diagnostic laboratory tests, similar programs for CDSS tools are currently lacking. To address this, we piloted an international ring test documenting CDSS usage, performance, and manual interpretation. Materials and methods: Twenty synthetic datasets were generated, mimicking small variant call sets from a typical targeted 500-gene panel (VCF format) across multiple cancer types (10 tumour-normal pairs and 10 tumour-only). Participants received standardised instructions via e-mail and at a virtual meeting and submitted results using a structured response form. Results: Eight laboratories from seven countries participated. All participants submitted results for the 10 tumour-only cases; one submitted results from two assessors. Tumour-only cases contained 6-18 variants where interpretation could be critical. Oncogenic calls for hotspot variants showed good agreement across the various CDSS tools applied; however, variability existed regarding reported variants and clinical interpretation. Conclusion: The pilot ring test revealed clinically relevant discrepancies between laboratories and interpreters, underscoring the need for structured external quality assessment schemes for CDSS tools in addition to the existing laboratory workflow schemes. It also highlighted several challenges related to the generation of realistic synthetic data, the design of reporting formats, the definition of ground truth, and the manual interpretation of results.
DOI: 10.1016/j.esmorw.2026.100731
Authors: V. Nygaard, S. Zhao, D. Tamborero, R. Rosenquist, A. Stenzinger, P. Roepman, J. Lehtiö, C.W. Yde, K. Rekker, C. Brodin, L. Verlingue, D. Bordin, J. Klajic, S.F. Haj Mohammad, L. Silwal-Pandit, A. Nilsen, M.R. Teixeira, A. Peixoto, S. Nakken, E. Hovig, A. Edsjö, H.G. Russnes
Institutions: Oslo University Hospital, Karolinska University Hospital, Science for Life Laboratory, Karolinska Institutet, Heidelberg University, University Hospital Heidelberg, Hartwig Medical Foundation, Rigshospitalet, Tartu University Hospital, Centre Léon Bérard, Centre de Recherche en Cancérologie de Lyon, Akershus University Hospital, Leiden University Medical Center, Universidade do Porto, IPO Porto, Instituto de Ciências Biomédicas Albel Salazar, University of Oslo, Lund University, Skåne University Hospital
Language: English
Field: Medicine
Open Access status: gold
Estimated APC paid: $3,170
OpenAlex ID: W7168188441
FWCI:
Cites: 17
Cited by:
Related to: