Development of a Performance Measurement Framework for European Health Technology Assessment: Stakeholder-Centric Key Performance Indicators Identified in a Delphi Approach by the European Access Academy
Year: 2026
Type: article
Abstract: BACKGROUND: The objective of this work was to support the implementation of the European Health Technology Assessment Regulation (EU HTAR) and optimize performance of the evolving EU HTA system. Therefore, an inclusive multi-stakeholder framework of key performance indicators (KPI) for success measurement was developed. METHODS: A modified Delphi-procedure was applied as follows: (1) development of a generic KPI pool at the Fall Convention 2024 of the European Access Academy (EAA); (2) review of initial pool and identification of additional KPIs; (3) development of prioritized KPIs covering patient, clinician, Health Technology Developer (HTD), and System/Member State (MS) perspectives, and (4) consolidation of the stakeholder-centric KPIs after EAA's Spring Convention 2025. RESULTS: Steps 1 and 2 of the Delphi procedure revealed 14 generic KPI domains. Steps 3 and 4 resulted in four prioritized KPIs for patients (patient input; utilization of patient-centric outcome measures; time to access; equity); six for clinicians (population/intervention/comparator/outcomes (PICO); addressing uncertainty; clinician involvement; transparency; equity and time to access); four for HTDs (PICO; joint scientific consultation (JSC) process; joint clinical assessment (JCA) process; time to national decision making); five from a system/MS perspective (PICO; learning and training the health system; reducing duplication; equity and time to access). The scope of, e.g., the PICO-related KPI, differed between stakeholder groups. Also, several KPIs intentionally reached beyond the remit of EU HTA as they are also dependent on MS-specific factors including national health systems and budgets. DISCUSSION AND CONCLUSIONS: The KPI framework developed here presents a step towards the generation of systematic multi-stakeholder evidence to support a successful implementation of the EU HTAR. The relevance of the identified stakeholder-centric KPIs is confirmed by their alignment with the Health System Goals suggested in the context of "Performance measurement for health improvement" by the World Health Organisation. Implementation of the framework, i.e., measurement of KPIs, is envisioned to provide evidence to inform the 2028 revision of the EU HTAR.
Authors: Elaine Julian, Nicolas S. H. Xander, Konstantina Boumaki, Maria João Garcia, Evelina Jahimovica, Joséphine Mosset-Keane, Monica Hildegard Otto, Mira Pavlovic, Giovanna Scroccaro, Valentina Strammiello, Renato Bernardini, Stefano Capri, Ruben Casado-Arroyo, Thomas Desmet, Walter Van Dyck, Frank-Ulrich Fricke, Fabrizio Gianfrate, Oriol Solà-Morales, Jürgen Wasem, Bernhard J. Wörmann, Jörg Ruof
Institutions: Erasmus University Rotterdam, Roche (Switzerland), Bocconi University, Hôpital Saint-Louis, Regione del Veneto, University of Catania, University Carlo Cattaneo, Université Libre de Bruxelles, Erasmus Hospital, European Society of Cardiology, Vlerick Business School, KU Leuven, Georg Simon Ohm University of Applied Sciences Nuremberg, University of Ferrara, University of Duisburg-Essen, Deutsche Gesellschaft für Hämatologie und Medizinische Onkologie, Stiftung Charité, Charité - Universitätsmedizin Berlin, Medizinische Hochschule Hannover
Language: English
Subfield: Economics and Econometrics
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $1,810
OpenAlex ID: W7124257706