Year: 2004
Type: report
Abstract: Assessing whether two models are statistically significantly different from each other is a very important step in research, although it has unfortunately not received enough attention in the field of person authentication.Several performance measures are often used to compare models, such as half total error rates (HTERs) and equal error rates (EERs), but most being aggregates of two measures (such as the false acceptance rate and the false rejection rate), simple statistical tests cannot be used as is.We show in this paper how to adapt one of these tests in order to assess the statistical significantness of the difference between two HTER measures.We also compare our technique with other naive solutions that are sometimes used in the literature and show why they yield often too optimistic results (resulting in false statements about statistical significantness).
Authors: Samy Bengio, Johnny Mariéthoz
Institution: Idiap Research Institute
Language: English
Subfield: Signal Processing
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2019915615