Work

Facial Expression Recognition in Improving User Experience

Year: 2026
Type: dissertation
Abstract: The utilization of AI in emotion-aware systems has been a rising trend in the latest years. With emotion-aware systems and interfaces user experience can be improved, and different modalities can help in achieving this improvement. Facial expression recognition is an AI based technology, and its output is a type of signal that can be used in user interface adaptation. The research methods for this thesis were a literature review and an empirical study utilizing an adaptive web application with two integrated facial expression recognition models. The study collected data on detected facial expressions, accuracy in performing tasks in the application, and on how user interface adaptation affected the performance accuracy of the participants and the facial expression recognition models. 25 participants were included in the study, and after completing the tasks in the application the participants filled a survey reflecting on their emotions throughout the experiment. The literature review and conducted study show that emotion-aware adaptive applications can be designed successfully with cloud-based APIs, but there is still a need for more research in the field. The performance of the two facial expression recognition models varied greatly, and improvements in the abilities of detecting faces and recognizing more emotions is something to research more in the future. An adaptive user interface improved the user experience of around 20% of the participants, and 10% stated that the user interface was the main factor for positive emotions felt through the experiment.
Language: English
Open Access status: green
OpenAlex ID: W7220795771
Cites: 77
Cited by:
Related to: 10