Narrative Balance Management in an Intelligent Training Application with User Task Recognition for Enhancing User Interest and Performance
Year: 2014
Type: dissertation
Abstract: The use of three-dimensional virtual environments in training applications allows the simulation of complex scenarios and realistic object behavior.These environments offer an ideal setting to develop intelligent training applications; yet, their ability to support complex procedures depends on the appropriate integration of knowledge-based techniques and natural interaction.However, while these environments have the potential of providing an advanced training experience to students, it is difficult to design and manage a training session in real time due to the number of parameters to pay attention: timing of the events, difficulty, user"s actions and its consequences or eventualities are some examples.In this work, we describe the implementation of a Narrative Manager system controlling automatically an intelligent training system for biohazard laboratory procedures, based on the real-time instantiation of task models from the trainee"s actions.This project was made in collaboration with the National Institute of Infectious Diseases in Tokyo.A virtual biohazard laboratory has been recreated using the Unity3D engine, in which users interact with laboratory objects using keyboard/mouse input or hand gestures through a Kinect device.Realistic behavior for objects is supported by the implementation of a relevant subset of common sense and physics knowledge.In order to solve the issue of how maintain the user engaged, the Narrative Manager controls the simulation deciding which events will take place in the simulation and when, by controlling the narrative balance of the session.The dynamics of this instantiation process with narrative control supports trainee evaluation, engagement management and real-time assistance.The Narrative Manager is an independent module and is generic so it could be applied to other training applications.We present also the results of two experiment testing different aspects of our application.The first one with students from the Faculty of Medical Sciences at Kyushu University where we investigated the effect of real-time task recognition on recovery time after user mistakes and the usability aspect by comparing interaction with mouse and Kinect devices.In the second one, in the National Institute of informatics in Tokyo we finally tested if users using our Narrative Manager improve their learning output.Our hypothesis is that the Narrative Manager allows us to increase the number of tasks for the user to solve but keeps the user interested in the training due to balancing difficulty and intensity.When evaluating our system we observed that the Narrative Manager effectively introduces more tasks for the user to solve, and despite of that, is accepted by the users as more interesting and not harder than an identic system without Narrative Manager.Also, by observing the knowledge test results we saw that the learning output increases, being a consequence of solving more tasks.
Author: Ayerza Nahum Alvarez
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: green
OpenAlex ID: W3034610602
