An Immersive Disease Treatment and Cognitive Recovery System for Alzheimer's Patients using Artificial Intelligence and Virtual Reality
Year: 2024
Type: conference-paper
Abstract: The problem I’m trying to solve is the trouble with Alzheimer’s patients in recalling memories. This program will be used as a memory aid to help users with remembering past events through past memory image display. The key technologies I used are Unity, ChatGPT, and DALLE. The application is shown in Unity in Virtual Reality, it sends the memory prompts the user typed in Unity to ChatGPT, then DALLE will generate a memory image that is then displayed in Unity [1]. The three important systems are the ChatGPT prompt, the DALLE generator, and the Unity client. The ChatGPT prompt uses prompt engineering concepts to generate a visual description of what to make, which is then fed into DALLE, which attempts to create an artistic interpretation of the user’s memory [2]. This is in turn fed back to the Unity client on the VR headset for display in an art gallery. Several design considerations and challenges were encountered and resolved along the way. The principal challenge was considerations for user experience. In the end we found that since this is a service used by caretakers and patients alike it was essential to make the program as simple to use as possible, which required some simplification of the UI and strengthening of the backend systems [3]. The experiment results indicate that this design decision was positive.
Authors: Xilei Zhong, Samuel Silverberg
Institution: California State Polytechnic University
Language: English
Subfield: Psychiatry and Mental health
Field: Medicine
Domain: Health Sciences
Open Access status: gold
OpenAlex ID: W4404448577