Developing a Virtual Reality System Integrated With Large Language Models for Real-time Evaluation and Feedback to Improve Public Speaking Skills
Year: 2025
Type: conference-paper
Abstract: Public speaking skills are considered both difficult as well as anxiety inducing for many, which in our society, dominated by frequent communication and presentation, can be problematic as well as prohibitive[1]. We propose a system using VR technology and AI large language models in order to help assist users in practicing their public speaking skills [2][3]. Users will be situated in a virtual environment, and an AI model will grade their speech and provide them notes on improvement. This required overcoming several design challenges such as prompt engineering our LLM as well as speech transcription. We performed an experiment in order to test our LLM model by having it grade varying types of speeches. Analysis of the data supports the idea that our model is consistently evaluating user speeches at the quality that we expect it should, although there are some improvements we could make to the AI model to improve its evaluation quality even further.
Authors: Yuantu Chen, Justin Dang
Institution: California State Polytechnic University
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: gold
OpenAlex ID: W4414475984
FWCI:
Cites:
Cited by:
Related to: