Development of a 360-Degree Medical Live Streaming System with Learner-Controllable Picture-in-Picture Functionality
Year: 2024
Type: conference-paper
Abstract: Cross-reality (XR) technology using head-mounted displays (HMDs) is still under development in the education field, and there is a lack of platforms that provide learning programs tailored to the needs of educators. In this study, we developed an XR system that improves usability for learners in medical live demonstrations. / The developed system transmits 360-degree camera and medical image, and allows users to move and zoom in and out of the picture-in-picture (PinP) medical image using HMD controllers, optimizing the layout for each learner. An implementation demonstration was conducted using an endoscope, achieving performance at a resolution of 1920 x 960 and a frame rate of 29-30 fps. The system developed in this study offers high interactivity, enabling learners to customize their viewing experience. / This system can be applied to live demonstrations in various medical fields, providing immersive and personalized learning experiences. However, to implement actual demonstrations, security and other functional modifications are needed. Further research will focus on user evaluations and improving system functionalities to ensure effective and secure usage in real-world applications.
Institutions: Kyushu University, Kyushu University Hospital
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7027723137
FWCI:
Cites:
Cited by:
Related to:
