Work

Toward a Predictive eXtended Reality Teleoperation System with Duo-Virtual Spaces

Year: 2024
Type: preprint
Abstract: Extended Reality (XR) provides a more intuitive interaction method for teleoperating robots compared to traditional 2D controls. Recent studies have laid the groundwork for usable teleoperation with XR, but it fails in tasks requiring rapid motion and precise manipulations due to the large delay between user motion and agent feedback. In this work, we profile the end-to-end latency in a state-of-the-art XR teleoperation system and propose our idea to optimize the latency by implementing a duo-virtual spaces design and localizing the agent and objects in the user-side virtual space, while calibrating with periodic ground-truth poses from the agent-side virtual space.
Language: English
Open Access status: green
OpenAlex ID: W4403786274
Cites: 6
Cited by: 1
Related to: 10