Work

CHASER: Robust Human Following on a Legged Robot Using Vision and Bluetooth

Year: 2026
Type: conference-paper
Abstract: Human-following robots have achieved commercial adoption in structured indoor environments such as healthcare facilities, airports, and educational campuses, where environmental conditions are predictable and operational risk is low. However, their deployment in high-risk and unstructured domains, including firefighting, search and rescue, and defense operations remains limited. Existing platforms either rely on visual tracking, which struggles when the user leaves the camera field of view or when under low-light conditions. Radio-based followers provide reasonable accuracy, but suffer from poor resolution when using a single locator, signal interference, and limited applicability in certain environments. To overcome these limitations, we present a system that fuses a depth-camera perception pipeline with a single-antenna Bluetooth Angle-of-Arrival (AoA) direction estimator mounted on a quadruped robot. Our novel visual tracker runs a YOLOv8n detector, extracts multimodal embeddings (RGB, depth, pose, colored arm-sleeve histograms) and re-identifies the operator at 5 Hz on a CPU-only platform. When visual contact is challenged, the AoA module supplies a heading cue that steers the robot back into view. Experiments were conducted in unknown, unstructured, indoor and outdoor environments. Using a Spot legged robot, we show that the hybrid approach reduces tracking interruptions by 70% compared with vision-only, while maintaining a lateral position error of 0.54m (RMSE) and a heading error of 0.31rad. The result is a hybrid system capable of robust real-time user following across diverse environments. We call our system CHASER (Collaborative Helper Autonomous System for Exploration Robots), a wearable-enabled multimodal follower designed for field deployment.
Language: English
Open Access status: hybrid
OpenAlex ID: W7204201830
FWCI:
Cites: 21
Cited by:
Related to: 10