Work

Emperror: A Flexible Generative Perception Error Model for Probing Self-Driving Planners

Year: 2025
Type: article
Abstract: To handle the complexities of real-world traffic, learning planners for self-driving from data is a promising direction. While recent approaches have shown great progress, they typically assume a setting in which the ground-truth world state is available as input. However, when deployed, planning needs to be robust to the long-tail of errors incurred by a noisy perception system, which is often neglected in evaluation. To address this, previous work has proposed drawing adversarial samples from a (PEM) mimicking the noise characteristics of a target object detector. However, these methods use simple PEM that fail to accurately capture all failure modes of detection. In this paper, we presentEMPERROR, a novel transformer-based generative PEM, apply it to stress-test an imitation learning (IL)-based planner and show that it imitates modern detectors more faithfully than previous work. Furthermore, it is able to produce realistic noisy inputs that increase the planner's collision rate by up to$85 \%$, demonstrating its utility as a valuable tool for a more complete evaluation of self-driving planners.
Language: English
Open Access status: green
OpenAlex ID: W4409640587
FWCI: 0.248
Cites: 41
Cited by: 1
Related to: 10