Distance-Adaptive Depth Camera–LiDAR Fusion for Object Distance Estimation on a Moving Tractor: A Field Evaluation Against RTK-GNSS
Year: 2026
Type: article
Abstract: Agricultural machinery has extensive blind zones, and reliable proximity alerts need distance information that no single sensor provides across the working range. We fused a depth camera and a 16-channel LiDAR by distance-adaptive inverse-variance weighting, with weights derived from nominal, specification-based error models that cross at 3.87 m. YOLO11m, trained on five classes, detected objects, and the pipeline ran at 26 frames per second on an edge computing platform. Distances to Person and Tractor targets were evaluated against real-time kinematic GNSS in 2521 samples from front and rear tractor approaches at nominal speeds of 3, 5, and 7 km/h. Fusion reduced the root mean square error (RMSE) to 0.211 m, 30.9% below that of the depth camera alone, with the largest reduction (35.8%) at 7–12 m and no change within 7 m. The LiDAR alone was more accurate (0.167 m) but valid in only 82.7% of frames. With both sensors valid, the fused RMSE (0.141 m) was lower than that of either sensor. For detected targets, alert levels agreed with the reference in 99.0% of frames, but a Person recall of 0.72 limits overall reliability. Target geometry and LiDAR resolution strongly affect the benefit of fusion, which may guide sensor selection for other agricultural machines.
Source: Agriculture
Language: English
Subfield: Automotive Engineering
Field: Engineering
Domain: Physical Sciences
SDG: Zero hunger
Open Access status: gold
Estimated APC paid: $3,137
Award: G9001340925
OpenAlex ID: W7225915342
