Multimodal deep learning model for real-Time severity assessment of maize stalk rot integrating visual and soil sensing data
Year: 2026
Type: article
Abstract: Maize stalk rot is a destructive fungal disease that reduces yield by weakening stalks and causing lodging. However, current methods for detecting the disease rely solely on artificial vision, which limits comprehensive assessment of severity by omitting critical environmental variables such as soil moisture. This study proposes a multimodal deep learning model for real-time assessment of maize stalk rot severity, integrating visual features and soil moisture data collected by a mobile robot. An enhanced YOLOv8n was used to localize stalk regions, followed by a VGG16 classifier that assigns three severity levels: healthy, moderately infected, and severely infected. Simultaneously, volumetric water content (VWC) near the root zone was measured using moisture sensors, and temporal dynamics were analyzed to obtain severity thresholds from soil moisture patterns. A fuzzy logic-based late fusion integrates soil and image predictions, improving robustness under heterogeneous field conditions. Field validation on the test subset showed that the multimodal model achieved 94.4%, 94.1%, and 94.1% in overall precision, recall, and F1-score, respectively, outperforming the vision-only baseline by up to 7.8% in accuracy. These results indicate that the proposed model provides a reliable and scalable assessment of stalk rot severity under real agricultural conditions
Source: Smart Agricultural Technology
Institution: Peruvian University of Applied Sciences
Language: English
Topic: Smart Agriculture and AI
Subfield: Plant Science
Domain: Life Sciences
SDG: Zero hunger
Open Access status: gold
Estimated APC paid: $1,770
OpenAlex ID: W7140042468