Work

Multi-Modal Dynamic Fusion for Defect Detection in Electronic Products: A Novel Approach Based on Energy and Deep Learning

Year: 2025

Type: article

Abstract: As electronic products continue to evolve in complexity, maintaining stringent quality standards during manufacturing presents mounting challenges. Conventional defect detection approaches, which typically depend on a single modality, often fall short in both efficiency and reliability. To address these shortcomings, this study introduces a dynamic multi-modal fusion framework that leverages data from sensors, visual imagery, and component attributes to enhance detection performance. Specifically, Transformer architectures are employed for sensor data analysis, Convolutional Neural Networks (CNNs) are applied to process image data, and Multi-Layer Perceptrons (MLPs) are used to represent part-level features. A distinguishing element of this approach is an energy-based late-stage fusion mechanism that adaptively modulates each modality’s influence according to its uncertainty level. Empirical evaluations demonstrate that the proposed model achieves superior results across multiple performance metrics—including accuracy, precision, recall, and F1 score—compared to conventional and unimodal systems. These findings underscore the model’s potential in advancing practical defect detection and quality assurance in manufacturing environments.

Source: IEEE Access

DOI: 10.1109/access.2025.3584551

Authors: Yulin Liu, Yang Gao

Institution: University of Electronic Science and Technology of China

Language: English

Topic: Industrial Vision Systems and Defect Detection

Subfield: Industrial and Manufacturing Engineering

Field: Engineering

Domain: Physical Sciences

SDG: Industry, innovation and infrastructure

Open Access status: gold

Estimated APC paid: $2,075