Work

FusionNet: A Supervised Multi-Modal Deep Learning Framework for Enhanced Product Recommendation Using SBERT and MobileNetV2

Year: 2026
Type: article
Abstract: The rapid expansion of e-commerce platforms has rendered recommender systems indispensable for alleviating information overload and facilitating product discovery. However, conventional collaborative filtering and content-based approaches are fundamentally constrained by data sparsity, the cold-start problem, and their reliance on single-modality signals, which collectively undermine recommendation quality in dynamic environments. To address these limitations, this paper presents FusionNet, a supervised multi-modal deep learning framework that jointly learns unified product representations from unstructured textual descriptions and visual imagery without requiring historical user–item interactions. Specifically, textual attributes are encoded using a Sentence-BERT model fine-tuned on the Stanford Natural Language Inference (SNLI) and Multi-Genre Natural Language Inference (MNLI) corpora to capture nuanced semantic relationships. Concurrently, visual features are extracted via a lightweight MobileNetV2 backbone and projected into a compatible embedding space. The MobileNet model is specifically designed for high-efficiency operation on smart devices and embedded systems. It achieves this by drastically reducing its computing resources compared to traditional neural networks, requiring only very low processing power (low computation) because it relies on Depthwise Separable Convolutions instead of traditional convolution. Furthermore, MobileNet occupies a very small amount of storage space (between 16 and 32 MB depending on the version used) and reduces the number of calculations, thus minimizing the load on the processor. These heterogeneous features are subsequently fused through a multilayer perceptron-based fusion network, which is explicitly supervised by product category labels to learn a discriminative shared embedding space of 256 dimensions. Recommendation retrieval is then performed via cosine similarity over this unified space. Experiments conducted on Amazon product corpus comprising 459,229 items across 112 categories demonstrate the efficacy of the proposed framework. FusionNet achieves a Precision@10 of 0.860, an NDCG@10 of 0.861, and a HitRate@10 of 0.933, indicating that over 93% of the generated recommendation lists contain at least one relevant item within the top ten positions. Furthermore, at k=7, the model attains an NDCG of 0.902 and a product coverage of 0.920, confirming its ability to surface diverse and relevant items effectively. Comprehensive ablation and robustness analyses further corroborate that the synergistic integration of semantic and visual modalities, guided by categorical supervision, significantly mitigates the cold-start challenge and enhances overall system reliability. The results establish FusionNet as a highly accurate, scalable, and deployable content-driven solution for modern e-commerce and digital content platforms.
Language: English
Open Access status: green
OpenAlex ID: W7237357488
FWCI:
Cites:
Cited by:
Related to: