Work

Opportunities and Challenges of Foundation Models in Industrial Manufacturing

Year: 2025
Type: article
Abstract: The field of artificial intelligence (AI) is undergoing a transformative shift, propelled by the emergence of Foundation Models such as BERT, DALL-E, and GPT. These models, trained on large and diverse datasets using self-supervision techniques at unprecedented scales, demonstrate remarkable adaptability across numerous downstream tasks. Their versatility underscores their pivotal role in the evolving AI landscape. In this paper, we explore the complexities of Foundation Models, delving into their broad capabilities that span from natural language processing to advanced robotic manipulation. We also examine their potential industrial applications, recognizing the profound impact they could exert across sectors. However, integrating these models into industrial settings presents significant challenges. While rooted in traditional deep learning and transfer learning principles, the scale and intricacy of Foundation Models introduce new behaviors and characteristics that demand careful consideration. Industries often gravitate toward standardized AI application methods to streamline processes, yet this approach risks embedding inherent flaws or biases within the adapted models. Addressing these challenges requires a nuanced understanding that extends beyond technical proficiency. As industries move toward more widespread adoption of Foundation Models, the intersection of technological, ethical, and domain-specific considerations becomes increasingly important. Navigating this complexity calls for collaborative efforts across disciplines, ensuring that these powerful tools are deployed effectively, responsibly, and with a holistic awareness of their broader implications.
Source: IEEE Access
Authors: Mohammed Ayyat, Mohamed Osman, Tamer Nadeem
Language: English
Open Access status: gold
Estimated APC paid: $2,075
OpenAlex ID: W4413074739
FWCI: 9.144
Cites: 218
Cited by: 22
Related to: 10