Challenges, Solutions, and Best Practices in Post Deployment Monitoring of Machine Learning Models
Year: 2024
Type: article
Abstract: In production environments, machine learning models often encounter data and operational conditions that differ significantly from the training environment. These differences lead to various challenges, such as data drift, concept drift, harmful feedback loops, adversarial attacks, model failures, and potential biases that may emerge in real-world applications. Model interpretability also becomes crucial in these environments, as understanding how models make decisions is necessary for debugging, trust-building, and mitigating any inadvertent biases that could lead to unfair outcomes. This paper explores these challenges in depth, presenting effective strategies for handling them. Drawing from industry practices and research insights, the paper outlines key solutions such as dynamic retraining, versioning, adversarial training, robust monitoring, and fairness-aware model evaluation to ensure continued model performance and equity post-deployment.
Authors: Surabhi Bhargava, Shubham Singhal
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W4407001584