Year: 2024
Type: conference-paper
Abstract: Software systems with machine learning (ML) components are being used in a wide range of domains. Developers of such systems face challenges that are different from those of traditional systems because the performance of ML systems is directly linked to their input data. This work shows that ML systems can be improved over time by actively monitoring the data that passes through them and retraining their models in case of drift detection. To this end, we first assess some widely used statistical and distance-based methods for data drift detection, discussing their pros and cons. Then, we present results from experiments performed using these methods in real-world and synthetic datasets to detect data drifts and improve the system’s robustness automatically.
Authors: Lucas Helfstein, Kelly Rosa Braghetto
Institution: Universidade de São Paulo
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Awards: G1196391079, G123767387, Development of infrastructure for integration and improvement of accessibility of socio-environmental data and support to public policies, G1677423749, INCT 2014: on the Internet of the Future, G2453956027, G29316538, G5261207559, Future internet for smart cities, G7003434421, G7530371462, G8463386322
OpenAlex ID: W4403823730